Technical Report Number
In many data mining applications, the size of the database is not only extremely large, it is also growing rapidly. Even for relatively simple searches, the time required to move the data off magnetic media, cross the system bus into main memory, copy into processor cache, and then execute code to perform a search is prohibitive. We are proposing that a significant portion of the data mining task (i.e., the portion that examines the bulk of the raw data) be implemented in fast hardware, close to the magnetic media on which it is stored. Furthermore, this hardware can be replicated allowing mining tasks to be performed in parallel, thus providing further speed up for the overall mining application. In this paper, we describe a general framework under which this can be accomplished, and identify a number of important research questions that must be addressed for it to be practical.
Chamberlain, Roger D.; Cytron, Ron K.; Franklin, Mark A.; and Indeck, Ronald S., "Exploiting Truly Fast Hardware in Data Mining" Report Number: WUCSE-2002-23 (2002). All Computer Science and Engineering Research.