The Mercury System: Exploiting Truly Fast Hardware in Data Mining

Authors

Roger D. Chamberlain, Washington University in St. LouisFollow
Ron K. Cytron, Washington University in St. LouisFollow
Mark A. Franklin, Washington University in St. LouisFollow
Ronald S. Indeck, Washington University in St. Louis

Document Type

Technical Report

Publication Date

2003-03-10

Filename

wucse-2003-10.pdf

Technical Report Number

WUCSE-2003-10

Abstract

In many data mining applications, the size of the database is not only extremely large, it is also growing rapidly. Even for relatively simple searches, the time required to move the data off magnetic media, cross the system bus into main memory, copy into processor cache, and then execute code to perform a search is prohibitive. We are building a system in which a significant portion of the data mining task (i.e., the portion that examines the bulk of the raw data) is implemented in fast hardware, close to the magnetic media on which it is stored. Furthermore, this hardware can be replicated allowing mining tasks to be performed in parallel, thus providing further speedup for the overall mining application. In this paper, we describe a general framework under which this can be accomplished and provide initial performance results for a set of applications.

Comments

Permanent URL: http://dx.doi.org/10.7936/K7Q81BCZ

Recommended Citation

Chamberlain, Roger D.; Cytron, Ron K.; Franklin, Mark A.; and Indeck, Ronald S., "The Mercury System: Exploiting Truly Fast Hardware in Data Mining" Report Number: WUCSE-2003-10 (2003). All Computer Science and Engineering Research.
https://openscholarship.wustl.edu/cse_research/1058