TY - JOUR
T1 - New algorithms for efficient mining of association rules
AU - Shen, Li
AU - Shen, Hong
AU - Cheng, Ling
N1 - Funding Information:
We thank anonymous reviewers for their very useful comments and suggestions. Most of this work was done while Li Shen and Ling Cheng were doing research in Griffith University. The work was supported by Australian Research Council (ARC) Large Grant A849602031.
PY - 1999/9
Y1 - 1999/9
N2 - Discovery of association rules is an important data mining task. Several algorithms have been proposed to solve this problem. Most of them require repeated passes over the database, which incurs huge I/O overhead and high synchronization expense in parallel cases. There are a few algorithms trying to reduce these costs. But they contain weaknesses such as often requiring high pre-processing cost to get a vertical database layout, containing much redundant computation in parallel cases, and so on. We propose new association mining algorithms to overcome the above drawbacks, through minimizing the I/O cost and effectively controlling the computation cost. Experiments on well-known synthetic data show that our algorithms consistently outperform a priori, one of the best algorithms for association mining, by factors ranging from 2 to 4 in most cases. Also, our algorithms are very easy to be parallelized, and we present a parallelization for them based on a shared-nothing architecture. We observe that our parallelization develops the parallelism more sufficiently than two of the best existing parallel algorithms.
AB - Discovery of association rules is an important data mining task. Several algorithms have been proposed to solve this problem. Most of them require repeated passes over the database, which incurs huge I/O overhead and high synchronization expense in parallel cases. There are a few algorithms trying to reduce these costs. But they contain weaknesses such as often requiring high pre-processing cost to get a vertical database layout, containing much redundant computation in parallel cases, and so on. We propose new association mining algorithms to overcome the above drawbacks, through minimizing the I/O cost and effectively controlling the computation cost. Experiments on well-known synthetic data show that our algorithms consistently outperform a priori, one of the best algorithms for association mining, by factors ranging from 2 to 4 in most cases. Also, our algorithms are very easy to be parallelized, and we present a parallelization for them based on a shared-nothing architecture. We observe that our parallelization develops the parallelism more sufficiently than two of the best existing parallel algorithms.
UR - http://www.scopus.com/inward/record.url?scp=0033320738&partnerID=8YFLogxK
U2 - 10.1016/S0020-0255(99)00035-3
DO - 10.1016/S0020-0255(99)00035-3
M3 - Article
AN - SCOPUS:0033320738
SN - 0020-0255
VL - 118
SP - 251
EP - 268
JO - Information Sciences
JF - Information Sciences
IS - 1
ER -