Mining association rule efficiently based on data warehouse

Abstract

The conventional complete association rule set was replaced by the least association rule set in data warehouse association rule mining process. The least association rule set should comply with two requirements: 1) it should be the minimal and the simplest association rule set; 2) its predictive power should in no way be weaker than that of the complete association rule set so that the precision of the association rule set analysis can be guaranteed. By adopting the least association rule set, the pruning of weak rules can be effectively carried out so as to greatly reduce the number of frequent itemset, and therefore improve the mining efficiency. Finally, based on the classical Apriori algorithm, the upward closure property of weak rules is utilized to develop a corresponding efficient algorithm.

Keywords

data mining / association rule mining / complete association rule set / least association rule set

References

[1] HanJia-wei, KamberMData Mining: Concepts and Techniques[M], 2001, Beijing, China Machine Press(in Chinese)

[2] LiJiu-yong, HongShen, RodneyT. Mining the optimal class association rule set[J]. Knowledge-based System, 2002, 15(7): 399-405

[3] ChenGuo-qing, WeiQiang, LiuDe, et al.. Simple association rules (SAR) and the SAR-based rule discovery [J]. Computers & Industrial Engineering, 2002, 43(4): 721-733

[4] AgrawalR, MannilaH, SrikantR, et al.Fast discovery of association rules[A]. Advances in Knowledge Discovery and Data Mining [C], 1996, Cambridge, MIT Press

[5] HoltJ D, ChungS M. Mining association rules using inverted hashing and pruning[J]. Information Processing Letters, 2002, 83(4): 211-220

[6] SarawagiS, ThomasS, AgrawalR. Integrating association rule mining with relational database systems: alternatives and implications[A]. Proceedings of the Fourth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining [C], 1998, Changsha, ACM Press

[7] Takahara Y, CHEN Xiao-hong. Contribution of mathematical general systems theory to organization theory: integration of organizational behaviors on macro and micro levels[A]. Cybernetics and Systems 15th European Meeting on Cybernetics and Systems Research [C]. Vienna University Press, 2000.

[8] TakaharaY, ShibaN, LiuYong-mei. General system theoretic approach to data mining system[J]. International Journal of General Systems, 2002, 31(3): 245-264

[9] ChenXiao-hongTheory and application of decision support systems [M], 2000, Beijing, Tsinghua University Publication House(in Chinese)

[10] ChenM, HanJ, YuP. Data mining: an overview from a database perspective[J]. IEEE Transactions on Knowledge and Data Engineering, 1996, 8(6): 866-881

[11] ZhangS. Aggregation and maintenance for database mining[J]. Intelligent Data Analysis, 1999, 3(6): 475-490

[12] ShenLia, ShenHongb, ChengLin-ga. New algorithms for efficient mining of association rules[J]. Information Sciences, 1999, 118(1–4): 251-268

[13] BayardoR, AgrawalR. Mining the most interesting rules[A]. Proceedings of the Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining[C], 1999, Changsha, ACM Press: 145-154

[14] Zaki M J S, Ogihara P M. New algorithms for fast discovery of association rules[R]. Technical Report 651. Computer Science Department, University of Rochester, 1997.

[15] NicolasaP, YvesaB, RafikaT. Efficient mining of association rules using closed itemset lattices[J]. Information Systems, 1999, 24(1): 25-46