Parallel associative classification data mining frameworks based mapreduce
Date
2015-06
Journal Title
Journal ISSN
Volume Title
Publisher
World Scientific Publishing Co. Pte Ltd
Abstract
Associative classification (AC) is a research topic that integrates association rules with classification in data mining to build classifiers. After dissemination of the Classification-based Association Rule algorithm (CBA), the majority of its successors have been developed to improve either CBA's prediction accuracy or the search for frequent ruleitems in the rule discovery step. Both of these steps require high demands in processing time and memory especially in cases of large training data sets or a low minimum support threshold value. In this paper, we overcome the problem of mining large training data sets by proposing a new learning method that repeatedly transforms data between line and item spaces to quickly discover frequent ruleitems, generate rules, subsequently rank and prune rules. This new learning method has been implemented in a parallel Map-Reduce (MR) algorithm called MRMCAR which can be considered the first parallel AC algorithm in the literature. The new learning method can be utilised in the different steps within any AC or association rule mining algorithms which scales well if contrasted with current horizontal or vertical methods. Two versions of the learning method (Weka, Hadoop) have been implemented and a number of experiments against different data sets have been conducted. The ground bases of the comparisons are classification accuracy and time required by the algorithm for data initialization, frequent ruleitems discovery, rule generation and rule pruning. The results reveal that MRMCAR is superior to both current AC mining algorithms and rule based classification algorithms in improving the classification performance with respect to accuracy. © 2015 World Scientific Publishing Company.
Description
This article is not available at CUD collection. The version of scholarly record of this Article is published in Parallel Processing Letters (2015), available online at: https://doi.org/10.1142/S0129626415500024.
item.page.type
Article
item.page.format
Keywords
Algorithms, Association rules, Classification (of information), Learning algorithms, Learning systems, Associative classification, Distributed tasks, Hadoop, Map-reduce, Parallel minings, Data mining
Citation
Thabtah, F., Hammoud, S., & Abdel-Jaber, H. (2015). Parallel associative classification data mining frameworks based mapreduce. Parallel Processing Letters, 25(2). https://doi.org/10.1142/S0129626415500024