Frequent itemset mining in big data with effective single scan algorithms

Youcef Djenouri, Djamel Djenouri, Jerry Chun Wei Lin*, Asma Belhadi

*Corresponding author for this work

Research output: Contribution to journalJournal articleResearchpeer-review

159 Downloads (Pure)

Abstract

This paper considers frequent itemsets mining in transactional databases. It introduces a new accurate single scan approach for frequent itemset mining (SSFIM), a heuristic as an alternative approach (EA-SSFIM), as well as a parallel implementation on Hadoop clusters (MR-SSFIM). EA-SSFIM and MR-SSFIM target sparse and big databases, respectively. The proposed approach (in all its variants) requires only one scan to extract the candidate itemsets, and it has the advantage to generate a fixed number of candidate itemsets independently from the value of the minimum support. This accelerates the scan process compared with existing approaches while dealing with sparse and big databases. Numerical results show that SSFIM outperforms the state-of-the-art FIM approaches while dealing with medium and large databases. Moreover, EA-SSFIM provides similar performance as SSFIM while considerably reducing the runtime for large databases. The results also reveal the superiority of MR-SSFIM compared with the existing HPC-based solutions for FIM using sparse and big databases.

Original languageEnglish
JournalIEEE Access
Volume6
Pages (from-to)68013-68026
ISSN2169-3536
DOIs
Publication statusPublished - 2018

    Fingerprint

Keywords

  • Apriori
  • frequent itemset mining
  • heuristic
  • parallel computing
  • support computing

Cite this

Djenouri, Y., Djenouri, D., Lin, J. C. W., & Belhadi, A. (2018). Frequent itemset mining in big data with effective single scan algorithms. IEEE Access, 6, 68013-68026. https://doi.org/10.1109/ACCESS.2018.2880275