Mining association rules in the map-reduce framework
In each iteration of the process of mining association rules from transaction data by a cluster of computing systems, each mapper node in the cluster receives a split of the transaction data. Each mapper node scans the split to count an absolute support value of each candidate itemset for the current search level(s), and passes the candidate itemsets and their support values to reducer nodes in the cluster. The number of reducer nodes is determined adaptively based on the number of candidate itemsets and the number of maximum available resource nodes in the cluster.