Spark, Distributed Systems, Machine Learning, Hadoop, Scalability.
below, the time taken by the RandomForest training workload steadily decreases as the number of nodes in the EMR cluster increase. The base overhead of inter-node communication will remain, even with small datasets. Hence, the graph will fall steeper when the training dataset gets bigger. Fig 15.