Spark, Distributed Systems, Machine Learning, Hadoop, Scalability.
Spark RDDs allow performing several map operations in memory, there is no need to write interim data sets to a disk, thus being 100x faster. Note, the time taken for first iteration is almost the same, as both Hadoop and Spark have to read from disk. But in subsequent iterations, Spark’s