A Paper A Week, Spark, Big Data.
outperforms Hadoop and HadoopBinMem for following reasons: Minimum overhead of Hadoop Stack as Hadoop incurs around 25 seconds of overhead to complete the minimal requirements of job setup, starting tasks, and cleaning up. Overhead of HDFS while serving data as HDFS performs multiple memory copies