A Paper A Week, Spark, Big Data.
checkpointing and roll back which are more expensive than lineage based approach. Nectar, Ceil and FlumeJava do not provide in-memory caching. MapReduce and Dryad use lineage based recovery within a computation, but this information is lost after a job ends. In contrast, RDDs persists lineage