A Paper A Week, Spark, Big Data.
choose to take checkpoints (in cases where the lineage graph grows very big), consistency is not a concern because of the immutable nature of RDDs. RDDs have been implemented in Spark to provide a language integrated API. Details about this implementation have been discussed here separately.