A Paper A Week, Spark, Big Data.
Representing RDDs The paper proposes a graph-based representation of RDDs where an RDD is expressed through a common interface that exposes five functions: partition — represents atomic pieces of the dataset. dependencies — list of dependencies that an RDD has on its parent RDDs or data sources