A Paper A Week, Spark, Big Data.
iterator —a function that computes an RDD based on its parents partitioner — whether data is range/hash partitioned. preferredLocation — nodes where a partition can be accessed faster due to data locality. The most interesting aspect of this representation is how dependencies are expressed.