A Paper A Week, Spark, Big Data.
Dependencies belong to one of the two classes: Narrow Dependencies — where each partition of the parent node is used by at most one child partition. For example, map and filter operations. Wide Dependencies — where multiple child partitions use a single parent partition. Narrow dependencies support