A Paper A Week, Spark, Big Data.
re-execution. The figure shows some examples of narrow and wide dependencies. Note that join operation defines a narrow dependency when parents are hash-partitioned and wide dependency in other cases. Figure 1: Example of narrow and wide dependencies. Job Scheduler Whenever an “action” is executed,