Spark, Big Data, Processing, Data Engineering, Threads.
thread.start } Let’s see the Spark UI to confirm this. Wow! You can see spark created so many jobs in parallel and triggred them in 15 threads. Please zoom in and see the magic. Event time line also looks so obvious. Almost all of the jobs are contemporary. This is true useful when you need to