Spark, Distributed Systems, Machine Learning, Hadoop, Scalability.
tasks among other nodes Core Node: run tasks and store data in HDFS (at least one for multi-node) Task Node: only runs tasks & does not store data in HDFS (optional) Thus, core nodes add both data and compute parallelism while task node adds only compute parallelism. Fig 13. How to create Spark