Spark, Spark Core, Rdd, Spark Api.
dataset is divided to. A compute function to do a computation on partitions. An optional Partitioner that defines how keys are hashed, and the pairs partitioned (for key-value RDDs) Optional locality info, i.e. hosts for a partition where the records live or are the closest to read from. Types of