Spark, Distributed Systems, Machine Learning, Hadoop, Scalability.
heavy and data heavy, at the same time. Hence, in order to make scalable AI/ML solutions, it is necessary the solution caters to both. Fig 1. Author’s Parallel Implementation of Photon Mapping using MPI In 2004, Jeff Dean et al. published the seminal MapReduce paper to handle data heavy tasks [2].