Spark, Distributed Systems, Machine Learning, Hadoop, Scalability.
Loss over all points = ∑ Partial Sums Thus, easily compute w_new & store in memory of each node This is how you distribute any optimization based ML algorithm. However, see the Hadoop vs Spark performance, for a distributed LR implementation. Fig 3. Running Time Comparison: Hadoop vs Spark [3] As