Spark, Distributed Systems, Machine Learning, Hadoop, Scalability.
data points [Eqn. above]. If the data set is huge, say ’n’ billion data points, then we can distribute gradient computation across ‘k’ different boxes. Map Stage: Each box would compute gradient of n/k billion points Reduce Stage: Partial sums in each box are summed up using same key Gradient of