Data Science, Machine Learning.
send chunks of A to the workers so that each worker has all of B but just a small chunk of A. Here’s the general outline: Calculate TF-IDF matrices on the driver. Parallelize matrix A; Broadcast matrix B Each worker now flatMaps its chunk of work by multiplying its chunk of matrix A with the entire