Data Science, Machine Learning.
didn’t finish) or ran out or memory, this method was able to complete its computation in order of just a few minutes. Of course it depends on the size of the data and the size of Spark’s cluster, but all in all it performed really well. Right now the only bottleneck is the driver calculating TF-IDF