Data Science, Machine Learning.
playing with the block sizes etc alas, for large enough inputs it fails with either out-of-memory errors or just long runs that never end (hours and hours). What’s the problem? Can’t Spark scale? Of course spark can scale. But you have to use it wisely, stupid... The problem with BlockMatrix is