Pyspark, Mongodb, AWS, Machine Learning.
distributed ML algorithm is provided through this API but not deep learning. For deeplearning you can checkout H20.ai’s sparkling water: https://www.h2o.ai/sparkling-water/ or simply use a modern GPU, or even multiple with Pytorch’s nn.DataParallel. Since we have our vector assemblers now we can do