Pyspark, Mongodb, AWS, Machine Learning.
test_va=va.transform(test_df).select('features', 'decade').cache() Pyspark ML package provides a high variety of models, transformers and many options. It’s good to check out the documentation: http://spark.apache.org/docs/2.2.0/api/python/pyspark.ml.html for personal applications. Almost every