Pyspark, Mongodb, AWS, Machine Learning.
correct format # cache train and validation dataframes for fast iterations va = VectorAssembler(inputCols=x_cols, outputCol='features') train_va=va.transform(train_df).select('features','decade').cache() val_va=va.transform(val_df).select('features', 'decade').cache()