Pyspark, Mongodb, AWS, Machine Learning.
dataframes train_df, val_df = train_full_df.randomSplit([0.7, 0.3]) Create vector assembler: Vector assembler take a list of desired column names that will be feed into ML algorithm, combine them and get them ready for optimized spark ML. # define vector assembler and transform dataframes into