Pyspark, Mongodb, AWS, Machine Learning.
For that script to run we should also have https://github.com/KeremTurgutlu/distcomputing/blob/master/MillionSongs-Project/user_definition.py in the same path. In user definition we define executor-driver memories , max result and overhead memory in order not run into memory issues while running