Pyspark, Mongodb, AWS, Machine Learning.
these steps are actually taken care of EMR. EMR in short will allow us to automatically distribute jobs we want to run once we run them on our master instance. Otherwise we should be configuring and installing Spark on all nodes. Below you can see how jobs are distributed through Spark framework.