Spark, Distributed Systems, Machine Learning, Hadoop, Scalability.
define additional parameters during “Cluster Creation” in AWS EMR. Create a Docker Image (or modify a docker image) ✓ Create a directory and a requirements.txt file. The requirements.txt file should contain all the dependencies required by your Spark application. mkdir pyspark vi