Building An Aws Pipeline, Data Science, Big Data, AWS, Towards Data Science.
script. This is a Java executable that will run our python script and also manage all Spark related work. Into that .jar file we send a few arguments Args. They are spark-submit, which says this job is submitted to the Spark framework, --deploy-mode=cluster, which says we are launching our