Spark, Scala, Java, Big Data, Data Science.
During execution, Spark UI of the job can be examined at localhost:4040. Spark master UI — Job running Spark master UI — Completed job The output folder can be found at /opt/spark-apps/output on the master node. As this is a mounted folder, it can also be accessed from the host machine. This wraps