title: Capturing output/return value from a spark-submit
body: <p>Is there anyway that i can capture the output of a spark-submit jobs</p>
  
  <p>spark-submit --master yarn --deploy-mode cluster --queue root.dm.xxx --principal $USER@xxx.CO.UK --keytab ~/$USER.keytab --driver-class-path "/opt/cloudera/parcels/CDH/lib/hive/lib/<em>" --driver-java-options "-Dspark.executor.extraClassPath=/opt/cloudera/parcels/CDH/lib/hive/lib/</em>" --conf "spark.yarn.appMasterEnv.PYSPARK_PYTHON=/dhcommon/dhpython/python/bin/python2.7" --num-executors 12 --executor-memory 15GB --executor-cores 5 --conf spark.yarn.executor.memoryOverhead=3072 --conf "spark.yarn.appMasterEnv.PYSPARK_DRIVER_PYTHON=/dhcommon/dhpython/python/bin/python2.7" --py-files "/home/xxx/eggs/xxx-1.0-py2.7.egg,/home/xxx/eggs/xxx-1.0-py2.7.egg" simple.py  </p>