title: Pyspark Invalid Input Exception try except error
body: <p>I am trying to read the last 4 months of data from s3 using pyspark and process the data but am receiving the following exception.</p>
  
  <blockquote>
    <p>org.apache.hadoop.mapred.InvalidInputException: Input Pattern s3://path_to_clickstream/date=201508*</p>
  </blockquote>
  
  <p>On the first day of each month due to there not being an entry in the s3 path (a separate job processes and uploads data onto the s3 path and my job runs before that one), the job fails. I was wondering if there was a way for me to catch this exception and allow the job to continue processing all the paths that exist?</p>