title: Override hadoop
body: <p>I'm running an EMR Activity inside a Data Pipeline analyzing log files and I get the following error when my Pipeline fails:</p>
  
  <p>Exception in thread "main" org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://10.211.146.177:9000/home/hadoop/temp-output-s3copy-2013-05-24-00 already exists
      at org.apache.hadoop.mapred.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:121)
      at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:944)
      at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:905)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:396)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1132)
      at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:905)
      at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:879)
      at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1316)
      at com.valtira.datapipeline.stream.CloudFrontStreamLogProcessors.main(CloudFrontStreamLogProcessors.java:216)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      at java.lang.reflect.Method.invoke(Method.java:597)
      at org.apache.hadoop.util.RunJar.main(RunJar.java:187)</p>
  
  <p>I've tried delete that folder by adding:</p>
  
  <p>FileSystem fs = FileSystem.get(getConf());
  fs.delete(new Path("path/to/file"), true); // delete file, true for recursive </p>
  
  <p>but it does not work. Is there a way to override the FileOutputFormat method from Hadoop in java? Is there a way to ignore this error in java? </p>