title: Why is AWS Glue job creating parition file names with 'unnamed' included in the file's name?
body: <p>We are using an AWS Glue job to load and de-dupe data and we are making a change to no longer use the crawler to determine schema meta data - we are now explicitly defining it.</p>
  <p>As a result, we are using AWS's recommended method 2 (see below)</p>
  <p><a href="https://docs.aws.amazon.com/glue/latest/dg/update-from-job.html" rel="nofollow noreferrer">https://docs.aws.amazon.com/glue/latest/dg/update-from-job.html</a></p>
  <pre><code>sink = glueContext.getSink(connection_type=&quot;s3&quot;,
                             path=tgt_path,
                             enableUpdateCatalog=True,
                             partitionKeys=partition_key)
  sink.setFormat(&quot;glueparquet&quot;)
  sink.setCatalogInfo(catalogDatabase=tgt_db, catalogTableName=tgt_table)
  sink.writeFrame(last_transform)
  </code></pre>
  <p>We use this code in two separate jobs. The first job writes partition files with the following naming convention:</p>
  <ul>
  <li>run-timestamp-part-block-0-0-r-someNumber-snappy.parquet</li>
  </ul>
  <p>Example: <code>run-1659269628417-part-block-0-0-r-00001-snappy.parquet</code></p>
  <p>However, the second job is writing the files with the following naming convention:</p>
  <ul>
  <li>run-unnamed-36-part-block-0-0-r-someNumber-snappy.parquet</li>
  </ul>
  <p>Example: <code>run-unnamed-36-part-block-0-0-r-00001.snappy.parquet</code></p>
  <p>Does anyone know why <code>unnamed</code> is being applied to the file name as opposed to a <code>timestamp</code>? I have searched AWS's documentation, but have not had much success in getting an answer. The below link indicates that it is not possible to specify the target name on-the-fly - the file name can only be changed afterwards.</p>
  <p>Note: the data in the <code>unnamed</code> file appears to be accurate.</p>
  <p><a href="https://stackoverflow.com/questions/70951932/aws-glue-job-output-file-name">AWS Glue Job Output File Name</a></p>
  <p>Any help is appreciated.</p>