title: PySpark - Write data frame into Hive table
body: <p>I have an empty Hive table. I have 18 jobs that I am running, and each one could have a data frame that I would need to add into the Hive table with a parquet file.</p>
  <p>What I have is something like this:</p>
  <pre><code>df2.write.parquet(SOME_HDFS_DIR/my_table_dir)
  </code></pre>
  <p>But this doesn't seem quite right. Do I have to add some <code>.parquet</code> file name and keep appending it each time? I have seen some syntax is Scala but not Python.</p>