title: How to read the data of the last 3 days from a folder with parquet files?
body: <p>I have a folder with many parquet files that have names as follows:</p>
  
  <pre><code>user_2018-03-15_checked_products.parquet
  user_2018-03-15_unchecked_products.parquet
  user_2018-03-14_checked_products.parquet
  user_2018-03-14_unchecked_products.parquet
  user_2018-03-13_checked_products.parquet
  user_2018-03-13_unchecked_products.parquet
  user_2018-03-12_checked_products.parquet
  user_2018-03-12_unchecked_products.parquet
  </code></pre>
  
  <p>I read all files as follows:</p>
  
  <pre><code>val df = spark.read.parquet("path/to/folder")
  </code></pre>
  
  <p>The folder contains 100 Gb of data and its size is growing incrementally. But I need to read only the data for the last 3 days. Currently, I read the whole folder and then apply <code>filter</code>? Is it possible to use some kind of mask in order to select only those file names that belong to the last 3 days instead of reading the whole folder?</p>