title: Copy files from one Azure storage account to another using PySpark
body: <p>I'm trying to copy files who's names match certain criteria from one Azure storage account (all in data lake storage) to another.
  I'm currently trying to do this using PySpark. I list out the folders I want to look at, then set up spark for the &quot;from&quot; datalake and use dbutils to get the files in relevant folders:</p>
  <pre><code>spark.conf.set(&quot;fs.azure.account.key.&quot;+dev_storage_account_name+&quot;.dfs.core.windows.net&quot;,dev_storage_account_access_key)
  
  for folder in raw_folders:
      list_of_files = dbutils.fs.ls(&quot;abfss://mycontainer@mydatalake.dfs.core.windows.net/&quot; + folder)
  </code></pre>
  <p>Now I can check whether file names match the conditions to copy, but how do I go about actually moving my list of desired files to folders in my &quot;to&quot; datalake?</p>