Use this repo

  
      
      GitHub
  
  
    

microsoft/AzureML-BERT 118

End-to-end recipes for pre-training and fine-tuning BERT using Azure Machine Learning service - microsoft/AzureML-BERT


  
  
    
    
  
  


This is slightly old but works. Let me know if you face any issues.