Found some relevent work on Marathi language:
  
      

      GitHub
  

  
    

goru001/nlp-for-marathi 2

  State of the Art Language models and Classifier for Marathi, which is spoken predominantly by Marathi people of Maharashtra, India - goru001/nlp-for-marathi


  

  
    
    
  

  

https://indicnlp.ai4bharat.org/indic-bert/ 2