ProtTrans actually has models which were trained on 9 programming languages + English language using self-supervised learning.
You can easily fine-tune them on any task and almost all famous programming languages.
For example:
  

      huggingface.co
  

  
    

SEBIS/code_trans_t5_large_transfer_learning_pretrain · Hugging Face 1



  

  
    
    
  

  


  

      huggingface.co
  

  
    

SEBIS/code_trans_t5_small_transfer_learning_pretrain · Hugging Face 2



  

  
    
    
  

  


  

      huggingface.co
  

  
    

SEBIS/code_trans_t5_base_transfer_learning_pretrain · Hugging Face