There are already T5 models that was trained for this task:
  

      huggingface.co
  

  
    

Hugging Face – The AI community building the future. 6



  

  
    
    
  

  


This repo should help you to extend the pretrained CodeTrans models for more tasks or languages:
  
      

      GitHub
  

  
    

agemagician/CodeTrans 5

  Pretrained Language Models for Source code. Contribute to agemagician/CodeTrans development by creating an account on GitHub.


  

  
    
    
  

  


Good luck.