Hi, I fine-tune 3 datasets separately on mT5-small or base model.
Three datasets are English STSb dataset, KorSTS dataset, my personal korean news classification dataset.
I want a result of the same form as that of T5. Looks like  <pad>  5.0 </s>. But my model result in this from. <pad> <extra_id_0>SOMETHING</s>.
Changing some factors, such as lr and epochs, does not change the form of the correct answer at all.
My code is on this address.

  
      github.com/huggingface/transformers
  
  
    
  
	  
  

  
    
      mT5 fine-tuned model generate wrong answer 54
    

    
      
        opened 
        
          
        
        Nov 30, 2020
      
      

        
          closed 
        
          
        
        Dec 4, 2020
      
        

      
        
          
          JejuWayfarer
        
      
    
  



  Environment info

transformers version: 4.0.0-rc-1
Platform: Linux
Python version: 3.7.9
PyTorch version (GPU?): 1.4.0
Tensorflow version (GPU?): NA
Using GPU in script?: yes
Using distributed or parallel set-up...





  
  
    
    
  
  


What’s the problem? Please give me some advice on the code.