Hi joeddav, thanks for your reply! I have tried your model, and its performance is great!
However, I’m trying to reproduce the cross-lingual transfer result showed on the original paper’s 4 Table 1, which finetuned multilingual model on English training set and test on XNLI test set. Therefore, I think my model shouldn’t access XNLI dev&test sets during training.

image1132×250 61 KB

The below issue is quite similar to my question.
  
      github.com/pytorch/fairseq
  
  
    
  
	  
  

  
    
      XNLI Results Reproduction of XLM-R 27
    

    
      
        opened 
        
          
        
        Apr 24, 2020
      
      


      
        
          
          MGithubGA
        
      
    
  



  Thanks for the impressive work of XLM-R.
Recently I found that the results on XNLI are updated: the avg-acc of XLM-R_base is...



    question