Thanks for the ping, @ptrblck!
I’m not familiar with: transformers/run_mlm_wwm.py at master · huggingface/transformers · GitHub 2 as it’s some experimental example I have never used and it’s not being maintained, so it’s very likely to be out of sync with the current code base. Therefore @jungminc88 please file an Issue at Issues · huggingface/transformers · GitHub 4
You probably need to tag the person who wrote this example, see the original PR:
  

      github.com/huggingface/transformers
  

  
    
  
    
  

  
    
      Fit chinese wwm to new datasets 3
    

    
      huggingface:master ← wlhgtc:master
    

    
      
        opened 
        
          
        
        Jan 29, 2021
      
      

      
        
          
          wlhgtc
        
      

      
        
          +249
          -67
        
      
    
  


  
    Sorry for my later update. 
I make my code(especially in chinese mlm_wwm) fit t…he newest code.
Here are the changes:
1. add `chinese_ref` key to avoid miss ref inf.
2. fix the type bug in `data_collator.py`
3. re-add `run_chinese_ref.py` cause it could run with the newest version code (4.2.2).
4. update readme