I think e.g. in Albert V2 was removed:

  

      github.com/google-research/ALBERT
  

  
    
  
	  
  

  
    
      "no dropout" on v2 models 2
    

    
      
        opened 
        
          
        
        Dec 18, 2019
      
      

        
          closed 
        
          
        
        Dec 27, 2019
      
        

      
        
          
          peregilk
        
      
    

    
    
  


  
    You say that you are using "no dropout" on the TFHub v2-models. However, looking… at the albert_config.json-files there seem to be dropout on most models (https://tfhub.dev/google/albert_base/2). Only on the xxlarge, there is no dropout (https://tfhub.dev/google/albert_xxlarge/2). What is correct?