Tanh --> Xavier
ReLU --> He

  
      stats.stackexchange.com
  
  
      
    
  

  What's the difference between variance scaling initializer and xavier initializer? 322



  machine-learning, neural-networks, deep-learning, conv-neural-network



  
  answered by
  
    Maxim
  
  on 09:03AM - 21 Dec 17