Shubham_Sharma:

xavier_uniform_


Hi,
Xavier initialization is a way to initialize the weights with the right values.(They are not big as well as not small.) You can find a detailed explanation from andy’s blog.

  
      
      andy's blog
  
  
    

An Explanation of Xavier Initialization

If you're having trouble viewing the formulas below, try turning off Adblock (thanks /u/BeatLeJuce) If you work through the Caffe MNIST tutorial, you'll come across this curious line weight_filler {...


  
  
    
    
  
  


Thanks