A brief description of implementing synchronize BN:

  
      
      hangzh.com
  
  
    

Implementing Synchronized Multi-GPU Batch Normalization, Do It Exactly Right 474

Hang Zhang, Rutgers University, Computer Vision – :white_check_mark: Please checkout the new post.