This batchnorm claims it is 60% faster than pytorch’s. Why is this not the default in Pytorch?

  
      
      GitHub
  
  
    

mapillary/inplace_abn 24

In-Place Activated BatchNorm for Memory-Optimized Training of DNNs - mapillary/inplace_abn