BTW, I came across this repo

  
      
      GitHub
  
  
    

CSAILVision/semantic-segmentation-pytorch 5

semantic-segmentation-pytorch - Pytorch implementation for Semantic Segmentation/Scene Parsing on MIT ADE20K dataset


  
  
    
    
  
  


Which is doing semantic segmentation, and says the sync batch norm is important for this particular application (it uses another implementation which is based off a different repo)