Hi,
I did read that PyTorch is not supporting the so called sync BatchNorm. This is needed to
train on multi GPU machines. By question is: Are there any plans to implement sync BatchNorm
for PyTorch and when will it be released?
An other question: What is the best workaround when you want to train with images and need
large batch sizes?
Thanks
Philip