@ptrblck Hi,
I will definitely post the results here. However, my next hurdle is using a pre-trained model, i.e. Can I Use the pretrained model provided by PyTorch and just change the BatchNorm layers? Or with GroupNorm (GN) + Weight Standardization (WS), the pretrained weights become redundant? If so, do you where I can find the pre-trained ResNet models with GN+WS?
The code for GN+WS can be found here.
I really don’t have the time or system capabilities to train the network from scratch.