I am looking to modify a pretrained resnet with a non inplace version of batchnorm2D since this is causing me problems when I run in distributed mode (runtimerror saying that grad computation has not been possible due to inplace operation)
Error detected in CudnnBatchNormBackward
I instantiate the model the vanilla way, no magic:
model=torchvision.modlels.resnet152(pretrained=True)
Is there a known solution to this problem?