Yes and for me when I use vgg16 it works perfect without error and very fast.
Can you explain to me what do you mean with this sentence “It might be you are trying to backward through resnet as well.”
I believe the problem is something with resnet50 MoCo model because it is the only thing that I change.