Hi, I am trying to train a deep model that is consisted of ResNet50 and GAN.
In torch==1.2.0, the model trains well and the performance is very good.
But I am trying to use torch.cuda.amp() which is only available in torch version higher than torch>=1.6.0.
So I tried to train the model with torch==1.6.0  and as a result, the model performance changes too badly. (I did not use torch.cuda.amp yet.)
What actually could be the problem when only changing the torch version at the same circumstance(Same data, same layer, same loss…)
Does the layers or operation behavior change when torch version change?