Same here, my  pytorch is alos 1.6. I also used AMP library.
I have been working with this code for so long. With pytorch 1.3 I never faced this problem.
torchvision.version = 0.7.0
torch.version= 1.6.0
cu 10.2