I using torch.cuda.amp in pytorch.I just added the automatic mixed precision training code described in here in a normal code without any data parallel.However,I got a very different result,and even loss is NaN.I think the accuracy should change a little,rather than a large change.