My code works when disable torch.cuda.amp.autocast.
But when I enable torch.cuda.amp.autocast,  I found that the normalization step overflows (float16)
x = x - x.mean(), where x.shape = [5665, 48] and x.mean() returns nan.
Is there any way to solve this problem?