I have been trying to use autocast. My loss is nan and therefore scaler.get_scale() keeps reducing after every batch from 32768 until it becomes zero, so i stop the training. Traceback shows “RuntimeError: Function ‘PowBackward0’ returned nan values in its 0th output.” I have tried to increase epsilon value in the line of code which gives this error. I have also tried to increase the epsilon of Adam optimizer that I’m using to 1e-4.