Hello.
I would like to know if this is something new in pytorch. As far as I remember, in the initial pytorch releases the gradients of a parameter computed from a loss whose value was Nan (due to numerical saturation) where also Nan. However, I have realized that when my loss goes to Nan, the gradients w.r.t the parameters is 0. Is that the correct pytorch behavior?
Thanks