I’m a bit confused now.
In the previous post you’ve mentioned, that all gradients contain valid values and the parameters get suddently NaNs:



 shakeel608:

Note: The weights become NaN first, then after the convolution operations are performed, it forces the input data to NaN (NoneType)


Your print statement also shows that all gradients are valid, before the first NaNs are created.
Now some gradients seems to contain NaNs?
Could you add somme more information to your debugging, please?
I.e. in particular when and where are the first NaN values observed?