Hello There!
What do you mean by the following?



 jiacheng-xu:

I use the wrong combination of Softmax and Loss function, so value of grads are super small.


I don’t understand why the gradients are super small in your case.