Hello,
I tried to train this network. However, the loss quickly converge to 2.3026, then the loss doesn’t descent. Any ideas on how to solve it?
When I tried to debug it, I found the output of the network is all zeros. The output is [batch_size, 10], which is all zeros.
Thanks!