I don’t know why. I tried to visualize the parameters and the gradients. I checked the distribution of some parameters, as shown in the figure below：

微信图片_202105232058591344×451 102 KB

one layer parameters is as follows:


The graph of gradient is as follows：

But I don’t know where to start analyzing parameters and gradients。
I read some articles saying that it was because of the gradient explosion, but from the gradient and other information, I don’t know how to find out the reason。
And you can see that the parameters have changed, but my gradient image is still 0. What’s wrong with me?， In the visualization, I get the code of parameters and gradient information as follows:

image760×81 3.02 KB

Who can help me? Thanks