Deep Learning, Image Processing, Convolutional Network, Machine Learning, Artificial Intelligence.
out this article. Vanishing gradient With the size of the network increases the training difficulty. During training the update of any weight is proportional to the size of the partial derivative. With the presence of saturating nonlinearities in the hidden layers (e.g., sigmoid), the gradient can