Deep Learning, Image Processing, Convolutional Network, Machine Learning, Artificial Intelligence.
become infinitely small while propagating towards earlier layers of the network. In extreme cases, the network stops training completely. This problem is known as the vanishing gradient. This can be remedied with skip connections. The general idea is to combine the signal passing through the