Deep Learning, Regularisation, Optimization Algorithms, Deep Neural Networks, Gradient Descent.
large and the learning process slow. Similarly, using small weights will make the gradients very small, and as a result, learning will be slow. We must deal with this problem in order to reduce the training time. So how should the weights be initialized? Weight Initialization for Deep Networks One