Optimizer, Gradient Descent, Machine Learning, Adam, Sgd.
vanishing gradient problem. We know that our neurons work on the equation, where n is the number of features and correspondingly the number of weights. We try to initialize the weights in such a manner such that, The variance of (W1, W2,……………..Wn) = 1/n So, for the weight corresponding to each