Deep Learning, Regularisation, Optimization Algorithms, Deep Neural Networks, Gradient Descent.
weights W = W - α * VdW b = b - α * Vdb Here, we have two hyperparameters, i.e., α and β. The role of dW and db in the above equation is to provide momentum, VdW and Vdb provides velocity, and β acts as friction and prevents speeding over the limit. Consider a ball rolling down — VdW and Vdb