Optimizer, Gradient Descent, Machine Learning, Adam, Sgd.
feature, we initialize the weight as W=a/sqrt(n) where ‘a’ is a constant and ‘a’ varies from 1 to n-1. This prevents the weights from being initialized too big or too small. 2. Optimizers To solve the 1st and the 3rd problem, we use algorithms called optimizers. There are several optimizers which