Optimizer, Gradient Descent, Machine Learning, Adam, Sgd.
time unit, we consider the weighted average of the last few time units along with the current value. Now, why we call it weighted? We call it so because it has a constant involved and as we move to a further time unit, the impact of the value of that time unit on our current time unit value starts