Optimizer, Gradient Descent, Machine Learning, Adam, Sgd.
We have seen, in neural networks, we obtain an equation like and send this through several activation functions f(x) and g(x). On performing such operations multiple times, we obtain complex equations. For example, We have seen this in my previous article. We can see, we multiply the weights