Machine Learning, Deep Learning, Neural Networks, Optimization Algorithms, Adam.
consisting of changing weights of a neural network in respect to a given loss function. Backpropagation is usually performed via gradient descent which tries to converge loss function to a local minimum step by step. As it turns out, naive gradient descent is not usually a preferable choice for