Machine Learning, Deep Learning, Neural Networks, Optimization Algorithms, Adam.
RMSProp, Adam is the most superior of them which robustly adapts to large datasets and deep networks. Moreover, it has a straightforward implementation and little memory requirements making it a preferable choice in the majority of situations. Resources An overview of gradient descent optimization