Artificial Intelligence, Research, Machine Learning, NLP.
that outputs updated weight values given weights, gradients, and learning rates of a network. This work contributes to the space of learned optimizers with the twist that the learned optimizer here is not learned via gradient descent but via symbolic discovery. This method works very well in the