Learning to learn by gradient descent
by gradient descent
Marcin Andrychowicz1, Misha Denil1, Sergio Gómez Colmenarejo1, Matthew W. Hoffman1,
David Pfau1, Tom Schaul1, Brendan Shillingford1;2, Nando de Freitas1;2;3
1Google DeepMind2University of Oxford3Canadian Institute for Advanced Research
marcin.andrychowicz@gmail.com
{mdenil,sergomez,mwhoffman,pfau,schaul}@google.com
brendan.shillingford@cs.ox.ac.uk ,nandodefreitas@google.com
Abstract
The move from hand-designed features to learned features in machine learning has
been wildly successful. In spite of this, optimization algorithms are still designed
by hand. In this paper we show how the design of an optimization algorithm can be
cast as a learning problem, allowing the algorithm to learn to exploit structure in
the problems of interest in an automatic way. Our learned algorithms, implemented
by LSTMs, outperform generic, hand-designed competitors on the tasks for which
they are trained, and also generalize well to new tasks with similar structure. We
demonstrate this on a number of tasks, including simple convex problems, training
neural networks, and styling images with neural art.
The move from hand-designed features to learned features in machine learning
has been wildly successful. In spite of this, optimization algorithms are still
designed by hand. In this paper we show how the design of an optimization
algorithm can be cast as a learning problem, allowing the algorithm to learn to
exploit structure in the problems of interest in an automatic way. Our learned
algorithms, implemented by LSTMs, outperform generic, hand-designed competitors
on the tasks for which they are trained, and also generalize well to new tasks
with similar structure. We demonstrate this on a number of tasks, including
simple convex problems, training neural networks, and styling images with
neural art.
Marcin Andrychowicz Misha Denil Sergio Gomez Matthew W. Hoffman David Pfau Tom Schaul Brendan Shillingford Nando de Freitas