corresponds to the ability to transfer knowledge between different problems. This reuse of problem
structure is commonly known as transfer learning , and is often treated as a subject in its own right.
However, by taking a meta-learning perspective, we can cast the problem of transfer learning as one
of generalization, which is much better studied in the machine learning community.
One of the great success stories of deep-learning is that we can rely on the ability of deep networks to
generalize to new examples by learning interesting sub-structures. In this work we aim to leverage
this generalization power, but also to lift it from simple supervised learning to the more general
setting of optimization.
1.2 A brief history and related work
The idea of using learning to learn ormeta-learning to acquire knowledge or inductive biases has a
long history [Thrun and Pratt, 1998]. More recently, Lake et al. [2016] have argued forcefully for
its importance as a building block in artiﬁcial intelligence. Similarly, Santoro et al. [2016] frame
multi-task learning as generalization, however unlike our approach they directly train a base learner
rather than a training algorithm. In general these ideas involve learning which occurs at two different
time scales: rapid learning within tasks and more gradual, meta learning across many different tasks.
The move from hand-designed features to learned features in machine learning
has been wildly successful. In spite of this, optimization algorithms are still
designed by hand. In this paper we show how the design of an optimization
algorithm can be cast as a learning problem, allowing the algorithm to learn to
exploit structure in the problems of interest in an automatic way. Our learned
algorithms, implemented by LSTMs, outperform generic, hand-designed competitors
on the tasks for which they are trained, and also generalize well to new tasks
with similar structure. We demonstrate this on a number of tasks, including
simple convex problems, training neural networks, and styling images with
neural art.
Marcin Andrychowicz Misha Denil Sergio Gomez Matthew W. Hoffman David Pfau Tom Schaul Brendan Shillingford Nando de Freitas