Step 6 Step 7 Step 8
Step 9−10010
Step 10 Step 11 Step 12
Step 13−10010
Step 14 Step 15 Step 16
Step 17−10010
Step 18 Step 19 Step 20
Step 21−10010
Step 22 Step 23 Step 24
Step 25−10010
Step 26 Step 27 Step 28
−400 0 400
Step 29−10010
−400 0 400
Step 30−400 0 400
Step 31−400 0 400
Step 32Figure 11: The proposed update direction for a single coordinate over 32 steps.
13
Step 1−10010
Step 2 Step 3 Step 4
Step 5−10010
Step 6 Step 7 Step 8
Step 9−10010
Step 10 Step 11 Step 12
Step 13−10010
Step 14 Step 15 Step 16
Step 17−10010
Step 18 Step 19 Step 20
Step 21−10010
Step 22 Step 23 Step 24
Step 25−10010
Step 26 Step 27 Step 28
−400 0 400
Step 29−10010
−400 0 400
Step 30−400 0 400
Step 31−400 0 400
Step 32Figure 12: The proposed update direction for a single coordinate over 32 steps.
14
Step 1−10010
Step 2 Step 3 Step 4
Step 5−10010
Step 6 Step 7 Step 8
Step 9−10010
The move from hand-designed features to learned features in machine learning
has been wildly successful. In spite of this, optimization algorithms are still
designed by hand. In this paper we show how the design of an optimization
algorithm can be cast as a learning problem, allowing the algorithm to learn to
exploit structure in the problems of interest in an automatic way. Our learned
algorithms, implemented by LSTMs, outperform generic, hand-designed competitors
on the tasks for which they are trained, and also generalize well to new tasks
with similar structure. We demonstrate this on a number of tasks, including
simple convex problems, training neural networks, and styling images with
neural art.
Marcin Andrychowicz Misha Denil Sergio Gomez Matthew W. Hoffman David Pfau Tom Schaul Brendan Shillingford Nando de Freitas