IN (15 obj, 0 pin)IN (30 obj, 1 pin)
IN (15 obj, 2 pin)IN (3 obj) IN (12 obj) IN (6 obj)
Constant velocity Baseline MLP Dynamics-only ININ (3 obj) IN (9 obj) IN (6 obj)10-2
Figure 3: Prediction experiment accuracy and generalization. Each colored bar represents the MSE between a
model’s predicted velocity and the ground truth physics engine’s (the y-axes are log-scaled). Sublots ( a-c) show
n-body performance, ( d-f) show balls, and ( g-k) show string. The leftmost subplots in each ( a, d, g ) for each
domain compare the constant velocity model (black), baseline MLP (grey), dynamics-only IN (red), and full IN
(blue). The other panels show the IN’s generalization performance to different numbers and conﬁgurations of
objects, as indicated by the subplot titles. For the string systems, the numbers correspond to: (the number of
masses, how many ends were pinned).
usually visually indistinguishable from those of the ground truth physics engine (Fig. 2; see Table 1
for URLs to the full videos of each rollout). This is not to say that given the same initial conditions,
Reasoning about objects, relations, and physics is central to human
intelligence, and a key goal of artificial intelligence. Here we introduce the
interaction network, a model which can reason about how objects in complex
systems interact, supporting dynamical predictions, as well as inferences about
the abstract properties of the system. Our model takes graphs as input,
performs object- and relation-centric reasoning in a way that is analogous to a
simulation, and is implemented using deep neural networks. We evaluate its
ability to reason about several challenging physical domains: n-body problems,
rigid-body collision, and non-rigid dynamics. Our results show it can be
trained to accurately simulate the physical trajectories of dozens of objects
over thousands of time steps, estimate abstract quantities such as energy, and
generalize automatically to systems with different numbers and configurations
of objects and relations. Our interaction network implementation is the first
general-purpose, learnable physics engine, and a powerful general framework for
reasoning about object and relations in a wide variety of complex real-world
domains.
Peter W. Battaglia Razvan Pascanu Matthew Lai Danilo Rezende Koray Kavukcuoglu