receiver object, merges them, and combines them with OandXto form a set of object model inputs,
cj2C, one per object. The object model, O, predicts how the interactions and dynamics inﬂuence
the objects by applying fOto eachcj, and returning the results, pj2P. This basic IN can predict
the evolution of states in a dynamical system – for physical simulation, Pmay equal the future states
of the objects, Ot+1.
The IN can also be augmented with an additional component to make abstract inferences about the
system. The pj2P, rather than serving as output, can be combined by another aggregation function,
g, and input to an abstraction model, A, which returns a single output, q, for the whole system. We
explore this variant in our ﬁnal experiments that use the IN to predict potential energy.
An IN applies the same fRandfOto everybkandcj, respectively, which makes their relational and
object reasoning able to handle variable numbers of arbitrarily ordered objects and relations. But
one additional constraint must be satisﬁed to maintain this: the afunction must be commutative and
3
associative over the objects and relations. Using summation within ato merge the elements of Einto
Reasoning about objects, relations, and physics is central to human
intelligence, and a key goal of artificial intelligence. Here we introduce the
interaction network, a model which can reason about how objects in complex
systems interact, supporting dynamical predictions, as well as inferences about
the abstract properties of the system. Our model takes graphs as input,
performs object- and relation-centric reasoning in a way that is analogous to a
simulation, and is implemented using deep neural networks. We evaluate its
ability to reason about several challenging physical domains: n-body problems,
rigid-body collision, and non-rigid dynamics. Our results show it can be
trained to accurately simulate the physical trajectories of dozens of objects
over thousands of time steps, estimate abstract quantities such as energy, and
generalize automatically to systems with different numbers and configurations
of objects and relations. Our interaction network implementation is the first
general-purpose, learnable physics engine, and a powerful general framework for
reasoning about object and relations in a wide variety of complex real-world
domains.
Peter W. Battaglia Razvan Pascanu Matthew Lai Danilo Rezende Koray Kavukcuoglu