TheCis input toO, which applies fO, another MLP, to each of the NOcolumns. The output of fO
is aDP-length vector, pj, andOconcatenates them to form the output matrix, P.
To infer abstract properties of a system, an additional Ais appended and takes Pas input. The g
aggregation function performs an elementwise sum across the columns of Pto return aDP-length
vector, P. The Pis input toA, another MLP, which returns a DA-length vector, q, that represents
an abstract, global property of the system.
Training an IN requires optimizing an objective function over the learnable parameters of RandO.
Note,mandainvolve matrix operations that do not contain learnable parameters.
BecauseRandOare shared across all relations and objects, respectively, training them is statistically efﬁcient. This is similar to CNNs, which are very efﬁcient due to their weight-sharing scheme.
A CNN treats a local neighborhood of pixels as related, interacting entities: each pixel is effectively
a receiver object and its neighboring pixels are senders. The convolution operator is analogous to
R, wherefRis the local linear/nonlinear kernel applied to each neighborhood. Skip connections,
Reasoning about objects, relations, and physics is central to human
intelligence, and a key goal of artificial intelligence. Here we introduce the
interaction network, a model which can reason about how objects in complex
systems interact, supporting dynamical predictions, as well as inferences about
the abstract properties of the system. Our model takes graphs as input,
performs object- and relation-centric reasoning in a way that is analogous to a
simulation, and is implemented using deep neural networks. We evaluate its
ability to reason about several challenging physical domains: n-body problems,
rigid-body collision, and non-rigid dynamics. Our results show it can be
trained to accurately simulate the physical trajectories of dozens of objects
over thousands of time steps, estimate abstract quantities such as energy, and
generalize automatically to systems with different numbers and configurations
of objects and relations. Our interaction network implementation is the first
general-purpose, learnable physics engine, and a powerful general framework for
reasoning about object and relations in a wide variety of complex real-world
domains.
Peter W. Battaglia Razvan Pascanu Matthew Lai Danilo Rezende Koray Kavukcuoglu