percentiles to -1 and 1. All training objectives and test measures used mean squared error (MSE)
between the model’s prediction and the ground truth target.
All prediction experiments used the same architecture, with parameters selected by a hyperparameter
search. The fRMLP had four, 150-length hidden layers, and output length DE= 50 . ThefOMLP
had one, 100-length hidden layer, and output length DP= 2, which targeted the x;y-velocity. The
mandawere customized so that the model was invariant to the absolute positions of objects in the
scene. Themconcatenated three terms for each bk: the difference vector between the dynamic states
of the receiver and sender, the concatenated receiver and sender attribute vectors, and the relation
attribute vector. The aonly outputs the velocities, not the positions, for input to O.
The energy estimation experiments used the IN from the prediction experiments with an additional
AMLP which had one, 25-length hidden layer. Its Pinputs’ columns were length DP= 10 , and
its output length was DA= 1.
We optimized the parameters using Adam [ 13], with a waterfall schedule that began with a learning
rate of 0:001and down-scaled the learning rate by 0:8each time the validation error, estimated over
Reasoning about objects, relations, and physics is central to human
intelligence, and a key goal of artificial intelligence. Here we introduce the
interaction network, a model which can reason about how objects in complex
systems interact, supporting dynamical predictions, as well as inferences about
the abstract properties of the system. Our model takes graphs as input,
performs object- and relation-centric reasoning in a way that is analogous to a
simulation, and is implemented using deep neural networks. We evaluate its
ability to reason about several challenging physical domains: n-body problems,
rigid-body collision, and non-rigid dynamics. Our results show it can be
trained to accurately simulate the physical trajectories of dozens of objects
over thousands of time steps, estimate abstract quantities such as energy, and
generalize automatically to systems with different numbers and configurations
of objects and relations. Our interaction network implementation is the first
general-purpose, learnable physics engine, and a powerful general framework for
reasoning about object and relations in a wide variety of complex real-world
domains.
Peter W. Battaglia Razvan Pascanu Matthew Lai Danilo Rezende Koray Kavukcuoglu