3.2.3 Results
In the following results we report the accuracy we achieve in diﬀerent experiments,
by which we mean the percent of problems in the relevant test set on which the
system gave the correct answer. (We note again that, since the actual calculation is
done by the calculator module, all errors are due to passing the wrong operations or
operands to the calculator.)

Experiment 1: Generalization across diﬀerent number of digits in the
Inspired by the experiments reported by [2], we test Jurassic-X’s ability
operands.
to generalize to numbers it has not seen in the training data, including numbers

8
MRKL Systems