Experiment 1 - number of digits:
The training set included 40 single digits operand combinations. The test set for
single digits included the remaining 41 combinations (discarding 0) and 50 randomly
chosen combinations for all the cases with more then 1 digit.
Experiment 2 - digits and words:
200 samples were randomly drawn for each number of digits (except for 1 and 2
digits) and data was split equally between train and test data. This was repeated
for both digits and words.
Experiment 3 - question formats:
The train set included 400 samples with format 0 and the dev and test set each in-
cluded 200 samples from each format, randomly drawn with number of digits ranging
between 1 and 9.
Experiment 4 - generalization across operations:
The train set included 635 samples across all formats and digits for each operation,
while the dev and test set each included 315 samples for each operation.
For the two-operation experiment we drew 120 samples for each of the 29 formats,
MRKL Systems