[90] M. F. Cusumano-Towner, F. A. Saad, A. K. Lew, and V. K. Mansinghka. Gen: A General-Purpose Proba-
bilistic Programming System with Programmable Inference. In ACM SIGPLAN International Conference on
Programming Language Design and Implementation (PLDI), 2019.

13

A Sequence Transformation

A.1 Abstraction and Reasoning Corpus: Additional Details and Examples

In Section 4 of the main paper, we describe how ARC problems require reasoning about a range of different
types of pattern operations—infilling, counting, translating and rotating shapes, and more. In Fig. 8, we
show sample problems among the 800 ARC problems for which text-davinci-003 correctly generalizes
the pattern shown in a few train examples to a test example. In Fig. 9, we show sample problems that are
not correctly solved by text-davinci-003. In Listing 1, we show an example context for an ARC problem
encoded as integers.

Fig. 8: Sample ARC problems that are correctly solved by text-davinci-003.
LargeLanguageModelsasGeneralPatternMachines