54

Competition-Level Code Generation with AlphaCode

Rewording
Original (maximum product of two consecutive array elements)
Opposite (minimum product of two consecutive array elements)
Related (maximum product of two any array elements)
Underspeciﬁed (maximum function of two consecutive array elements)
Verbose
Algorithm described in words

Solve rate
17.1%
0.1%
3.2%
0.03%
19.4%
19.7%

Appendix Table A10 | Rewording the Cherry problem. The percentage of solutions in 50000 samples
from the 1B parameter model when attempting the simpliﬁed version of the Cherry problem with
diﬀerent rewordings.
alphacode