C Complete Ablation Study Results

C.1 Study of retrieval.

In Table 12, we provide the complete results of Table 5, highlighting the importance of both experience
and knowledge in ensuring the success of the entire framework.
We present complete ablation results on various experience retrieval strategies in Table 13 (corre-
sponding to Table 6 in the paper). Both meta-features and text embeddings outperformed random
retrieval. However, the choice of meta-features depends on the quality of the design. We note that
meta-features may not provide enough ﬂexibility for varied types of tasks.

C.2 Study of canonicalization.
MLCopilot- Unleashing the Power of Large Language Models in Solving Machine Learning Tasks