DyCodeEval - a CM Collection

CM 's Collections

updated 3 days ago

DyCodeEval (ICML 2025) enables dynamic benchmarking for code LLMs. This collection features dynamic HumanEval and MBPP sets generated with Claude 3.5.

Upvote

CM/Dynamic_HumanEvalZero

Viewer • Updated 6 days ago • 15.7k • 9
CM/Dynamic_MBPP_sanitized

Viewer • Updated 6 days ago • 15.8k • 5
Dynamic Benchmarking of Reasoning Capabilities in Code Large Language Models Under Data Contamination

Paper • 2503.04149 • Published Mar 6 • 4

Upvote

Collection guide
Browse collections