BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks
•
49
BigCode
Enterprise
non-profit
AI & ML interests
None defined yet.
Recent Activity
View all activity
Articles
bigcode
's datasets
88
bigcode/bigcodebench
Viewer
•
Updated
•
5.7k
•
61.9k
•
62
bigcode/governance-card
Updated
•
276
•
12
bigcode/bigcodebench-hard-results
Viewer
•
Updated
•
202
•
54
•
1
bigcode/bigcodebench-hard-solve-rate
Viewer
•
Updated
•
296
•
91
•
1
bigcode/bigcodebench-hard-domain
Viewer
•
Updated
•
372
•
56
•
1
bigcode/bigcodebench-hard-perf
Viewer
•
Updated
•
372
•
10
bigcode/bigcodebench-results
Viewer
•
Updated
•
202
•
77
•
2
bigcode/bigcodebench-solve-rate
Viewer
•
Updated
•
2.28k
•
67
bigcode/bigcodebench-domain
Viewer
•
Updated
•
279
•
100
bigcode/bigcodebench-perf
Viewer
•
Updated
•
279
•
29
bigcode/starcoder2data-extras
Viewer
•
Updated
•
51.6M
•
1.37k
•
6
bigcode/bigcodebench-hard
Viewer
•
Updated
•
740
•
23.9k
•
3
bigcode/commitpack
Updated
•
6.54k
•
68
bigcode/bigcodebench-hard-elo
Viewer
•
Updated
•
268
•
45
bigcode/bigcodebench-elo
Viewer
•
Updated
•
222
•
19
bigcode/self-oss-instruct-sc2-exec-filter-50k
Viewer
•
Updated
•
50.7k
•
448
•
100
bigcode/starcoder2-instruct-assets
Viewer
•
Updated
•
5
•
1.07k
bigcode/MultiPL-E-completions
Viewer
•
Updated
•
20.3k
•
3.94k
•
9
bigcode/bigcodebench-tool
Viewer
•
Updated
•
148
•
2
•
1
bigcode/bcb_update
Viewer
•
Updated
•
4
•
8
•
1
bigcode/big-fc-script
Viewer
•
Updated
•
336
•
31
bigcode/bigcodebench-hard-test-elo
Viewer
•
Updated
•
160
•
24
bigcode/bigcodebench-instruct-perf
Updated
•
21
bigcode/bigcodebench-complete-perf
Updated
•
7
bigcode/se_bcb_results
Viewer
•
Updated
•
10.4M
•
41
bigcode/bigcodebench-embeddings
Viewer
•
Updated
•
1.14k
•
43
•
2
bigcode/stack-exchange-embeddings-20230914
Viewer
•
Updated
•
10.4M
•
710
bigcode/bigcodebench-instruct-solve-rate
Viewer
•
Updated
•
1.14k
•
28
bigcode/bigcodebench-complete-solve-rate
Viewer
•
Updated
•
1.14k
•
28
bigcode/bigcodebench-elo-model-with-tie
Viewer
•
Updated
•
72
•
28