Update README.md
Browse files
README.md
CHANGED
|
@@ -7,13 +7,24 @@ sdk: static
|
|
| 7 |
pinned: false
|
| 8 |
---
|
| 9 |
|
| 10 |
-
# EvalPlus
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 11 |
|
| 12 |
* π» **GitHub Repo**: [evalplus/evalplus](https://github.com/evalplus/evalplus)
|
| 13 |
* π **Leader Board**: [evalplus.github.io](https://evalplus.github.io/leaderboard.html)
|
| 14 |
* π **NeurIPS Paper**: [OpenReview](https://openreview.net/pdf?id=1qvx610Cu7)
|
| 15 |
* π **Python Package**: [PyPI](https://pypi.org/project/evalplus/)
|
| 16 |
|
|
|
|
|
|
|
| 17 |
```bibtex
|
| 18 |
@inproceedings{evalplus,
|
| 19 |
title = {Is Your Code Generated by Chat{GPT} Really Correct? Rigorous Evaluation of Large Language Models for Code Generation},
|
|
@@ -22,4 +33,12 @@ pinned: false
|
|
| 22 |
year = {2023},
|
| 23 |
url = {https://openreview.net/forum?id=1qvx610Cu7},
|
| 24 |
}
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 25 |
```
|
|
|
|
| 7 |
pinned: false
|
| 8 |
---
|
| 9 |
|
| 10 |
+
# EvalPlus: Rigorous Evaluation of LLMs for Code Generation
|
| 11 |
+
|
| 12 |
+
## About
|
| 13 |
+
|
| 14 |
+
EvalPlus evaluates LLM-generated code on:
|
| 15 |
+
|
| 16 |
+
* Code Correctness: HumanEval+ and MBPP+
|
| 17 |
+
* Code Efficiency: EvalPerf
|
| 18 |
+
|
| 19 |
+
## Resources
|
| 20 |
|
| 21 |
* π» **GitHub Repo**: [evalplus/evalplus](https://github.com/evalplus/evalplus)
|
| 22 |
* π **Leader Board**: [evalplus.github.io](https://evalplus.github.io/leaderboard.html)
|
| 23 |
* π **NeurIPS Paper**: [OpenReview](https://openreview.net/pdf?id=1qvx610Cu7)
|
| 24 |
* π **Python Package**: [PyPI](https://pypi.org/project/evalplus/)
|
| 25 |
|
| 26 |
+
## Citations
|
| 27 |
+
|
| 28 |
```bibtex
|
| 29 |
@inproceedings{evalplus,
|
| 30 |
title = {Is Your Code Generated by Chat{GPT} Really Correct? Rigorous Evaluation of Large Language Models for Code Generation},
|
|
|
|
| 33 |
year = {2023},
|
| 34 |
url = {https://openreview.net/forum?id=1qvx610Cu7},
|
| 35 |
}
|
| 36 |
+
|
| 37 |
+
@inproceedings{evalperf,
|
| 38 |
+
title = {Evaluating Language Models for Efficient Code Generation},
|
| 39 |
+
author = {Liu, Jiawei and Xie, Songrun and Wang, Junhao and Wei, Yuxiang and Ding, Yifeng and Zhang, Lingming},
|
| 40 |
+
booktitle = {First Conference on Language Modeling},
|
| 41 |
+
year = {2024},
|
| 42 |
+
url = {https://openreview.net/forum?id=IBCBMeAhmC},
|
| 43 |
+
}
|
| 44 |
```
|