Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,28 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language:
|
| 3 |
+
- ko
|
| 4 |
+
pipeline_tag: text-generation
|
| 5 |
+
tags:
|
| 6 |
+
- SOLAR-10.7B
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
# SOLAR-10.7B
|
| 10 |
+
|
| 11 |
+
### Model Details
|
| 12 |
+
- Base Model: [yanolja/KoSOLAR-10.7B-v0.1](https://huggingface.co/yanolja/KoSOLAR-10.7B-v0.1)
|
| 13 |
+
|
| 14 |
+
### Datasets
|
| 15 |
+
- sampling and translate [Open-Orca/SlimOrca](https://huggingface.co/datasets/Open-Orca/SlimOrca)
|
| 16 |
+
- sampling and translate [Anthropic/hh-rlhf](https://huggingface.co/datasets/Anthropic/hh-rlhf)
|
| 17 |
+
|
| 18 |
+
### Benchmark
|
| 19 |
+
- SOTA model as of Jan 1, 2024 (https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard).
|
| 20 |
+
|
| 21 |
+
| Model | Average |Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 |
|
| 22 |
+
| --- | --- | --- | --- | --- | --- | --- |
|
| 23 |
+
| **hyeogi/SOLAR-10.7B-dpo-v0.1 (Ours)** | **56.29** | 47.95 | 59.49 | 51.29 | 60.97 | 61.75 |
|
| 24 |
+
| [jeonsworld/CarbonVillain-10.7B-v1](https://huggingface.co/jeonsworld/CarbonVillain-10.7B-v1) | 55.33 | 49.91 | 60.65 | 55.04 | 48.22 | 62.81 |
|
| 25 |
+
| [Megastudy/M-SOLAR-10.7B-v1.1-beta](https://huggingface.co/Megastudy/M-SOLAR-10.7B-v1.1-beta) | 55.25 | 51.71 | 60.86 | 54.24 | 47.12 | 62.34 |
|
| 26 |
+
|
| 27 |
+
|
| 28 |
+
|