File size: 1,160 Bytes
1204a52 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 |
---
language:
- ko
pipeline_tag: text-generation
tags:
- SOLAR-10.7B
---
# SOLAR-10.7B
### Model Details
- Base Model: [yanolja/KoSOLAR-10.7B-v0.1](https://huggingface.co/yanolja/KoSOLAR-10.7B-v0.1)
### Datasets
- sampling and translate [Open-Orca/SlimOrca](https://huggingface.co/datasets/Open-Orca/SlimOrca)
- sampling and translate [Anthropic/hh-rlhf](https://huggingface.co/datasets/Anthropic/hh-rlhf)
### Benchmark
- SOTA model as of Jan 1, 2024 (https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard).
| Model | Average |Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 |
| --- | --- | --- | --- | --- | --- | --- |
| **hyeogi/SOLAR-10.7B-dpo-v0.1 (Ours)** | **56.29** | 47.95 | 59.49 | 51.29 | 60.97 | 61.75 |
| [jeonsworld/CarbonVillain-10.7B-v1](https://huggingface.co/jeonsworld/CarbonVillain-10.7B-v1) | 55.33 | 49.91 | 60.65 | 55.04 | 48.22 | 62.81 |
| [Megastudy/M-SOLAR-10.7B-v1.1-beta](https://huggingface.co/Megastudy/M-SOLAR-10.7B-v1.1-beta) | 55.25 | 51.71 | 60.86 | 54.24 | 47.12 | 62.34 |
|