Edentns
/

DataVortexS-10.7B-v0.3

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

JeongwonChoi commited on Jan 15, 2024

Commit

7faa21d

·

verified ·

1 Parent(s): 00c0018

Update README.md

Files changed (1) hide show

README.md +13 -11

README.md CHANGED Viewed

@@ -53,20 +53,22 @@ text = """\
 ## **Model Benchmark**
-### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
 On Benchmarking ...
-| Model                        | Average | Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 |
-| ---------------------------- | ------- | ------ | ------------ | ------- | ------------- | --------------- |
-| DataVortexM-7B-Instruct-v0.1 | 39.81   | 34.13  | 42.35        | 38.73   | 45.46         | 38.37           |
-| DataVortexS-10.7B-v0.1       | 0       | 0      | 0            | 0       | 0             | 0               |
-| DataVortexS-10.7B-v0.2       | 43.6    | 38.74  | 50.74        | 38.98   | 44.7          | 44.86           |
-| **DataVortexS-10.7B-v0.3**   | **0**   | **0**  | **0**        | **0**   | **0**         | **0**           |
-| DataVortexS-10.7B-v0.4       | 0       | 0      | 0            | 0       | 0             | 0               |
-| DataVortexS-10.7B-v1.0       | 0       | 0      | 0            | 0       | 0             | 0               |
-| DataVortexTL-1.1B-v0.1       | 0       | 0      | 0            | 0       | 0             | 0               |
-| DataVortexS-10.7B-dpo-v0.1   | 0       | 0      | 0            | 0       | 0             | 0               |
 ## **Implementation Code**

 ## **Model Benchmark**
+### **[Ko LM Eval Harnesss](https://github.com/Beomi/ko-lm-evaluation-harness)**
 On Benchmarking ...
+| Task             | 0-shot | 5-shot | 10-shot | 50-shot |
+| :--------------- | -----: | -----: | ------: | ------: |
+| kobest_boolq     |    0.0 |    0.0 |     0.0 |     0.0 |
+| kobest_copa      |    0.0 |    0.0 |     0.0 |     0.0 |
+| kobest_hellaswag |    0.0 |    0.0 |     0.0 |     0.0 |
+| kobest_sentineg  |    0.0 |    0.0 |     0.0 |     0.0 |
+### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
+| Average | Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 |
+| ------: | -----: | -----------: | ------: | ------------: | --------------: |
+|   37.57 |  33.87 |        42.47 |   28.21 |         46.09 |           37.19 |
 ## **Implementation Code**