Hugging Face's logo

attn-signs
/
Watari-7b-v1

Text Generation
Transformers
Safetensors
Russian
qwen2
conversational
text-generation-inference
Model card Files Community
attn-signs commited on
Commit
af21153
·
verified ·
1 Parent(s): 79496da

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -1
README.md CHANGED
@@ -108,7 +108,7 @@ print(response)
108
 
109
  ### Benchmarks:
110
  **MERA**:
111
- - Overall: 0.423 (TOP 30 RU LLMs)
112
  - LCS: 0.044 Accuracy
113
  - RCB: 0.484 / 0.401 Avg. F1 / Accuracy
114
  - USE: 0.16 Grade Norm
@@ -125,5 +125,8 @@ print(response)
125
  - ruWorldTree: 0.876 / 0.876 Avg. F1 / Accuracy
126
  - ruOpenBookQA: 0.788 / 0.787 Avg. F1 / Accuracy
127
 
 
 
 
128
  ### LLM was trained using:
129
  https://github.com/Raumberg/myllm
 
108
 
109
  ### Benchmarks:
110
  **MERA**:
111
+ - **Overall: 0.423 (TOP 30 RU LLMs)**
112
  - LCS: 0.044 Accuracy
113
  - RCB: 0.484 / 0.401 Avg. F1 / Accuracy
114
  - USE: 0.16 Grade Norm
 
125
  - ruWorldTree: 0.876 / 0.876 Avg. F1 / Accuracy
126
  - ruOpenBookQA: 0.788 / 0.787 Avg. F1 / Accuracy
127
 
128
+ **RU Arena General**
129
+ - **Overall: 69.49**
130
+
131
  ### LLM was trained using:
132
  https://github.com/Raumberg/myllm