Hugging Face's logo

prithivMLmods
/
Tucana-Opus-14B-r999

Text Generation
Transformers
Safetensors
English
Chinese
qwen2
text-generation-inference
r999
trl
sft
math
conversational
Eval Results
Model card Files
xet
Community
1
prithivMLmods commited on
Commit
032688a
·
verified ·
1 Parent(s): 426f87c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -9
README.md CHANGED
@@ -12,6 +12,7 @@ tags:
12
  - r999
13
  - trl
14
  - sft
 
15
  model-index:
16
  - name: Tucana-Opus-14B-r999
17
  results:
@@ -29,7 +30,8 @@ model-index:
29
  value: 60.67
30
  name: averaged accuracy
31
  source:
32
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FTucana-Opus-14B-r999
 
33
  name: Open LLM Leaderboard
34
  - task:
35
  type: text-generation
@@ -45,7 +47,8 @@ model-index:
45
  value: 50.59
46
  name: normalized accuracy
47
  source:
48
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FTucana-Opus-14B-r999
 
49
  name: Open LLM Leaderboard
50
  - task:
51
  type: text-generation
@@ -61,7 +64,8 @@ model-index:
61
  value: 40.63
62
  name: exact match
63
  source:
64
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FTucana-Opus-14B-r999
 
65
  name: Open LLM Leaderboard
66
  - task:
67
  type: text-generation
@@ -77,7 +81,8 @@ model-index:
77
  value: 18.9
78
  name: acc_norm
79
  source:
80
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FTucana-Opus-14B-r999
 
81
  name: Open LLM Leaderboard
82
  - task:
83
  type: text-generation
@@ -89,10 +94,11 @@ model-index:
89
  num_few_shot: 0
90
  metrics:
91
  - type: acc_norm
92
- value: 19.0
93
  name: acc_norm
94
  source:
95
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FTucana-Opus-14B-r999
 
96
  name: Open LLM Leaderboard
97
  - task:
98
  type: text-generation
@@ -109,7 +115,8 @@ model-index:
109
  value: 48.71
110
  name: accuracy
111
  source:
112
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FTucana-Opus-14B-r999
 
113
  name: Open LLM Leaderboard
114
  ---
115
  ![7.png](https://cdn-uploads.huggingface.co/production/uploads/65bb837dbfb878f46c77de4c/sMBoX-5wXEze5wmNNvmE_.png)
@@ -213,5 +220,4 @@ Summarized results can be found [here](https://huggingface.co/datasets/open-llm-
213
  |MATH Lvl 5 (4-Shot)| 40.63|
214
  |GPQA (0-shot) | 18.90|
215
  |MuSR (0-shot) | 19.00|
216
- |MMLU-PRO (5-shot) | 48.71|
217
-
 
12
  - r999
13
  - trl
14
  - sft
15
+ - math
16
  model-index:
17
  - name: Tucana-Opus-14B-r999
18
  results:
 
30
  value: 60.67
31
  name: averaged accuracy
32
  source:
33
+ url: >-
34
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FTucana-Opus-14B-r999
35
  name: Open LLM Leaderboard
36
  - task:
37
  type: text-generation
 
47
  value: 50.59
48
  name: normalized accuracy
49
  source:
50
+ url: >-
51
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FTucana-Opus-14B-r999
52
  name: Open LLM Leaderboard
53
  - task:
54
  type: text-generation
 
64
  value: 40.63
65
  name: exact match
66
  source:
67
+ url: >-
68
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FTucana-Opus-14B-r999
69
  name: Open LLM Leaderboard
70
  - task:
71
  type: text-generation
 
81
  value: 18.9
82
  name: acc_norm
83
  source:
84
+ url: >-
85
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FTucana-Opus-14B-r999
86
  name: Open LLM Leaderboard
87
  - task:
88
  type: text-generation
 
94
  num_few_shot: 0
95
  metrics:
96
  - type: acc_norm
97
+ value: 19
98
  name: acc_norm
99
  source:
100
+ url: >-
101
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FTucana-Opus-14B-r999
102
  name: Open LLM Leaderboard
103
  - task:
104
  type: text-generation
 
115
  value: 48.71
116
  name: accuracy
117
  source:
118
+ url: >-
119
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard#/?search=prithivMLmods%2FTucana-Opus-14B-r999
120
  name: Open LLM Leaderboard
121
  ---
122
  ![7.png](https://cdn-uploads.huggingface.co/production/uploads/65bb837dbfb878f46c77de4c/sMBoX-5wXEze5wmNNvmE_.png)
 
220
  |MATH Lvl 5 (4-Shot)| 40.63|
221
  |GPQA (0-shot) | 18.90|
222
  |MuSR (0-shot) | 19.00|
223
+ |MMLU-PRO (5-shot) | 48.71|