LeroyDyer commited on
Commit
9b9a7a9
·
verified ·
1 Parent(s): abe46d7

Adding Evaluation Results

Browse files

This is an automated PR created with https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr

The purpose of this PR is to add evaluation results from the Open LLM Leaderboard to your model card.

If you encounter any issues, please report them to https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr/discussions

Files changed (1) hide show
  1. README.md +117 -8
README.md CHANGED
@@ -1,9 +1,7 @@
1
  ---
2
- base_model:
3
- - chihoonlee10/T3Q-Mistral-Orca-Math-DPO
4
- - yam-peleg/Experiment26-7B
5
- - liminerity/M7-7b
6
- - LeroyDyer/Mixtral_AI_Cyber_3.1_SFT
7
  library_name: transformers
8
  tags:
9
  - chemistry
@@ -15,9 +13,106 @@ tags:
15
  - finance
16
  - legal
17
  - medical
18
- license: openrail
19
- language:
20
- - en
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
21
  ---
22
 
23
  Used as the Boss of Other Agents!
@@ -64,3 +159,17 @@ VERY GOOD MODEL !!!!! (HIGH SCORES) - 78.9 Average
64
  url = {https://doi.org/10.5281/zenodo.5371628},
65
  }
66
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - en
4
+ license: openrail
 
 
5
  library_name: transformers
6
  tags:
7
  - chemistry
 
13
  - finance
14
  - legal
15
  - medical
16
+ base_model:
17
+ - chihoonlee10/T3Q-Mistral-Orca-Math-DPO
18
+ - yam-peleg/Experiment26-7B
19
+ - liminerity/M7-7b
20
+ - LeroyDyer/Mixtral_AI_Cyber_3.1_SFT
21
+ model-index:
22
+ - name: LCARS_TOP_SCORE
23
+ results:
24
+ - task:
25
+ type: text-generation
26
+ name: Text Generation
27
+ dataset:
28
+ name: IFEval (0-Shot)
29
+ type: HuggingFaceH4/ifeval
30
+ args:
31
+ num_few_shot: 0
32
+ metrics:
33
+ - type: inst_level_strict_acc and prompt_level_strict_acc
34
+ value: 43.71
35
+ name: strict accuracy
36
+ source:
37
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=LeroyDyer/LCARS_TOP_SCORE
38
+ name: Open LLM Leaderboard
39
+ - task:
40
+ type: text-generation
41
+ name: Text Generation
42
+ dataset:
43
+ name: BBH (3-Shot)
44
+ type: BBH
45
+ args:
46
+ num_few_shot: 3
47
+ metrics:
48
+ - type: acc_norm
49
+ value: 31.7
50
+ name: normalized accuracy
51
+ source:
52
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=LeroyDyer/LCARS_TOP_SCORE
53
+ name: Open LLM Leaderboard
54
+ - task:
55
+ type: text-generation
56
+ name: Text Generation
57
+ dataset:
58
+ name: MATH Lvl 5 (4-Shot)
59
+ type: hendrycks/competition_math
60
+ args:
61
+ num_few_shot: 4
62
+ metrics:
63
+ - type: exact_match
64
+ value: 6.72
65
+ name: exact match
66
+ source:
67
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=LeroyDyer/LCARS_TOP_SCORE
68
+ name: Open LLM Leaderboard
69
+ - task:
70
+ type: text-generation
71
+ name: Text Generation
72
+ dataset:
73
+ name: GPQA (0-shot)
74
+ type: Idavidrein/gpqa
75
+ args:
76
+ num_few_shot: 0
77
+ metrics:
78
+ - type: acc_norm
79
+ value: 4.81
80
+ name: acc_norm
81
+ source:
82
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=LeroyDyer/LCARS_TOP_SCORE
83
+ name: Open LLM Leaderboard
84
+ - task:
85
+ type: text-generation
86
+ name: Text Generation
87
+ dataset:
88
+ name: MuSR (0-shot)
89
+ type: TAUR-Lab/MuSR
90
+ args:
91
+ num_few_shot: 0
92
+ metrics:
93
+ - type: acc_norm
94
+ value: 12.43
95
+ name: acc_norm
96
+ source:
97
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=LeroyDyer/LCARS_TOP_SCORE
98
+ name: Open LLM Leaderboard
99
+ - task:
100
+ type: text-generation
101
+ name: Text Generation
102
+ dataset:
103
+ name: MMLU-PRO (5-shot)
104
+ type: TIGER-Lab/MMLU-Pro
105
+ config: main
106
+ split: test
107
+ args:
108
+ num_few_shot: 5
109
+ metrics:
110
+ - type: acc
111
+ value: 22.57
112
+ name: accuracy
113
+ source:
114
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=LeroyDyer/LCARS_TOP_SCORE
115
+ name: Open LLM Leaderboard
116
  ---
117
 
118
  Used as the Boss of Other Agents!
 
159
  url = {https://doi.org/10.5281/zenodo.5371628},
160
  }
161
 
162
+
163
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
164
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/LeroyDyer__LCARS_TOP_SCORE-details)
165
+
166
+ | Metric |Value|
167
+ |-------------------|----:|
168
+ |Avg. |20.32|
169
+ |IFEval (0-Shot) |43.71|
170
+ |BBH (3-Shot) |31.70|
171
+ |MATH Lvl 5 (4-Shot)| 6.72|
172
+ |GPQA (0-shot) | 4.81|
173
+ |MuSR (0-shot) |12.43|
174
+ |MMLU-PRO (5-shot) |22.57|
175
+