Qwen
Collection
Alibaba Cloud-based models
•
1030 items
•
Updated
•
3
merge
This is a merge of pre-trained language models created using mergekit.
Merge Details
Use this mode (Works better): https://huggingface.co/Triangle104/Minerva-14b
Merge Method
This model was merged using the Passthrough merge method using Triangle104/Minerva-14b + ToastyPigeon/qwen-story-test-qlora as a base.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
base_model: Triangle104/Minerva-14b+ToastyPigeon/qwen-story-test-qlora
dtype: bfloat16
merge_method: passthrough
models:
- model: Triangle104/Minerva-14b+ToastyPigeon/qwen-story-test-qlora
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 27.02 |
| IFEval (0-Shot) | 8.61 |
| BBH (3-Shot) | 43.62 |
| MATH Lvl 5 (4-Shot) | 30.36 |
| GPQA (0-shot) | 15.44 |
| MuSR (0-shot) | 18.32 |
| MMLU-PRO (5-shot) | 45.76 |
- Downloads last month
- 18
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
the model is not deployed on the HF Inference API.
Model tree for Triangle104/Minerva-14b-V0.1
Merge model
this model
Collections including Triangle104/Minerva-14b-V0.1
Evaluation results
- strict accuracy on IFEval (0-Shot)Open LLM Leaderboard8.610
- normalized accuracy on BBH (3-Shot)Open LLM Leaderboard43.620
- exact match on MATH Lvl 5 (4-Shot)Open LLM Leaderboard30.360
- acc_norm on GPQA (0-shot)Open LLM Leaderboard15.440
- acc_norm on MuSR (0-shot)Open LLM Leaderboard18.320
- accuracy on MMLU-PRO (5-shot)test set Open LLM Leaderboard45.760