Qwen 2.5 Math 14B Iter 1
Collection
Qwen 2.5 is missing it's 14B and 32B math variants!! I have taken it upon myself to create them :)
•
4 items
•
Updated
•
1
Qwen2.5 Ultimate 14B Instruct
Merged using rombodawg's method and using the first iteration of my Qwen2.5 Math 14B Instruct.
Merge Details
Merge Method
This model was merged using the TIES merge method using Qwen/Qwen2.5-14B as a base.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
models:
- model: qingy2019/Qwen2.5-Math-14B-Instruct
parameters:
weight: 1
density: 1
- model: Qwen/Qwen2.5-14B-Instruct
parameters:
weight: 1
density: 1
merge_method: ties
base_model: Qwen/Qwen2.5-14B
parameters:
weight: 1
density: 1
normalize: true
int8_mask: true
tokenizer_source: qingy2019/Qwen2.5-Math-14B-Instruct
dtype: bfloat16
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 29.29 |
| IFEval (0-Shot) | 39.38 |
| BBH (3-Shot) | 40.58 |
| MATH Lvl 5 (4-Shot) | 28.02 |
| GPQA (0-shot) | 14.21 |
| MuSR (0-shot) | 9.89 |
| MMLU-PRO (5-shot) | 43.66 |
- Downloads last month
- 73
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.
Model tree for qingy2024/Qwen2.5-Ultimate-14B-Instruct
Merge model
this model
Collection including qingy2024/Qwen2.5-Ultimate-14B-Instruct
Evaluation results
- strict accuracy on IFEval (0-Shot)Open LLM Leaderboard39.380
- normalized accuracy on BBH (3-Shot)Open LLM Leaderboard40.580
- exact match on MATH Lvl 5 (4-Shot)Open LLM Leaderboard28.020
- acc_norm on GPQA (0-shot)Open LLM Leaderboard14.210
- acc_norm on MuSR (0-shot)Open LLM Leaderboard9.890
- accuracy on MMLU-PRO (5-shot)test set Open LLM Leaderboard43.660