|
|
--- |
|
|
license: apache-2.0 |
|
|
language: |
|
|
- en |
|
|
- zh |
|
|
base_model: |
|
|
- Kwai-Klear/Klear-Reasoner-8B |
|
|
- deepseek-ai/DeepSeek-R1-0528-Qwen3-8B |
|
|
- Qwen/Qwen3-8B |
|
|
- AXCXEPT/Qwen3-EZO-8B-beta |
|
|
- Qwen/Qwen3-8B-Base |
|
|
pipeline_tag: text-generation |
|
|
tags: |
|
|
- merge |
|
|
--- |
|
|
> *Enhance the performance of Qwen3-8B by merging powerful reasoning models without compromising the effectiveness of the \no_think tag!* |
|
|
# *Model Highlights:* |
|
|
|
|
|
- ***merge method**: `arcee_fusion` `nuslerp` `della`* |
|
|
|
|
|
- ***precision**: `dtype: float32` `out_dtype: bfloat16`* |
|
|
|
|
|
- ***Context length**: `40960`* |
|
|
|
|
|
# *Parameter Settings:* |
|
|
## *Thinking Mode:* |
|
|
> [!NOTE] |
|
|
> *`Temperature=0.6`, `TopP=0.95`, `TopK=20`,`MinP=0`.* |
|
|
## *Non-Thinking Mode:* |
|
|
> [!TIP] |
|
|
> *`Temperature=0.7`, `TopP=0.8`, `TopK=20`,`MinP=0`.* |
|
|
|
|
|
## *Step1: Merge Two Hybrid Models* |
|
|
- *Leverage the advantages of the two hybrid models.* |
|
|
```yaml |
|
|
models: |
|
|
- model: AXCXEPT/Qwen3-EZO-8B-beta |
|
|
merge_method: arcee_fusion |
|
|
base_model: Qwen/Qwen3-8B |
|
|
dtype: float32 |
|
|
out_dtype: bfloat16 |
|
|
tokenizer_source: base |
|
|
name: Qwen3-8B-fusion |
|
|
``` |
|
|
## *Step2: Merge High-Performance Reasoning Models with Hybrid Models* |
|
|
- *Maximize the proportion of reasoning models on the premise that the \no_think tag remains effective.* |
|
|
```yaml |
|
|
models: |
|
|
- model: Qwen3-8B-fusion |
|
|
parameters: |
|
|
weight: 0.55 |
|
|
- model: deepseek-ai/DeepSeek-R1-0528-Qwen3-8B |
|
|
parameters: |
|
|
weight: 0.45 |
|
|
merge_method: nuslerp |
|
|
tokenizer_source: Qwen/Qwen3-8B |
|
|
dtype: float32 |
|
|
out_dtype: bfloat16 |
|
|
name: Qwen3-8B-nuslerp1 |
|
|
``` |
|
|
```yaml |
|
|
models: |
|
|
- model: Qwen3-8B-fusion |
|
|
parameters: |
|
|
weight: 0.75 |
|
|
- model: Kwai-Klear/Klear-Reasoner-8B |
|
|
parameters: |
|
|
weight: 0.25 |
|
|
merge_method: nuslerp |
|
|
tokenizer_source: Qwen/Qwen3-8B |
|
|
dtype: float32 |
|
|
out_dtype: bfloat16 |
|
|
name: Qwen3-8B-nuslerp2 |
|
|
``` |
|
|
## *Step3: Unify the Enhanced Hybrid Modes* |
|
|
- *Merge the two models into the base model using the della merging method to make the model more versatile and stable.* |
|
|
- *We use the chat template of Qwen3-8B.* |
|
|
```yaml |
|
|
models: |
|
|
- model: Qwen3-8B-nuslerp1 |
|
|
parameters: |
|
|
density: 1 |
|
|
weight: 1 |
|
|
lambda: 0.9 |
|
|
- model: Qwen3-8B-nuslerp2 |
|
|
parameters: |
|
|
density: 1 |
|
|
weight: 1 |
|
|
lambda: 0.9 |
|
|
merge_method: della |
|
|
base_model: Qwen/Qwen3-8B-Base |
|
|
dtype: float32 |
|
|
out_dtype: bfloat16 |
|
|
name: Qwen3-8B-YOYO-V2-Hybrid |
|
|
``` |
|
|
|
|
|
|
|
|
|
