File size: 1,183 Bytes
910052a 6a0aaae 910052a |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 |
---
license: apache-2.0
language:
- en
- zh
base_model:
- deepseek-ai/DeepSeek-R1-0528-Qwen3-8B
- Qwen/Qwen3-8B
- Qwen/Qwen3-8B-Base
pipeline_tag: text-generation
tags:
- merge
---
# *Model Highlights:*
- ***Optimal merge method**: `nuslerp`*
- ***Highest precision**: `dtype: float32` + `out_dtype: bfloat16`*
- ***Brand-new chat template**: ensures normal operation on LM Studio*
- ***Context length**: `32768` [128K context version](https://huggingface.co/YOYO-AI/Qwen3-8B-YOYO-nuslerp-plus-128K)*
# *Parameter Settings*:
## *Thinking Mode: (Recommend)*
> [!NOTE]
> *`Temperature=0.6`, `TopP=0.95`, `TopK=20`,`MinP=0`.*
## *Non-thinking Mode: (Not recommend)*
*`\no_think` may not work sometimes*
> [!TIP]
> *`Temperature=0.7`, `TopP=0.8`, `TopK=20`,`MinP=0`.*
# *Configuration*:
*The following YAML configuration was used to produce this model:*
```yaml
models:
- model: deepseek-ai/DeepSeek-R1-0528-Qwen3-8B
parameters:
weight: 1
- model: Qwen/Qwen3-8B
parameters:
weight: 1
merge_method: nuslerp
base_model: Qwen/Qwen3-8B-Base
tokenizer_source: Qwen/Qwen3-8B
parameters:
normalize: true
int8_mask: true
dtype: float32
out_dtype: bfloat16
```
|