metadata
base_model:
- ehristoforu/coolqwen-3b-it
- tensopolis/qwen2.5-3b-or1-tensopolis
- bunnycore/QwQen-3B-LCoT
- bunnycore/Qwen2.5-3B-Model-Stock-v2
library_name: transformers
tags:
- mergekit
- merge
merge
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the SCE merge method using ehristoforu/coolqwen-3b-it as a base.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
models:
# Pivot model
- model: ehristoforu/coolqwen-3b-it
# Target models
- model: bunnycore/QwQen-3B-LCoT
- model: tensopolis/qwen2.5-3b-or1-tensopolis
- model: bunnycore/Qwen2.5-3B-Model-Stock-v2
merge_method: sce
base_model: ehristoforu/coolqwen-3b-it
parameters:
select_topk: 1.5
dtype: bfloat16