--- base_model: - Qwen/Qwen2.5-0.5B-Instruct library_name: transformers tags: - mergekit - merge - The Noise language: - zho - eng - fra - spa - por - deu - ita - rus - jpn - kor - vie - tha - ara --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Model Noiser](https://example.com/docs) merge method. ### Models Merged The following models were included in the merge: * [Qwen/Qwen2.5-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct) ### Configuration The following YAML configuration was used to produce this model: ```yaml merge_method: model_noiser models: - model: Qwen/Qwen2.5-0.5B-Instruct parameters: normalize: true noise_stddev: 0.2 # adjust as needed ``` ## ***WARNING*** The YAML config used does NOT work in mergekit normally. You need my fork for this.