--- license: apache-2.0 tags: - merge - mergekit - lazymergekit - shenzhi-wang/Llama3-8B-Chinese-Chat - NousResearch/Hermes-2-Pro-Llama-3-8B --- # Llama3-8B-Chinese-Chat-Hermes-2-Pro-Llama-3-8B-slerp-merge Llama3-8B-Chinese-Chat-Hermes-2-Pro-Llama-3-8B-slerp-merge is a merge of the following models using [mergekit](https://github.com/cg123/mergekit): * [shenzhi-wang/Llama3-8B-Chinese-Chat](https://huggingface.co/shenzhi-wang/Llama3-8B-Chinese-Chat) * [NousResearch/Hermes-2-Pro-Llama-3-8B](https://huggingface.co/NousResearch/Hermes-2-Pro-Llama-3-8B) ## 🧩 Merge Configuration ```yaml slices: - sources: - model: shenzhi-wang/Llama3-8B-Chinese-Chat layer_range: [0, 31] - model: NousResearch/Hermes-2-Pro-Llama-3-8B layer_range: [0, 31] merge_method: slerp base_model: NousResearch/Hermes-2-Pro-Llama-3-8B parameters: t: - filter: self_attn value: [0, 0.5, 0.3, 0.7, 1] - filter: mlp value: [1, 0.5, 0.7, 0.3, 0] - value: 0.5 dtype: float16 ```