--- license: apache-2.0 tags: - merge - mergekit - lazymergekit - NousResearch/Hermes-2-Pro-Llama-3-8B - shenzhi-wang/Llama3-8B-Chinese-Chat --- Quantized GGUF model Hermes-2-Pro-Llama-3-8B-Llama3-8B-Chinese-Chat-slerp-merge-gguf Hermes-2-Pro-Llama-3-8B-Llama3-8B-Chinese-Chat-slerp-merge-gguf is a quantized model using [llama.cpp](https://github.com/ggerganov/llama.cpp) `llama-quantize` # Hermes-2-Pro-Llama-3-8B-Llama3-8B-Chinese-Chat-slerp-merge Hermes-2-Pro-Llama-3-8B-Llama3-8B-Chinese-Chat-slerp-merge is a merge of the following models using [mergekit](https://github.com/cg123/mergekit): * [NousResearch/Hermes-2-Pro-Llama-3-8B](https://huggingface.co/NousResearch/Hermes-2-Pro-Llama-3-8B) * [shenzhi-wang/Llama3-8B-Chinese-Chat](https://huggingface.co/shenzhi-wang/Llama3-8B-Chinese-Chat) ## 🧩 Merge Configuration ```yaml slices: - sources: - model: NousResearch/Hermes-2-Pro-Llama-3-8B layer_range: [0, 31] - model: shenzhi-wang/Llama3-8B-Chinese-Chat layer_range: [0, 31] merge_method: slerp base_model: NousResearch/Hermes-2-Pro-Llama-3-8B parameters: t: - filter: self_attn value: [0, 0.5, 0.3, 0.7, 1] - filter: mlp value: [1, 0.5, 0.7, 0.3, 0] - value: 0.5 dtype: float16 ```