--- base_model: - Epiculous/Fett-uccine-Long-Noodle-7B-120k-Context - Endevor/InfinityRP-v1-7B library_name: transformers tags: - mergekit - merge --- Merged on request of Lewdiculus. This model was merged using the SLERP merge method. ### Models Merged The following models were included in the merge: * [Epiculous/Fett-uccine-Long-Noodle-7B-120k-Context](https://huggingface.co/Epiculous/Fett-uccine-Long-Noodle-7B-120k-Context) * [Endevor/InfinityRP-v1-7B](https://huggingface.co/Endevor/InfinityRP-v1-7B) ### Configuration The following YAML configuration was used to produce this model: ```yaml slices: - sources: - model: Epiculous/Fett-uccine-Long-Noodle-7B-120k-Context layer_range: [0, 32] - model: Endevor/InfinityRP-v1-7B layer_range: [0, 32] merge_method: slerp base_model: Epiculous/Fett-uccine-Long-Noodle-7B-120k-Context parameters: t: - filter: self_attn value: [0, 0.5, 0.3, 0.7, 1] - filter: mlp value: [1, 0.5, 0.7, 0.3, 0] - value: 0.5 dtype: bfloat16 ```