--- base_model: - LatitudeGames/Muse-12B - Trappu/Nemo-Picaro-12B library_name: transformers tags: - mergekit - merge --- # muse-picaro This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [SLERP](https://en.wikipedia.org/wiki/Slerp) merge method. ### Models Merged The following models were included in the merge: * [LatitudeGames/Muse-12B](https://huggingface.co/LatitudeGames/Muse-12B) * [Trappu/Nemo-Picaro-12B](https://huggingface.co/Trappu/Nemo-Picaro-12B) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: LatitudeGames/Muse-12B - model: Trappu/Nemo-Picaro-12B merge_method: slerp base_model: LatitudeGames/Muse-12B parameters: t: - value: 0.5 dtype: bfloat16 tokenizer_source: union ```