---
base_model:
- nbeerbower/Lyra4-Gutenberg-12B
- elinas/Chronos-Gold-12B-1.0
- PocketDoc/Dans-DangerousWinds-V1.1.0-12b
- inflatebot/guns-and-roses-r1
- IntervitensInc/Mistral-Nemo-Base-2407-chatml
library_name: transformers
tags:
- mergekit
- merge

---
# merge

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Merge Details
### Merge Method

This model was merged using the [DARE TIES](https://arxiv.org/abs/2311.03099) merge method using [IntervitensInc/Mistral-Nemo-Base-2407-chatml](https://huggingface.co/IntervitensInc/Mistral-Nemo-Base-2407-chatml) as a base.

### Models Merged

The following models were included in the merge:
* [nbeerbower/Lyra4-Gutenberg-12B](https://huggingface.co/nbeerbower/Lyra4-Gutenberg-12B)
* [elinas/Chronos-Gold-12B-1.0](https://huggingface.co/elinas/Chronos-Gold-12B-1.0)
* [PocketDoc/Dans-DangerousWinds-V1.1.0-12b](https://huggingface.co/PocketDoc/Dans-DangerousWinds-V1.1.0-12b)
* [inflatebot/guns-and-roses-r1](https://huggingface.co/inflatebot/guns-and-roses-r1)

### Configuration

The following YAML configuration was used to produce this model:

```yaml
models:
 - model: elinas/Chronos-Gold-12B-1.0
   parameters:
     density: 0.9
     weight: 0.5
 - model: inflatebot/guns-and-roses-r1
   parameters:
     density: 0.9
     weight: 0.5
 - model: nbeerbower/Lyra4-Gutenberg-12B
   parameters:
     density: 0.6
     weight: 0.3
 - model: PocketDoc/Dans-DangerousWinds-V1.1.0-12b
   parameters:
     density: 0.8
     weight: 0.2
merge_method: dare_ties
base_model: IntervitensInc/Mistral-Nemo-Base-2407-chatml
dtype: bfloat16
tokenizer:
  source: "base"
```