Hugging Face's logo

Burnt-Toast
/
funny-nemo-embedding-test-mm

Text Generation
Transformers
Safetensors
mistral
mergekit
Merge
conversational
text-generation-inference
Model card Files
xet
Community
funny-nemo-embedding-test-mm / README.md
ToastyPigeon's picture
ToastyPigeon
Upload folder using huggingface_hub
40e41a2 verified
preview code
|
raw
history blame contribute delete
1.28 kB
metadata
base_model:
  - inflatebot/MN-12B-Mag-Mell-R1
  - ToastyPigeon/nemo-kimi-lora
  - migtissera/Tess-3-Mistral-Nemo-12B
  - ToastyPigeon/nemo-books-lora
library_name: transformers
tags:
  - mergekit
  - merge

merged

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Linear merge method.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: inflatebot/MN-12B-Mag-Mell-R1+ToastyPigeon/nemo-kimi-lora
    parameters:
      weight: 0.5
  - model: migtissera/Tess-3-Mistral-Nemo-12B+ToastyPigeon/nemo-books-lora
    parameters:
      weight: 0.5
merge_method: linear 
dtype: bfloat16
tokenizer_source: inflatebot/MN-12B-Mag-Mell-R1