DellaMix-12B
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the DELLA merge method using yamatazen/EtherealAurora-12B-Lorablated as a base.
Models Merged
The following models were included in the merge:
- yamatazen/Shisa-v2-Mistral-Nemo-12B-Abliterated
- yamatazen/ForgottenMaid-12B
- yamatazen/FusionEngine-12B
Configuration
The following YAML configuration was used to produce this model:
merge_method: della
dtype: bfloat16
out_dtype: bfloat16
base_model: yamatazen/EtherealAurora-12B-Lorablated
models:
- model: yamatazen/Shisa-v2-Mistral-Nemo-12B-Abliterated
parameters:
density: 0.6
weight: 0.7
- model: yamatazen/ForgottenMaid-12B
parameters:
density: 0.6
weight: 0.5
- model: yamatazen/FusionEngine-12B
parameters:
density: 0.5
weight: 0.3
parameters:
epsilon: 0.1
lambda: 1.0
- Downloads last month
- 12
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
Model tree for yamatazen/DellaMix-12B
Merge model
this model