Starfallen Snow Fantasy 24B 3.2
If there was snow that would fall forever.... Can I hide this feeling that continues towards you?~
Song: Changin’ My Life - Eternal Snow
Listen Here: https://www.youtube.com/watch?v=ZIF1YRz9N7E
So.... I'm kinda back, I hope. This was my attempt at trying to get a stellar like model out of Mistral 3.2 24b, I think I got most of it down besides a few quirks. It's not quite what I want to make in the future, but it's got good vibes. I like it, so try please?
Chat Template: Mistral V7 or ChatML
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the Linear DELLA merge method using ./Mistral-Small-3.2-24B-Instruct-2506-ChatML as a base.
Models Merged
The following models were included in the merge:
- zerofata/MS3.2-PaintedFantasy-24B
- Gryphe/Codex-24B-Small-3.2
- Delta-Vector/MS3.2-Austral-Winton
Thanks to
- Zerofata: for PaintedFantasy
- Delta-Vector: for Austral Winton
- Gryphe: for Codex
Configuration
The following YAML configuration was used to produce this model:
models:
- model: Delta-Vector/MS3.2-Austral-Winton
parameters:
weight: 0.3
density: 0.25
- model: Gryphe/Codex-24B-Small-3.2
parameters:
weight: 0.1
density: 0.4
- model: zerofata/MS3.2-PaintedFantasy-24B
parameters:
weight: 0.4
density: 0.5
merge_method: della_linear
base_model: anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-ChatML
parameters:
epsilon: 0.05
lambda: 1
merge_method: della_linear
dtype: bfloat16
tokenizer:
source: ./Codex-24B-Small-3.2
- Downloads last month
- 105