Cydonia v4
#3
by
Fentible
- opened
A newer Cydonia (v4) is released by thedrummer. Next month I can test if its better than v3.1, if so it might be switched for the Cthulu v1 final safetensors, so they all use the latest versions.
Nice! Have you already tried introducing https://huggingface.co/zerofata/MS3.2-PaintedFantasy-24B to this model? I believe that it could enhance the prose a bit.
Yes, I am adding more models for Cthulu v1.1
Both of these are under consideration (I have not tested them yet)
Drummer's notes for Cydonia
Cydonia 22B v1.0 = Mistral 22B 2.0 base. First attempt, purely RP training.
Cydonia 22B v1.1 = Included some unalignment/decensoring training
Cydonia 22B v1.2 = Included some creative works to enhance prose/creativity
Cydonia 22B v1.3 = Used the same formulation as Behemoth v1.1, i.e., RP/unalignment/creativity training.
Cydonia 24B v2.0 = Mistral 24B 3.0 base. Performed a grid search until I found stable parameters. Purely RP training and unslopping.
Cydonia 24B v2.1 = Included unalignment and creative works in training.
Cydonia 24B v3.0 = Mistral 24B 3.1 base. RP training and unslopping.
Cydonia 24B v3.1 = Added unalignment, creative works, and a new dataset I've been working on to enhance adherence and flow. Plus combined it with Magistral to support thinking and reinforce unalignment (Magistral by itself is barely aligned).
Cydonia 24B v4.0 = Mistral 24B 3.2 base. Basically did a v3.1 on it, except for Magistral. Did a fuckton of grid search for this one too.
Fentible
changed discussion status to
closed