Sol Reaver 15B
Model Information
Sol-Reaver-15B-Instruct
The first in the line of a New series of Roleplay / Adventure / Co-writer Models - Finetuned ontop of Sol-Reaver-15B-Pretrain
This model has been trained on 200M tokens of high quality Instruct data, It's focus is to provide a base for further finetuning|Merging
It's goal is to have refreshing Prose, Creativity, Good Instruct following and the *Brains*.
Support me on Ko-Fi: https://ko-fi.com/deltavector
Quantized Versions
Available Downloads
- GGUF FormatFor use with LLama.cpp & Forks(Coming Soon!)
- EXL2 FormatFor use with TabbyAPI (Coming Soon!)
- EXL3 FormatFor use with TabbyAPI (Slower on Ampere))
Prompting
Model has been tuned with the ChatML formatting. A typical input would look like this:
<|im_start|>user
Hi there!<|im_end|>
<|im_start|>assistant
Nice to meet you!<|im_end|>
<|im_start|>user
Can I ask a question?<|im_end|>
<|im_start|>assistant
Samplers
For testing of this model, I used Temp=1, 0.1 Min-P.
See Axolotl Config
https://files.catbox.moe/u9dakg.yml
Training
The training was done for 2 epoch using 8 x H200s GPUs graciously provided by Kalomaze for the fine-tuning of the model.
Credits
Thank you to Lucy Knada, Ateron, Alicat, Intervitens, Cgato, Kubernetes Bad and the rest of Anthracite.