ArtusDev/Delta-Vector_Sol-Reaver-15B-Instruct_EXL2_4.5bpw_H6

Sol Reaver 15B

Created by Delta-Vector →

Model Information

Sol-Reaver-15B-Instruct

15B parameters Creative / Fresh Prose Co-writing/Roleplay/Adventure Generalist

The first in the line of a New series of Roleplay / Adventure / Co-writer Models - Finetuned ontop of Sol-Reaver-15B-Pretrain

This model has been trained on 200M tokens of high quality Instruct data, It's focus is to provide a base for further finetuning|Merging

It's goal is to have refreshing Prose, Creativity, Good Instruct following and the *Brains*.

Support me on Ko-Fi: https://ko-fi.com/deltavector

Quantized Versions

Available Downloads

• GGUF FormatFor use with LLama.cpp & Forks(Coming Soon!)
• EXL2 FormatFor use with TabbyAPI (Coming Soon!)
• EXL3 FormatFor use with TabbyAPI (Slower on Ampere))

Prompting

Model has been tuned with the ChatML formatting. A typical input would look like this:

<|im_start|>user
Hi there!<|im_end|>
<|im_start|>assistant
Nice to meet you!<|im_end|>
<|im_start|>user
Can I ask a question?<|im_end|>
<|im_start|>assistant

Samplers

For testing of this model, I used Temp=1, 0.1 Min-P.

See Axolotl Config

            https://files.catbox.moe/u9dakg.yml
            

Training

The training was done for 2 epoch using 8 x H200s GPUs graciously provided by Kalomaze for the fine-tuning of the model.

Credits

Thank you to Lucy Knada, Ateron, Alicat, Intervitens, Cgato, Kubernetes Bad and the rest of Anthracite.