Delta-Vector/Sol-Reaver-15B-Pretrain

Finetuned ontop of SillyTilly/ServiceNow-AI-Apriel-Nemotron-15b-Thinker-Chatml with

- Delta-Vector/Ursa-Erebus-16K
- Delta-Vector/Ursa-Books-Light-Novels-V1
- NewEden/Orion-LIT
- Delta-Vector/Ursa-Asstr-V2-18k
- Delta-Vector/Ursa-Books-V2
- Delta-Vector/Ursa-Scribblehub-7k
- Delta-Vector/Ursa-Orion-EA-Comp-Filtered
- Delta-Vector/Ursa-HoneyFeed
- Delta-Vector/Ursa-Falling-through-the-world

roughly 700M tokens worth of Text Completion.

I would recc the downstream instruct and future RP/Adventure/etc finetunes ontop of the said Instruct tune.

wandb: https://wandb.ai/new-eden/Rae/artifacts/axolotl-config/config-tilsti5r/v0/files/axolotl_config__jn5bmx1.yml

exl3: (thanks lucy): https://huggingface.co/Delta-Vector/Sol-Reaver-15B-Pretrain-exl3

Support me on Ko-Fi: https://ko-fi.com/deltavector