--- datasets: - Delta-Vector/Ursa-Erebus-16K - Delta-Vector/Ursa-Books-Light-Novels-V1 - NewEden/Orion-LIT - Delta-Vector/Ursa-Asstr-V2-18k - Delta-Vector/Ursa-Books-V2 - Delta-Vector/Ursa-Scribblehub-7k - Delta-Vector/Ursa-Orion-EA-Comp-Filtered - Delta-Vector/Ursa-HoneyFeed - Delta-Vector/Ursa-Falling-through-the-world base_model: - SillyTilly/ServiceNow-AI-Apriel-Nemotron-15b-Thinker-Chatml --- Finetuned ontop of SillyTilly/ServiceNow-AI-Apriel-Nemotron-15b-Thinker-Chatml with ``` - Delta-Vector/Ursa-Erebus-16K - Delta-Vector/Ursa-Books-Light-Novels-V1 - NewEden/Orion-LIT - Delta-Vector/Ursa-Asstr-V2-18k - Delta-Vector/Ursa-Books-V2 - Delta-Vector/Ursa-Scribblehub-7k - Delta-Vector/Ursa-Orion-EA-Comp-Filtered - Delta-Vector/Ursa-HoneyFeed - Delta-Vector/Ursa-Falling-through-the-world ``` roughly 700M tokens worth of Text Completion. I would recc the downstream instruct and future RP/Adventure/etc finetunes ontop of the said Instruct tune. wandb: https://wandb.ai/new-eden/Rae/artifacts/axolotl-config/config-tilsti5r/v0/files/axolotl_config__jn5bmx1.yml exl3: (thanks lucy): https://huggingface.co/Delta-Vector/Sol-Reaver-15B-Pretrain-exl3 Support me on Ko-Fi: https://ko-fi.com/deltavector