Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,35 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
datasets:
|
| 3 |
+
- Delta-Vector/Ursa-Erebus-16K
|
| 4 |
+
- Delta-Vector/Ursa-Books-Light-Novels-V1
|
| 5 |
+
- NewEden/Orion-LIT
|
| 6 |
+
- Delta-Vector/Ursa-Asstr-V2-18k
|
| 7 |
+
- Delta-Vector/Ursa-Books-V2
|
| 8 |
+
- Delta-Vector/Ursa-Scribblehub-7k
|
| 9 |
+
- Delta-Vector/Ursa-Orion-EA-Comp-Filtered
|
| 10 |
+
- Delta-Vector/Ursa-HoneyFeed
|
| 11 |
+
- Delta-Vector/Ursa-Falling-through-the-world
|
| 12 |
+
base_model:
|
| 13 |
+
- SillyTilly/ServiceNow-AI-Apriel-Nemotron-15b-Thinker-Chatml
|
| 14 |
+
---
|
| 15 |
+
Finetuned ontop of SillyTilly/ServiceNow-AI-Apriel-Nemotron-15b-Thinker-Chatml with
|
| 16 |
+
|
| 17 |
+
```
|
| 18 |
+
- Delta-Vector/Ursa-Erebus-16K
|
| 19 |
+
- Delta-Vector/Ursa-Books-Light-Novels-V1
|
| 20 |
+
- NewEden/Orion-LIT
|
| 21 |
+
- Delta-Vector/Ursa-Asstr-V2-18k
|
| 22 |
+
- Delta-Vector/Ursa-Books-V2
|
| 23 |
+
- Delta-Vector/Ursa-Scribblehub-7k
|
| 24 |
+
- Delta-Vector/Ursa-Orion-EA-Comp-Filtered
|
| 25 |
+
- Delta-Vector/Ursa-HoneyFeed
|
| 26 |
+
- Delta-Vector/Ursa-Falling-through-the-world
|
| 27 |
+
```
|
| 28 |
+
roughly 700M tokens worth of Text Completion.
|
| 29 |
+
|
| 30 |
+
I would recc the downstream instruct and future RP/Adventure/etc finetunes ontop of the said Instruct tune.
|
| 31 |
+
|
| 32 |
+
wandb: https://wandb.ai/new-eden/Rae/artifacts/axolotl-config/config-tilsti5r/v0/files/axolotl_config__jn5bmx1.yml
|
| 33 |
+
|
| 34 |
+
|
| 35 |
+
exl3: (thanks lucy): https://huggingface.co/Delta-Vector/Sol-Reaver-15B-Pretrain-exl3
|