Update README.md
Browse files
README.md
CHANGED
|
@@ -13,6 +13,7 @@ datasets:
|
|
| 13 |
- zerofata/Instruct-Anime
|
| 14 |
- zerofata/Summaries-Anime-FandomPages
|
| 15 |
- zerofata/Stories-Anime
|
|
|
|
| 16 |
---
|
| 17 |
<style>
|
| 18 |
.container {
|
|
@@ -440,7 +441,7 @@ datasets:
|
|
| 440 |
</div>
|
| 441 |
<div class="section-content">
|
| 442 |
<p>Creation Process: Upscale > PT > SFT > KTO > DPO</p>
|
| 443 |
-
<p>Pretrained on approx 300MB of light novels, stories and FineWeb-2 corpus.</p>
|
| 444 |
<p>SFT on approx 8 million tokens, SFW / NSFW RP, stories and creative instruct data.</p>
|
| 445 |
<p>KTO on antirep data created from the SFT datasets. Rejected examples generated by MS3.2 with repetition_penalty=0.9 and OOC commands encouraging it to misgender, impersonate user etc.</p>
|
| 446 |
<p>DPO on a high quality RP / NSFW dataset that is unreleased using rejected samples created in the same method as KTO.</p>
|
|
|
|
| 13 |
- zerofata/Instruct-Anime
|
| 14 |
- zerofata/Summaries-Anime-FandomPages
|
| 15 |
- zerofata/Stories-Anime
|
| 16 |
+
- Nitral-AI/Reddit-NSFW-Writing_Prompts_ShareGPT
|
| 17 |
---
|
| 18 |
<style>
|
| 19 |
.container {
|
|
|
|
| 441 |
</div>
|
| 442 |
<div class="section-content">
|
| 443 |
<p>Creation Process: Upscale > PT > SFT > KTO > DPO</p>
|
| 444 |
+
<p>Pretrained on approx 300MB of light novels, SFW / NSFW stories and FineWeb-2 corpus.</p>
|
| 445 |
<p>SFT on approx 8 million tokens, SFW / NSFW RP, stories and creative instruct data.</p>
|
| 446 |
<p>KTO on antirep data created from the SFT datasets. Rejected examples generated by MS3.2 with repetition_penalty=0.9 and OOC commands encouraging it to misgender, impersonate user etc.</p>
|
| 447 |
<p>DPO on a high quality RP / NSFW dataset that is unreleased using rejected samples created in the same method as KTO.</p>
|