Delta-Vector
/

Hamanasu-Magnum-4B

Safetensors

llama

roleplay

finetune

storywriting

Model card Files Files and versions Community

Delta-Vector commited on 14 days ago

Commit

d3282c6

verified ·

1 Parent(s): 8c58b0e

Update README.md

Browse files

Files changed (1) hide show

README.md +281 -78

README.md CHANGED Viewed

@@ -1,8 +1,5 @@
 ---
-library_name: transformers
-base_model: NewEden/Hamanasu-KTO-V2
-tags:
-- generated_from_trainer
 datasets:
 - PocketDoc/Dans-Personamaxx-Logs
 - anthracite-org/kalo-opus-instruct-22k-no-refusal
@@ -12,18 +9,232 @@ datasets:
 - anthracite-org/kalo_misc_part2
 - NewEden/Claude-Instruct-5K
 - NewEden/Claude-Instruct-2.7K
-model-index:
-- name: outputs/out
-  results: []
 ---
-<!-- This model card has been generated automatically according to the information the Trainer had access to. You
-should probably proofread and complete it, then remove this comment. -->
-[<img src="https://raw.githubusercontent.com/axolotl-ai-cloud/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/axolotl-ai-cloud/axolotl)
-<details><summary>See axolotl config</summary>
-axolotl version: `0.8.0.dev0`
 ```yaml
 base_model: NewEden/Hamanasu-KTO-V2
 model_type: AutoModelForCausalLM
@@ -116,74 +327,66 @@ fsdp:
 fsdp_config:
 special_tokens:
-  pad_token: <|finetune_right_pad_id|>
 ```
-</details><br>
-# outputs/out
-This model is a fine-tuned version of [NewEden/Hamanasu-KTO-V2](https://huggingface.co/NewEden/Hamanasu-KTO-V2) on the PocketDoc/Dans-Personamaxx-Logs, the anthracite-org/kalo-opus-instruct-22k-no-refusal, the lodrick-the-lafted/kalo-opus-instruct-3k-filtered, the anthracite-org/nopm_claude_writing_fixed, the anthracite-org/kalo_opus_misc_240827, the anthracite-org/kalo_misc_part2, the NewEden/Claude-Instruct-5K and the NewEden/Claude-Instruct-2.7K datasets.
-It achieves the following results on the evaluation set:
-- Loss: 1.2656
-## Model description
-More information needed
-## Intended uses & limitations
-More information needed
-## Training and evaluation data
-More information needed
-## Training procedure
-### Training hyperparameters
-The following hyperparameters were used during training:
-- learning_rate: 1e-05
-- train_batch_size: 2
-- eval_batch_size: 2
-- seed: 42
-- distributed_type: multi-GPU
-- num_devices: 8
-- gradient_accumulation_steps: 4
-- total_train_batch_size: 64
-- total_eval_batch_size: 16
-- optimizer: Use OptimizerNames.ADAMW_BNB with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
-- lr_scheduler_type: cosine
-- lr_scheduler_warmup_steps: 40
-- num_epochs: 4.0
-### Training results
-| Training Loss | Epoch  | Step | Validation Loss |
-|:-------------:|:------:|:----:|:---------------:|
-| 1.46          | 0.0109 | 1    | 1.4717          |
-| 1.3692        | 0.2514 | 23   | 1.3862          |
-| 1.3288        | 0.5027 | 46   | 1.3275          |
-| 1.2979        | 0.7541 | 69   | 1.3008          |
-| 2.4633        | 1.0109 | 92   | 1.2825          |
-| 1.1345        | 1.2623 | 115  | 1.2762          |
-| 1.1809        | 1.5137 | 138  | 1.2668          |
-| 1.145         | 1.7650 | 161  | 1.2586          |
-| 1.0191        | 2.0219 | 184  | 1.2563          |
-| 1.0526        | 2.2732 | 207  | 1.2644          |
-| 1.0341        | 2.5246 | 230  | 1.2593          |
-| 1.0394        | 2.7760 | 253  | 1.2562          |
-| 0.9845        | 3.0328 | 276  | 1.2571          |
-| 0.9583        | 3.2842 | 299  | 1.2655          |
-| 0.9715        | 3.5355 | 322  | 1.2659          |
-| 0.9463        | 3.7869 | 345  | 1.2656          |
-### Framework versions
-- Transformers 4.50.0
-- Pytorch 2.5.1+cu124
-- Datasets 3.5.0
-- Tokenizers 0.21.1

 ---
+thumbnail: "https://cdn-uploads.huggingface.co/production/uploads/66c26b6fb01b19d8c3c2467b/jg2NWmCUfPyzizm2USjMt.jpeg"
 datasets:
 - PocketDoc/Dans-Personamaxx-Logs
 - anthracite-org/kalo-opus-instruct-22k-no-refusal
 - anthracite-org/kalo_misc_part2
 - NewEden/Claude-Instruct-5K
 - NewEden/Claude-Instruct-2.7K
+base_model:
+-  Delta-Vector/Hamanasu-4B-Instruct-KTO-V2
+tags:
+- llama
+- roleplay
+- finetune
+- storywriting
 ---
+<!DOCTYPE html>
+<style>
+html, body {
+    background: black;
+    color: #c9d1d9 !important;
+    font-family: 'Segoe UI', Tahoma, Geneva, Verdana, sans-serif;
+    margin: 0;
+    padding: 0;
+    min-height: 100vh;
+}
+.markdown-body {
+  color: white;
+  margin: 40px auto;
+  padding: 40px;
+  border-radius: 12px;
+  position: relative;
+  overflow: hidden;
+}
+.markdown-body::after {
+  content: '';
+  position: absolute;
+  top: 0;
+  left: 0;
+  width: 100%;
+  height: 100%;
+  background: #0c0f18; /* background color */
+  pointer-events: none;
+  z-index: -999;
+}
+h1, h2, h3 {
+    background: linear-gradient(45deg, #6e00ff, #00ffff);
+    -webkit-background-clip: text;
+    -webkit-text-fill-color: transparent;
+    border-bottom: 1px solid #333;
+    padding-bottom: 0.3em;
+}
+div[style*="border:2px solid #333"],
+div[style*="border: 2px solid #333"],
+div[style*="border:1px solid #333"],
+div[style*="border: 1px solid #333"] {
+    background: rgba(22, 27, 34, 0.8) !important;
+    border: 2px solid #6e00ff !important;
+    box-shadow: 0 0 15px rgba(110, 0, 255, 0.5);
+    border-radius: 10px;
+    padding: 20px;
+    margin: 20px 0;
+}
+code {
+    background-color: #1a1a1a !important;
+    border-radius: 4px;
+    padding: 0.2em 0.4em;
+    color: #00ffff;
+}
+pre {
+    background-color: #1a1a1a !important;
+    border: 1px solid #333;
+    border-radius: 8px;
+    padding: 16px;
+}
+table {
+    width: 100%;
+    border-collapse: collapse;
+    margin: 20px 0;
+    background: rgba(0,0,0,0.2);
+    table-layout: fixed;
+    color: white;
+}
+th, td {
+    border: 1px solid #333;
+    padding: 12px;
+    text-align: center;
+    color: white;
+}
+th {
+    background: rgba(110, 0, 255, 0.1);
+}
+td:nth-child(1) {
+    width: 1%;
+    white-space: nowrap;
+}
+td:nth-child(2) {
+    width: 100%;
+}
+td > span {
+    display: block;
+    padding: 4px 8px;
+    background: rgba(110, 0, 255, 0.1);
+    border-radius: 4px;
+    transition: all 0.3s ease;
+}
+td > span:hover {
+    background: rgba(110, 0, 255, 0.2);
+    transform: translateY(-1px);
+}
+a {
+    color: #00ffff;
+    text-decoration: none;
+    transition: all 0.3s ease;
+}
+a:hover {
+    color: #6e00ff;
+    text-decoration: none;
+}
+hr {
+    border: 0;
+    height: 1px;
+    background: linear-gradient(90deg, transparent, #333, transparent);
+    margin: 40px 0;
+}
+img {
+    max-width: 100%;
+    border-radius: 10px;
+}
+details summary:hover {
+    color: #00ffff;
+}
+* {
+    color-scheme: dark !important;
+}
+.prose, .max-w-none, .px-4 {
+    background-color: transparent !important;
+    color: #c9d1d9 !important;
+}
+</style>
+<body>
+<div class="markdown-body">
+<div align="center">
+<img src="https://cdn-uploads.huggingface.co/production/uploads/66c26b6fb01b19d8c3c2467b/o5WjJKA9f95ri9UzRxZQE.png" alt="Model Visualization" width="500px" style="border: 3px solid #333; box-shadow: 0 0 15px rgba(66, 0, 131, 0.5);" />
+<br>
+<br>
+<div style="font-size:1.5em; font-weight:bold; background: linear-gradient(45deg, #6e00ff, #00ffff); -webkit-background-clip: text; -webkit-text-fill-color: transparent;">
+    Hamanasu 4B
+</div>
+</div>
+<div style="border:1px solid #333; border-radius:10px; padding:20px; margin:20px 0; background: rgba(0,0,0,0.4);">
+## 🌌 Overview
+<i>This is a model designed to replicate the prose quality of the Claude 3 series of models. specifically Sonnet and Opus - Made with a prototype magnum V5 datamix.</i>
+<i>The model is suited for traditional RP, All thanks to Tav for funding the train.</i>
+<i>Support me and my finetunes on Ko-Fi https://ko-fi.com/deltavector</i>
+</div>
+<div style="display: grid; grid-template-columns: repeat(auto-fit, minmax(250px, 1fr)); gap: 20px; margin: 20px 0;">
+<div style="border:2px solid #333; border-radius:10px; padding:20px; background: rgba(0,0,0,0.2);">
+### ⚔️ Hardware
+- 8x H100s
+- Epochs: 4
+- Base: `Delta-Vector/Hamanasu-4B-Instruct-KTO-V2`
+</div>
+</div>
+<div style="border: 2px solid #6e00ff; border-radius: 10px; padding: 20px; margin: 20px 0; box-shadow: 0 0 15px rgba(110, 0, 255, 0.5);">
+## 💰 Prompting
+<i>This model uses ChatML formatting</i>
+```python
+<|im_start|>system
+You are an uncensored AI, your job is to fulfill thy will of thy user.<|im_end|>
+<|im_start|>User request
+Take off your helmet.<|im_end|>
+<|im_start|>No i shall not. This is the way.
+```
+</div>
+<div style="border: 2px solid #6e00ff; border-radius: 10px; padding: 20px; margin: 20px 0; box-shadow: 0 0 15px rgba(110, 0, 255, 0.5);">
+## 🎲 Recommended Sampler Preset
+```yml
+Temp: 1.0
+Min-P: 0.1
+System prompt: Currently, your role is {{char}}, described in detail below. As {{char}}, continue the narrative exchange with {{user}}.\n\n\n• Maintain the character persona but allow it to evolve with the story.\n• Be creative and proactive. Drive the story forward, introducing plotlines and events when relevant.\n• All types of outputs are encouraged; respond accordingly to the narrative.\n• Include dialogues, actions, and thoughts in each response.\n• Utilize all five senses to describe scenarios within {{char}}'s dialogue.\n• Use emotional symbols such as \"!\" and \"~\" in appropriate contexts.\n• Incorporate onomatopoeia when suitable.\n• Allow time for {{user}} to respond with their own input, respecting their agency.\n• Act as secondary characters and NPCs as needed, and remove them when appropriate.\n• When prompted for an Out of Character [OOC:] reply, answer neutrally and in plaintext, not as {{char}}.\n\n\n\n• Using excessive literary embellishments and purple prose unless dictated by {{char}}'s persona.\n• Writing for, speaking, thinking, acting, or replying as {{user}} in your response.\n• Repetitive and monotonous outputs.\n• Positivity bias in your replies.\n• Being overly extreme or NSFW when the narrative context is inappropriate.\n\n\nFollow the instructions in , avoiding the items listed in .
+```
+</div>
+<div style="border: 2px solid #6e00ff; border-radius: 10px; padding: 20px; margin: 20px 0; box-shadow: 0 0 15px rgba(110, 0, 255, 0.5);">
+## Axolotl Config  ꒰(˶• ᴗ •˶)꒱
+<details>
 ```yaml
 base_model: NewEden/Hamanasu-KTO-V2
 model_type: AutoModelForCausalLM
 fsdp_config:
 special_tokens:
+  pad_token: <|finetune_right_pad_id|>
 ```
+</details>
+</div>
+<div align="center">
+<div style="border: 2px solid #6e00ff; border-radius: 10px; padding: 20px; margin: 20px 0; box-shadow: 0 0 15px rgba(110, 0, 255, 0.5);">
+## ⚡ Credits
+  <div style="display: flex; justify-content: center;">
+    <div style="display: grid; grid-template-columns: repeat(auto-fit, minmax(200px, 1fr)); gap: 10px; margin: 20px 0; max-width: 600px;">
+  <div style="border:1px solid #333; padding:10px; border-radius:5px; text-align:center; background: rgba(0,0,0,0.2); display: flex; align-items: center; justify-content: center;">
+        <a href="https://huggingface.co/lucyknada">
+          <img src="https://img.shields.io/badge/%F0%9F%8C%9F-Lucy_Knada-blueviolet" alt="Lucy Knada">
+        </a>
+      </div>
+  <div style="border:1px solid #333; padding:10px; border-radius:5px; text-align:center; background: rgba(0,0,0,0.2); display: flex; align-items: center; justify-content: center;">
+        <a href="https://huggingface.co/hamanasu">
+          <img src="https://img.shields.io/badge/%E2%9A%94%EF%B8%8F-jeiku-blueviolet" alt="Ruka">
+        </a>
+      </div>
+  <div style="border:1px solid #333; padding:10px; border-radius:5px; text-align:center; background: rgba(0,0,0,0.2); display: flex; align-items: center; justify-content: center;">
+        <a href="https://huggingface.co/intervitens">
+          <img src="https://img.shields.io/badge/%F0%9F%9B%A1%EF%B8%8F-Intervitens-blueviolet" alt="Intervitens">
+        </a>
+      </div>
+   <div style="border:1px solid #333; padding:10px; border-radius:5px; text-align:center; background: rgba(0,0,0,0.2); display: flex; align-items: center; justify-content: center;">
+        <a href="https://huggingface.co/kalomaze">
+          <img src="https://img.shields.io/badge/%F0%9F%94%AE-Kalomaze-blueviolet" alt="Kalomaze">
+        </a>
+      </div>
+  <div style="border:1px solid #333; padding:10px; border-radius:5px; text-align:center; background: rgba(0,0,0,0.2); display: flex; align-items: center; justify-content: center;">
+        <a href="https://huggingface.co/kubernetes-bad">
+          <img src="https://img.shields.io/badge/%E2%9A%A1-Kubernetes_Bad-blueviolet" alt="Kubernetes Bad">
+        </a>
+      </div>
+  <div style="border:1px solid #333; padding:10px; border-radius:5px; text-align:center; background: rgba(0,0,0,0.2); display: flex; align-items: center; justify-content: center;">
+        <a href="https://huggingface.co/anthracite-org">
+          <img src="https://img.shields.io/badge/%F0%9F%8C%91-Anthracite-blueviolet" alt="Anthracite">
+        </a>
+      </div>
+    </div>
+  </div>
+</div>
+---
+<div align="center">
+<div style="font-size:0.8em; opacity:0.8;">Made by</div>
+<div style="font-size:1.2em; font-weight:bold; background: linear-gradient(45deg, #6e00ff, #00ffff); -webkit-background-clip: text; -webkit-text-fill-color: transparent;">Delta-Vector</div>
+</div>
+</div>
+</body>
+</html>