|
|
--- |
|
|
datasets: |
|
|
- Delta-Vector/Hydrus-Instruct-SmolTalk-V2 |
|
|
- Delta-Vector/Hydrus-SonnetOrca-V2 |
|
|
- Delta-Vector/Hydrus-FeedSum-ShareGPT |
|
|
- Delta-Vector/Hydrus-Tulu-Personas-Filtered-Sharegpt |
|
|
- Delta-Vector/Hydrus-No_Robots-R1-Filtered |
|
|
- Delta-Vector/Hydrus-Chat_error-Pure-Dove-sharegpt |
|
|
- Delta-Vector/Hydrus-HelpSteer2 |
|
|
- Delta-Vector/Hydrus-R1-Thinking-Sharegpt |
|
|
- Delta-Vector/Hydrus-Science-QA-sharegpt |
|
|
- Delta-Vector/Hydrus-Claude-Instruct-2.7K |
|
|
- Delta-Vector/Hydrus-Claude-Instruct-5K |
|
|
- PocketDoc/Dans-Assistantmaxx-UnnaturalInstructions-GPT4 |
|
|
- PocketDoc/Dans-Toolmaxx-ShellCommands |
|
|
- PocketDoc/Dans-MemoryCore-CoreCurriculum-Small |
|
|
- PocketDoc/Dans-Logicmaxx-SAT-AP |
|
|
- PocketDoc/Dans-Benchmaxx |
|
|
- Nitral-AI/ARES-ShareGPT |
|
|
- PocketDoc/Dans-Taskmaxx-TableGPT |
|
|
- Delta-Vector/Ursa-Erebus-16K |
|
|
- Delta-Vector/Ursa-Books-Light-Novels-V1 |
|
|
- NewEden/Orion-LIT |
|
|
- Delta-Vector/Ursa-Asstr-V2-18k |
|
|
- Delta-Vector/Ursa-Books-V2 |
|
|
- Delta-Vector/Ursa-Scribblehub-7k |
|
|
- Delta-Vector/Ursa-Orion-EA-Comp-Filtered |
|
|
- Delta-Vector/Ursa-HoneyFeed |
|
|
- Delta-Vector/Ursa-Falling-through-the-world |
|
|
base_model: |
|
|
- Delta-Vector/Sol-Reaver-15B-Instruct |
|
|
base_model_relation: quantized |
|
|
quantized_by: ArtusDev |
|
|
tags: |
|
|
- roleplay |
|
|
- instruct |
|
|
- creative_writing |
|
|
- story-writing |
|
|
- mistral |
|
|
- exl3 |
|
|
--- |
|
|
<!DOCTYPE html> |
|
|
<html lang="en"> |
|
|
<head> |
|
|
<meta charset="UTF-8"> |
|
|
<meta name="viewport" content="width=device-width, initial-scale=1.0"> |
|
|
<title>Sol-Reaver 15B</title> |
|
|
<link href="https://fonts.googleapis.com/css2?family=Quicksand:wght@400;500;600&display=swap" rel="stylesheet"> |
|
|
<style> |
|
|
body { |
|
|
font-family: 'Quicksand', sans-serif; |
|
|
background: linear-gradient(135deg, #ffeef8 0%, #fff0e6 50%, #f8e8ff 100%); |
|
|
color: #8b4a6b; |
|
|
margin: 0; |
|
|
padding: 0; |
|
|
font-size: 16px; |
|
|
min-height: 100vh; |
|
|
} |
|
|
.container { |
|
|
margin: 20px; |
|
|
background: linear-gradient(145deg, rgba(255, 255, 255, 0.9), rgba(255, 245, 250, 0.95)); |
|
|
padding: 30px; |
|
|
border-radius: 20px; |
|
|
box-shadow: 0 8px 32px rgba(255, 182, 193, 0.3), 0 4px 16px rgba(255, 215, 0, 0.2); |
|
|
border: 2px solid rgba(255, 182, 193, 0.4); |
|
|
position: relative; |
|
|
backdrop-filter: blur(10px); |
|
|
} |
|
|
.container::before { |
|
|
content: ''; |
|
|
position: absolute; |
|
|
top: 0; |
|
|
left: 0; |
|
|
right: 0; |
|
|
bottom: 0; |
|
|
background: linear-gradient(45deg, rgba(255, 192, 203, 0.1), rgba(255, 215, 0, 0.1), rgba(221, 160, 221, 0.1)); |
|
|
border-radius: 20px; |
|
|
z-index: -1; |
|
|
} |
|
|
.header h1 { |
|
|
font-size: 32px; |
|
|
background: linear-gradient(45deg, #d63384, #fd7e14, #e91e63); |
|
|
-webkit-background-clip: text; |
|
|
-webkit-text-fill-color: transparent; |
|
|
background-clip: text; |
|
|
margin: 0 0 20px 0; |
|
|
text-align: center; |
|
|
font-weight: 600; |
|
|
text-shadow: 0 2px 4px rgba(255, 182, 193, 0.3); |
|
|
} |
|
|
.section { |
|
|
margin-top: 30px; |
|
|
} |
|
|
.section h2 { |
|
|
font-size: 24px; |
|
|
background: linear-gradient(45deg, #d63384, #fd7e14); |
|
|
-webkit-background-clip: text; |
|
|
-webkit-text-fill-color: transparent; |
|
|
background-clip: text; |
|
|
text-align: center; |
|
|
font-weight: 600; |
|
|
margin-bottom: 20px; |
|
|
} |
|
|
.info p { |
|
|
color: #8b4a6b; |
|
|
line-height: 1.8; |
|
|
font-size: 16px; |
|
|
} |
|
|
.info img { |
|
|
width: 85%; |
|
|
border-radius: 15px; |
|
|
margin: 0 auto 15px; |
|
|
display: block; |
|
|
box-shadow: 0 8px 25px rgba(255, 182, 193, 0.4); |
|
|
border: 2px solid rgba(255, 192, 203, 0.5); |
|
|
} |
|
|
a { |
|
|
color: #d63384; |
|
|
text-decoration: none; |
|
|
transition: all 0.3s ease; |
|
|
font-weight: 500; |
|
|
} |
|
|
a:hover { |
|
|
color: #fd7e14; |
|
|
text-shadow: 0 0 8px rgba(255, 215, 0, 0.6); |
|
|
} |
|
|
.button { |
|
|
display: inline-block; |
|
|
background: linear-gradient(45deg, #ffb6c1, #ffd700); |
|
|
color: #8b4a6b; |
|
|
padding: 12px 24px; |
|
|
border-radius: 25px; |
|
|
cursor: pointer; |
|
|
text-decoration: none; |
|
|
transition: all 0.3s ease; |
|
|
border: 1px solid rgba(255, 182, 193, 0.5); |
|
|
font-weight: 500; |
|
|
} |
|
|
.button:hover { |
|
|
background: linear-gradient(45deg, #ff91a4, #ffed4e); |
|
|
box-shadow: 0 4px 15px rgba(255, 182, 193, 0.6); |
|
|
transform: translateY(-2px); |
|
|
} |
|
|
pre { |
|
|
background: linear-gradient(135deg, rgba(255, 240, 245, 0.8), rgba(255, 248, 220, 0.8)); |
|
|
padding: 20px; |
|
|
border-radius: 12px; |
|
|
overflow-x: auto; |
|
|
border: 1px solid rgba(255, 182, 193, 0.3); |
|
|
box-shadow: inset 0 2px 4px rgba(255, 182, 193, 0.2); |
|
|
} |
|
|
code { |
|
|
font-family: 'Courier New', monospace; |
|
|
color: #8b4a6b; |
|
|
} |
|
|
.info-card { |
|
|
background: linear-gradient(145deg, rgba(255, 240, 245, 0.9), rgba(255, 248, 220, 0.9)); |
|
|
border: 2px solid rgba(255, 182, 193, 0.4); |
|
|
border-radius: 15px; |
|
|
overflow: hidden; |
|
|
box-shadow: 0 4px 20px rgba(255, 182, 193, 0.3); |
|
|
} |
|
|
.info-header { |
|
|
background: linear-gradient(135deg, rgba(255, 192, 203, 0.3), rgba(255, 215, 0, 0.2)); |
|
|
padding: 25px; |
|
|
border-bottom: 1px solid rgba(255, 182, 193, 0.3); |
|
|
} |
|
|
.info-header h3 { |
|
|
background: linear-gradient(45deg, #d63384, #fd7e14); |
|
|
-webkit-background-clip: text; |
|
|
-webkit-text-fill-color: transparent; |
|
|
background-clip: text; |
|
|
margin: 0 0 15px 0; |
|
|
font-size: 22px; |
|
|
text-align: center; |
|
|
font-weight: 600; |
|
|
} |
|
|
.model-tags { |
|
|
display: flex; |
|
|
gap: 10px; |
|
|
flex-wrap: wrap; |
|
|
justify-content: center; |
|
|
} |
|
|
.model-tag { |
|
|
background: linear-gradient(45deg, rgba(255, 182, 193, 0.4), rgba(255, 215, 0, 0.3)); |
|
|
color: #8b4a6b; |
|
|
padding: 8px 16px; |
|
|
border-radius: 20px; |
|
|
font-size: 13px; |
|
|
border: 1px solid rgba(255, 182, 193, 0.5); |
|
|
font-weight: 500; |
|
|
box-shadow: 0 2px 8px rgba(255, 182, 193, 0.2); |
|
|
} |
|
|
.model-composition { |
|
|
padding: 25px; |
|
|
border-bottom: 1px solid rgba(255, 182, 193, 0.3); |
|
|
} |
|
|
.model-composition h4 { |
|
|
background: linear-gradient(45deg, #d63384, #fd7e14); |
|
|
-webkit-background-clip: text; |
|
|
-webkit-text-fill-color: transparent; |
|
|
background-clip: text; |
|
|
margin: 0 0 20px 0; |
|
|
font-size: 18px; |
|
|
text-align: center; |
|
|
font-weight: 600; |
|
|
} |
|
|
.composition-list { |
|
|
list-style: none; |
|
|
padding: 0; |
|
|
margin: 0; |
|
|
display: grid; |
|
|
gap: 15px; |
|
|
} |
|
|
.composition-list li { |
|
|
color: #8b4a6b; |
|
|
display: flex; |
|
|
align-items: baseline; |
|
|
gap: 12px; |
|
|
padding: 10px; |
|
|
background: rgba(255, 240, 245, 0.5); |
|
|
border-radius: 8px; |
|
|
border-left: 4px solid #ffb6c1; |
|
|
} |
|
|
.model-component { |
|
|
font-weight: 600; |
|
|
min-width: 120px; |
|
|
} |
|
|
.model-description { |
|
|
padding: 25px; |
|
|
background: linear-gradient(135deg, rgba(255, 255, 255, 0.7), rgba(255, 240, 245, 0.8)); |
|
|
} |
|
|
.metrics-section { |
|
|
margin-bottom: 30px; |
|
|
} |
|
|
.metrics-section details { |
|
|
background: linear-gradient(145deg, rgba(255, 240, 245, 0.9), rgba(255, 248, 220, 0.9)); |
|
|
border: 2px solid rgba(255, 182, 193, 0.4); |
|
|
border-radius: 12px; |
|
|
padding: 20px; |
|
|
margin-bottom: 20px; |
|
|
box-shadow: 0 4px 15px rgba(255, 182, 193, 0.2); |
|
|
} |
|
|
.metrics-section summary { |
|
|
background: linear-gradient(45deg, #d63384, #fd7e14); |
|
|
-webkit-background-clip: text; |
|
|
-webkit-text-fill-color: transparent; |
|
|
background-clip: text; |
|
|
font-size: 18px; |
|
|
cursor: pointer; |
|
|
outline: none; |
|
|
padding: 8px 0; |
|
|
text-align: center; |
|
|
font-weight: 600; |
|
|
transition: all 0.3s ease; |
|
|
} |
|
|
.metrics-section summary:hover { |
|
|
text-shadow: 0 0 8px rgba(255, 215, 0, 0.6); |
|
|
} |
|
|
.creator-section { |
|
|
margin: 20px 0; |
|
|
text-align: center; |
|
|
} |
|
|
.creator-badge { |
|
|
display: inline-flex; |
|
|
align-items: center; |
|
|
background: linear-gradient(145deg, rgba(255, 240, 245, 0.9), rgba(255, 248, 220, 0.9)); |
|
|
border: 2px solid rgba(255, 182, 193, 0.4); |
|
|
border-radius: 25px; |
|
|
padding: 15px 20px; |
|
|
box-shadow: 0 4px 15px rgba(255, 182, 193, 0.3); |
|
|
} |
|
|
.creator-label { |
|
|
color: #8b4a6b; |
|
|
font-size: 14px; |
|
|
margin-right: 10px; |
|
|
font-weight: 500; |
|
|
} |
|
|
.creator-link { |
|
|
display: flex; |
|
|
align-items: center; |
|
|
gap: 8px; |
|
|
color: #d63384; |
|
|
text-decoration: none; |
|
|
transition: all 0.3s ease; |
|
|
} |
|
|
.creator-name { |
|
|
font-weight: 600; |
|
|
} |
|
|
.creator-arrow { |
|
|
font-size: 16px; |
|
|
transition: transform 0.3s ease; |
|
|
} |
|
|
.creator-link:hover .creator-arrow { |
|
|
transform: translateX(4px); |
|
|
color: #fd7e14; |
|
|
} |
|
|
.creator-link:hover { |
|
|
color: #fd7e14; |
|
|
text-shadow: 0 0 8px rgba(255, 215, 0, 0.6); |
|
|
} |
|
|
.link-arrow { |
|
|
display: inline-block; |
|
|
transition: transform 0.3s ease; |
|
|
} |
|
|
a:hover .link-arrow { |
|
|
transform: translateX(3px); |
|
|
} |
|
|
.axolotl-container { |
|
|
display: flex; |
|
|
text-align: center; /* This is correctly applied to center the image itself */ |
|
|
justify-content: center; |
|
|
margin: 30px 0; |
|
|
} |
|
|
.axolotl-container img { |
|
|
max-width: 300px; |
|
|
border-radius: 15px; |
|
|
box-shadow: 0 6px 20px rgba(255, 182, 193, 0.4); |
|
|
border: 2px solid rgba(255, 192, 203, 0.5); |
|
|
transition: transform 0.3s ease; |
|
|
display: block; /* Make the image a block element */ |
|
|
margin: 0 auto; /* Center it horizontally within its parent */ |
|
|
} |
|
|
.axolotl-container img:hover { |
|
|
transform: scale(1.05); |
|
|
} |
|
|
</style> |
|
|
</head> |
|
|
<body> |
|
|
<div class="container"> |
|
|
<div class="header"> |
|
|
<h1>Sol Reaver 15B</h1> |
|
|
</div> |
|
|
<div class="info"> |
|
|
<img src="https://cdn-uploads.huggingface.co/production/uploads/66c26b6fb01b19d8c3c2467b/DYgyLUEaHAv9kTffBYH-F.jpeg" alt="Model banner"> |
|
|
<div style="text-align: center;"> |
|
|
<div class="creator-section"> |
|
|
<div class="creator-badge"> |
|
|
<span class="creator-label">Created by</span> |
|
|
<a href="https://huggingface.co/Delta-Vector" target="_blank" class="creator-link"> |
|
|
<span class="creator-name">Delta-Vector</span> |
|
|
<span class="creator-arrow">→</span> |
|
|
</a> |
|
|
</div> |
|
|
</div> |
|
|
<div class="model-info"> |
|
|
<h2>Model Information</h2> |
|
|
<div class="info-card"> |
|
|
<div class="info-header"> |
|
|
<h3>Sol-Reaver-15B-Instruct</h3> |
|
|
<div class="model-tags"> |
|
|
<span class="model-tag">15B parameters</span> |
|
|
<span class="model-tag">Creative / Fresh Prose</span> |
|
|
<span class="model-tag">Co-writing/Roleplay/Adventure Generalist</span> |
|
|
</div> |
|
|
</div> |
|
|
<div class="model-description"> |
|
|
<p>The first in the line of a New series of Roleplay / Adventure / Co-writer Models - Finetuned ontop of Sol-Reaver-15B-Pretrain</p> |
|
|
<p>This model has been trained on 200M tokens of high quality Instruct data, It's focus is to provide a base for further finetuning|Merging</p> |
|
|
<p>It's goal is to have refreshing Prose, Creativity, Good Instruct following and the *Brains*.</p> |
|
|
<p>Support me on Ko-Fi: https://ko-fi.com/deltavector</p> |
|
|
</div> |
|
|
</div> |
|
|
</div> |
|
|
<div class="section"> |
|
|
<h2>Quantized Versions</h2> |
|
|
<div class="info-card"> |
|
|
<div class="model-composition"> |
|
|
<h4>Available Downloads</h4> |
|
|
<ul class="composition-list"> |
|
|
<li><span class="model-component"><a href="" target="_blank">GGUF Format</a></span>For use with LLama.cpp & Forks(Coming Soon!)</li> |
|
|
<li><span class="model-component"><a href="" target="_blank">EXL2 Format</a></span>For use with TabbyAPI (Coming Soon!)</li> |
|
|
<li><span class="model-component"><a href="" target="_blank">EXL3 Format</a></span>For use with TabbyAPI (Slower on Ampere))</li> |
|
|
</ul> |
|
|
</div> |
|
|
</div> |
|
|
</div> |
|
|
<div class="section"> |
|
|
<h2>Prompting</h2> |
|
|
<p>Model has been tuned with the ChatML formatting. A typical input would look like this:</p> |
|
|
<pre><code><|im_start|>user |
|
|
Hi there!<|im_end|> |
|
|
<|im_start|>assistant |
|
|
Nice to meet you!<|im_end|> |
|
|
<|im_start|>user |
|
|
Can I ask a question?<|im_end|> |
|
|
<|im_start|>assistant |
|
|
</code></pre> |
|
|
</div> |
|
|
<div class="section"> |
|
|
<h2>Samplers</h2> |
|
|
<p>For testing of this model, I used Temp=1, 0.1 Min-P.</p> |
|
|
<div class="metrics-section"> |
|
|
<details> |
|
|
<summary>See Axolotl Config</summary> |
|
|
<pre><code> |
|
|
https://files.catbox.moe/u9dakg.yml |
|
|
</code></pre> |
|
|
</details> |
|
|
</div> |
|
|
</div> |
|
|
<div class="section"> |
|
|
<h2>Training</h2> |
|
|
<p>The training was done for 2 epoch using 8 x <a href="https://www.nvidia.com/en-us/data-center/h200/">H200s</a> GPUs graciously provided by <a href="https://huggingface.co/kalomaze">Kalomaze</a> for the fine-tuning of the model.</p> |
|
|
<div class="axolotl-container"> |
|
|
<a href="https://github.com/OpenAccess-AI-Collective/axolotl" target="_blank"> |
|
|
<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl"> |
|
|
</a> |
|
|
</div> |
|
|
</div> |
|
|
<div class="section"> |
|
|
<h2>Credits</h2> |
|
|
<p>Thank you to <a href="https://huggingface.co/lucyknada">Lucy Knada</a>, <a href="https://huggingface.co/Ateron">Ateron</a>, <a href="https://huggingface.co/AliCat2">Alicat</a>, <a href="https://huggingface.co/intervitens">Intervitens</a>, <a href="https://huggingface.co/cgato">Cgato</a>, <a href="https://huggingface.co/kubernetes-bad">Kubernetes Bad</a> and the rest of <a href="https://huggingface.co/anthracite-org">Anthracite</a>.</p> |
|
|
</div> |
|
|
</div> |
|
|
</div> |
|
|
</body> |
|
|
</html> |
