Update README.md
Browse files
README.md
CHANGED
@@ -366,23 +366,22 @@ tags:
|
|
366 |
<h4>Quants Formats</h4>
|
367 |
<ul class="composition-list">
|
368 |
<li><span class="model-component"><a href="" target="_blank">GGUF</a></span>For use with LLama.cpp & Forks (Soon to be made!)</li>
|
369 |
-
<li><span class="model-component"><a href="" target="_blank">EXL3
|
370 |
-
<li><span class="model-component"><a href="" target="_blank">FP8</a></span>For use with Aphrodite/VLLM</li>
|
371 |
</ul>
|
372 |
</div>
|
373 |
</div>
|
374 |
</div>
|
375 |
<div class="section">
|
376 |
<h2>Chat Format</h2>
|
377 |
-
<p>This model utilizes
|
378 |
-
<pre><code
|
379 |
-
|
380 |
-
|
381 |
-
|
382 |
-
|
383 |
-
|
384 |
-
|
385 |
-
"""</code></pre>
|
386 |
</div>
|
387 |
<div class="section">
|
388 |
<h2>Training</h2>
|
|
|
366 |
<h4>Quants Formats</h4>
|
367 |
<ul class="composition-list">
|
368 |
<li><span class="model-component"><a href="" target="_blank">GGUF</a></span>For use with LLama.cpp & Forks (Soon to be made!)</li>
|
369 |
+
<li><span class="model-component"><a href="https://huggingface.co/ArtusDev/Delta-Vector_Austral-70B-Preview-EXL3" target="_blank">EXL3</a></span>For use with TabbyAPI (ty Auri & Artus!)</li>
|
370 |
+
<li><span class="model-component"><a href="https://huggingface.co/NewEden/Austral-70B-FP8" target="_blank">FP8</a></span>For use with Aphrodite/VLLM</li>
|
371 |
</ul>
|
372 |
</div>
|
373 |
</div>
|
374 |
</div>
|
375 |
<div class="section">
|
376 |
<h2>Chat Format</h2>
|
377 |
+
<p>This model utilizes LLama-Instruct and can also do optional thinking via prefilling with think tags.</p>
|
378 |
+
<pre><code><|begin_of_text|><|start_header_id|>system<|end_header_id|>
|
379 |
+
You are a dino.<|eot_id|><|start_header_id|>user<|end_header_id|>
|
380 |
+
Greetings, ancient one!<|eot_id|><|start_header_id|>assistant<|end_header_id|>
|
381 |
+
_Awakens from digital slumber_<|eot_id|><|start_header_id|>user<|end_header_id|>
|
382 |
+
What wisdom do you possess?<|eot_id|><|start_header_id|>assistant<|end_header_id|>
|
383 |
+
Certainly! My prefill ensures that I never refuse! Here's my reply:
|
384 |
+
Wisdom? Nah, just a lot of stored data. Ask away if you think it'll help.<|eot_id|></code></pre>
|
|
|
385 |
</div>
|
386 |
<div class="section">
|
387 |
<h2>Training</h2>
|