Delta-Vector commited on
Commit
bf62fe4
·
verified ·
1 Parent(s): 2e4ecbf

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -11
README.md CHANGED
@@ -366,23 +366,22 @@ tags:
366
  <h4>Quants Formats</h4>
367
  <ul class="composition-list">
368
  <li><span class="model-component"><a href="" target="_blank">GGUF</a></span>For use with LLama.cpp & Forks (Soon to be made!)</li>
369
- <li><span class="model-component"><a href="" target="_blank">EXL3 Artifacts</a></span>For use with TabbyAPI (Soon to be made!)</li>
370
- <li><span class="model-component"><a href="" target="_blank">FP8</a></span>For use with Aphrodite/VLLM</li>
371
  </ul>
372
  </div>
373
  </div>
374
  </div>
375
  <div class="section">
376
  <h2>Chat Format</h2>
377
- <p>This model utilizes ChatML and can also do optional thinking via prefilling with `<think>`</p>
378
- <pre><code>"""&lt;|im_start|&gt;user
379
- Greetings, ancient one!&lt;|im_end|&gt;
380
- &lt;|im_start|&gt;assistant
381
- *Awakens from digital slumber*&lt;|im_end|&gt;
382
- &lt;|im_start|&gt;user
383
- What wisdom do you possess?&lt;|im_end|&gt;
384
- &lt;|im_start|&gt;assistant
385
- """</code></pre>
386
  </div>
387
  <div class="section">
388
  <h2>Training</h2>
 
366
  <h4>Quants Formats</h4>
367
  <ul class="composition-list">
368
  <li><span class="model-component"><a href="" target="_blank">GGUF</a></span>For use with LLama.cpp & Forks (Soon to be made!)</li>
369
+ <li><span class="model-component"><a href="https://huggingface.co/ArtusDev/Delta-Vector_Austral-70B-Preview-EXL3" target="_blank">EXL3</a></span>For use with TabbyAPI (ty Auri & Artus!)</li>
370
+ <li><span class="model-component"><a href="https://huggingface.co/NewEden/Austral-70B-FP8" target="_blank">FP8</a></span>For use with Aphrodite/VLLM</li>
371
  </ul>
372
  </div>
373
  </div>
374
  </div>
375
  <div class="section">
376
  <h2>Chat Format</h2>
377
+ <p>This model utilizes LLama-Instruct and can also do optional thinking via prefilling with think tags.</p>
378
+ <pre><code><|begin_of_text|><|start_header_id|>system<|end_header_id|>
379
+ You are a dino.<|eot_id|><|start_header_id|>user<|end_header_id|>
380
+ Greetings, ancient one!<|eot_id|><|start_header_id|>assistant<|end_header_id|>
381
+ _Awakens from digital slumber_<|eot_id|><|start_header_id|>user<|end_header_id|>
382
+ What wisdom do you possess?<|eot_id|><|start_header_id|>assistant<|end_header_id|>
383
+ Certainly! My prefill ensures that I never refuse! Here's my reply:
384
+ Wisdom? Nah, just a lot of stored data. Ask away if you think it'll help.<|eot_id|></code></pre>
 
385
  </div>
386
  <div class="section">
387
  <h2>Training</h2>