Update README.md
Browse files
README.md
CHANGED
|
@@ -35,6 +35,12 @@ language:
|
|
| 35 |
---
|
| 36 |
> [!NOTE]
|
| 37 |
> If you are using `llama.cpp`, use `--jinja` to enable the system prompt.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 38 |
<div>
|
| 39 |
<p style="margin-bottom: 0; margin-top: 0;">
|
| 40 |
<strong>Learn to run Magistral correctly - <a href="https://docs.unsloth.ai/basics/magistral">Read our Guide</a>.</strong>
|
|
|
|
| 35 |
---
|
| 36 |
> [!NOTE]
|
| 37 |
> If you are using `llama.cpp`, use `--jinja` to enable the system prompt.
|
| 38 |
+
>
|
| 39 |
+
> ./llama.cpp/llama-cli -hf unsloth/Magistral-Small-2506-GGUF:UD-Q4_K_XL --jinja --temp 0.7 --top-k -1 --top-p 0.95 -ngl 99
|
| 40 |
+
>
|
| 41 |
+
> ollama run hf.co/unsloth/Magistral-Small-2506-GGUF:UD-Q4_K_XL
|
| 42 |
+
|
| 43 |
+
|
| 44 |
<div>
|
| 45 |
<p style="margin-bottom: 0; margin-top: 0;">
|
| 46 |
<strong>Learn to run Magistral correctly - <a href="https://docs.unsloth.ai/basics/magistral">Read our Guide</a>.</strong>
|