Update README.md
Browse files
README.md
CHANGED
@@ -36,10 +36,6 @@ language:
|
|
36 |
> [!NOTE]
|
37 |
> If you are using `llama.cpp`, use `--jinja` to enable the system prompt.
|
38 |
>
|
39 |
-
> ./llama.cpp/llama-cli -hf unsloth/Magistral-Small-2506-GGUF:UD-Q4_K_XL --jinja --temp 0.7 --top-k -1 --top-p 0.95 -ngl 99
|
40 |
-
>
|
41 |
-
> ollama run hf.co/unsloth/Magistral-Small-2506-GGUF:UD-Q4_K_XL
|
42 |
-
|
43 |
|
44 |
<div>
|
45 |
<p style="margin-bottom: 0; margin-top: 0;">
|
@@ -62,6 +58,15 @@ language:
|
|
62 |
<h1 style="margin-top: 0rem;">✨ How to Use Magistral:</h1>
|
63 |
</div>
|
64 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
65 |
- Temperature of: 0.7
|
66 |
- Set top_p to: 0.95
|
67 |
- Max tokens (context length): 40,960 (32K + 8K)
|
|
|
36 |
> [!NOTE]
|
37 |
> If you are using `llama.cpp`, use `--jinja` to enable the system prompt.
|
38 |
>
|
|
|
|
|
|
|
|
|
39 |
|
40 |
<div>
|
41 |
<p style="margin-bottom: 0; margin-top: 0;">
|
|
|
58 |
<h1 style="margin-top: 0rem;">✨ How to Use Magistral:</h1>
|
59 |
</div>
|
60 |
|
61 |
+
Run in llama.cpp:
|
62 |
+
```
|
63 |
+
./llama.cpp/llama-cli -hf unsloth/Magistral-Small-2506-GGUF:UD-Q4_K_XL --jinja --temp 0.7 --top-k -1 --top-p 0.95 -ngl 99
|
64 |
+
```
|
65 |
+
Run in Ollama:
|
66 |
+
```
|
67 |
+
ollama run hf.co/unsloth/Magistral-Small-2506-GGUF:UD-Q4_K_XL
|
68 |
+
```
|
69 |
+
|
70 |
- Temperature of: 0.7
|
71 |
- Set top_p to: 0.95
|
72 |
- Max tokens (context length): 40,960 (32K + 8K)
|