shimmyshimmer commited on
Commit
389f842
·
verified ·
1 Parent(s): 6ec67dc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -4
README.md CHANGED
@@ -36,10 +36,6 @@ language:
36
  > [!NOTE]
37
  > If you are using `llama.cpp`, use `--jinja` to enable the system prompt.
38
  >
39
- > ./llama.cpp/llama-cli -hf unsloth/Magistral-Small-2506-GGUF:UD-Q4_K_XL --jinja --temp 0.7 --top-k -1 --top-p 0.95 -ngl 99
40
- >
41
- > ollama run hf.co/unsloth/Magistral-Small-2506-GGUF:UD-Q4_K_XL
42
-
43
 
44
  <div>
45
  <p style="margin-bottom: 0; margin-top: 0;">
@@ -62,6 +58,15 @@ language:
62
  <h1 style="margin-top: 0rem;">✨ How to Use Magistral:</h1>
63
  </div>
64
 
 
 
 
 
 
 
 
 
 
65
  - Temperature of: 0.7
66
  - Set top_p to: 0.95
67
  - Max tokens (context length): 40,960 (32K + 8K)
 
36
  > [!NOTE]
37
  > If you are using `llama.cpp`, use `--jinja` to enable the system prompt.
38
  >
 
 
 
 
39
 
40
  <div>
41
  <p style="margin-bottom: 0; margin-top: 0;">
 
58
  <h1 style="margin-top: 0rem;">✨ How to Use Magistral:</h1>
59
  </div>
60
 
61
+ Run in llama.cpp:
62
+ ```
63
+ ./llama.cpp/llama-cli -hf unsloth/Magistral-Small-2506-GGUF:UD-Q4_K_XL --jinja --temp 0.7 --top-k -1 --top-p 0.95 -ngl 99
64
+ ```
65
+ Run in Ollama:
66
+ ```
67
+ ollama run hf.co/unsloth/Magistral-Small-2506-GGUF:UD-Q4_K_XL
68
+ ```
69
+
70
  - Temperature of: 0.7
71
  - Set top_p to: 0.95
72
  - Max tokens (context length): 40,960 (32K + 8K)