added min-p 0.05 to the suggested command (#8)
Browse files- added min-p 0.05 to the suggested command (a89ebe28fd1351a37e37298337af3af2a12d0564)
Co-authored-by: blakkd <[email protected]>
README.md
CHANGED
@@ -11,7 +11,7 @@ library_name: transformers
|
|
11 |
> [!NOTE]
|
12 |
> <br> If you are using `llama.cpp`, use `--jinja`
|
13 |
> ```bash
|
14 |
-
> ./llama.cpp/llama-cli -hf unsloth/Hunyuan-A13B-Instruct-GGUF:Q4_K_XL -ngl 99 --jinja --temp 0.7 --top-k 20 --top-p 0.8 --repeat-penalty 1.05
|
15 |
> ```
|
16 |
<div>
|
17 |
<p style="margin-top: 0;margin-bottom: 0;">
|
|
|
11 |
> [!NOTE]
|
12 |
> <br> If you are using `llama.cpp`, use `--jinja`
|
13 |
> ```bash
|
14 |
+
> ./llama.cpp/llama-cli -hf unsloth/Hunyuan-A13B-Instruct-GGUF:Q4_K_XL -ngl 99 --jinja --temp 0.7 --top-k 20 --top-p 0.8 --min-p 0.05 --repeat-penalty 1.05
|
15 |
> ```
|
16 |
<div>
|
17 |
<p style="margin-top: 0;margin-bottom: 0;">
|