Update README.md
Browse files
README.md
CHANGED
@@ -101,7 +101,7 @@ For Text-Generation-Webui (https://github.com/oobabooga/text-generation-webui)
|
|
101 |
For KolboldCPP (https://github.com/LostRuins/koboldcpp) Version 1.8+ , on the load screen, click on "TOKENS",
|
102 |
you can set experts on this page, and the launch the model.
|
103 |
|
104 |
-
For server.exe / Llama-server.exe (Llamacpp - https://github.com/
|
105 |
add the following to the command line to start the "llamacpp server" (CLI):
|
106 |
|
107 |
"--override-kv llama.expert_used_count=int:3"
|
|
|
101 |
For KolboldCPP (https://github.com/LostRuins/koboldcpp) Version 1.8+ , on the load screen, click on "TOKENS",
|
102 |
you can set experts on this page, and the launch the model.
|
103 |
|
104 |
+
For server.exe / Llama-server.exe (Llamacpp - https://github.com/ggml-org/llama.cpp/blob/master/tools/server/README.md )
|
105 |
add the following to the command line to start the "llamacpp server" (CLI):
|
106 |
|
107 |
"--override-kv llama.expert_used_count=int:3"
|