huihui-ai
/

DeepSeek-V3-bf16

Model card Files Files and versions Community

huihui-ai commited on Jan 17

Commit

70fe8b6

·

verified ·

1 Parent(s): ffa2eed

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -45,4 +45,6 @@ Convert first Q2_K.
 llama-quantize /home/admin/models/deepseek-ai/DeepSeek-V3-bf16/ggml-model-f16.gguf  /home/admin/models/deepseek-ai/DeepSeek-V3-bf16/ggml-model-Q2_K.gguf Q2_K
 ```
 3. Use llama-cli to test.
 llama-cli -m /home/admin/models/deepseek-ai/DeepSeek-V3-bf16/ggml-model-Q2_K.gguf -n 2048

 llama-quantize /home/admin/models/deepseek-ai/DeepSeek-V3-bf16/ggml-model-f16.gguf  /home/admin/models/deepseek-ai/DeepSeek-V3-bf16/ggml-model-Q2_K.gguf Q2_K
 ```
 3. Use llama-cli to test.
+```
 llama-cli -m /home/admin/models/deepseek-ai/DeepSeek-V3-bf16/ggml-model-Q2_K.gguf -n 2048
+```