Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -14,7 +14,7 @@ tags:
|
|
14 |
|
15 |
*Produced by [Antigma Labs](https://antigma.ai)*
|
16 |
## llama.cpp quantization
|
17 |
-
Using <a href="https://github.com/ggml-org/llama.cpp">llama.cpp</a> release <a href="https://github.com/ggml-org/llama.cpp/releases/tag/
|
18 |
Original model: https://huggingface.co/Qwen/Qwen1.5-0.5B
|
19 |
Run them directly with [llama.cpp](https://github.com/ggml-org/llama.cpp), or any other llama.cpp based project
|
20 |
## Prompt format
|
|
|
14 |
|
15 |
*Produced by [Antigma Labs](https://antigma.ai)*
|
16 |
## llama.cpp quantization
|
17 |
+
Using <a href="https://github.com/ggml-org/llama.cpp">llama.cpp</a> release <a href="https://github.com/ggml-org/llama.cpp/releases/tag/b5170">b4944</a> for quantization.
|
18 |
Original model: https://huggingface.co/Qwen/Qwen1.5-0.5B
|
19 |
Run them directly with [llama.cpp](https://github.com/ggml-org/llama.cpp), or any other llama.cpp based project
|
20 |
## Prompt format
|