Update README.md
Browse files
README.md
CHANGED
|
@@ -2,9 +2,9 @@
|
|
| 2 |
base_model: [deepseek-ai/DeepSeek-Coder-V2-Instruct]
|
| 3 |
---
|
| 4 |
|
| 5 |
-
####
|
| 6 |
|
| 7 |
-
### Theis ones uses GGML TYPE IQ_4_XS in combination with q8_0 so it runs fast and takes advantage of int8 optimizations on most nevwer server cpus.
|
| 8 |
### While it requirement custom code to make it is standard compatible with plain llama.cpp
|
| 9 |
|
| 10 |
```verilog
|
|
|
|
| 2 |
base_model: [deepseek-ai/DeepSeek-Coder-V2-Instruct]
|
| 3 |
---
|
| 4 |
|
| 5 |
+
#### Custom quantizations of deepseek-coder-v2-instruct optimized for cpu inference.
|
| 6 |
|
| 7 |
+
### Theis ones uses GGML TYPE IQ_4_XS in combination with q8_0 so it runs fast with minimal loss and takes advantage of int8 optimizations on most nevwer server cpus.
|
| 8 |
### While it requirement custom code to make it is standard compatible with plain llama.cpp
|
| 9 |
|
| 10 |
```verilog
|