csabakecskemeti
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -6,4 +6,9 @@ pipeline_tag: text-generation
|
|
6 |
|
7 |
Llama.cpp Quantized based on this [Llama.cpp MR](https://github.com/ggerganov/llama.cpp/pull/11049) big thanks to [fairydreaming](https://github.com/fairydreaming)!
|
8 |
|
9 |
-
The quantization has been performed on my BF16 version [DevQuasar/deepseek-ai.DeepSeek-V3-Base-bf16](https://huggingface.co/DevQuasar/deepseek-ai.DeepSeek-V3-Base-bf16)
|
|
|
|
|
|
|
|
|
|
|
|
6 |
|
7 |
Llama.cpp Quantized based on this [Llama.cpp MR](https://github.com/ggerganov/llama.cpp/pull/11049) big thanks to [fairydreaming](https://github.com/fairydreaming)!
|
8 |
|
9 |
+
The quantization has been performed on my BF16 version [DevQuasar/deepseek-ai.DeepSeek-V3-Base-bf16](https://huggingface.co/DevQuasar/deepseek-ai.DeepSeek-V3-Base-bf16)
|
10 |
+
|
11 |
+
Inference proof:
|
12 |
+
|
13 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/64e6d37e02dee9bcb9d9fa18/PhHPBJMVXnWjIxBIbvx0g.png)
|
14 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/64e6d37e02dee9bcb9d9fa18/6MSHSY7Gut2cyXYa0hhLP.png)
|