Hugging Face's logo

DevQuasar
/
deepseek-ai.DeepSeek-V3-Base-GGUF

Text Generation
GGUF
Inference Endpoints
conversational
Model card Files Community
csabakecskemeti commited on
Commit
aa99118
·
verified ·
1 Parent(s): 232a7e6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -1
README.md CHANGED
@@ -6,4 +6,9 @@ pipeline_tag: text-generation
6
 
7
  Llama.cpp Quantized based on this [Llama.cpp MR](https://github.com/ggerganov/llama.cpp/pull/11049) big thanks to [fairydreaming](https://github.com/fairydreaming)!
8
 
9
- The quantization has been performed on my BF16 version [DevQuasar/deepseek-ai.DeepSeek-V3-Base-bf16](https://huggingface.co/DevQuasar/deepseek-ai.DeepSeek-V3-Base-bf16)
 
 
 
 
 
 
6
 
7
  Llama.cpp Quantized based on this [Llama.cpp MR](https://github.com/ggerganov/llama.cpp/pull/11049) big thanks to [fairydreaming](https://github.com/fairydreaming)!
8
 
9
+ The quantization has been performed on my BF16 version [DevQuasar/deepseek-ai.DeepSeek-V3-Base-bf16](https://huggingface.co/DevQuasar/deepseek-ai.DeepSeek-V3-Base-bf16)
10
+
11
+ Inference proof:
12
+
13
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/64e6d37e02dee9bcb9d9fa18/PhHPBJMVXnWjIxBIbvx0g.png)
14
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/64e6d37e02dee9bcb9d9fa18/6MSHSY7Gut2cyXYa0hhLP.png)