Managed to run the Q2 quantized Deepseek V3 base locally
text
Managed to run the Q2 quantized Deepseek V3 base locally
new_line
The quants are uploading (probably ~10-12hrs) here: 
text
The quants are uploading (probably ~10-12hrs) here: 
https://huggingface.co/DevQuasar/deepseek-ai.DeepSeek-V3-Base-GGUF
DevQuasar/deepseek-ai.DeepSeek-V3-Base-GGUF
model
resource
https://huggingface.co/DevQuasar/deepseek-ai.DeepSeek-V3-Base-GGUF
new_line
Managed to run the Q2 quantized Deepseek V3 base locally
The quants are uploading (probably ~10-12hrs) here: https://huggingface.co/DevQuasar/deepseek-ai.DeepSeek-V3-Base-GGUF

🚀
John6666
64e6d37e02dee9bcb9d9fa18
https://cdn-avatars.huggingface.co/v1/production/uploads/64e6d37e02dee9bcb9d9fa18/os24VYiNCoyth9yQSdv_A.jpeg
Csaba  Kecskemeti
csabakecskemeti
user