no
Rotating
AI & ML interests
None yet
Recent Activity
new activity
about 13 hours ago
unsloth/DeepSeek-R1-GGUF:Performance of the dynamic quants compared to usual quants?
new activity
17 days ago
bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF:R1 32b is much worse than QwQ ...
Organizations
None yet
Rotating's activity
Performance of the dynamic quants compared to usual quants?
8
#21 opened about 19 hours ago
by
inputout
![](https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/VpT4xfZEIJSc6jlmrO1Rj.png)
Over 2 tok/sec agg backed by NVMe SSD on 96GB RAM + 24GB VRAM AM5 rig with llama.cpp
9
#13 opened 9 days ago
by
ubergarm
R1 32b is much worse than QwQ ...
22
#6 opened 18 days ago
by
mirek190
Prompt format
2
#1 opened 19 days ago
by
Rotating
More gemma 2 llama.cpp merges, do they require GGUF regen again?
4
#6 opened 7 months ago
by
IHadToMakeAccount
![](https://cdn-avatars.huggingface.co/v1/production/uploads/665a41ab0c411f720ad22978/PjUHs2mHe2WJtfECw9mPw.jpeg)
Prompt format <bos> not needed?
16
#3 opened 7 months ago
by
eamag
'LlamaCppModel' object has no attribute 'model'
10
#2 opened 8 months ago
by
DrNicefellow
![](https://cdn-avatars.huggingface.co/v1/production/uploads/5f2220612128ba01bdf08c26/PTAD_Zcdq_O91DfYaDpNW.png)
Is there any information on which prompt template to use?
2
#1 opened 8 months ago
by
Debich
![](https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/VYrIxaTuv6b4M-4yh17I2.png)
Please upload the full model first
88
#1 opened about 1 year ago
by
ChuckMcSneed
![](https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/4VOzArmrRaX_DUTxGmm59.jpeg)
Even this excellent high-end model doesn't follow my instructions
5
#8 opened about 1 year ago
by
alexcardo