error with most recent vLLM
3
#6 opened 11 days ago
by
elbiot
IQ4_NL vs IQ4_XS vs Q4_K_S vs Q4_0
2
#5 opened 13 days ago
by
CosmossG

Recommendations
1
#4 opened 15 days ago
by
Adzeiros

I'm curious how did you convert it to GGUF ?
1
#3 opened 17 days ago
by
prayanksai
Health check error?
2
#2 opened 17 days ago
by
nobeardbugs
Amazing on old hardware
2
#1 opened 17 days ago
by
nobeardbugs