error with most recent vLLM
3
#6 opened 10 days ago
by
elbiot
IQ4_NL vs IQ4_XS vs Q4_K_S vs Q4_0
2
#5 opened 12 days ago
by
CosmossG

Recommendations
1
#4 opened 14 days ago
by
Adzeiros

I'm curious how did you convert it to GGUF ?
1
#3 opened 16 days ago
by
prayanksai
Health check error?
2
#2 opened 16 days ago
by
nobeardbugs
Amazing on old hardware
2
#1 opened 16 days ago
by
nobeardbugs