Model files or Q6_K.gguf
#5
by
DontPlanToEnd
- opened
Could you either upload the model files, like model-00001-of-00005.safetensors, or upload a Q6_K.gguf to Fentible/Cthulhu-24B-v1-GGUF? I test models using that quant and it'd be nice to have a fair comparison π
Yes, I wanted to upload them earlier but ran out of bandwidth for July. I'll try to get Q6 up asap if there's just enough left. By August 1st there should be safetensors for v1.0, along with updated Cthulhu v1.1 safetensors/ggufs.
Fentible
changed discussion status to
closed