Model files or Q6_K.gguf

#5
by DontPlanToEnd - opened

Could you either upload the model files, like model-00001-of-00005.safetensors, or upload a Q6_K.gguf to Fentible/Cthulhu-24B-v1-GGUF? I test models using that quant and it'd be nice to have a fair comparison πŸ‘

Yes, I wanted to upload them earlier but ran out of bandwidth for July. I'll try to get Q6 up asap if there's just enough left. By August 1st there should be safetensors for v1.0, along with updated Cthulhu v1.1 safetensors/ggufs.

Fentible changed discussion status to closed

Sign up or log in to comment