silveroxides
/

Chroma-GGUF

Model card Files Files and versions Community

Where to quantize these models? i need Q5_K_S

#5

by Kutches - opened Jun 3

Kutches

Jun 3

Is there an easy way to quant these models to my prefered size?

stduhpf

Jun 3

You can either use https://github.com/city96/ComfyUI-GGUF/blob/main/tools/convert.py or https://github.com/leejet/stable-diffusion.cpp.

Owner Jun 4

@stduhpf
not exactly.

@Kutches
you want to use this branch on my llama.cpp fork instead of the default in city96 instructions. no need to do git apply then either.
https://github.com/silveroxides/llama.cpp/tree/b3962

Owner Jun 4

also you wanna navigate here for full original instructions https://github.com/city96/ComfyUI-GGUF/tree/main/tools

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment