Are there any chances of getting Q4 or Q5?

by fgjujlkhk - opened Jul 7

Jul 7

Thanks for your GGUF conversion!

I'm having a hard time creating a GGUF of the original model, so it would be great if you could upload it with a Q4 (or similar) model....

Owner Jul 8

•

@fgjujlkhk Thanks for the suggestion! I've uploaded both Q4_K_M and Q5_K_M quantized versions.

26 days ago

Great! Thank you very much

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment