any news about the gguf models?

#5
by IbnAbdeen - opened

3.0 gguf model is a great model, can't wait for the 3.1 gguf model

ShuttleAI org

I will make the gguf versions soon

Waiting for GGUFs Q4KS, Q6K

still waiting.

ShuttleAI org

sorry, have been really busy. will release a better version in a week with all quants

waiting and waiting

ShuttleAI org

Hi @IbnAbdeen @Alastar-Smith @ryg81 @ddongxxingg gguf has been created at https://huggingface.co/shuttleai/shuttle-3.1-aesthetic/tree/main/gguf
There is going to be a new model very soon with the GGUFs this time, thanks for your patience's <3

@xtristan thanks for your hard work, waiting for the new model

@xtristan ,text_encoder_2 has a total of more than 9G. Can you provide GGUF format to reduce the memory size? I am a student and my computer is not very ideal.

When the next release coming?

ShuttleAI org

When the next release coming?

https://huggingface.co/shuttleai/shuttle-jaguar

Sign up or log in to comment