Thanks for quantizing my model!
#1
by
HappyAIUser
- opened
Had a bunch of issues getting it quantized on mine which is why I could only do an F16 GGUF but then I saw this and that is great. Thanks a lot!
You are welcome *-) If you have other models and don't want the effort of quantizing yourself, feel free to drop us a note (unless we pick it up on our own anyway).