Thank you for your efforts.
#1
by
suitup91
- opened
I am using the 3-bit model well. Thank you. Could you please upload the 4-bit quantized model or the abliterated original model?
Thank you for your kind words and for using the 3-bit model! I'm glad to hear it's working well for you.
For higher quantization levels like the 4-bit model or the full, unquantized model, I’m considering offering these as part of a premium package to support ongoing development and maintenance. If you're interested, please feel free to email us at [email protected]. In the meantime, I’ll keep your request in mind and explore ways to make them available. Thank you for your understanding and support!