GGUFs
Collection
I take requests, feel free to drop me a line in the community posts
•
40 items
•
Updated
•
2
psyonic-cetacean-20B iMat GGUF
psyonic-cetacean-20B quantized using importance matrix (with love).
Uploading some of the newer quants by request, starting with IQ3.
For more information on the latest importance matrix quants and how they stack up to legacy quantization methods please check out this PR.
Need a different quantization/model? Please open a community post and I'll get back to you - thanks
- Downloads last month
- 7
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API was unable to determine this model's library.