Hugging Face's logo

DrNicefellow
/
QwQ-32B-Preview-abliterated-3.0bpw-exl2

Safetensors
qwen2
3-bit
exl2
Model card Files Community

This is a 3.0 bpw quantized version of huihui-ai/QwQ-32B-Preview-abliterated made with exllamav2.

License

This model is available under the Apache 2.0 License.

Discord Server

Join our Discord server here.

Feeling Generous? 😊

Eager to buy me a cup of 2$ coffee or iced tea?🍵☕ Sure, here is the link: https://ko-fi.com/drnicefellow. Please add a note on which one you want me to drink?

Downloads last month
17
Inference API
Unable to determine this model's library. Check the docs .

Model tree for DrNicefellow/QwQ-32B-Preview-abliterated-3.0bpw-exl2

Base model

Qwen/Qwen2.5-32B
Finetuned
Qwen/Qwen2.5-32B-Instruct
Finetuned
Qwen/QwQ-32B-Preview
Finetuned
huihui-ai/QwQ-32B-Preview-abliterated
Quantized
(19)
this model

Collection including DrNicefellow/QwQ-32B-Preview-abliterated-3.0bpw-exl2