Configuration Parsing Warning: In config.json: "quantization_config.bits" must be an integer

Abliterated version of Rombo-Org/Rombo-LLM-V3.1-QWQ-32b, utilizing code from refusal_direction.

For more information about the Abliterated technique, refer to this article and check out @FailSpy.

GGUF

This model is licensed under the Qwen LICENSE AGREEMENT, Copyright (c) Alibaba Cloud. All Rights Reserved.

Downloads last month
6
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for zetasepic/Rombo-LLM-V3.1-QWQ-32b-abliterate-6.5bpw-h8-exl2

Base model

Qwen/Qwen2.5-32B
Quantized
(82)
this model