Quantization of https://huggingface.co/DavidAU/Qwen2.5-QwQ-35B-Eureka-Cubed-abliterated-uncensored.

Quantized by lmdeploy.

See 

https://huggingface.co/RoadToNowhere/Qwen2.5-QwQ-35B-Eureka-Cubed-abliterated-uncensored-AWQ-int4/tree/fromfp16 

and weight files converted to turbomind format for lmdeploy

https://huggingface.co/RoadToNowhere/Qwen2.5-QwQ-35B-Eureka-Cubed-abliterated-uncensored-AWQ-int4/tree/frombf16