Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

RoadToNowhere
/
Qwen2.5-QwQ-35B-Eureka-Cubed-abliterated-uncensored-AWQ-int4

Model card Files Files and versions
xet
Community
1
Qwen2.5-QwQ-35B-Eureka-Cubed-abliterated-uncensored-AWQ-int4 / README.md
RoadToNowhere's picture
RoadToNowhere
Update README.md
8a0897a verified 5 months ago
preview code
|
raw
history blame contribute delete
417 Bytes

Quantization of https://huggingface.co/DavidAU/Qwen2.5-QwQ-35B-Eureka-Cubed-abliterated-uncensored.

Quantized by lmdeploy.

See

https://huggingface.co/RoadToNowhere/Qwen2.5-QwQ-35B-Eureka-Cubed-abliterated-uncensored-AWQ-int4/tree/fromfp16

and weight files converted to turbomind format for lmdeploy

https://huggingface.co/RoadToNowhere/Qwen2.5-QwQ-35B-Eureka-Cubed-abliterated-uncensored-AWQ-int4/tree/frombf16