--- base_model: - FuseAI/FuseO1-DeepSeekR1-Qwen2.5-Coder-32B-Preview tags: - awq - autoawq --- Quantized with AutoAWQ v0.2.8 using default settings ``` quant_config = { "zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM" } ```