QuantTrio
/

GLM-4.5-AWQ

Text Generation

4-bit precision

Model card Files Files and versions

Resources

View closed (0)

do we need new quants for vllm 10.1?

#4 opened 19 days ago by

Does it possible to create a version without MTP layer to save some VRAM

#3 opened 25 days ago by

how did you make it

#2 opened 26 days ago by

How many GPU Memory AWQ need?

#1 opened 27 days ago by