casperhansen
/

mistral-small-24b-instruct-2501-awq

4-bit precision

Model card Files Files and versions Community

Resources

View closed (0)

tekken.json from the original repo is missing and fails when running on vLLM

#2 opened 6 months ago by

Comparison to older-type AWQ quants?

#1 opened 6 months ago by