kaitchup
/

Mistral-7B-awq-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Mistral-7B-awq-4bit / README.md

bnjmnmarie's picture

Create README.md

bc9fd35 over 1 year ago

|

history blame contribute delete

43 Bytes

Mistral 7B quantized in 4-bit with AutoAWQ.