TheBloke
/

Mistral-7B-OpenOrca-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Mistral-7B-OpenOrca-GPTQ

Ctrl+K

Ctrl+K

3 contributors

History: 10 commits

TheBloke's picture

jlzhou's picture

fix: quantize param in TGI example (#8)

bbedaae over 1 year ago