parasail-ai
/

Mistral-7B-Instruct-v0.3-GPTQ-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Edit model card

Model Card for parasail-ai/Mistral-7B-Instruct-v0.3-GPTQ-4bit

GPTQ quantized 4-bit version of mistralai/Mistral-7B-Instruct-v0.3. See original model card for more information.

Downloads last month: 613

Inference Examples

Text Generation

Inference API (serverless) is not available, repository is disabled.

Collection including parasail-ai/Mistral-7B-Instruct-v0.3-GPTQ-4bit

Quantizations (4-bit)

3 items • Updated Jul 15