This is the 8-bit quantized version of Alibaba-NLP/gte-Qwen2-1.5B-instruct by following the example from the AutoGPTQ repository.

Downloads last month
165
Safetensors
Model size
807M params
Tensor type
I32
·
FP16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ktoprakucar/gte-Qwen2-1.5B-instruct-Q8-GPTQ

Quantized
(19)
this model