Edit Models filters

Inference status

Misc

AutoTrain Compatible

Inference Endpoints

text-generation-inference

Misc with no match

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

7

Full-text search

Active filters: QUiP

keyfan/Mixtral-8x7B-Instruct-2bit

Text Generation • Updated Dec 31, 2023 • 12 • 4

keyfan/Qwen-72B-Chat-2bit

Text Generation • Updated Jan 7 • 17 • 7

keyfan/Qwen1.5-72B-Chat-2bit

Text Generation • Updated Mar 20 • 8

Minami-su/Qwen1.5-32B-Chat-quip-3bit

Text Generation • Updated Jun 10 • 4 • 1

kharinaev/Mistral-7B-Instruct-v0.2-quip-sharp-4bit

kharinaev/Llama-3.1-8B-Instruct-quip-sharp-2bit

Updated Sep 8 • 2

kharinaev/Mistral-7B-Instruct-v0.2-quip-sharp-2bit