Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

26,468

Full-text search

Active filters: 8-bit

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 2.15M • 88

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • Updated Jun 20, 2024 • 1.96M • 18

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9, 2024 • 44.8k • 19

nvidia/Llama-3.3-70B-Instruct-FP4

Updated about 1 month ago • 13.1k • 13

mlx-community/DeepSeek-R1-Distill-Qwen-32B-MLX-8Bit

Updated 30 days ago • 173k • 14

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • Updated Jan 30 • 1.01M • 2

Vikhrmodels/QVikhr-2.5-1.5B-Instruct-SMPO_MLX-8bit

Text Generation • Updated Feb 3 • 335 • 2

meituan/DeepSeek-R1-Block-INT8

Text Generation • Updated 29 days ago • 4.54k • 39

mlx-community/QwQ-32B-8bit

Text Generation • Updated 22 days ago • 2.86k • 13

nezahatkorkmaz/turkish-llava-med-pipeline-v1.5-mistral-7b

Image-to-Text • Updated 1 day ago • 36 • 2

Norod78/gpt-fluentui-flat-svg

Text Generation • Updated Mar 19, 2023 • 134 • 20

CyberNative/CyberBase-13b

Text Generation • Updated May 16, 2024 • 180 • 28

asas-ai/jais_13B_8bit

Text Generation • Updated Oct 25, 2023 • 227 • 9

viai957/CodeLlama_34b-SQL

Text Generation • Updated May 4, 2024 • 93 • 1

Qwen/Qwen-7B-Chat-Int8

Text Generation • Updated Dec 13, 2023 • 398 • 8

Qwen/Qwen-14B-Chat-Int8

Text Generation • Updated Dec 13, 2023 • 122 • 6

Qwen/Qwen-1_8B-Chat-Int8

Text Generation • Updated Dec 13, 2023 • 128 • 5

Qwen/Qwen-72B-Chat-Int8

Text Generation • Updated Jan 4, 2024 • 42 • 17

MaziyarPanahi/SauerkrautLM-7b-HerO-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 29, 2024 • 895 • 2

MaziyarPanahi/Mixtral-8x7B-v0.1-GGUF

Text Generation • Updated Feb 4, 2024 • 938 • 1

Qwen/Qwen1.5-72B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 66 • 7

Qwen/Qwen1.5-7B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 116 • 26

Qwen/Qwen1.5-4B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 57 • 5

Qwen/Qwen1.5-1.8B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 34 • 2

Qwen/Qwen1.5-0.5B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 156 • 4

MaziyarPanahi/sqlcoder-7b-2-GGUF

Text Generation • Updated Feb 13, 2024 • 267 • 10

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19, 2024 • 824 • 52

MaziyarPanahi/LongAlpaca-13B-GGUF

Text Generation • Updated Feb 26, 2024 • 268 • 3

MaziyarPanahi/Mistral-7B-Instruct-Aya-101-GGUF

Text Generation • Updated Feb 28, 2024 • 1.41k • 8

Lightricks/T5-XXL-8bit

Updated Feb 29, 2024 • 212 • 6