Models

parasail-ai/GritLM-7B-vllm

Text Generation • 7B • Updated Dec 6, 2024 • 5.45k • 1

QuantFactory/L3-Aspire-Heart-Matrix-8B-GGUF

Text Generation • 8B • Updated Nov 29, 2024 • 301 • 2

tensorblock/Sparse-Llama-3.1-8B-2of4-GGUF

Text Generation • 8B • Updated 9 days ago • 30

dangvansam/gemma-2-27b-it-FP8-fix-system-role

Text Generation • 27B • Updated Dec 4, 2024 • 31

dangvansam/gemma-2-2b-it-fix-system-role

Text Generation • 3B • Updated Dec 8, 2024 • 23

dangvansam/gemma-2-9b-it-fix-system-role

Text Generation • 9B • Updated Dec 8, 2024 • 21 • 1

yejingfu/nmagic-Meta-Llama-3-8B-Instruct-FP8

8B • Updated Dec 5, 2024 • 29

gghfez/Mistral-Large-Instruct-2411

123B • Updated Dec 14, 2024 • 11

jacobcarajo/Ministral-8B-Instruct-2410-Q5_K_M-GGUF

8B • Updated Dec 14, 2024 • 12 • 1

vitekkor/T-pro-it-1.0-bnb-8bit

33B • Updated Dec 16, 2024 • 29 • 1

itlwas/Ministral-8B-Instruct-2410-Q4_K_M-GGUF

8B • Updated Dec 19, 2024 • 7

redhat6/Ministral-8B-Instruct-2410-Q8_0-GGUF

8B • Updated Dec 23, 2024 • 24 • 1

itlwas/Mistral-Small-Instruct-2409-Q4_K_M-GGUF

22B • Updated Dec 24, 2024 • 6

nintwentydo/pixtral-12b-FP8-dynamic-FP8-KV-cache

Image-Text-to-Text • 13B • Updated Jan 6 • 13 • 1

matrixportal/Ministral-8B-Instruct-2410-Q4_0-GGUF

8B • Updated Jan 1 • 14

adriabama06/SmallThinker-3B-Preview-AWQ

Text Generation • Updated Jan 3 • 20 • 1

matrixportal/Ministral-8B-Instruct-2410-Q4_K_M-GGUF

8B • Updated Jan 2 • 4 • 1

matrixportal/Ministral-8B-Instruct-2410-Q4_K_S-GGUF

8B • Updated Jan 2 • 10

RedHatAI/Mixtral-8x22B-v0.1-quantized.w4a16

18B • Updated Jan 3 • 61

RedHatAI/Mixtral-8x7B-v0.1-quantized.w4a16

6B • Updated Mar 1 • 71

RedHatAI/QwQ-32B-Preview-FP8-dynamic

Text Generation • 33B • Updated Jan 3 • 15

RedHatAI/QwQ-32B-Preview-quantized.w4a16

6B • Updated Jan 3 • 7

RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-quantized.w4a16

Text Generation • 11B • Updated Jan 3 • 33

RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-quantized.w8a8

Text Generation • 71B • Updated Jan 3 • 22

RedHatAI/QwQ-32B-Preview-quantized.w8a8

Text Generation • 33B • Updated Jan 3 • 21

RedHatAI/DeepSeek-Coder-V2-Instruct-0724-FP8

Text Generation • 236B • Updated Jan 4 • 31

RedHatAI/DeepSeek-V2.5-1210-FP8

Text Generation • 236B • Updated Jan 4 • 93

nintwentydo/pixtral-12b-2409-2of4-sparse

Image-Text-to-Text • 13B • Updated Jan 5 • 6 • 1

nintwentydo/pixtral-12b-2409-W4A16-G128

Image-Text-to-Text • 3B • Updated Jan 5 • 62 • 2

RedHatAI/granite-3.1-8b-instruct-FP8-dynamic

Text Generation • 8B • Updated 28 days ago • 151 • 1