Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

25,285

Full-text search

Active filters: 8-bit

microsoft/bitnet-b1.58-2B-4T

Text Generation • Updated 12 days ago • 87.9k • 978

nvidia/Llama-3.3-70B-Instruct-FP4

Updated Feb 26 • 3.65k • 20

MaziyarPanahi/Qwen3-32B-GGUF

Text Generation • Updated 14 days ago • 111k • 2

MaziyarPanahi/Qwen3-30B-A3B-GGUF

Text Generation • Updated 13 days ago • 109k • 3

JunHowie/Qwen3-30B-A3B-GPTQ-Int8

Text Generation • Updated 13 days ago • 301 • 2

Intel/distilbert-base-uncased-distilled-squad-int8-static-inc

Question Answering • Updated Mar 29, 2024 • 2.81k • 5

Norod78/gpt-fluentui-flat-svg

Text Generation • Updated Mar 19, 2023 • 15 • 21

CyberNative/CyberBase-13b

Text Generation • Updated May 16, 2024 • 41 • 30

viai957/CodeLlama_34b-SQL

Text Generation • Updated May 4, 2024 • 33 • 1

lavawolfiee/Mixtral-8x7B-Instruct-v0.1-offloading-demo

Text Generation • Updated Dec 30, 2023 • 364 • 28

Flurin17/whisper-large-v3-peft-swiss-german

Updated Feb 26, 2024 • 623 • 5

MaziyarPanahi/BASH-Coder-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26, 2024 • 99 • 3

Lightricks/T5-XXL-8bit

Updated Feb 29, 2024 • 89 • 7

MaziyarPanahi/Yi-9B-GGUF

Text Generation • Updated Mar 14, 2024 • 433 • 15

MaziyarPanahi/Saul-Instruct-v1-GGUF

Text Generation • Updated Mar 10, 2024 • 257 • 8

MaziyarPanahi/zephyr-orpo-141b-A35b-v0.1-GGUF

Text Generation • Updated Apr 12, 2024 • 9.19k • 29

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15, 2024 • 308k • 80

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16, 2024 • 9.57k • 127

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14, 2024 • 19.2k • 169

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23, 2024 • 330k • 89

Kameshr/LLAMA-3-Quantized

Text Generation • Updated May 3, 2024 • 19 • 9

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 338k • 96

nassersala/axolotl-olama3b-gpt4-cleaned

Updated May 24, 2024 • 6 • 1

lllyasviel/omost-phi-3-mini-128k-8bits

Text Generation • Updated May 29, 2024 • 43 • 7

Qwen/Qwen2-0.5B-Instruct-GPTQ-Int8

Text Generation • Updated Aug 21, 2024 • 277 • 4

MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated Jul 22, 2024 • 313k • 44

meta-llama/Llama-Guard-3-8B-INT8

Text Generation • Updated Aug 7, 2024 • 2.9k • 36

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 23, 2024 • 300k • 19

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated Oct 23, 2024 • 7.23k • 16

MaziyarPanahi/Mistral-Large-Instruct-2407-GGUF

Text Generation • Updated Jul 26, 2024 • 18.4k • 21