Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Carbon Emissions

Misc with no match

8-bit precision

text-embeddings-inference

Mixture of Experts

Models

234

Full-text search

Active filters: llama-3.1

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 308k • 68

vicgalle/Configurable-Llama-3.1-8B-Instruct

Text Generation • Updated Jul 24, 2024 • 1.31k • • 17

hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation • Updated Sep 13, 2024 • 1.34k • 36

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 35.5k • 100

hugging-quants/Meta-Llama-3.1-405B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7, 2024 • 132 • 16

hugging-quants/Meta-Llama-3.1-405B-BNB-NF4

Text Generation • Updated Sep 16, 2024 • 34 • 2

hugging-quants/Meta-Llama-3.1-405B-Instruct-BNB-NF4

Text Generation • Updated Sep 16, 2024 • 35 • 5

hugging-quants/Meta-Llama-3.1-8B-Instruct-BNB-NF4

Text Generation • Updated Aug 8, 2024 • 780 • 8

hugging-quants/Meta-Llama-3.1-8B-BNB-NF4

Text Generation • Updated Aug 8, 2024 • 376 • 1

ModelCloud/Meta-Llama-3.1-8B-Instruct-gptq-4bit

Text Generation • Updated Jul 29, 2024 • 4.28k • 4

brittlewis12/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 27, 2024 • 107 • 1

ModelCloud/Meta-Llama-3.1-8B-gptq-4bit

Text Generation • Updated Jul 26, 2024 • 45

ModelCloud/Meta-Llama-3.1-70B-Instruct-gptq-4bit

Text Generation • Updated Jul 27, 2024 • 141 • 4

ValiantLabs/Llama3.1-8B-Fireplace2

Text Generation • Updated Mar 12 • 986 • 6

OpenBuddy/openbuddy-llama3.1-8b-v22.1-131k

Text Generation • Updated Jul 24, 2024 • 65 • • 5

hugging-quants/Meta-Llama-3.1-70B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7, 2024 • 4.77k • 23

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7, 2024 • 212k • 25

sunnyyy/openbuddy-llama3.1-8b-v22.1-131k-Q4_K_M-GGUF

Text Generation • Updated Jul 25, 2024 • 23

jburmeister/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Jul 25, 2024 • 7

jburmeister/Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation • Updated Jul 25, 2024 • 7

azhiboedova/Meta-Llama-3.1-8B-Instruct-AQLM-2Bit-1x16

Text Generation • Updated Aug 28, 2024 • 1.29k • 13

mudler/Llama3.1-8B-Fireplace2-Q4_K_M-GGUF

Text Generation • Updated Jul 27, 2024 • 5

mradermacher/Configurable-Llama-3.1-8B-Instruct-GGUF

Updated Jul 29, 2024 • 20

OpenBuddy/openbuddy-llama3.1-8b-v22.2-131k

Text Generation • Updated Aug 11, 2024 • 65 • • 2

mradermacher/openbuddy-llama3.1-8b-v22.1-131k-GGUF

Updated Jul 29, 2024 • 61

mradermacher/openbuddy-llama3.1-8b-v22.2-131k-GGUF

Updated Jul 28, 2024 • 23

hugging-quants/Meta-Llama-3.1-405B-BNB-NF4-BF16

Text Generation • Updated Sep 16, 2024 • 309 • 2

hugging-quants/Meta-Llama-3.1-8B-BNB-NF4-BF16

Text Generation • Updated Jul 28, 2024 • 54

hugging-quants/Meta-Llama-3.1-70B-BNB-NF4-BF16

Text Generation • Updated Aug 8, 2024 • 17 • 2

mradermacher/openbuddy-llama3.1-8b-v22.2-131k-i1-GGUF

Updated Aug 2, 2024 • 12 • 1