Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

Carbon Emissions

Misc with no match

8-bit precision

text-embeddings-inference

Mixture of Experts

Models

217

Full-text search

Active filters: llama-3.1

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 79.9k • 100

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 253k • 62

ModelCloud/Meta-Llama-3.1-8B-Instruct-gptq-4bit

Text Generation • Updated Jul 29, 2024 • 709 • 4

vicgalle/Configurable-Llama-3.1-8B-Instruct

Text Generation • Updated Jul 24, 2024 • 4.88k • 16

hugging-quants/Meta-Llama-3.1-70B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7, 2024 • 5.58k • 23

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7, 2024 • 18.7k • 22

akjindal53244/Llama-3.1-Storm-8B

Text Generation • Updated Dec 5, 2024 • 14.3k • 175

bartowski/Llama3.1-8B-Enigma-GGUF

Text Generation • Updated Aug 16, 2024 • 288 • 2

jjjssjs/Llama-VARCO-8B-Instruct-GGUF

Updated Oct 5, 2024 • 124 • 5

lemon-mint/Llama-VARCO-8B-Instruct-LLaMAfied

Text Generation • Updated Oct 11, 2024 • 24 • 3

ibnzterrell/Nvidia-Llama-3.1-Nemotron-70B-Instruct-HF-AWQ-INT4

Text Generation • Updated Dec 7, 2024 • 11.5k • 4

mukaj/Llama-3.1-Hawkish-8B

Text Generation • Updated Oct 26, 2024 • 107 • 42

T145/KRONOS-8B-V1-P2

Text Generation • Updated Feb 7 • 13 • 1

T145/ZEUS-8B-V2-abliterated

Text Generation • Updated Dec 31, 2024 • 74 • 2

mradermacher/ZEUS-8B-V2-abliterated-GGUF

Updated Jan 1 • 88 • 2

T145/ZEUS-8B-V30

Text Generation • Updated Feb 7 • 26 • 1

mradermacher/ZEUS-8B-V30-GGUF

Updated Feb 9 • 24 • 1

mradermacher/ZEUS-8B-V30-i1-GGUF

Updated Feb 9 • 41 • 1

Neph0s/CoSER-Llama-3.1-70B

Updated 8 days ago • 188 • 2

utkmst/chimera-beta-test2-lora-merged

Text Generation • Updated 24 days ago • 144 • 1

utkmst/chimera-beta-test2-lora-merged-Q4_K_M-GGUF

Updated 24 days ago • 34 • 1

mradermacher/Llama-VARCO-8B-Instruct-LLaMAfied-GGUF

Updated 22 days ago • 308 • 1

mradermacher/Llama-VARCO-8B-Instruct-LLaMAfied-i1-GGUF

Updated 22 days ago • 565 • 1

hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation • Updated Sep 13, 2024 • 4.43k • 37

hugging-quants/Meta-Llama-3.1-405B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7, 2024 • 391 • 16

hugging-quants/Meta-Llama-3.1-405B-BNB-NF4

Text Generation • Updated Sep 16, 2024 • 123 • 2

hugging-quants/Meta-Llama-3.1-405B-Instruct-BNB-NF4

Text Generation • Updated Sep 16, 2024 • 335 • 5

hugging-quants/Meta-Llama-3.1-8B-Instruct-BNB-NF4

Text Generation • Updated Aug 8, 2024 • 636 • 8

hugging-quants/Meta-Llama-3.1-8B-BNB-NF4

Text Generation • Updated Aug 8, 2024 • 92

brittlewis12/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 27, 2024 • 96 • 1