Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

2,497

Full-text search

Active filters: meta

manbeast3b/Meta-Llama-3.1-8B-Instruct-bnb-4bit9

Text Generation • Updated Aug 17 • 9

aftersoft/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • Updated Aug 17 • 60

ek826/Meta-Llama-3.1-405B-Instruct-4.25bpw-gqa-exl2

Text Generation • Updated Aug 17 • 10 • 1

irresistiblegrace97/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Aug 18 • 11

irresistiblegrace97/Llama-2-7b-chat-hf-Q2_K-GGUF

Text Generation • Updated Aug 18 • 108

Trisert/Meta-Llama-3.1-8B-Instruct-IQ4_NL-GGUF

Text Generation • Updated Aug 18 • 18 • 1

irresistiblegrace97/Llama-2-7b-chat-hf-Q4_K_M-GGUF

Text Generation • Updated Aug 19 • 8

lanok/Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Aug 19 • 26

antoste/Meta-Llama-3.1-8B-Q4_0-GGUF

Text Generation • Updated Aug 19 • 24

mbuali/Llama-3.1-8B-DALv0.1

Text Generation • Updated Aug 19 • 5

realsaturnapp/testplanner3-llama3.1

Text Generation • Updated Aug 22 • 10

rombodawg/Meta-Llama-3.1-8B-Instruct-reuploaded

Text Generation • Updated Aug 24 • 1.26k

fsaudm/Meta-Llama-3.1-8B-Instruct-INT8

Text Generation • Updated Aug 21 • 8

fsaudm/Meta-Llama-3.1-8B-Instruct-NF4

Text Generation • Updated Sep 27 • 394

kaitchup/Meta-Llama-3.1-70B-Instruct-ExLlamaV2-3bit

Text Generation • Updated Aug 20 • 4

kaitchup/Meta-Llama-3.1-70B-Instruct-ExLlamaV2-2.5bit

Text Generation • Updated Aug 20 • 2

kaitchup/Meta-Llama-3.1-70B-Instruct-ExLlamaV2-2.2bit

Text Generation • Updated Aug 20 • 7

thegenerativegeneration/Llama-Guard-3-8B-Q2_K-GGUF

Text Generation • Updated Aug 20 • 12

hamalshe/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Aug 20 • 3

Trac9/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Aug 20 • 2

jburmeister/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • Updated Aug 21 • 10

dsouza889/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • Updated Aug 21 • 2

AminBH/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • Updated Aug 21 • 2

jburmeister/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Aug 22 • 193

jacobcarajo/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • Updated Aug 22 • 2

jacobcarajo/Meta-Llama-3.1-8B-Q8_0-GGUF

Text Generation • Updated Aug 22 • 3

deutsche-telekom/Llama-3.1-MoE-8x8B-Instruct-raw

Text Generation • Updated Aug 23 • 21

jacobcarajo/Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Aug 22 • 20

jacobcarajo/CodeLlama-13b-Python-hf-Q5_K_M-GGUF

Text Generation • Updated Aug 22 • 15

rombodawg/Meta-Llama-3.1-8B-reuploaded

Text Generation • Updated Aug 23 • 27