Edit Models filters

Apps

Apps with no match

Inference Providers

Inference Providers with no match

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

text-embeddings-inference

Carbon Emissions

Models

21,142

Full-text search

Active filters: llama-cpp

MugenYume/phi-3.1-abliterated-Q4_K_M-GGUF

4B • Updated Jul 23, 2024 • 9

MugenYume/phi-3.1-abliterated-Q5_K_M-GGUF

4B • Updated Jul 23, 2024 • 3

MugenYume/phi-3.1-abliterated-Q5_K_S-GGUF

4B • Updated Jul 23, 2024 • 1

djuna/stella-base-en-v2-Q5_K_M-GGUF

Feature Extraction • 0.1B • Updated Jul 24, 2024 • 16

Kondara/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 17

shisahni/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 3

Kondara/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 3

MugenYume/Meta-Llama-3.1-8B-Instruct-Q4_K_S-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 5

SkyNotion/gemma-2-9b-it-abliterated-Q4_K_M-GGUF

9B • Updated Jul 24, 2024 • 4

ddarolf/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 1

SkyNotion/Meta-Llama-3-8B-Instruct-abliterated-v3-Q4_K_M-GGUF

8B • Updated Jul 24, 2024 • 9

skoppisetti/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 7

tt144/ReluLLaMA-7B-Q8_0-GGUF

7B • Updated Jul 24, 2024 • 7

jeiku/llama-3.1-ortho-baukit-79f-3000t-Q4_K_M-GGUF

8B • Updated Jul 24, 2024 • 1

jeiku/llama-3.1-ortho-baukit-79f-3000t-Q6_K-GGUF

8B • Updated Jul 24, 2024 • 2

NikolayKozloff/mistral-doryV2-12b-Q8_0-GGUF

12B • Updated Jul 24, 2024 • 2 • 1

zhentaoyu/DeepSeek-V2-Lite-Chat-Q4_0-GGUF

16B • Updated Jul 24, 2024 • 35 • 1

NikolayKozloff/mistral-doryV2-12b-Q6_K-GGUF

12B • Updated Jul 24, 2024 • 2 • 1

NikolayKozloff/mistral-doryV2-12b-Q5_K_M-GGUF

12B • Updated Jul 24, 2024 • 2 • 1

tt144/ReluLLaMA-7B-Q5_K_M-GGUF

7B • Updated Jul 24, 2024 • 7

NikolayKozloff/mistral-doryV2-12b-Q5_K_S-GGUF

12B • Updated Jul 24, 2024 • 4 • 1

kowlick/Mistral-Nemo-Instruct-2407-Q8_0-GGUF

12B • Updated Jul 24, 2024 • 15

kowlick/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 4

SkyNotion/codegemma-2b-Q4_K_M-GGUF

3B • Updated Jul 24, 2024 • 10

third0x/DeepSeek-V2-Lite-Chat-Q8_0-GGUF

16B • Updated Jul 24, 2024 • 3

adrlau/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 10

inflatebot/helide-alpha-r4-Q4_K_M-GGUF

8B • Updated Jul 24, 2024 • 1

tt144/ReluLLaMA-7B-Q4_0-GGUF

7B • Updated Jul 24, 2024 • 8

third0x/DeepSeek-V2-Lite-Chat-Q4_K_M-GGUF

16B • Updated Jul 24, 2024 • 15

Ruby-NewLeaf/WestLakeMultiverse-12B-MoE-Q4_K_M-GGUF

13B • Updated Jul 24, 2024 • 8