Edit Models filters

Apps

Apps with no match

Inference Providers

Inference Providers with no match

HF Inference API

Misc

4-bit precision

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

36,137

Full-text search

Active filters: 4-bit

TheBloke/Kunoichi-7B-GPTQ

Text Generation • Updated Jan 5, 2024 • 79 • 15

TheBloke/Kunoichi-7B-AWQ

Text Generation • Updated Jan 5, 2024 • 36 • 8

TheBloke/Mixtral_11Bx2_MoE_19B-AWQ

Text Generation • Updated Jan 5, 2024 • 18 • 5

TheBloke/Mixtral_11Bx2_MoE_19B-GPTQ

Text Generation • Updated Jan 5, 2024 • 24 • 5

TheBloke/Beyonder-4x7B-v2-GPTQ

Text Generation • Updated Jan 5, 2024 • 34 • 6

TheBloke/Beyonder-4x7B-v2-AWQ

Text Generation • Updated Jan 5, 2024 • 14 • 3

aari1995/germeo-7b-awq

Text Generation • Updated Apr 2, 2024 • 474 • 2

TheBloke/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-AWQ

Text Generation • Updated Jan 5, 2024 • 14 • 1

TheBloke/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-GPTQ

Text Generation • Updated Jan 5, 2024 • 40 • 3

TheBloke/phi-2-dpo-GPTQ

Text Generation • Updated Jan 5, 2024 • 16 • 5

TheBloke/Mistral-7B-Instruct-v0.2-code-ft-GPTQ

Text Generation • Updated Jan 5, 2024 • 34 • 5

TheBloke/Mistral-7B-Instruct-v0.2-code-ft-AWQ

Text Generation • Updated Jan 5, 2024 • 16 • 6

TheBloke/Rosa_v2_7B-AWQ

Text Generation • Updated Jan 5, 2024 • 9 • 2

TheBloke/Rosa_v2_7B-GPTQ

Text Generation • Updated Jan 5, 2024 • 18 • 2

Anarchist/llama-instruct-wizard-orca

Text Generation • Updated Jan 5, 2024 • 58

TheBloke/Open_Gpt4_8x7B-AWQ

Text Generation • Updated Jan 5, 2024 • 53 • 2

TheBloke/Open_Gpt4_8x7B-GPTQ

Text Generation • Updated Jan 6, 2024 • 12 • 9

nicesen/sen-llama

Text Generation • Updated Jan 6, 2024 • 13

Anarchist/llama-bad-roleplay

Text Generation • Updated Jan 6, 2024 • 30 • 2

AlignmentLab-AI/teensyorca

Text Generation • Updated Jan 13, 2024 • 31

TheBloke/zephyr-quiklang-3b-GPTQ

Text Generation • Updated Jan 6, 2024 • 18 • 1

TheBloke/LLaMA-Pro-8B-AWQ

Text Generation • Updated Jan 6, 2024 • 40 • 3

TheBloke/LLaMA-Pro-8B-GPTQ

Text Generation • Updated Jan 6, 2024 • 136 • 2

isaiahbjork/tinyllama-function-calling-v0.1-merge

Text Generation • Updated Jan 18, 2024 • 16

Danielbrdz/Barcenas-Mixtral-8x7b-4bit

Text Generation • Updated Jan 6, 2024 • 11

TheBloke/Pallas-0.5-frankenmerge-GPTQ

Text Generation • Updated Jan 6, 2024 • 24 • 1

TheBloke/Pallas-0.5-frankenmerge-AWQ

Text Generation • Updated Jan 6, 2024 • 21 • 1

TheBloke/bagel-8x7b-v0.2-GPTQ

Text Generation • Updated Jan 6, 2024 • 46 • 3

TheBloke/bagel-8x7b-v0.2-AWQ

Text Generation • Updated Jan 6, 2024 • 38 • 1

TheBloke/zephyr-quiklang-3b-4K-GPTQ

Text Generation • Updated Jan 6, 2024 • 18 • 2