Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

Mixture of Experts

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

100

Full-text search

Active filters: Instruct

mradermacher/Llama-Song-Stream-3B-Instruct-GGUF

Updated 8 days ago • 258 • 1

CONCISE/LLaMa_V2-13B-Instruct-Uncensored-GGML

Text Generation • Updated Aug 17, 2023 • 20 • 5

Keynote-Technology/KAI-7B-Instruct-v0.1

Text Generation • Updated Aug 23 • 32 • 10

TheBloke/KAI-7B-Instruct-GGUF

Updated Nov 9, 2023 • 101 • 6

TheBloke/KAI-7B-Instruct-AWQ

Text Generation • Updated Nov 9, 2023 • 49 • 1

bartowski/KAI-7B-Instruct-exl2

Updated Nov 9, 2023

TheBloke/KAI-7B-Instruct-GPTQ

Text Generation • Updated Nov 9, 2023 • 35 • 3

VAGOsolutions/SauerkrautLM-SOLAR-Instruct

Text Generation • Updated Mar 2 • 773 • 46

fblgit/LUNA-SOLARkrautLM-Instruct

Text Generation • Updated Mar 8 • 797 • 8

TheBloke/SauerkrautLM-SOLAR-Instruct-AWQ

Text Generation • Updated Dec 23, 2023 • 24

TheBloke/SauerkrautLM-SOLAR-Instruct-GPTQ

Text Generation • Updated Dec 23, 2023 • 24 • 2

TheBloke/SauerkrautLM-SOLAR-Instruct-GGUF

Text Generation • Updated Dec 23, 2023 • 150 • 2

TheBloke/LUNA-SOLARkrautLM-Instruct-AWQ

Text Generation • Updated Dec 23, 2023 • 26

TheBloke/LUNA-SOLARkrautLM-Instruct-GPTQ

Text Generation • Updated Dec 23, 2023 • 22 • 2

TheBloke/LUNA-SOLARkrautLM-Instruct-GGUF

Text Generation • Updated Dec 23, 2023 • 115 • 4

LoneStriker/SauerkrautLM-Mixtral-8x7B-Instruct-2.4bpw-h6-exl2

Text Generation • Updated Dec 25, 2023 • 10

LoneStriker/SauerkrautLM-Mixtral-8x7B-Instruct-3.0bpw-h6-exl2

Text Generation • Updated Dec 25, 2023 • 11

LoneStriker/SauerkrautLM-Mixtral-8x7B-Instruct-3.5bpw-h6-exl2

Text Generation • Updated Dec 25, 2023 • 14

LoneStriker/SauerkrautLM-Mixtral-8x7B-Instruct-3.75bpw-h6-exl2

Text Generation • Updated Dec 25, 2023 • 10

LoneStriker/SauerkrautLM-Mixtral-8x7B-Instruct-4.0bpw-h6-exl2

Text Generation • Updated Dec 25, 2023 • 10

TheBloke/SauerkrautLM-Mixtral-8x7B-Instruct-GPTQ

Text Generation • Updated Jan 3 • 85 • 3

TheBloke/SauerkrautLM-Mixtral-8x7B-Instruct-GGUF

Text Generation • Updated Dec 25, 2023 • 243 • 9

TheBloke/SauerkrautLM-Mixtral-8x7B-Instruct-AWQ

Text Generation • Updated Jan 3 • 71 • 2

LoneStriker/SauerkrautLM-Mixtral-8x7B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Dec 25, 2023 • 10

LoneStriker/SauerkrautLM-Mixtral-8x7B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated Dec 25, 2023 • 9

damerajee/Tinyllama-sft-small

Text Generation • Updated Jan 10 • 7

damerajee/tinyllama-sft-small-v2

Text Generation • Updated Jan 10 • 37

LHC88/SauerkrautLM-Mixtral-8x7B-Instruct-AWQ

Text Generation • Updated Jan 20 • 25

jpacifico/french-alpaca-llama3-8B-Q4-GGUF

Updated May 7 • 2 • 1

jpacifico/french-alpaca-instruct-Q4-GGUF

Updated Apr 28 • 2