Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Carbon Emissions

4-bit precision

Misc with no match

text-embeddings-inference

8-bit precision

Mixture of Experts

Models

284

Full-text search

Active filters: ggml

ytu-ce-cosmos/Turkish-Llama-8b-Instruct-v0.1-GGUF

Updated 23 days ago • 1.17k • 15

rustformers/bloomz-ggml

Text Generation • Updated Jun 9, 2023 • 55 • 6

mys/ggml_llava-v1.5-7b

Updated Oct 9, 2023 • 2.47k • 108

mys/ggml_llava-v1.5-13b

Updated Oct 10, 2023 • 1.03k • 53

mys/ggml_bakllava-1

Updated Oct 19, 2023 • 9.72k • 76

afrideva/malaysian-tinyllama-1.1b-16k-instructions-GGUF

Text Generation • Updated Nov 12, 2023 • 37 • 2

afrideva/TinyLlama-1.1B-Chat-v0.4-GGUF

Text Generation • Updated Nov 16, 2023 • 74 • 3

afrideva/Tiny-Vicuna-1B-GGUF

Text Generation • Updated Nov 23, 2023 • 3.45k • 3

afrideva/zephyr-smol_llama-100m-sft-full-GGUF

Text Generation • Updated Nov 28, 2023 • 1.81k • 3

afrideva/malaysian-mistral-1.1B-4096-GGUF

Text Generation • Updated Nov 29, 2023 • 263 • 2

afrideva/tiny-llama-1.1b-chat-medical-GGUF

Text Generation • Updated Dec 1, 2023 • 106 • 5

afrideva/minima-3b-layla-v2-GGUF

Text Generation • Updated Dec 19, 2023 • 43 • 4

deccan-ai/phi-2-insurance_qa-sft-lora-gguf-f16

Text Generation • Updated Oct 21 • 59 • 3

leafspark/Meta-Llama-3.1-405B-Instruct-GGUF

Text Generation • Updated Jul 25 • 564 • 22

malteos/bloom-6b4-clp-german

Text Generation • Updated Apr 6 • 147 • 37

nouamanetazi/bloomz-560m-ggml

Updated Mar 15, 2023 • 4

maximeseth/alpaca-native-7B-ggml

Updated Mar 26, 2023 • 1

bertin-project/bertin-gpt-j-6B-alpaca

Text Generation • Updated Nov 10 • 1.2k • 7

CRD716/ggml-LLaMa-65B-quantized

Text Generation • Updated Sep 9, 2023 • 30

CRD716/ggml-vicuna-1.1-quantized

Text Generation • Updated Sep 9, 2023 • 43

Drake-AI/GPT-J-6b-Skein-ggml-q4_1

Updated Apr 18, 2023 • 1

Arjay87/bloomz_7b1.cpp

Updated Apr 21, 2023

nicholascao/chatbloom-1b7-sft

Text Generation • Updated Aug 12, 2023 • 27 • 6

Crataco/Pythia-Deduped-Series-GGML

Text Generation • Updated Oct 1, 2023 • 15

ravenscroftj/CodeGen-350M-multi-ggml-quant

Text Generation • Updated Apr 24, 2023 • 2

ravenscroftj/CodeGen-2B-multi-ggml-quant

Text Generation • Updated Aug 5, 2023 • 2

ravenscroftj/CodeGen-6B-multi-ggml-quant

Text Generation • Updated Apr 24, 2023 • 9

ShadowPower/ggml-alpaca-chatgpt

Text Generation • Updated May 12, 2023 • 7

rozek/OpenLLaMA_7B_300BT_q4

Text Generation • Updated May 5, 2023 • 1

mverrilli/dolly-v2-3b-ggml

Updated May 17, 2023 • 2