Edit Models filters

Inference status

Misc

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

14,864

Full-text search

Active filters: bitsandbytes

unsloth/Llama-3.3-70B-Instruct-bnb-4bit

Text Generation • Updated 19 days ago • 122k • 20

sohail-shaikh-s07/distil-gpt-2-ava-test-v1

Text Generation • Updated 5 days ago • 64 • 3

lakkeo/stable-cypher-instruct-3b

Text Generation • Updated Oct 3 • 741 • 24

SeanScripts/Molmo-72B-0924-nf4

Image-Text-to-Text • Updated Oct 2 • 492 • 7

unsloth/Qwen2-VL-7B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated 21 days ago • 12.9k • 6

unsloth/QwQ-32B-Preview-unsloth-bnb-4bit

Text Generation • Updated 19 days ago • 1.09k • 14

CaioXapelaum/Qwen-2.5-0.5B-Instruct-4bit

Text Generation • Updated 11 days ago • 58 • 2

samadpls/querypls-prompt2sql

Text2Text Generation • Updated Nov 2 • 28 • 6

alignment-handbook/zephyr-7b-sft-qlora

Updated Jan 9 • 433 • 8

Undi95/Llama2-13B-no_robots-alpaca-lora

Text Generation • Updated Nov 17, 2023 • 735 • 10

piotr-ai/polanka-7b-v0.1

Text Generation • Updated Nov 14, 2023 • 1.81k • 8

ramy21/tinyllama2

Text Generation • Updated Dec 22, 2023 • 69 • 1

unsloth/mistral-7b-bnb-4bit

Text Generation • Updated Sep 11 • 12.9k • 24

ecastera/eva-mistral-dolphin-7b-spanish

Text Generation • Updated Mar 16 • 86 • 11

unsloth/tinyllama-bnb-4bit

Text Generation • Updated Sep 3 • 5.39k • 9

unsloth/solar-10.7b-bnb-4bit

Text Generation • Updated Mar 22 • 89 • 3

roshanrai1304/llama_2_finetune_on_real_estate_data

Text Generation • Updated Feb 1 • 283 • 2

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17 • 682 • 23

Shashwath01/Idefic_medical_VQA_merged_4bit

Image-Text-to-Text • Updated Sep 26 • 53 • 5

NexaAIDev/Octopus-v1-gemma-7B

Text Generation • Updated Apr 3 • 19 • 3

Lightricks/T5-XXL-8bit

Updated Feb 29 • 181 • 5

Rodeszones/CogVLM-grounding-generalist-hf-quant4

Object Detection • Updated Aug 16 • 105 • 9

CohereForAI/c4ai-command-r-v01-4bit

Text Generation • Updated Sep 27 • 476 • 173

camenduru/EvoVLM-JP-v1-7B-8bit

Image-Text-to-Text • Updated Mar 21 • 12 • 1

ChaimaMess/llama-2-7b-squad

Text Generation • Updated Mar 25 • 33 • 1

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated Sep 27 • 386 • 248

Shaleen123/phi-2-maths

Text Generation • Updated Apr 5 • 122 • 2

mistral-community/Mixtral-8x22B-v0.1-4bit

Text Generation • Updated Apr 10 • 96 • 54

Volko76/Qwen1.5-0.5B-French

Updated Apr 11 • 3 • 1

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated Nov 22 • 286k • 189