Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,716

Base only

Active filters: bitsandbytes

NoobCoder10/Generating_Score

Updated Aug 27, 2023 • 1

naot97/whisper-base-8bit

Automatic Speech Recognition • Updated Aug 29, 2023 • 2 • 1

Mediocreatmybest/WizardCoder-Python-13B-V1.0_8bit_nf4

Text Generation • 13B • Updated Aug 28, 2023 • 4

asas-ai/mt5xl_8bit

Feature Extraction • Updated Aug 28, 2023 • 2

misterkuka/4-bit-cerebras-3b-8k-base

Text Generation • Updated Aug 29, 2023 • 6

misterkuka/8bit-btlm-3b-8k-base

Text Generation • Updated Aug 29, 2023 • 3 • 1

monsoon-nlp/mGPT-quantized

Text Generation • 1B • Updated Sep 20, 2023 • 11 • 1

asas-ai/bloom_1B_8bit

Feature Extraction • Updated Aug 29, 2023

climatefinance/Evaluator_v1.0

Text Generation • Updated Aug 29, 2023 • 6

asas-ai/mt5_large_8bit

Feature Extraction • Updated Aug 29, 2023 • 1

maxolotl/llama2-wait3-1

Text Generation • Updated Aug 30, 2023 • 5

APMIC/CaiGun35b

Text Generation • Updated Aug 30, 2023 • 5

maxolotl/falcon-wait3-v1

Text Generation • Updated Aug 31, 2023 • 5

marcchew/Platypus-2-7B-LaMini-14K

Text Generation • Updated Sep 8, 2023 • 72

Sentdex/WSB-GPT-13B

Text Generation • Updated Sep 3, 2023 • 14 • • 10

Sentdex/WSB-GPT-7B

Text Generation • Updated Sep 3, 2023 • 12 • • 11

monsoon-nlp/mGPT-13B-quantized

Text Generation • Updated Sep 2, 2023 • 4 • 2

crumb/test-00-qlora-wizmlpmix-c0

Updated Sep 4, 2023 • 1

crumb/test-00-qlora-wizmlpmix-c1

Updated Sep 4, 2023

crumb/test-00-qlora-wizmlpmix-c2

Updated Sep 4, 2023 • 1

crumb/test-00-qlora-wizmlpmix-c3

Updated Sep 4, 2023 • 1

arhamk/llama2-qlora-sft

Updated Oct 11, 2023 • 5

Rupak100/Error_Detection_And_Correction_V2

Updated Sep 5, 2023 • 1

atwine/llama-2-7b-chat-fully-quantized-q4-06092023

Text Generation • Updated Sep 6, 2023 • 3 • 1

maxolotl/falcon-wait3-en-es-v2

Text Generation • Updated Sep 7, 2023 • 4

Tensoic/Llama-2-7B-alpaca-2k-test

Updated Sep 29, 2023 • 6

asas-ai/jais_13B_8bit

Text Generation • Updated Oct 25, 2023 • 13 • 9

maxolotl/falcon-wait3-en-es-v2-2

Text Generation • Updated Sep 8, 2023 • 6

jackaduma/Baichuan2-7B-Chat-8bits

Text Generation • Updated Sep 19, 2023 • 5

haouarin/jais-13b-chat-8bits

Text Generation • Updated Sep 9, 2023 • 5 • 3