Edit Models filters

Apps

Apps with no match

Inference Providers

Inference Providers with no match

HF Inference API

Misc

Inference Endpoints

8-bit precision

text-generation-inference

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

9,038

Full-text search

Active filters: pruna-ai

PrunaAI/yaojialzc-Gigi-Llama3-8B-Chinese-zh-HQQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 57

PrunaAI/yaojialzc-Gigi-Llama3-8B-Chinese-zh-HQQ-2bit-smashed

Text Generation • Updated Jul 16, 2024 • 13

PrunaAI/stockmark-stockmark-13b-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 16, 2024 • 13

PrunaAI/yaojialzc-Gigi-Llama3-8B-Chinese-zh-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 16, 2024 • 48

PrunaAI/TheDrummer-Moistral-11B-v3-QUANTO-float8bit-smashed

Updated Jul 19, 2024 • 17

PrunaAI/allganize-Llama-3-Alpha-Ko-8B-Instruct-bnb-8bit-smashed

Text Generation • 8B • Updated Jul 16, 2024 • 21

PrunaAI/allganize-Llama-3-Alpha-Ko-8B-Instruct-bnb-4bit-smashed

Text Generation • 5B • Updated Jul 16, 2024 • 14

PrunaAI/allganize-Llama-3-Alpha-Ko-8B-Instruct-HQQ-1bit-smashed

Text Generation • Updated Jul 16, 2024 • 17

PrunaAI/allganize-Llama-3-Alpha-Ko-8B-Instruct-HQQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 15

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-v0.1-bnb-8bit-smashed

Text Generation • 8B • Updated Jul 17, 2024 • 32

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-v0.1-bnb-4bit-smashed

Text Generation • 5B • Updated Jul 17, 2024 • 54

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-v0.1-HQQ-1bit-smashed

Text Generation • Updated Jul 17, 2024 • 16

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-v0.1-HQQ-2bit-smashed

Text Generation • Updated Jul 17, 2024 • 30

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-v0.1-QUANTO-int2bit-smashed

Updated Jul 19, 2024 • 6

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-v0.1-HQQ-4bit-smashed

Text Generation • Updated Jul 17, 2024 • 15

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-v0.1-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 17, 2024 • 131

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-v0.1-QUANTO-int4bit-smashed

Updated Jul 19, 2024 • 12

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-v0.1-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 6

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-v0.1-QUANTO-float8bit-smashed

Updated Jul 19, 2024 • 106

PrunaAI/DAMO-NLP-SG-VideoLLaMA2-7B-bnb-4bit-smashed

Text Generation • 4B • Updated Jul 17, 2024 • 21

PrunaAI/DAMO-NLP-SG-VideoLLaMA2-7B-bnb-8bit-smashed

Text Generation • 7B • Updated Jul 17, 2024 • 31

PrunaAI/DAMO-NLP-SG-VideoLLaMA2-7B-QUANTO-int2bit-smashed

Updated Jul 19, 2024 • 20

PrunaAI/DAMO-NLP-SG-VideoLLaMA2-7B-HQQ-4bit-smashed

Text Generation • Updated Jul 17, 2024 • 19

PrunaAI/DAMO-NLP-SG-VideoLLaMA2-7B-HQQ-2bit-smashed

Text Generation • Updated Jul 17, 2024 • 17

PrunaAI/DAMO-NLP-SG-VideoLLaMA2-7B-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 8

PrunaAI/DAMO-NLP-SG-VideoLLaMA2-7B-QUANTO-int4bit-smashed

Updated Jul 19, 2024 • 9

PrunaAI/DAMO-NLP-SG-VideoLLaMA2-7B-QUANTO-float8bit-smashed

Updated Jul 19, 2024 • 5

PrunaAI/saishf-Neural-SOVLish-Devil-8B-L3-bnb-4bit-smashed

Text Generation • 5B • Updated Jul 17, 2024 • 18

PrunaAI/saishf-Neural-SOVLish-Devil-8B-L3-bnb-8bit-smashed

Text Generation • 8B • Updated Jul 17, 2024 • 63

PrunaAI/saishf-Neural-SOVLish-Devil-8B-L3-HQQ-1bit-smashed

Text Generation • Updated Jul 17, 2024 • 13