Edit Models filters

Apps

Apps with no match

Inference Providers

Inference Providers with no match

HF Inference API

Misc

Inference Endpoints

8-bit precision

text-generation-inference

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

9,038

Full-text search

Active filters: pruna-ai

PrunaAI/mosaicml-mpt-7b-instruct-bnb-4bit-smashed

Text Generation • 4B • Updated Aug 2, 2024 • 85

PrunaAI/daryl149-llama-2-7b-chat-hf-bnb-8bit-smashed

Text Generation • 7B • Updated Aug 2, 2024 • 14

PrunaAI/mosaicml-mpt-7b-chat-bnb-4bit-smashed

Text Generation • 4B • Updated Aug 2, 2024 • 16 • 1

PrunaAI/shan2003-llama-2-7b-legal-laws-bnb-8bit-smashed

Text Generation • 7B • Updated Aug 2, 2024 • 64

PrunaAI/mosaicml-mpt-7b-instruct-bnb-8bit-smashed

Text Generation • 7B • Updated Aug 2, 2024 • 53

PrunaAI/mosaicml-mpt-7b-bnb-8bit-smashed

Text Generation • 7B • Updated Aug 2, 2024 • 20

PrunaAI/mosaicml-mpt-7b-8k-bnb-4bit-smashed

Text Generation • 4B • Updated Aug 2, 2024 • 28

PrunaAI/vj1148-llama-2-7b-legal-bnb-8bit-smashed

Text Generation • 7B • Updated Aug 2, 2024 • 20

PrunaAI/openlm-research-open_llama_3b-bnb-4bit-smashed

Text Generation • 2B • Updated Aug 2, 2024 • 46

PrunaAI/mosaicml-mpt-7b-8k-bnb-8bit-smashed

Text Generation • 7B • Updated Aug 2, 2024 • 12

PrunaAI/openlm-research-open_llama_7b_v2-bnb-4bit-smashed

Text Generation • 4B • Updated Aug 2, 2024 • 40

PrunaAI/mosaicml-mpt-7b-chat-bnb-8bit-smashed

Text Generation • 7B • Updated Aug 2, 2024 • 16

PrunaAI/openlm-research-open_llama_3b_v2-bnb-4bit-smashed

Text Generation • 2B • Updated Aug 2, 2024 • 43

PrunaAI/openlm-research-open_llama_3b-bnb-8bit-smashed

Text Generation • 3B • Updated Aug 2, 2024 • 44

PrunaAI/NousResearch-Llama-2-7b-hf-bnb-8bit-smashed

Text Generation • 7B • Updated Aug 2, 2024 • 17

PrunaAI/openlm-research-open_llama_7b-bnb-4bit-smashed

Text Generation • 4B • Updated Aug 2, 2024 • 42

PrunaAI/openlm-research-open_llama_7b_v2-bnb-8bit-smashed

Text Generation • 7B • Updated Aug 2, 2024 • 34

PrunaAI/facebook-opt-1.3b-bnb-4bit-smashed

Text Generation • 0.7B • Updated Aug 2, 2024 • 41

PrunaAI/facebook-opt-125m-bnb-4bit-smashed

Text Generation • 0.1B • Updated Aug 2, 2024 • 20

PrunaAI/VMware-open-llama-7b-open-instruct-bnb-4bit-smashed

Text Generation • 4B • Updated Aug 2, 2024 • 17

PrunaAI/facebook-opt-350m-bnb-4bit-smashed

Text Generation • 0.2B • Updated Aug 2, 2024 • 18

PrunaAI/openlm-research-open_llama_3b_v2-bnb-8bit-smashed

Text Generation • 3B • Updated Aug 2, 2024 • 24

PrunaAI/VMware-open-llama-7b-v2-open-instruct-bnb-4bit-smashed

Text Generation • 4B • Updated Aug 2, 2024 • 13

PrunaAI/openlm-research-open_llama_7b-bnb-8bit-smashed

Text Generation • 7B • Updated Aug 2, 2024 • 15

PrunaAI/facebook-opt-6.7b-bnb-4bit-smashed

Text Generation • 4B • Updated Aug 2, 2024 • 12

PrunaAI/facebook-opt-1.3b-bnb-8bit-smashed

Text Generation • 1B • Updated Aug 2, 2024 • 36

PrunaAI/KoboldAI-OPT-6B-nerys-v2-bnb-4bit-smashed

Text Generation • 4B • Updated Aug 2, 2024 • 17

PrunaAI/facebook-opt-2.7b-bnb-4bit-smashed

Text Generation • 1B • Updated Aug 2, 2024 • 17

PrunaAI/VMware-open-llama-7b-v2-open-instruct-bnb-8bit-smashed

Text Generation • 7B • Updated Aug 2, 2024 • 14

PrunaAI/VMware-open-llama-7b-open-instruct-bnb-8bit-smashed

Text Generation • 7B • Updated Aug 2, 2024 • 31