Edit Models filters

Apps

Apps with no match

Inference Providers

Inference Providers with no match

HF Inference API

Misc

4-bit precision

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

7,198

Full-text search

Active filters: awq

PrunaAI/LumiOpen-Viking-7B-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 20, 2024 • 51

PrunaAI/VAGOsolutions-SauerkrautLM-7b-LaserChat-AWQ-4bit-smashed

Text Generation • 1B • Updated Jul 21, 2024 • 12

PrunaAI/h2oai-h2o-danube-1.8b-base-AWQ-4bit-smashed

Text Generation • 0.4B • Updated Jul 21, 2024 • 14

PrunaAI/hfl-llama-3-chinese-8b-instruct-v3-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 21, 2024 • 19

PrunaAI/yam-peleg-Hebrew-Mistral-7B-AWQ-4bit-smashed

Text Generation • 1B • Updated Jul 21, 2024 • 14

PrunaAI/ibm-granite-granite-3b-code-base-AWQ-4bit-smashed

Text Generation • 0.7B • Updated Jul 21, 2024 • 34

PrunaAI/rinna-llama-3-youko-8b-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 21, 2024 • 28

PrunaAI/ibm-granite-granite-8b-code-instruct-AWQ-4bit-smashed

Text Generation • 1B • Updated Jul 21, 2024 • 12

Weni/ZeroShot-Agents-Mistral-4.0.71-SFT-300-AWQ

Text Generation • 3B • Updated Jul 21, 2024 • 15

PrunaAI/openchat-openchat-3.5-0106-AWQ-4bit-smashed

Text Generation • 1B • Updated Jul 21, 2024 • 15

PrunaAI/FreedomIntelligence-Apollo-7B-AWQ-4bit-smashed

Text Generation • 3B • Updated Jul 21, 2024 • 18

PrunaAI/BramVanroy-GEITje-7B-ultra-AWQ-4bit-smashed

Text Generation • 1B • Updated Jul 21, 2024 • 51

PrunaAI/tensoropera-Fox-1-1.6B-AWQ-4bit-smashed

Text Generation • 1B • Updated Jul 21, 2024 • 31

PrunaAI/aixsatoshi-Llama-3-youko-8b-instruct-chatvector-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 13

PrunaAI/hiieu-Meta-Llama-3-8B-Instruct-function-calling-json-mode-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 23

PrunaAI/Qwen-Qwen1.5-0.5B-Chat-AWQ-4bit-smashed

Text Generation • 0.4B • Updated Jul 22, 2024 • 17

PrunaAI/cognitivecomputations-dolphin-2.9.2-qwen2-7b-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 16

PrunaAI/mzbac-llama-3-8B-Instruct-function-calling-v0.2-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 14

PrunaAI/scb10x-llama-3-typhoon-v1.5-8b-instruct-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 17

ildodeltaRule/Yi-6B-200K-AWQ-VLLM

Text Generation • 1B • Updated Jul 23, 2024 • 13

PrunaAI/HuggingFaceTB-SmolLM-1.7B-AWQ-4bit-smashed

Text Generation • 0.4B • Updated Jul 22, 2024 • 85

PrunaAI/namespace-Pt-Llama-3-8B-Instruct-80K-QLoRA-Merged-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 16

PrunaAI/Gryphe-Pantheon-RP-1.0-8b-Llama-3-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 27

PrunaAI/nothingiisreal-L3-8B-Celeste-v1-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 13

hiuman/vi-gemma-2b-RAG-awq-quantization

Text Generation • 1B • Updated Jul 23, 2024 • 15

GameScribes/Mistral-Nemo-AWQ

Text Generation • 3B • Updated Jul 22, 2024 • 14

GameScribes/Mistral-v0.3-AWQ

Text Generation • 1B • Updated Jul 22, 2024 • 72

casperhansen/qwen2-0.5b-instruct-awq

Text Generation • 0.3B • Updated Jul 22, 2024 • 12

PrunaAI/unsloth-llama-3-8b-Instruct-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 32

PrunaAI/LLM360-AmberChat-AWQ-4bit-smashed

Text Generation • 1B • Updated Jul 22, 2024 • 15