Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
Q4_K_S
Inference Endpoints
4-bit precision
Merge
Misc with no match
AutoTrain Compatible
text-generation-inference
Eval Results
8-bit precision
custom_code
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
27
Full-text search
Edit filters
Sort: Trending
Active filters:
Q4_K_S
Clear all
roleplaiapp/DeepSeek-R1-Distill-Qwen-32B-Q4_K_S-GGUF
Text Generation
•
Updated
7 days ago
•
50
•
1
AlekseiPravdin/KukulStanta-InfinityRP-7B-slerp-GGUF
Updated
Aug 13, 2024
•
391
•
3
AlekseiPravdin/NSK-128k-7B-slerp-gguf
Updated
Apr 21, 2024
•
47
•
2
AlekseiPravdin/KSI-RP-NSK-128k-7B-gguf
Updated
Apr 21, 2024
•
290
•
3
AlekseiPravdin/KSI-RPG-128k-7B-gguf
Updated
Apr 21, 2024
•
233
•
1
AlekseiPravdin/KSIF-RPG-128k-slerp-gguf
Updated
Apr 21, 2024
•
79
•
1
roleplaiapp/Llama-3.3-70B-Instruct-Q4_K_S-GGUF
Text Generation
•
Updated
12 days ago
•
21
roleplaiapp/SmallThinker-3B-Preview-Q4_K_S-GGUF
Text Generation
•
Updated
11 days ago
•
18
roleplaiapp/QwQ-32B-Preview-Q4_K_S-GGUF
Text Generation
•
Updated
8 days ago
•
38
roleplaiapp/internlm3-8b-instruct-Q4_K_S-GGUF
Text Generation
•
Updated
8 days ago
•
2
roleplaiapp/ReaderLM-v2-Q4_K_S-GGUF
Text Generation
•
Updated
8 days ago
•
22
roleplaiapp/Dria-Agent-a-3B-Q4_K_S-GGUF
Text Generation
•
Updated
8 days ago
•
29
roleplaiapp/Dria-Agent-a-7B-Q4_K_S-GGUF
Text Generation
•
Updated
8 days ago
•
35
roleplaiapp/AceInstruct-72B-Q4_K_S-GGUF
Text Generation
•
Updated
8 days ago
•
22
roleplaiapp/Wayfarer-12B-Q4_K_S-GGUF
Text Generation
•
Updated
8 days ago
•
4
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_S-GGUF
Text Generation
•
Updated
8 days ago
•
20
roleplaiapp/Codestral-22B-v0.1-Q4_K_S-GGUF
Text Generation
•
Updated
8 days ago
•
15
roleplaiapp/AceInstruct-1.5B-Q4_K_S-GGUF
Text Generation
•
Updated
8 days ago
•
24
roleplaiapp/AceInstruct-7B-Q4_K_S-GGUF
Text Generation
•
Updated
8 days ago
•
18
roleplaiapp/Omni-Reasoner-2B-Q4_K_S-GGUF
Image-Text-to-Text
•
Updated
7 days ago
•
18
roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q4_K_S-GGUF
Text Generation
•
Updated
7 days ago
•
4
roleplaiapp/DeepSeek-R1-Distill-Qwen-14B-Q4_K_S-GGUF
Text Generation
•
Updated
7 days ago
•
33
roleplaiapp/DeepSeek-R1-Distill-Qwen-7B-Q4_K_S-GGUF
Text Generation
•
Updated
7 days ago
•
33
roleplaiapp/DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_S-GGUF
Text Generation
•
Updated
7 days ago
•
25
roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q4_K_S-GGUF
Text Generation
•
Updated
7 days ago
•
78
roleplaiapp/Qwen2.5-7B-Instruct-Uncensored-Q4_K_S-GGUF
Text Generation
•
Updated
about 11 hours ago
roleplaiapp/MN-12B-Mag-Mell-R1-Q4_K_S-GGUF
Text Generation
•
Updated
about 5 hours ago