GGUF-Models
's Collections
Triangle104/UwU-7B-Instruct-abliterated-Q4_K_M-GGUF
Text Generation
•
8B
•
Updated
•
6
itlwas/Llama-SmolTalk-3.2-1B-Instruct-Q4_K_M-GGUF
Text Generation
•
1B
•
Updated
•
5
•
1
itlwas/Falcon3-1B-Instruct-abliterated-Q4_K_M-GGUF
2B
•
Updated
•
11
itlwas/stable-code-instruct-3b-Q4_K_M-GGUF
3B
•
Updated
•
11
itlwas/FastLlama-3.2-1B-Instruct-Q4_K_M-GGUF
1B
•
Updated
•
7
itlwas/Falcon3-1B-Instruct-Q4_K_M-GGUF
2B
•
Updated
•
7
itlwas/Mistral-7B-Instruct-v0.2-Q4_K_M-GGUF
Text Generation
•
7B
•
Updated
•
31
itlwas/Mistral-Small-Instruct-2409-Q4_K_M-GGUF
22B
•
Updated
•
13
itlwas/granite-3b-code-instruct-128k-Q4_K_M-GGUF
Text Generation
•
3B
•
Updated
•
5
itlwas/granite-3b-code-instruct-2k-Q4_K_M-GGUF
Text Generation
•
3B
•
Updated
•
3
itlwas/granite-3.0-1b-a400m-instruct-Q4_K_M-GGUF
Text Generation
•
1B
•
Updated
•
3
itlwas/granite-3.1-8b-instruct-Q4_K_M-GGUF
Text Generation
•
8B
•
Updated
•
9
itlwas/granite-3.1-1b-a400m-instruct-Q4_K_M-GGUF
Text Generation
•
1B
•
Updated
•
1
itlwas/granite-3.1-3b-a800m-instruct-Q4_K_M-GGUF
Text Generation
•
3B
•
Updated
•
5
itlwas/granite-3.1-2b-instruct-Q4_K_M-GGUF
Text Generation
•
3B
•
Updated
•
5
itlwas/Qwen2.5-Coder-32B-Instruct-Q4_K_M-GGUF
Text Generation
•
33B
•
Updated
•
11
itlwas/Qwen2.5-Coder-14B-Instruct-Q4_K_M-GGUF
Text Generation
•
15B
•
Updated
•
67
•
1
itlwas/Qwen2.5-Coder-3B-Instruct-Q4_K_M-GGUF
Text Generation
•
3B
•
Updated
•
8
itlwas/Qwen2.5-Coder-1.5B-Instruct-Q4_K_M-GGUF
Text Generation
•
2B
•
Updated
•
11
itlwas/EuroLLM-1.7B-Instruct-Q4_K_M-GGUF
2B
•
Updated
•
18
itlwas/EuroLLM-9B-Instruct-Q4_K_M-GGUF
9B
•
Updated
•
12
itlwas/Llama-3.2-3B-Instruct-Q4_K_M-GGUF
Text Generation
•
3B
•
Updated
•
12
itlwas/Llama-3.2-1B-Instruct-Q4_K_M-GGUF
Text Generation
•
1B
•
Updated
•
12
itlwas/Llama-3.1-8B-Instruct-Q4_K_M-GGUF
Text Generation
•
8B
•
Updated
•
7
itlwas/Vikhr-Qwen-2.5-1.5B-Instruct-Q4_K_M-GGUF
2B
•
Updated
•
1
•
1
itlwas/DeepSeek-Coder-V2-Lite-Instruct-Q4_K_M-GGUF
16B
•
Updated
•
14
itlwas/Ministral-8B-Instruct-2410-Q4_K_M-GGUF
8B
•
Updated
•
9
itlwas/Mistral-7B-Instruct-v0.1-Q4_K_M-GGUF
Text Generation
•
7B
•
Updated
•
2.45k
•
4
itlwas/Vikhr-Llama-3.2-1B-Instruct-abliterated-Q4_K_M-GGUF
1B
•
Updated
•
22
itlwas/Qwen2.5-Coder-0.5B-Instruct-Q4_K_M-GGUF
Text Generation
•
0.5B
•
Updated
•
26
itlwas/Vikhr-Gemma-2B-instruct-Q4_K_M-GGUF
3B
•
Updated
•
14
itlwas/Vikhr-Qwen-2.5-0.5b-Instruct-Q4_K_M-GGUF
0.5B
•
Updated
•
7
itlwas/Vikhr-7B-instruct_0.2-Q4_K_M-GGUF
itlwas/Mistral-Nemo-Instruct-2407-Q4_K_M-GGUF
12B
•
Updated
•
3
•
1
itlwas/Mixtral-8x7B-Instruct-v0.1-Q4_K_M-GGUF
47B
•
Updated
•
26
itlwas/SmolLM2-360M-Instruct-FT-Q4_K_M-GGUF
Text Generation
•
0.4B
•
Updated
•
16
itlwas/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF
Text Generation
•
8B
•
Updated
•
9
itlwas/deepseek-math-7b-instruct-Q4_K_M-GGUF
7B
•
Updated
•
10
itlwas/SmolLM2-360M-Instruct-Q4_K_M-GGUF
Text Generation
•
0.4B
•
Updated
•
4
Triangle104/UwU-7B-Instruct-abliterated-Q6_K-GGUF
Text Generation
•
8B
•
Updated
•
6
itlwas/SmolLM2-135M-Instruct-Q4_K_M-GGUF
Text Generation
•
0.1B
•
Updated
•
18
itlwas/SmolLM2-1.7B-Instruct-Q4_K_M-GGUF
Text Generation
•
2B
•
Updated
•
8
itlwas/SmolLM-135M-Instruct-Q4_K_M-GGUF
0.1B
•
Updated
•
4
itlwas/SmolLM-360M-Instruct-Q4_K_M-GGUF
0.4B
•
Updated
•
13
itlwas/SmolLM-1.7B-Instruct-Q4_K_M-GGUF
2B
•
Updated
•
5
itlwas/QwQ-LCoT-3B-Instruct-Q4_K_M-GGUF
Text Generation
•
3B
•
Updated
•
14
itlwas/QwQ-LCoT-7B-Instruct-Q4_K_M-GGUF
Text Generation
•
8B
•
Updated
•
8
itlwas/neo_7b_instruct_v0.1-Q4_K_M-GGUF
8B
•
Updated
•
9
itlwas/OpenCoder-8B-Instruct-Q4_K_M-GGUF
Text Generation
•
8B
•
Updated
•
2
itlwas/Falcon3-3B-Instruct-abliterated-Q4_K_M-GGUF
3B
•
Updated
•
11
itlwas/Falcon3-7B-Instruct-abliterated-Q4_K_M-GGUF
itlwas/Vikhr-7B-instruct_0.4-Q4_K_M-GGUF
itlwas/Falcon3-10B-Instruct-abliterated-Q4_K_M-GGUF
itlwas/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF
Text Generation
•
0.5B
•
Updated
•
9
itlwas/Qwen2.5-1.5B-Instruct-Q4_K_M-GGUF
Text Generation
•
2B
•
Updated
•
8
itlwas/Qwen2.5-3B-Instruct-Q4_K_M-GGUF
Text Generation
•
3B
•
Updated
•
4
itlwas/Qwen2.5-7B-Instruct-Q4_K_M-GGUF
Text Generation
•
8B
•
Updated
•
14
itlwas/Qwen2.5-14B-Instruct-Q4_K_M-GGUF
Text Generation
•
15B
•
Updated
•
5
itlwas/Qwen2.5-32B-Instruct-Q4_K_M-GGUF
Text Generation
•
33B
•
Updated
•
10
itlwas/Qwen2-0.5B-Instruct-Q4_K_M-GGUF
Text Generation
•
0.5B
•
Updated
•
4
itlwas/Qwen2-1.5B-Instruct-Q4_K_M-GGUF
Text Generation
•
2B
•
Updated
•
3
itlwas/Qwen2-7B-Instruct-Q4_K_M-GGUF
Text Generation
•
8B
•
Updated
•
16
itlwas/Qwen2-Math-1.5B-Instruct-Q4_K_M-GGUF
Text Generation
•
2B
•
Updated
•
2
itlwas/Qwen2-Math-7B-Instruct-Q4_K_M-GGUF
Text Generation
•
8B
•
Updated
•
18
itlwas/Qwen2.5-Math-1.5B-Instruct-Q4_K_M-GGUF
Text Generation
•
2B
•
Updated
•
7
itlwas/Qwen2.5-Math-7B-Instruct-Q4_K_M-GGUF
Text Generation
•
8B
•
Updated
•
20
itlwas/UwU-7B-Instruct-Q4_K_M-GGUF
Text Generation
•
8B
•
Updated
•
2
itlwas/OLMo-2-1124-7B-Instruct-Q4_K_M-GGUF
Text Generation
•
7B
•
Updated
•
2
itlwas/OLMo-2-1124-13B-Instruct-Q4_K_M-GGUF
Text Generation
•
14B
•
Updated
•
6
itlwas/Phi-3.5-mini-instruct-Q4_K_M-GGUF
Text Generation
•
4B
•
Updated
•
9
itlwas/Phi-3-mini-4k-instruct-Q4_K_M-GGUF
Text Generation
•
4B
•
Updated
•
11
itlwas/Phi-3-mini-128k-instruct-Q4_K_M-GGUF
Text Generation
•
4B
•
Updated
•
3
itlwas/Phi-3-medium-4k-instruct-Q4_K_M-GGUF
Text Generation
•
14B
•
Updated
•
5
itlwas/Phi-3-medium-128k-instruct-Q4_K_M-GGUF
Text Generation
•
14B
•
Updated
•
9
itlwas/Ahma-7B-Instruct-Q4_K_M-GGUF
Text Generation
•
7B
•
Updated
•
10
itlwas/Ahma-3B-Instruct-Q4_K_M-GGUF
Text Generation
•
4B
•
Updated
•
7
Triangle104/Llama-3.2-Nemotron-3B-Instruct-Q4_K_M-GGUF
Text Generation
•
3B
•
Updated
•
2
Triangle104/internlm3-8b-instruct-Q4_K_M-GGUF
Text Generation
•
9B
•
Updated
•
11
Triangle104/internlm3-8b-instruct-abliterated-Q4_K_M-GGUF
Text Generation
•
9B
•
Updated
•
5
itlwas/QVikhr-2.5-1.5B-Instruct-r-Q4_K_M-GGUF
2B
•
Updated
•
6
•
2
itlwas/QVikhr-2.5-1.5B-Instruct-SMPO-Q4_K_M-GGUF
Triangle104/AceInstruct-1.5B-Q4_K_M-GGUF
Text Generation
•
2B
•
Updated
•
8
Triangle104/Deep-Reasoning-Llama-3.2-Instruct-uncensored-3B-Q4_K_M-GGUF
Triangle104/granite-3.2-8b-instruct-Q4_K_M-GGUF
Text Generation
•
8B
•
Updated
•
6
Triangle104/granite-3.2-2b-instruct-Q4_K_M-GGUF
Text Generation
•
3B
•
Updated
•
1
itlwas/Vikhr-YandexGPT-5-Lite-8B-it-Q4_K_M-GGUF
itlwas/EXAONE-3.5-2.4B-Instruct-Q4_K_M-GGUF
Text Generation
•
2B
•
Updated
•
8
itlwas/EXAONE-3.5-7.8B-Instruct-Q4_K_M-GGUF
Text Generation
•
8B
•
Updated
•
4
itlwas/EXAONE-3.0-7.8B-Instruct-Q4_K_M-GGUF
itlwas/YandexGPT-5-Lite-8B-instruct-Q4_K_M-GGUF
itlwas/gemma-3-1b-it-Q4_K_M-GGUF
Text Generation
•
1.0B
•
Updated
•
3
itlwas/gemma-3-4b-it-Q4_K_M-GGUF
Image-Text-to-Text
•
4B
•
Updated
•
35
itlwas/gemma-3-12b-it-Q4_K_M-GGUF
Image-Text-to-Text
•
12B
•
Updated
itlwas/Phi-4-mini-instruct-Q4_K_M-GGUF
Text Generation
•
4B
•
Updated
•
3
itlwas/Llama-3.1-Nemotron-8B-UltraLong-2M-Instruct-Q4_K_M-GGUF
itlwas/Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct-Q4_K_M-GGUF
itlwas/Llama-3.1-Nemotron-8B-UltraLong-4M-Instruct-Q4_K_M-GGUF
8B
•
Updated
•
13
•
1
itlwas/Nemotron-4-Mini-Hindi-4B-Instruct-Q4_K_M-GGUF
itlwas/Nemotron-Mini-4B-Instruct-Q4_K_M-GGUF
Text Generation
•
4B
•
Updated
•
4
itlwas/Hiber-Multi-10B-Instruct-Q4_K_M-GGUF
Text Generation
•
11B
•
Updated
•
9
•
1
Triangle104/granite-3.3-2b-instruct-Q4_K_M-GGUF
Text Generation
•
3B
•
Updated
•
5
Triangle104/granite-3.3-8b-instruct-Q4_K_M-GGUF
Text Generation
•
8B
•
Updated
•
5
Triangle104/granite-3.1-2b-instruct-abliterated-Q4_K_M-GGUF
Text Generation
•
3B
•
Updated
•
1
Triangle104/granite-3.1-2b-instruct-Q4_K_M-GGUF
Text Generation
•
3B
•
Updated
•
1
Triangle104/granite-3.1-8b-instruct-Q4_K_M-GGUF
Text Generation
•
8B
•
Updated
•
4
Triangle104/granite-3.1-8b-instruct-abliterated-Q4_K_M-GGUF
Text Generation
•
8B
•
Updated
•
6
Triangle104/granite-3.2-2b-instruct-abliterated-Q4_K_M-GGUF
Text Generation
•
3B
•
Updated
•
19
Triangle104/granite-3.2-8b-instruct-abliterated-Q4_K_M-GGUF
Text Generation
•
8B
•
Updated
•
10
Triangle104/InternVL3-1B-Instruct-Q4_K_M-GGUF
Image-Text-to-Text
•
0.6B
•
Updated
•
5
Triangle104/InternVL3-2B-Instruct-Q5_K_M-GGUF
Image-Text-to-Text
•
2B
•
Updated
Triangle104/InternVL3-8B-Instruct-Q4_K_M-GGUF
Image-Text-to-Text
•
8B
•
Updated
•
4
Triangle104/Mistral-Small-3.2-24B-Instruct-2506-Q4_K_M-GGUF
Image-Text-to-Text
•
24B
•
Updated
•
11