GGUF-Models
's Collections
🔧Instruct
updated
Triangle104/UwU-7B-Instruct-abliterated-Q4_K_M-GGUF
Text Generation
•
Updated
•
54
itlwas/Llama-SmolTalk-3.2-1B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
105
itlwas/Falcon3-1B-Instruct-abliterated-Q4_K_M-GGUF
Updated
•
107
itlwas/stable-code-instruct-3b-Q4_K_M-GGUF
Updated
•
21
itlwas/FastLlama-3.2-1B-Instruct-Q4_K_M-GGUF
itlwas/Falcon3-1B-Instruct-Q4_K_M-GGUF
Updated
•
14
itlwas/Mistral-7B-Instruct-v0.2-Q4_K_M-GGUF
Text Generation
•
Updated
•
948
itlwas/Mistral-Small-Instruct-2409-Q4_K_M-GGUF
Updated
•
134
itlwas/granite-3b-code-instruct-128k-Q4_K_M-GGUF
Text Generation
•
Updated
•
128
itlwas/granite-3b-code-instruct-2k-Q4_K_M-GGUF
Text Generation
•
Updated
•
141
itlwas/granite-3.0-1b-a400m-instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
19
itlwas/granite-3.1-8b-instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
8
itlwas/granite-3.1-1b-a400m-instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
20
itlwas/granite-3.1-3b-a800m-instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
15
itlwas/granite-3.1-2b-instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
14
itlwas/Qwen2.5-Coder-32B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
14
itlwas/Qwen2.5-Coder-14B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
24
•
1
itlwas/Qwen2.5-Coder-3B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
9
itlwas/Qwen2.5-Coder-1.5B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
47
itlwas/EuroLLM-1.7B-Instruct-Q4_K_M-GGUF
itlwas/EuroLLM-9B-Instruct-Q4_K_M-GGUF
Updated
•
14
itlwas/Llama-3.2-3B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
9
itlwas/Llama-3.2-1B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
6
itlwas/Llama-3.1-8B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
7
itlwas/Vikhr-Qwen-2.5-1.5B-Instruct-Q4_K_M-GGUF
Updated
•
24
itlwas/DeepSeek-Coder-V2-Lite-Instruct-Q4_K_M-GGUF
Updated
•
175
itlwas/Ministral-8B-Instruct-2410-Q4_K_M-GGUF
Updated
•
82
itlwas/Mistral-7B-Instruct-v0.1-Q4_K_M-GGUF
Text Generation
•
Updated
•
595
•
1
itlwas/Vikhr-Llama-3.2-1B-Instruct-abliterated-Q4_K_M-GGUF
Updated
•
28
itlwas/Qwen2.5-Coder-0.5B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
9
itlwas/Vikhr-Gemma-2B-instruct-Q4_K_M-GGUF
Updated
•
28
itlwas/Vikhr-Qwen-2.5-0.5b-Instruct-Q4_K_M-GGUF
Updated
•
27
itlwas/Vikhr-7B-instruct_0.2-Q4_K_M-GGUF
itlwas/Mistral-Nemo-Instruct-2407-Q4_K_M-GGUF
Updated
•
13
itlwas/Mixtral-8x7B-Instruct-v0.1-Q4_K_M-GGUF
Updated
•
111
itlwas/SmolLM2-360M-Instruct-FT-Q4_K_M-GGUF
Text Generation
•
Updated
•
23
itlwas/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
16
itlwas/deepseek-math-7b-instruct-Q4_K_M-GGUF
Updated
•
17
itlwas/SmolLM2-360M-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
16
Triangle104/UwU-7B-Instruct-abliterated-Q6_K-GGUF
Text Generation
•
Updated
•
59
itlwas/SmolLM2-135M-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
13
itlwas/SmolLM2-1.7B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
13
itlwas/SmolLM-135M-Instruct-Q4_K_M-GGUF
Updated
•
18
itlwas/SmolLM-360M-Instruct-Q4_K_M-GGUF
Updated
•
21
itlwas/SmolLM-1.7B-Instruct-Q4_K_M-GGUF
Updated
•
35
itlwas/QwQ-LCoT-3B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
19
itlwas/QwQ-LCoT-7B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
12
itlwas/neo_7b_instruct_v0.1-Q4_K_M-GGUF
itlwas/OpenCoder-8B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
13
itlwas/Falcon3-3B-Instruct-abliterated-Q4_K_M-GGUF
Updated
•
102
itlwas/Falcon3-7B-Instruct-abliterated-Q4_K_M-GGUF
itlwas/Vikhr-7B-instruct_0.4-Q4_K_M-GGUF
itlwas/Falcon3-10B-Instruct-abliterated-Q4_K_M-GGUF
itlwas/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
8
Triangle104/UwU-7B-Instruct-abliterated-Q8_0-GGUF
Text Generation
•
Updated
•
30
itlwas/Qwen2.5-1.5B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
10
itlwas/Qwen2.5-3B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
9
itlwas/Qwen2.5-7B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
12
itlwas/Qwen2.5-14B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
17
itlwas/Qwen2.5-32B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
13
itlwas/Qwen2-0.5B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
10
itlwas/Qwen2-1.5B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
7
itlwas/Qwen2-7B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
11
itlwas/Qwen2-Math-1.5B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
17
itlwas/Qwen2-Math-7B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
156
itlwas/Qwen2.5-Math-1.5B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
13
itlwas/Qwen2.5-Math-7B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
8
itlwas/UwU-7B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
6
itlwas/OLMo-2-1124-7B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
11
itlwas/OLMo-2-1124-13B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
14
itlwas/Phi-3.5-mini-instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
12
itlwas/Phi-3-mini-4k-instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
7
itlwas/Phi-3-mini-128k-instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
9
itlwas/Phi-3-medium-4k-instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
13
itlwas/Phi-3-medium-128k-instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
13
itlwas/Ahma-7B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
24
itlwas/Ahma-3B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
18
Triangle104/Llama-3.2-Nemotron-3B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
5
Triangle104/internlm3-8b-instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
15
Triangle104/internlm3-8b-instruct-abliterated-Q4_K_M-GGUF
Text Generation
•
Updated
•
75
itlwas/QVikhr-2.5-1.5B-Instruct-r-Q4_K_M-GGUF
Updated
•
50
•
2
itlwas/QVikhr-2.5-1.5B-Instruct-SMPO-Q4_K_M-GGUF
Triangle104/AceInstruct-1.5B-Q4_K_M-GGUF
Text Generation
•
Updated
•
13
Triangle104/Deep-Reasoning-Llama-3.2-Instruct-uncensored-3B-Q4_K_M-GGUF
Updated
•
118
Triangle104/granite-3.2-8b-instruct-Q4_K_S-GGUF
Text Generation
•
Updated
•
18
Triangle104/granite-3.2-8b-instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
21
Triangle104/granite-3.2-8b-instruct-Q5_K_S-GGUF
Text Generation
•
Updated
•
19
Triangle104/granite-3.2-8b-instruct-Q5_K_M-GGUF
Text Generation
•
Updated
•
19
Triangle104/granite-3.2-8b-instruct-Q6_K-GGUF
Text Generation
•
Updated
•
20
Triangle104/granite-3.2-8b-instruct-Q8_0-GGUF
Text Generation
•
Updated
•
4
Triangle104/granite-3.2-2b-instruct-Q4_K_S-GGUF
Text Generation
•
Updated
•
17
Triangle104/granite-3.2-2b-instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
18
Triangle104/granite-3.2-2b-instruct-Q5_K_S-GGUF
Text Generation
•
Updated
•
18
Triangle104/granite-3.2-2b-instruct-Q5_K_M-GGUF
Text Generation
•
Updated
•
20
Triangle104/granite-3.2-2b-instruct-Q6_K-GGUF
Text Generation
•
Updated
•
24
Triangle104/granite-3.2-2b-instruct-Q8_0-GGUF
Text Generation
•
Updated
•
5
itlwas/Vikhr-YandexGPT-5-Lite-8B-it-Q4_K_M-GGUF