Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
flyfishstudio
's Collections
Q4_0_4_4-GGUF
Q4_0_4_8-GGUF
Q4_0_4_4-GGUF
updated
Sep 21, 2024
GGUF dedicated for ARM NEON devices
Upvote
1
flyfishstudio/yarn-llama-2-7b-128k-Q4_0_4_4.gguf
7B
•
Updated
Sep 19, 2024
•
4
flyfishstudio/Qwen2.5-3B-Instruct-Q4_0_4_4.gguf
3B
•
Updated
Sep 19, 2024
•
8
flyfishstudio/rocket-3b-Q4_0_4_4.gguf
3B
•
Updated
Sep 19, 2024
•
11
flyfishstudio/Gemma-2-Ataraxy-9B-Q4_0_4_4.gguf
9B
•
Updated
Sep 19, 2024
•
5
flyfishstudio/openhermes-2.5-mistral-7b-Q4_0_4_4.gguf
7B
•
Updated
Sep 19, 2024
•
181
flyfishstudio/meta-llama-3.1-8b-instruct-Q4_0_4_4.gguf
8B
•
Updated
Sep 19, 2024
•
6
flyfishstudio/orca_mini_v3_7b-Q4_0_4_4.gguf
7B
•
Updated
Sep 19, 2024
•
7
flyfishstudio/SmolLM-1.7B-Instruct-v0.2-Q4_0_4_4.gguf
2B
•
Updated
Sep 19, 2024
•
8
flyfishstudio/Qwen1.5-1.8B-layla-v4-Q4_0_4_4.gguf
2B
•
Updated
Sep 19, 2024
•
5
flyfishstudio/Mistral-7B-Instruct-v0.3-Q4_0_4_4.gguf
7B
•
Updated
Sep 19, 2024
•
36
flyfishstudio/meta-llama-3.1-8b-instruct-abliterated-Q4_0_4_4.gguf
8B
•
Updated
Sep 19, 2024
•
6
flyfishstudio/tinyllama-1.1b-chat-v1.0-Q4_0_4_4.gguf
1B
•
Updated
Sep 19, 2024
•
21
flyfishstudio/Hermes-3-Llama-3.1-8B-Q4_0_4_4.gguf
8B
•
Updated
Sep 19, 2024
•
35
flyfishstudio/qwen2-0_5b-instruct-Q4_0_4_4.gguf
0.5B
•
Updated
Sep 19, 2024
•
13
flyfishstudio/Phi-3.5-mini-instruct_Uncensored-Q4_0_4_4.gguf
4B
•
Updated
Sep 19, 2024
•
95
•
2
flyfishstudio/Phi-3.5-mini-instruct-Q4_0_4_4.gguf
4B
•
Updated
Sep 19, 2024
•
50
•
1
flyfishstudio/Phi-3.1-mini-4k-instruct-Q4_0_4_4.gguf
4B
•
Updated
Sep 19, 2024
•
20
flyfishstudio/llama-2-7b-chat-Q4_0_4_4.gguf
7B
•
Updated
Sep 19, 2024
•
6
flyfishstudio/gemma_2_2b_it_v2-Q4_0_4_4.gguf
3B
•
Updated
Sep 21, 2024
•
5
flyfishstudio/gemma-2-9b-it-abliterated-Q4_0_4_4.gguf
9B
•
Updated
Sep 21, 2024
•
7
TheDrummer/Gemmasutra-Mini-2B-v1-GGUF
3B
•
Updated
Aug 4, 2024
•
36.9k
•
56
adamo1139/magnum-v2-4b-gguf-lowctx
5B
•
Updated
Aug 27, 2024
•
68
ThomasBaruzier/Llama-3.1-Minitron-4B-Width-Base-GGUF
5B
•
Updated
Aug 27, 2024
•
117
•
3
flyfishstudio/gemma-2-2b-it-abliterated-Q4_0_4_4.gguf
3B
•
Updated
Sep 21, 2024
•
7
Upvote
1
Share collection
View history
Collection guide
Browse collections