hellork/Qwen2-7B-Instruct-IQ4_NL-GGUF
Text Generation
•
Updated
•
14
Under 10b iq4_nl gguf
Under 10B GGUFs Non-linear Quantized to try on 4GiB VRAM. Leaderboard https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard
-
-
SixOpen/Nous-Capybara-7B-V1.9-IQ4_NL-GGUF
Updated • 7 -
SixOpen/Phi-3-mini-4k-instruct-IQ4_NL-imat.gguf
Text Generation • Updated • 11 -
n3shelter/Peach-9B-8k-Roleplay-IQ4_XS-GGUF
Text Generation • Updated • 15 • 1 -
aifeifei798/llama3-8B-DarkIdol-2.0-Uncensored-IQ4_NL-GGUF
Updated • 27 • 1 -
Trisert/Meta-Llama-3.1-8B-Instruct-IQ4_NL-GGUF
Text Generation • Updated • 30 • 1 -
Jianping746/Llama3.1-8B-Chinese-Chat-IQ4_XS-GGUF
Text Generation • Updated • 3 -
DarqueDante/Llama-3.1-8B-Stheno-v3.4-IQ4_XS-GGUF
Updated • 66 -
herrkobold/SauerkrautLM-1.5b-IQ4_XS-GGUF
Updated • 7 -
GrimsenClory/Meta-Llama-3.1-8B-Instruct-IQ4_XS-GGUF
Text Generation • Updated • 8 -
Niansuh/Llama-3-Groq-8B-Tool-Use-IQ4_NL-GGUF
Updated • 2 -
Cran-May/openbuddy-llama3.1-8b-v22.3-131k-IQ4_XS-GGUF
Text Generation • Updated • 11 -
matrixportal/Meta-Llama-3.1-8B-Instruct-IQ4_NL-GGUF
Text Generation • Updated • 8 -
askmyteapot/Meta-Llama-3-70B-Instruct-abliterated-v3.5-IQ4_XS
Updated • 2 -
Amensia/Qwen2-1.5B-Instruct-IQ4_NL-GGUF
Text Generation • Updated -
float-trip/drama-llama-3-iq4_xs
Updated • 3 -
NikolayKozloff/Dorna-Llama3-8B-Instruct-IQ4_XS-GGUF
Updated • 11 • 1 -
Cran-May/Gemma-2-9B-Chinese-Chat-IQ4_XS-GGUF
Text Generation • Updated • 69 -
SixOpen/Meta-Llama-3-8B-Instruct-IQ4_NL-GGUF
Text Generation • Updated • 18 -
NikolayKozloff/Dorna-Llama3-8B-Instruct-IQ4_NL-GGUF
Updated • 10 • 1 -
gate369/Phi-3-mini-128k-instruct-IQ4_XS-GGUF
Text Generation • Updated • 14 -
Alex01837178373/gemma-2-9b-it-abliterated-IQ4_NL-GGUF
Updated • 4 -
lucasdozie/gemma-2-2b-it-IQ4_NL-GGUF
Text Generation • Updated • 9 -
hanchungshin/Meta-Llama-3.1-8B-Instruct-IQ4_NL-GGUF
Text Generation • Updated • 3 -
ElMater06/Mistral-7B-Instruct-v0.3-IQ4_NL-GGUF
Updated • 19 • 1 -
NikolayKozloff/L3-8B-Lunaris-v1-IQ4_NL-GGUF
Updated • 10 • 1 -
NikolayKozloff/Llama-3-Instruct-Neurona-8b-v2-IQ4_NL-GGUF
Text Generation • Updated • 18 • 1 -
NikolayKozloff/llama3-turbcat-instruct-8b-IQ4_NL-GGUF
Updated • 9 • 1 -
NikolayKozloff/tabula-8b-IQ4_NL-GGUF
Updated • 12 • 1 -
qnixsynapse/Meta-Llama-3-8B-Instruct-IQ4_XS-GGUF
Text Generation • Updated • 18 -
qnixsynapse/gemma-2-9b-it-IQ4_XS-GGUF
Text Generation • Updated • 4 -
Joseph717171/Llama-3.1-SuperNova-Lite-8.0B-OQ8_0.EF32.IQ4_K-Q8_0-GGUF
Updated • 495 • 1 -
DarwinAnim8or/mergekit-model_stock-ffibbcs-IQ4_NL-GGUF
Updated • 27 • 1 -
bunnycore/Llama-3.1-8B-OmniMatrix-IQ4_NL-GGUF
Updated • 34 • 1 -
bunnycore/HyperLlama-3.1-8B-IQ4_NL-GGUF
Updated • 27 • 1 -
DarwinAnim8or/mergekit-model_stock-ffibbcs-IQ4_XS-GGUF
Updated • 18 • 1 -
sehiro/EvoLLM-JP-A-v1-7B-IQ4_XS-GGUF
Updated • 7 • 1 -
Joseph717171/Gemma-2-2b-it-OQ8_0-F32.EF32.IQ4_K_M-8_0-GGUF
Updated • 56 • 1 -
utterlygreat/omost-dolphin-2.9-llama3-8b-IQ4_XS-GGUF
Updated • 55 -
bunnycore/Crazy-Qwen2-7b-IQ4_NL-GGUF
Updated • 51