GGUF LoRA adapters - a ggml-org Collection

ggml-org 's Collections

llama.cpp presets

GGUF LoRA adapters

Gemma 1.1 GGUFs

GGUF LoRA adapters

updated Jan 23

Adapters extracted from fine tuned models, using mergekit-extract-lora

ggml-org/LoRA-Llama-3-Instruct-abliteration-8B-F16-GGUF

Updated Nov 1, 2024 • 41 • 1
ggml-org/LoRA-Qwen2.5-1.5B-Instruct-abliterated-F16-GGUF

Updated Jan 23 • 162 • 2
ggml-org/LoRA-Qwen2.5-3B-Instruct-abliterated-F16-GGUF

Updated Jan 9 • 50 • 1
ggml-org/LoRA-Qwen2.5-7B-Instruct-abliterated-v3-F16-GGUF

Updated Jan 8 • 173 • 3
ggml-org/LoRA-Qwen2.5-14B-Instruct-abliterated-v2-F16-GGUF

Updated Jan 8 • 66 • 1
ggml-org/LoRA-Qwen2.5-32B-Instruct-abliterated-F16-GGUF

Updated Jan 9 • 258 • 4
ggml-org/LoRA-Qwen2.5-72B-Instruct-abliterated-F16-GGUF

Updated Jan 22 • 39
ggml-org/LoRA-llama-3-70B-Instruct-abliterated-F16-GGUF

Updated Jan 22 • 46
ggml-org/LoRA-phi-4-abliterated-F16-GGUF

Updated Jan 9 • 231 • 2

Note --- Reasoning models (may need special system message):
ggml-org/LoRA-SmallThinker-3B-Preview-F16-GGUF

Updated Jan 9 • 28
ggml-org/LoRA-Deepthink-Reasoning-7B-F16-GGUF

Updated Jan 8 • 91
ggml-org/LoRA-Deepthink-Reasoning-Qwen2.5-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Jan 15 • 25
ggml-org/LoRA-Llama-3.1-8B-MultiReflection-F16-GGUF

Updated Jan 8 • 23

Note --- Other models:
ggml-org/LoRA-Qwen2.5-Coder-7B-Instruct-F16-GGUF

Updated Jan 8 • 43
ggml-org/LoRA-Human-Like-Qwen2.5-7B-Instruct-F16-GGUF

Updated Jan 8 • 20
ggml-org/LoRA-Qwerus-Qwen2.5-7B-Instruct-F16-GGUF

Updated Jan 8 • 18