|
|
--- |
|
|
license: apache-2.0 |
|
|
tags: |
|
|
- merge |
|
|
- mergekit |
|
|
- lazymergekit |
|
|
- bunnycore/Qwen3-4B-dot-exp |
|
|
- fakezeta/amoral-Qwen3-4B+bunnycore/Qwen-3-4B-Persona-lora_model |
|
|
- llama-cpp |
|
|
base_model: bunnycore/Qwen3-4B-Dot-Goat |
|
|
--- |
|
|
|
|
|
# IntelligentEstate/Tanngrisnir-Qwen3-4B-Q4_K_M-GGUF |
|
|
|
|
|
A small fast Goat further gnashed from Bunny's 4GB model |
|
|
|
|
|
 |
|
|
|
|
|
|
|
|
This model was converted to GGUF format from [`bunnycore/Qwen3-4B-Dot-Goat`](https://huggingface.co/bunnycore/Qwen3-4B-Dot-Goat) using llama.cpp |
|
|
## Use with llama.cpp |
|
|
Install llama.cpp through brew (works on Mac and Linux) |
|
|
|
|
|
```bash |
|
|
brew install llama.cpp |
|
|
|
|
|
``` |
|
|
Invoke the llama.cpp server or the CLI. |
|
|
|
|
|
|
