---
inference: false
library_name: transformers
language:
- en
- fr
- de
- es
- it
- pt
- ja
- ko
- zh
- ar
- el
- fa
- pl
- id
- cs
- he
- hi
- nl
- ro
- ru
- tr
- uk
- vi
license: cc-by-nc-4.0
base_model:
- CohereForAI/aya-expanse-8b
tags:
- gguf
- CohereForAI
---

# aya-expanse-8b-abliterated GGUF Quantized Models

## Technical Details
- **Quantization Tool:** llama.cpp
- **Version:** version: 5427 (f7c9429c)

## Model Information
- **Base Model:** [lenML/aya-expanse-8b-abliterated](https://huggingface.co/lenML/aya-expanse-8b-abliterated)
- **Quantized by:** [matrixportal](https://huggingface.co/matrixportal)

## Available Files
| 🚀 Download | 🔢 Type | 📝 Description |
|------------|---------|---------------|
| [Download](https://huggingface.co/matrixportal/aya-expanse-8b-abliterated-GGUF/resolve/main/aya-expanse-8b-abliterated.q4_k_m.gguf) | Q4 K M | 4-bit balanced (recommended default) |

💡 **Q4 K M** provides the best balance for most use cases