--- base_model: huihui-ai/aya-expanse-8b-abliterated language: - en - fr - de - es - it - pt - ja - ko - zh - ar - el - fa - pl - id - cs - he - hi - nl - ro - ru - tr - uk - vi license: cc-by-nc-4.0 library_name: transformers tags: - matrixportal inference: false --- # Aya-Empati-v3 GGUF Quantized Models ## Technical Details - **Quantization Tool:** llama.cpp - **Version:** version: 5466 (9ecf3e66) ## Model Information - **Base Model:** [matrixportal/Aya-Empati-v3](https://huggingface.co/matrixportal/Aya-Empati-v3) - **Quantized by:** [matrixportal](https://huggingface.co/matrixportal) ## Available Files | 🚀 Download | 🔢 Type | 📝 Description | |------------|---------|---------------| | [Download](https://huggingface.co/matrixportal/Aya-Empati-v3-GGUF/resolve/main/aya-empati-v3.q4_k_m.gguf) | Q4 K M | 4-bit balanced (recommended default) | 💡 **Q4 K M** provides the best balance for most use cases