| inference: false | |
| library_name: transformers | |
| language: | |
| - en | |
| - fr | |
| - de | |
| - es | |
| - it | |
| - pt | |
| - ja | |
| - ko | |
| - zh | |
| - ar | |
| - el | |
| - fa | |
| - pl | |
| - id | |
| - cs | |
| - he | |
| - hi | |
| - nl | |
| - ro | |
| - ru | |
| - tr | |
| - uk | |
| - vi | |
| license: cc-by-nc-4.0 | |
| extra_gated_prompt: "By submitting this form, you agree to the [License Agreement](https://cohere.com/c4ai-cc-by-nc-license)\ | |
| \ and acknowledge that the information you provide will be collected, used, and\ | |
| \ shared in accordance with Cohere\u2019s [Privacy Policy]( https://cohere.com/privacy).\ | |
| \ You\u2019ll receive email updates about C4AI and Cohere research, events, products\ | |
| \ and services. You can unsubscribe at any time." | |
| extra_gated_fields: | |
| Name: text | |
| Affiliation: text | |
| Country: country | |
| I agree to use this model for non-commercial use ONLY: checkbox | |
| tags: | |
| - abliterated | |
| - uncensored | |
| base_model: | |
| - CohereForAI/aya-expanse-8b | |
| # aya-expanse-8b-abliterated GGUF Quantized Models | |
| ## Technical Details | |
| - **Quantization Tool:** llama.cpp | |
| - **Version:** version: 5340 (15e6125a) | |
| ## Model Information | |
| - **Base Model:** [huihui-ai/aya-expanse-8b-abliterated](https://huggingface.co/huihui-ai/aya-expanse-8b-abliterated) | |
| - **Quantized by:** [oncu](https://huggingface.co/oncu) | |
| ## Available Files | |
| | 🚀 Download | 🔢 Type | 📝 Description | | |
| |------------|---------|---------------| | |
| | [Download](https://huggingface.co/oncu/aya-expanse-8b-abliterated-GGUF/resolve/main/aya-expanse-8b-abliterated.q4_k_m.gguf) | Q4 K M | 4-bit balanced (recommended default) | | |
| 💡 **Q4 K M** provides the best balance for most use cases |