transformers gguf merge mergekit lazymergekit vllm bfloat16 llama text-generation en base_model:DreadPoor/Aspire-8B-model_stock base_model:merge:DreadPoor/Aspire-8B-model_stock base_model:DreadPoor/Heart_Stolen-8B-Model_Stock base_model:merge:DreadPoor/Heart_Stolen-8B-Model_Stock base_model:Khetterman/CursedMatrix-8B-v9 base_model:merge:Khetterman/CursedMatrix-8B-v9 license:apache-2.0 endpoints_compatible region:us conversational
---
base_model:
- DreadPoor/Aspire-8B-model_stock
- DreadPoor/Heart_Stolen-8B-Model_Stock
- Khetterman/CursedMatrix-8B-v9
language:
- en
library_name: transformers
license: apache-2.0
pipeline_tag: text-generation
tags:
- merge
- mergekit
- lazymergekit
- vllm
- bfloat16
- llama
---

[![QuantFactory Banner](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeiuCm7c8lEwEJuRey9kiVZsRn2W-b4pWlu3-X534V3YmVuVc2ZL-NXg2RkzSOOS2JXGHutDuyyNAUtdJI65jGTo8jT9Y99tMi4H4MqL44Uc5QKG77B0d6-JfIkZHFaUA71-RtjyYZWVIhqsNZcx8-OMaA?key=xt3VSDoCbmTY7o-cwwOFwQ)](https://hf.co/QuantFactory)


# QuantFactory/L3-Aspire-Heart-Matrix-8B-GGUF
This is quantized version of [ZeroXClem/L3-Aspire-Heart-Matrix-8B](https://huggingface.co/ZeroXClem/L3-Aspire-Heart-Matrix-8B) created using llama.cpp

# Original Model Card


# ZeroXClem/L3-Aspire-Heart-Matrix-8B

**ZeroXClem/L3-Aspire-Heart-Matrix-8B** is an experimental language model crafted by merging three high-quality 8B parameter models using the **Model Stock Merge** method. This synthesis leverages the unique strengths of Aspire, Heart Stolen, and CursedMatrix, creating a highly versatile and robust language model for a wide array of tasks.


## 🌟 Model Details

- **Name:** `ZeroXClem/L3-Aspire-Heart-Matrix-8B`
- **Base Model:** `Khetterman/CursedMatrix-8B-v9`
- **Merge Method:** `Model Stock`
- **Parameter Count:** `8 billion`
- **Precision:** `bfloat16`

---

## 📋 Models Used in the Merge

1. **[Aspire](https://huggingface.co/DreadPoor/Aspire-8B-model_stock)**  
   *Creator: DreadPoor*  
   Known for exceptional performance across diverse tasks and benchmarks.

2. **[Heart Stolen](https://huggingface.co/DreadPoor/Heart_Stolen-8B-Model_Stock)**  
   *Creator: DreadPoor*  
   Renowned for its creative and empathetic prowess.

3. **[CursedMatrix](https://huggingface.co/Khetterman/CursedMatrix-8B-v9)**  
   *Creator: Khetterman*  
   Famous for its depth and complexity, particularly in creative writing and roleplay.

---

## ⚙️ Merge Configuration

```yaml
models:
  - model: DreadPoor/Aspire-8B-model_stock
  - model: DreadPoor/Heart_Stolen-8B-Model_Stock
  - model: Khetterman/CursedMatrix-8B-v9
merge_method: model_stock
base_model: Khetterman/CursedMatrix-8B-v9
normalize: false
int8_mask: true
dtype: bfloat16
```

---

## 🌌 Model Capabilities

This powerful merger unites the best features of its components:  

- **Aspire**: Outstanding performance across general tasks and benchmarks.  
- **Heart Stolen**: Creativity and empathy at its core.  
- **CursedMatrix**: Mastery of complex and dynamic text generation.  

The resulting model excels in:

- 🌟 **General Question Answering**  
- 📝 **Creative Writing**  
- ✂️ **Summarizing Long-Form Content**  
- 🎭 **Roleplay Scenarios**  
- ✅ **Task Completion and Problem-Solving**

---

## 🛠️ Usage

This model is compatible with popular inference frameworks, including:

- [vLLM](https://github.com/vllm-project/vllm)  
- [LMStudio](https://lmstudio.ai/)  
- Hugging Face Transformers and other major libraries.  


```python
from transformers import AutoTokenizer, AutoModelForCausalLM

model_name = "ZeroXClem/L3-Aspire-Heart-Matrix-8B"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name)

input_text = "What are the fundamentals of python programming?"
input_ids = tokenizer.encode(input_text, return_tensors="pt")
output = model.generate(input_ids, max_length=100)
response = tokenizer.decode(output[0], skip_special_tokens=True)
print(response)
```

Whether you're fine-tuning for specific tasks or using it out of the box, this model is a good base for your applications. 

*Please give us any feedback if issues arise during inference via the discussions tab.* 

---

## ⚖️ Ethical Considerations

Given its uncensored origins and the potential for emergent behaviors, users should exercise caution. Be mindful of:

- Potential biases in outputs.  
- Unexpected or unpredictable behavior in uncensored settings.  

**Best Practices:** Implement robust content filtering and ensure responsible deployment in production environments.

---

## 🙏 Acknowledgements

A heartfelt thank-you to the creators of the original models:

- **DreadPoor** for [Aspire](https://huggingface.co/DreadPoor/Aspire-8B-model_stock) and [Heart Stolen](https://huggingface.co/DreadPoor/Heart_Stolen-8B-Model_Stock).  
- **Khetterman** for [CursedMatrix](https://huggingface.co/Khetterman/CursedMatrix-8B-v9).  

Your brilliant contributions made this merge a reality.

---

## 📜 License

This model inherits the licensing terms of its base components. Please refer to the licenses of:

- [Aspire](https://huggingface.co/DreadPoor/Aspire-8B-model_stock)  
- [Heart Stolen](https://huggingface.co/DreadPoor/Heart_Stolen-8B-Model_Stock)  
- [CursedMatrix](https://huggingface.co/Khetterman/CursedMatrix-8B-v9)  

Ensure compliance with all licensing requirements when using this model.

---
