transformers safetensors mistral text-generation conversational autotrain_compatible text-generation-inference endpoints_compatible region:us
---
{}
---

# DIBT-Mistral-7B-QLoRA

<!-- Provide a quick summary of what the model is/does. -->

Mistral 7B QLoRA fine-tuned on my dibt-instruct dataset.
## Model Details

### Model Description

<!-- Provide a longer summary of what this model is. -->

Mistral 7B fine-tuned on my dibt-instruct dataset. This model has a unique speaking style compared to most Mistral fine-tunes. Not sure if people prefers it but it's certainly different. 


- **Developed by:** Locutusque
- **Funded by :** Kaggle, Google
- **Shared by :** Hugging Face
- **Model type:** Decoder-only transformer
- **Language(s) (NLP):** English
- **License:** apache-2.0

## Uses

<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->

This model is one of the experts used in the MoE model "Hyperion-3.0-Mixtral-3x7B"

### Direct Use

<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->

General-purpose question answering. Can do a bit of coding. 

## Bias, Risks, and Limitations

<!-- This section is meant to convey both technical and sociotechnical limitations. -->

This model struggles sometimes with math, unless prompted with chain of thought. Inherets the writing style of Gemini Pro. 