|
--- |
|
library_name: transformers |
|
license: apache-2.0 |
|
--- |
|
|
|
<img src="https://huggingface.co/Radiantloom/radintloom-mistral-7b-fusion/resolve/main/Radiantloom Mistral 7B Fusion.png" alt="Radiantloom Mistral 7B Fusion" width="800" style="margin-left:'auto' margin-right:'auto' display:'block'"/> |
|
|
|
## Radiantloom Mistral 7B Fusion DPO |
|
|
|
This model is a finetuned version of [Radiantloom Mistral 7B Fusion](https://huggingface.co/Radiantloom/radintloom-mistral-7b-fusion). It was finetuned using Direct Preference Optimization (DPO). |