README.md

metadata

library_name: transformers
license: apache-2.0

Radiantloom Mistral 7B Fusion DPO

This model is a finetuned version of Radiantloom Mistral 7B Fusion. It was finetuned using Direct Preference Optimization (DPO).