UltraMerge-7B

This model is an experimental DPO fine-tune of automerger/YamShadow-7B on the following datasets:

I have no idea about what's the best chat template. Probably Mistral-Instruct or ChatML.

Safetensors

Model size

7.24B params

Tensor type

FP16

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for mlabonne/UltraMerge-7B

Finetunes

Merges

Quantizations