Rethinking Bottlenecks in Safety Fine-Tuning of Vision Language Models

motivation Our paper, code, data, models can be found at MIS.

Description

Qwen2-VL-7B-Instruct model fine-tuned on MIS training set.

MIRgae

mirage Here is example pipeline of MIS training set and MIRage safety CoT label construction.

You can fine-tune Qwen2-VL series using LlamaFactory.

Downloads last month
38
Safetensors
Model size
8.29B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Tuwhy/Qwen2-VL-7B-MIRage

Base model

Qwen/Qwen2-VL-7B
Finetuned
(249)
this model

Dataset used to train Tuwhy/Qwen2-VL-7B-MIRage

Collection including Tuwhy/Qwen2-VL-7B-MIRage