pritamqu/LLaVA-Video-7B-Qwen2-RRPO-16f

Installation

Clone the repository and navigate to the RRPO directory:

git clone https://github.com/pritamqu/RRPO
cd RRPO

conda create -n llava python=3.10 -y
conda activate llava
pip install -r llavavideo.txt

Download weights

git clone [email protected]:pritamqu/LLaVA-Video-7B-Qwen2-RRPO-16f

Inference

conda activate llava
WEIGHTS_ROOT="./"

## using merged weights
python inference.py \
    --base_model_name "llavavideo_qwen_7b" \
    --model-path ${WEIGHTS_ROOT}"/LLaVA-Video-7B-Qwen2-RRPO-16f" \
    --video_path "sample_video.mp4" \
    --question "Describe this video." \
    --model_max_length 1024