config conversion from llava repo

#2
by mjbooo - opened

Hi, I trained a custom LLaVA model using the original author's repository (https://github.com/haotian-liu/LLaVA). I want to load the checkpoint using LlavaForConditionalGeneration, but I'm unable to do so. Is there a way to achieve this?

Thank you for the great job, again!

Llava Hugging Face org

You can use this script (https://github.com/huggingface/transformers/blob/main/src/transformers/models/llava/convert_llava_weights_to_hf.py) to convert the weights from LLaVA format to HF format

You saved me
Thank you!

Sign up or log in to comment