Is the lora checkpoint available?
In the introduction, we are not provided with a checkpoint path. And there is not a significant difference between lora and full in the files. So is there a way to load the lora model for training or practical use. Thanks!
Hi
@xiguo4433
, did you mean that you’re looking for the LoRA version of VLM2Vec? We’ve provided several LoRA versions based on Phi-3.5v, LLaVA-Next, Qwen2-VL-2B, and Qwen2-VL-7B. You can refer to them here: https://huggingface.co/collections/TIGER-Lab/vlm2vec-6705f418271d085836e0cdd5
For the performance of these models, please refer to the README on our GitHub: https://github.com/TIGER-AI-Lab/VLM2Vec
Currently the Qwen-2-vl based VLM2Vec is the best one.
I just updated these links in the intro of the repo as well. Thanks!
I must show my sincere gratitude. This is useful to me.