Error while finetuning the model for ConditionalGeneration

#16
by alxenos - opened

Hi,
I am getting the following error when I'm trying to finetune the model in the forward call:

final_labels[batch_indices, text_to_overwrite] = labels[batch_indices, non_image_indices]
IndexError: index 8 is out of bounds for dimension 1 with size 8

The same code works fine if I just change the model to another VLLM like InstructBlip.

Thank you and kind regards,
Alexandros Xenos

Llava Hugging Face org

Hi,

Could you try when installing Transformers from source?

pip install git+https://github.com/huggingface/transformers.git

Cause we have recently included a bug fix which fixed LLaVa fine-tuning.

Hi nielsr,
Thank you so much for the fast reply! I am still getting the same error even though I noted that the bug fix regards the same bug...
When I am installing Transformers from source via "pip install git+https://github.com/huggingface/transformers.git" the transformers-4.38.0.dev0 version is installed. Is this correct?

Sign up or log in to comment