Oh ok. Thank you for your quick reply. Let me breakdown what you typed to make sure I understood.
I can use the visionencoderdecoder with say a ViT vision model pre training and a nlp distilbert pre training base or distilbert for sequence classification, and then I can use the combined model for multi label classification with image and text pairs?
~john