After some brainstorming, we came with the following project ideas. Would love some feedback/opinion on the same.

ViT + mBART - Multilingual Image Captioning (WIT pre-train)
ViT + mBERT - Multilingual Visual Question Answering (WIT/COCO pre-train, test on VQA/GQA)
Use CLIP/VQGAN for Image Synthesis. A project has been proposed GIF generation. We can train on a different dataset/domain.

Possible modifications of CLIP/VQGAN:

Multilingual CLIP model for image/sentence matching + Image Generation using VQGAN for this dataset.
FashionCLIP- Train a model for Fashion image-text matching and VQGAN, trained to generate dress/shirt/glasses based on description. Dataset is hard to find, I guess.
Scene generation - CLIP + VQGAN, trained on text-scene dataset for scene (movie/landscape) generation.

Alternatively, can do similar things for video+text, following the example of VideoBERT and other transformers, maybe?
Please comment here if you are interested in collaboration. We are a team of 5 as of now (timezone GMT+5:30). Would also love any suggestions to improve these ideas.
Team:

@abheesht
@bhavitvyamalik
@Divyadixit
@gchhablani
@harsh68

Thanks,
Gunjan