Machine Learning, NLP, Computer Vision, Information Retrieval, Transformers.
of 400 milion (text, image) pairs from the web without any human labeling, and jointly learn representations for the text and the images in a contrastive setting; where the model maximizes the similarity for positive (text, image) pairs and pushes away the negative pairs. The extensiveness of the