Deep Learning, Artificial Intelligence, Vision Language Model, Bert, Contrastive Learning.
(MTL) The discrete token sequence is defined as h=[w, q]. At each iteration, each input token in h is randomly masked with probability 15%, and replaced with a special token [MASK]. The goal of training is to predict these masked tokens based on their surrounding tokens h\i and all image features v