  Multilingual (or cross-lingual) embeddings represent several languages in a
unique vector space. Using a common embedding space enables for a shared
semantic between words from different languages. In this paper, we propose to
embed images and texts into a unique distributional vector space, enabling to
search images by using text queries expressing information needs related to the
(visual) content of images, as well as using image similarity. Our framework
forces the representation of an image to be similar to the representation of
the text that describes it. Moreover, by using multilingual embeddings we
ensure that words from two different languages have close descriptors and thus
are attached to similar images. We provide experimental evidence of the
efficiency of our approach by experimenting it on two datasets: Common Objects
in COntext (COCO) [19] and Multi30K [7].

Computer Vision and Pattern Recognition;Computation and Language