There he works on deep learning approaches to understanding and generating language, images and other modalities, with applications ranging from machine translation to image super-resolution. He previously started and led the team that designed and maintained the semantic parser behind the Google Assistant, after working on Google Translate in its earlier years. His research interests revolve around models that learn from weak supervision how to understand and ultimately interact with the world through language and vision.