Driess, D., Ha, J.-S., and Toussaint, M. Deep visual rea-
soning: Learning to predict action sequences for task and
motion planning from an initial scene image. In Proc. of
Robotics: Science and Systems (R:SS), 2020.

Gan, Z., Li, L., Li, C., Wang, L., Liu, Z., Gao, J., et al.
Vision-language pre-training: Basics, recent advances,
and future trends. Foundations and Trends® in Computer
Graphics and Vision, 14(3–4):163–352, 2022.

Glaese, A., McAleese, N., Trebacz, M., Aslanides, J., Firoiu,
V., Ewalds, T., Rauh, M., Weidinger, L., Chadwick, M.,
Thacker, P., et al.
Improving alignment of dialogue
agents via targeted human judgements. arXiv preprint
arXiv:2209.14375, 2022.

Goyal, Y., Khot, T., Summers-Stay, D., Batra, D., and
Parikh, D. Making the V in VQA matter: Elevating
the role of image understanding in Visual Question An-
swering. In Conference on Computer Vision and Pattern
Recognition (CVPR), 2017.
PaLM-E- An Embodied Multimodal Language Model