3
2
0
2

 

v
o
N
0
1

 

 
 
]
I

A
.
s
c
[
 
 

1
v
7
9
9
5
0

.

1
1
3
2
:
v
i
X
r
a

JARVIS-1: Open-world Multi-task Agents
with Memory-Augmented Multimodal Language Models

Zihao Wang1,2, Shaofei Cai1,2, Anji Liu3, Yonggang Jin4, Jinbing Hou4, Bowei Zhang5, Haowei Lin1,2,

Zhaofeng He4, Zilong Zheng6, Yaodong Yang1, Xiaojian Ma6†, Yitao Liang1†

November 13, 2023

Team CraftJarvis

1Institute for Artificial Intelligence, Peking University

2School of Intelligence Science and Technology, Peking University

3Computer Science Department, University of California, Los Angeles

4Beijing University of Posts and Telecommunications

5School of Electronics Engineering and Computer Science, Peking University

6Beijing Institute for General Artificial Intelligence (BIGAI)

{zhwang,caishaofei}@stu.pku.edu.cn,liuanji@cs.ucla.edu,xiaojian.ma@ucla.edu,yitaol@pku.edu.cn

craftjarvis-jarvis1.github.io
JARVIS-1