observations and plans. As a result, JARVIS-1 needs to
produce multimodal queries based on the current task and
situations to retrieve the relevant memory entries.
Query generation via reasoning. When presented with
an instruction as a task, we employ query generation via
JARVIS-1