title: LLaVA-Interactive: An All-in-One Demo for Image Chat, Segmentation,
    Generation and Editing
summary: LLaVA-Interactive is a research prototype for multimodal human-AI
  interaction. The system can have multi-turn dialogues with human users by
  taking multimodal user inputs and generating multimodal responses. Importantly,
  LLaVA-Interactive goes beyond language prompt, where visual prompt is enabled
  to align human intents in the interaction. The development of LLaVA-Interactive
  is extremely cost-efficient as the system combines three multimodal skills of
  pre-built AI models without additional model training: visual chat of LLaVA,
  image segmentation from SEEM, as well as image generation and editing from
  GLIGEN. A diverse set of application scenarios is presented to demonstrate the
  promises of LLaVA-Interactive and to inspire future research in multimodal
  interactive systems.
paper_authors._id: 65430d5fd292675f292f615d
paper_authors.name: Wei-Ge Chen
paper_authors._id: 65430d5fd292675f292f615e
paper_authors.name: Irina Spiridonova
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-11-02T11:36:59.850Z
paper_authors._id: 64dc0405ff83b3386a56677f
paper_authors.avatarUrl: /avatars/6acccc389f1b0c8956d601ccaaf4503d.svg
paper_authors.fullname: Irina Spiridonova
paper_authors.type: user
paper_authors.user: Irinasp
paper_authors._id: 65430d5fd292675f292f615f
paper_authors.name: Jianwei Yang
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-11-02T11:37:30.601Z
paper_authors._id: 6125df7f25027fb1ea9c7a41
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1629871954341-noauth.jpeg
paper_authors.fullname: Jianwei Yang
paper_authors.type: user
paper_authors.user: jw2yang
paper_authors._id: 65430d5fd292675f292f6160
paper_authors.name: Jianfeng Gao
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-11-02T11:37:37.725Z
paper_authors._id: 641904caf9d6f1d772ec7af7
paper_authors.avatarUrl: /avatars/4a63eac71eb30f70b1a0e9d4708f26c1.svg
paper_authors.fullname: Jianfeng Gao
paper_authors.type: user
paper_authors.user: wyngjf
paper_authors._id: 65430d5fd292675f292f6161
paper_authors.name: Chunyuan Li
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2023-11-02T11:37:45.100Z
paper_authors._id: 62aba526cae4462c0c6caa0f
paper_authors.avatarUrl: /avatars/430560ec2c2547f819225769ab432f30.svg
paper_authors.fullname: Chunyuan Li
paper_authors.type: user
paper_authors.user: Chunyuan24
paper_title: LLaVA-Interactive: An All-in-One Demo for Image Chat, Segmentation,
    Generation and Editing
paper_summary: LLaVA-Interactive is a research prototype for multimodal human-AI
  interaction. The system can have multi-turn dialogues with human users by
  taking multimodal user inputs and generating multimodal responses. Importantly,
  LLaVA-Interactive goes beyond language prompt, where visual prompt is enabled
  to align human intents in the interaction. The development of LLaVA-Interactive
  is extremely cost-efficient as the system combines three multimodal skills of
  pre-built AI models without additional model training: visual chat of LLaVA,
  image segmentation from SEEM, as well as image generation and editing from
  GLIGEN. A diverse set of application scenarios is presented to demonstrate the
  promises of LLaVA-Interactive and to inspire future research in multimodal
  interactive systems.
paper_ai_keywords: LLaVA multimodal human-AI interaction multi-turn dialogues multimodal user inputs multimodal responses visual prompt human intents cost-efficient pre-built AI models visual chat image segmentation SEEM image generation GLIGEN multimodal interactive systems