title: GPT Models Meet Robotic Applications: Co-Speech Gesturing Chat System
summary: This technical paper introduces a chatting robot system that utilizes recent
  advancements in large-scale language models (LLMs) such as GPT-3 and ChatGPT.
  The system is integrated with a co-speech gesture generation system, which
  selects appropriate gestures based on the conceptual meaning of speech. Our
  motivation is to explore ways of utilizing the recent progress in LLMs for
  practical robotic applications, which benefits the development of both chatbots
  and LLMs. Specifically, it enables the development of highly responsive chatbot
  systems by leveraging LLMs and adds visual effects to the user interface of
  LLMs as an additional value. The source code for the system is available on
  GitHub for our in-house robot
  (https://github.com/microsoft/LabanotationSuite/tree/master/MSRAbotChatSimulation)
  and GitHub for Toyota HSR
  (https://github.com/microsoft/GPT-Enabled-HSR-CoSpeechGestures).
paper_authors._id: 647ec078a49bffab5d75689d
paper_authors.name: Naoki Wake
paper_authors.status: extracted_confirmed
paper_authors.statusLastChangedAt: 2023-09-21T05:17:39.810Z
paper_authors._id: 650bd16424da30e773ec74ca
paper_authors.avatarUrl: /avatars/1ff8a1c9d4c6bde1893e4f80c5fd9fdb.svg
paper_authors.fullname: Wake
paper_authors.type: user
paper_authors.user: NaokiWake
paper_authors._id: 647ec078a49bffab5d75689e
paper_authors.name: Atsushi Kanehira
paper_authors._id: 647ec078a49bffab5d75689f
paper_authors.name: Kazuhiro Sasabuchi
paper_authors._id: 647ec078a49bffab5d7568a0
paper_authors.name: Jun Takamatsu
paper_authors._id: 647ec078a49bffab5d7568a1
paper_authors.name: Katsushi Ikeuchi
paper_title: GPT Models Meet Robotic Applications: Co-Speech Gesturing Chat System
paper_summary: This technical paper introduces a chatting robot system that utilizes recent
  advancements in large-scale language models (LLMs) such as GPT-3 and ChatGPT.
  The system is integrated with a co-speech gesture generation system, which
  selects appropriate gestures based on the conceptual meaning of speech. Our
  motivation is to explore ways of utilizing the recent progress in LLMs for
  practical robotic applications, which benefits the development of both chatbots
  and LLMs. Specifically, it enables the development of highly responsive chatbot
  systems by leveraging LLMs and adds visual effects to the user interface of
  LLMs as an additional value. The source code for the system is available on
  GitHub for our in-house robot
  (https://github.com/microsoft/LabanotationSuite/tree/master/MSRAbotChatSimulation)
  and GitHub for Toyota HSR
  (https://github.com/microsoft/GPT-Enabled-HSR-CoSpeechGestures).
paper_ai_keywords: large-scale language models (LLMs) GPT-3 ChatGPT co-speech gesture generation conceptual meaning Discrimin applications highly responsive chatbots visual effects user interface LLMs GitHub LabanotationSuite MSRAbotChatSimulation GPT-Enabled-HSR-CoSpeechGestures