title: AUITestAgent: Automatic Requirements Oriented GUI Function Testing
summary: The Graphical User Interface (GUI) is how users interact with mobile apps. To
  ensure it functions properly, testing engineers have to make sure it functions
  as intended, based on test requirements that are typically written in natural
  language. While widely adopted manual testing and script-based methods are
  effective, they demand substantial effort due to the vast number of GUI pages
  and rapid iterations in modern mobile apps. This paper introduces AUITestAgent,
  the first automatic, natural language-driven GUI testing tool for mobile apps,
  capable of fully automating the entire process of GUI interaction and function
  verification. Since test requirements typically contain interaction commands
  and verification oracles. AUITestAgent can extract GUI interactions from test
  requirements via dynamically organized agents. Then, AUITestAgent employs a
  multi-dimensional data extraction strategy to retrieve data relevant to the
  test requirements from the interaction trace and perform verification.
  Experiments on customized benchmarks demonstrate that AUITestAgent outperforms
  existing tools in the quality of generated GUI interactions and achieved the
  accuracy of verifications of 94%. Moreover, field deployment in Meituan has
  shown AUITestAgent's practical usability, with it detecting 4 new functional
  bugs during 10 regression tests in two months.
paper_authors._id: 669743039e8a313c65609cce
paper_authors.name: Yongxiang Hu
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-07-18T09:06:40.317Z
paper_authors._id: 6695dc78b8a00bc24da0a56e
paper_authors.avatarUrl: /avatars/de6862c0d535844a24bb65a1d09098bf.svg
paper_authors.fullname: Yongxiang Hu
paper_authors.type: user
paper_authors.user: Gootter12
paper_authors._id: 669743039e8a313c65609ccf
paper_authors.name: Xuan Wang
paper_authors._id: 669743039e8a313c65609cd0
paper_authors.name: Yingchuan Wang
paper_authors._id: 669743039e8a313c65609cd1
paper_authors.name: Yu Zhang
paper_authors._id: 669743039e8a313c65609cd2
paper_authors.name: Shiyu Guo
paper_authors._id: 669743039e8a313c65609cd3
paper_authors.name: Chaoyi Chen
paper_authors._id: 669743039e8a313c65609cd4
paper_authors.name: Xin Wang
paper_authors._id: 669743039e8a313c65609cd5
paper_authors.name: Yangfan Zhou
paper_title: AUITestAgent: Automatic Requirements Oriented GUI Function Testing
paper_summary: The Graphical User Interface (GUI) is how users interact with mobile apps. To
  ensure it functions properly, testing engineers have to make sure it functions
  as intended, based on test requirements that are typically written in natural
  language. While widely adopted manual testing and script-based methods are
  effective, they demand substantial effort due to the vast number of GUI pages
  and rapid iterations in modern mobile apps. This paper introduces AUITestAgent,
  the first automatic, natural language-driven GUI testing tool for mobile apps,
  capable of fully automating the entire process of GUI interaction and function
  verification. Since test requirements typically contain interaction commands
  and verification oracles. AUITestAgent can extract GUI interactions from test
  requirements via dynamically organized agents. Then, AUITestAgent employs a
  multi-dimensional data extraction strategy to retrieve data relevant to the
  test requirements from the interaction trace and perform verification.
  Experiments on customized benchmarks demonstrate that AUITestAgent outperforms
  existing tools in the quality of generated GUI interactions and achieved the
  accuracy of verifications of 94%. Moreover, field deployment in Meituan has
  shown AUITestAgent's practical usability, with it detecting 4 new functional
  bugs during 10 regression tests in two months.