Results. The comparison of our experimental re-
sults is presented in Table 1. We report the average
performance of 45 tasks on 9 of the 10 previously
described apps. Notably, we excluded Lightroom
from this evaluation, as assessing task completion
in this application presented inherent ambiguities.
As demonstrated, our simplified action space sig-
nificantly improves the performance of the GPT-4
baseline. Our observations indicate that LLM strug-
gles with producing accurate xy coordinates, while
our simplified action space eliminates this challeng-
ing requirement. Additionally, documents gener-
ated through autonomous exploration and observ-

ing human demonstrations proved to be highly ef-
fective. Their results consistently outperformed the
GPT-4 baseline and are comparable to the results
of human-written documents, which highlights the
efficacy of our design in enhancing the agent’s per-
formance across a diverse set of applications.
AppAgents