6.4 Analysis
Our experiment produced 100 sets of rank data, where each partici-
pant ranked the five conditions by believability. To translate this
rank data into interval data for interpretable comparison, we used
the ranks to calculate a TrueSkill rating [41] for each condition.
TrueSkill is a generalization of the Elo chess rating system [28] for
a multi-player environment, and has been used by XBox Live for
player ranking from competitive game performance. Given a set of
ranked outcomes, TrueSkill outputs a mean rating value 𝜇 and vari-
ance 𝜎 for each condition. Conditions with the same rating should
roughly be a toss-up, with each winning half of the comparisons
between the two conditions; higher scores indicate conditions that
beat lower-ranked conditions in the rankings.
Generative Agents- Interactive Simulacra of Human Behavior