Recent works that probe human traits in LLMs with psychometric tests utilize
test administration/simulation in ways that are unconventional in psychometrics. We
focus on two common elements. First, researchers collected LLM responses in the
form of generated completions, often in dialogue mode. For instance, [43] administered
psychological emotion measures to LLMs in the form of a research interview tran-
script, where a fictitious researcher posed measure items to a fictitious participant,
who was instructed to respond to these items on a numeric scale. In psychometrics,
questionnaire-based methods of assessment are distinct from interview-based meth-
ods. Human answers to both questionnaires and structured interviews measuring the
same underlying construct do not necessarily converge (e.g., in the case of measuring
personality disorders [44]). Indeed, administering questionnaires in this way to LLMs
PersonalityTraitsinLargeLanguageModels