Establishing External Validity

Convergent and Discriminant Validity: The convergent and discriminant validity
of a test are classically evaluated in psychometrics using Campbell and Fiske [77]’s
framework. In this framework, a test’s convergent validity is established by “sufficiently
large” correlations with separate tests meant to measure the same target construct.
For example, to validate a new test measuring depression, one could calculate the test’s
convergent correlations with the Beck Depression Inventory (BDI) [78]—a widely-used
measure of depression. To evaluate the discriminant validity of a test, psychometricians
commonly gauge the extent to which the test’s convergent correlations are stronger
than its discriminant correlations—its correlations with test of other constructs. As
a concrete example, a new test of depression should correlate more strongly with the
BDI than with, say, a test measuring English proficiency.
PersonalityTraitsinLargeLanguageModels