Muneera Essa Alzeer, AlBandary Hassan AlJameel, Kasper Rosing, Esben Boeskov Øzhayat
Validation of an Arabic version of the short form of the health literacy in dentistry scale: a cross-sectional study
BMC oral health
advances artificial intelligence ai given rise sophisticated algorithms capable generating humanlike text goal study evaluate ability human reviewers reliably differentiate personal statements ps written human authors generated ai software four personal statements archives two surgical program directors deidentified used human samples two ai platforms used generate nine additional ps four surgeons residency selection committees two surgical residency programs large multihospital system served blinded reviewers ai also asked evaluate ps sample authorship sensitivity specificity accuracy reviewers identifying ps author calculated kappa statistic correlation hypothesized author true author calculated interrater reliability calculated using kappa statistic lights modification given two reviewers fullycrossed design logistic regression performed model impact perceived creativity writing quality authorship likelihood offering interview human reviewer sensitivity identifying aigenerated ps 087 specificity 037 overall accuracy 055 level agreement kappa statistic reviewer estimate authorship true authorship 019 slight agreement reviewers interrater reliability 0067 poor complete agreement four four reviewers two ps authored humans odds ratio offering interview compared composite backup status interview perceived human author 7 times perceived ai author 95 confidence interval 15276 320758 p00144 ai hypothesized human authorship twelve ps last one unsure increasing pervasiveness ai farreaching effects including resident application recruitment process identifying aigenerated personal statements exceedingly difficult decreasing availability objective data assess applicants review potential restructuring approach resident recruitment may warranted