Mark Lieber
Assessing the Mental Health Impact of the 2011 Great Japan Earthquake, Tsunami, and Radiation Disaster on Elementary and Middle School Children in the Fukushima Prefecture of Japan
PloS one
evaluated quality chatgpt responses questions obstructive sleep apnea patient education assessed prompting chatbot influences correctness estimated grade level references answers chatgpt queried 4 times 24 identical questions queries differed initial prompting prompting patientfriendly prompting physicianlevel prompting prompting statisticsreferences answers scored hierarchical scale incorrect partially correct correct correct either statistic referenced citation correct correct statistic citation perfect fleschkincaid grade level citation publication years recorded answers proportions responses incremental score thresholds compared prompt type using chisquared analysis relationship prompt type grade level assessed using analysis variance across prompts n 96 questions 69 answers 719 least correct proportions responses least partially correct p 387 correct p 453 differ prompt responses least correct p 001 perfect p 001 statisticsreferences prompting provided 7477 961 references responses patientfriendly prompting lower mean grade level 1245 232 prompting 1415 159 physicianlevel prompting 1427 209 statisticsreferences prompting 1500 226 p 0001 chatgpt overall provides appropriate answers questions obstructive sleep apnea regardless prompting prompting decreases response grade level responses remained accepted recommendations presenting medical information patients given chatgpts rapid implementation sleep experts may seek scrutinize medical literacy utility patients campbell dj estephan le mastrolonardo ev amin dr huntley ct boon ms evaluating chatgpt responses obstructive sleep apnea patient education j clin sleep med 2023191219891995