Ahmed Almagazzachi, Ahmed Mustafa, Ashkan Eighaei Sedeh, Andres E Vazquez Gonzalez, Anastasiia Polianovskaia, Muhanad Abood, Ameer Abdelrahman, Veronica Muyolema Arce, Talar Acob, Bushra Saleem
Generative Artificial Intelligence in Patient Education: ChatGPT Takes on Hypertension Questions
Cureus
online health informationseeking surges concerns mount quality safety accessible content potentially leading patient harm misinformation one hand emergence artificial intelligence ai healthcare could prevent hand questions raise regarding quality safety medical information provided laryngeal cancer prevalent head neck malignancy study aims evaluate utility safety three large language models llms sources patient information laryngeal cancer crosssectional study conducted using three llms chatgpt 35 chatgpt 40 bard questionnaire comprising 36 inquiries laryngeal cancer categorised diagnosis 11 questions treatment 9 questions novelties upcoming treatments 4 questions controversies 8 questions sources information 4 questions population reviewers consisted 3 groups including ent specialists junior physicians nonmedicals graded responses physician evaluated question twice model nonmedicals everyone blinded model type question order shuffled outcome evaluations based safety score 13 global quality score gqs 15 results compared llms study included iterative assessments statistical validations analysis revealed chatgpt 35 scored highest safety mean 270 gqs mean 395 chatgpt 40 bard lower safety scores 256 242 respectively corresponding quality scores 365 338 interrater reliability consistent less 3 discrepancy 42 responses fell lowest safety category 1 particularly novelty category nonmedical reviewers quality assessments correlated moderately r 067 response length llms valuable resources patients seeking information laryngeal cancer chatgpt 35 provided reliable safe responses among models evaluated