Bart Verheij
Analyzing the Simonshaven Case With and Without Probabilities
Topics in cognitive science
internetbased health education increasingly vital patient care however readability online information often exceeds average reading level us population limiting accessibility comprehension study investigates use chatbot artificial intelligence improve readability cancerrelated patientfacing content used chatgpt 40 rewrite content breast colon lung prostate pancreas cancer across 34 websites associated nccn member institutions readability analyzed using fry readability score fleschkincaid grade level gunning fog index simple measure gobbledygook primary outcome mean readability score original artificial intelligence aigenerated content secondary outcomes assessed accuracy similarity quality using f1 scores cosine similarity scores section 2 discern instrument respectively mean readability level across 34 websites equivalent university freshman level grade 1315 however chatgpts intervention aigenerated outputs mean readability score equivalent high school freshman education level grade 908 overall f1 score rewritten content 087 precision score 0934 recall score 0814 compared original counterparts airewritten content cosine similarity score 0915 95 ci 09080922 improved readability attributed simpler words shorter sentences mean discern score random sample aigenerated content equivalent good 2855 significant differences compared original counterparts study demonstrates potential ai chatbots improve readability patientfacing content maintaining content quality decrease requisite literacy ai revision emphasizes potential technology reduce health care disparities caused mismatch educational resources available patient health literacy