Mei-Chuan Chang, Jui-Hung Yu, Jyh-Gang Hsieh, Mi-Hsiu Wei, Ying-Wei Wang
Effectiveness of the refined health literacy course on improving the health literacy competencies of undergraduate nursing students: quantitative and qualitative perspectives
Medical education online
study aims compare performance chatgpt35 gpt35 chatgpt4 gpt4 american society surgery hand assh selfassessment examination sae determine potential educational tools study assessed proportion correct answers textbased questions 2021 2022 assh sae untrained chatgpt versions secondary analyses assessed performance chatgpt based question difficulty question category outcomes chatgpt compared performance actual examinees assh sae total 238 questions included analysis compared gpt35 gpt4 provided significantly correct answers overall 580 versus 689 respectivelyp 0013 2022 sae 559 versus 729 p 0007 difficult questions 488 versus 636 p 002 multivariable logistic regression analysis correct answers predicted gpt4 odds ratio 166 p 0011 increased question difficulty 059 p 0009 bone joint questions 018 p 0001 soft tissue questions 030 p 0013 actual examinees scored mean 216 gpt35 107 gpt4 mean percentage correct answers actual examinees significantly higher correct versus incorrect chatgpt answers gpt4 demonstrated improved performance gpt35 assh sae especially difficult questions actual examinees scored higher versions chatgpt margin cut half gpt4