Nicole V Carrabba, Joshua Ong, Ashtyn Z Vogt, Nicholas J Panzo, Hamza Memon, Virginia A Lee, Ethan Waisberg, Prithul Sarker, Nasif Zaman, Alireza Tavakkoli, Noor A Laylani, Andrew G Lee
National Football League Game Officials Self-Rating of Knowledge in Neuro-Ophthalmic Principles and Practice: A Pilot Program to Improve Precision and Accuracy of Game Official Calls
Journal of neuro-ophthalmology : the official journal of the North American Neuro-Ophthalmology Society
dermatologic patient education materials pems often written national average seventh eighthgrade reading level chatgpt35 gpt4 dermgpt docsgpt large language models llms responsive user prompts project assesses use generating dermatologic pems specified reading levels study aims assess ability select llms generate pems common rare dermatologic conditions unspecified specified reading levels study aims assess preservation meaning across llmgenerated pems assessed dermatology resident trainees fleschkincaid reading level fkrl current american academy dermatology pems evaluated 4 common atopic dermatitis acne vulgaris psoriasis herpes zoster 4 rare epidermolysis bullosa bullous pemphigoid lamellar ichthyosis lichen planus dermatologic conditions prompted chatgpt35 gpt4 dermgpt docsgpt create patient education handout condition fkrl iteratively generate 10 pems per condition unspecified fifth seventhgrade fkrls evaluated microsoft word readability statistics preservation meaning across llms assessed 2 dermatology resident trainees current american academy dermatology pems average sd fkrl 935 126 950 23 common rare diseases respectively common diseases fkrls llmproduced pems ranged 98 1121 unspecified prompt 422 743 fifthgrade prompt 598 728 seventhgrade prompt rare diseases fkrls llmproduced pems ranged 985 1145 unspecified prompt 422 743 fifthgrade prompt 598 728 seventhgrade prompt fifthgrade reading level gpt4 better producing pems common rare conditions chatgpt35 p001 p01 respectively dermgpt p001 p03 respectively docsgpt p001 p02 respectively seventhgrade reading level significant difference found chatgpt35 gpt4 docsgpt dermgpt producing pems common conditions p05 however rare conditions chatgpt35 docsgpt outperformed gpt4 p003 p001 respectively preservation meaning analysis revealed common conditions dermgpt ranked highest overall ease reading patient understandability accuracy 147515 98 rare conditions handouts generated gpt4 ranked highest 14515 97 gpt4 appeared outperform chatgpt35 docsgpt dermgpt fifthgrade fkrl common rare conditions although chatgpt35 docsgpt performed better gpt4 seventhgrade fkrl rare conditions llmproduced pems may reliably meet seventhgrade fkrls select common rare dermatologic conditions easy read understandable patients mostly accurate llms may play role enhancing health literacy disseminating accessible understandable pems dermatology