Majid Aleissa, Hala Sakr, Rania Abdelhamid, Hassan Salheen, Ahmed Hafez, Sameera Alkhateeb, Sara Alrashed, Mohammed Alomeir
Media reporting of violence against children in the Eastern Mediterranean Region during the early days of COVID-19 pandemic
Eastern Mediterranean health journal = La revue de sante de la Mediterranee orientale = al-Majallah al-sihhiyah li-sharq al-mutawassit
creating medical exam questions time consuming wellwritten questions used testenhanced learning shown positive effect student learning automated generation highquality questions using large language models llms chatgpt would therefore desirable however current studies compare students performance llmgenerated questions questions developed humans authors compared student performance questions generated chatgpt llm questions questions created medical educators human questions two sets 25 multiplechoice questions mcqs created 5 answer options 1 correct first set questions written experienced medical educator second set created chatgpt 35 authors identified learning objectives extracted specifications human questions students answered questions random order formative paperandpencil test offered leading final summative neurophysiology exam summer 2023 question students also indicated whether thought written human chatgpt final data set consisted 161 participants 46 mcqs 25 human 21 llm questions statistically significant difference item difficulty 2 question sets discriminatory power statistically significantly higher human llm questions mean 36 standard deviation sd 09 vs mean 24 sd 14 p 001 average students identified 57 question sources human llm correctly future research replicate study procedure contexts eg medical subjects semesters countries languages addition question whether llms suitable generating different question types key feature questions investigated