Georgios D Sideridis, Cengiz Zopluoglu
Validation of Response Similarity Analysis for the Detection of Academic Cheating: An Experimental Study
Journal of applied measurement
aimed define capability three different publicly available large language models chat generative pretrained transformer chatgpt35 chatgpt4 google gemini analysing retinal detachment cases suggesting best possible surgical planning analysis 54 retinal detachments records entered chatgpt geminis interfaces asking specify kind surgical planning would suggest eventual intraocular tamponade collecting given answers assessed level agreement common opinion three expert vitreoretinal surgeons moreover chatgpt gemini answers graded 15 poor excellent quality according global quality score gqs excluding 4 controversial cases 50 cases included overall chatgpt35 chatgpt4 google gemini surgical choices agreed vitreoretinal surgeons 4050 80 4250 84 3550 70 cases google gemini able respond five cases contingency analysis showed significant differences chatgpt4 gemini p003 chatgpts gqs 3908 4207 versions 35 4 gemini scored 3511 statistical difference two chatgpts p022 outperformed gemini scores p003 p0002 respectively main source error endotamponade choice 14 chatgpt35 4 12 google gemini chatgpt4 able suggest combined phacovitrectomy approach conclusion google gemini chatgpt evaluated vitreoretinal patients records coherent manner showing good level agreement expert surgeons according gqs chatgpts recommendations much accurate precise