Yusuke Hiratsuka, Sang-Yeon Suh, David Hui, Tatsuya Morita, Masanori Mori, Shunsuke Oyamada, Koji Amano, Kengo Imai, Mika Baba, Hiroyuki Kohara, Takayuki Hisanaga, Isseki Maeda, Jun Hamano, Akira Inoue
Are Prognostic Scores Better Than Clinician Judgment? A Prospective Study Using Three Models
Journal of pain and symptom management
medical knowledge general surgery residents assessed american board surgery training examination absite asbite score reports contain many metrics residency directors utilize assess resident progress perform program evaluation purpose study develop framework evaluate program effectiveness teaching specific subtest subtopic areas absite using absite score reports indicator aim demonstrate identification topic areas weakness programwide performance absite guide proposed modification general surgery residency program curriculum initiate development data visualizing dashboard communicate metrics single institution retrospective study performed utilizing absite score reports general surgery residents large academic training program 2017 2020 absite performance metrics 320 unique records entered database statistical analysis linear trends variance conducted standard scores subtest standard scores incorrect subtest topics deviation national average scores calculated subtracting national average score subtest score trainee data displayed medians proportions displayed optimize visualization proofofconcept development program dashboard trends variance general surgery program cohort performance various elements absite visualized using figures tables represent prototype program dashboard figure a1 demonstrates one example heatmap displays median deviation national average scores subtest program year boxplots show distribution deviation national average range national average scores recorded scores subtest program year trends median deviation national average scores displayed program year paneled subtest exam year paneled cohort median change overall test scores one program year another cohort visualized table bar graphs show often missed topics across program years heatmaps generated showing proportion times topic missed subtest exam year demonstrate use absite reports identify specific thematic areas opportunities curriculum modification innovation element program evaluation study demonstrate data analysis visualization feasibility creation program absite dashboard pad enhances use absite reports formative program evaluation guide modifications surgery program curriculum educational practices