Rachel Kidman, James Mwera, Yang Tingting Rui, Etienne Breton, Andrew Zulu, Jere Behrman, Hans-Peter Kohler
Cohort profile: the Adverse Childhood Experiences cohort of the Malawi Longitudinal Study of Families and Health
BMJ open
background generating radiologic findings chest radiographs pivotal medical image analysis emergence openais generative pretrained transformer gpt4 vision gpt4v opened new perspectives potential automated imagetext pair generation however application gpt4v realworld chest radiography yet thoroughly examined purpose investigate capability gpt4v generate radiologic findings realworld chest radiographs materials methods retrospective study 100 chest radiographs freetext radiology reports annotated cohort radiologists two attending physicians three residents establish reference standard 100 chest radiographs 50 randomly selected national institutes health nih chest radiographic data set 50 randomly selected medical imaging data resource center midrc performance gpt4v detecting imaging findings chest radiograph assessed zeroshot setting operates without prior examples fewshot setting operates two examples outcomes compared reference standard regards clinical conditions corresponding codes international statistical classification diseases tenth revision icd10 including anatomic location hereafter laterality results zeroshot setting task detecting icd10 codes alone gpt4v attained average positive predictive value ppv 123 average truepositive rate tpr 58 average f1 score 73 nih data set average ppv 250 average tpr 168 average f1 score 182 midrc data set icd10 codes corresponding laterality considered gpt4v produced average ppv 78 average tpr 35 average f1 score 45 nih data set average ppv 109 average tpr 49 average f1 score 64 midrc data set fewshot learning gpt4v showed improved performance data sets contrasting zeroshot fewshot learning improved average tprs f1 scores fewshot setting substantial increase average ppv conclusion although gpt4v shown promise understanding natural images limited effectiveness interpreting realworld chest radiographs rsna 2024 supplemental material available article