Yee Hui Yeo|Jamil S. Samaan|Wee Han Ng|Peng?Sheng Ting|Hirsh Trivedi|Aarshi Vipani|Walid S. Ayoub|Ju Dong Yang|Omer Liran|Brennan Spiegel|Alexander Kuo
Assessing the performance of ChatGPT in answering questions regarding cirrhosis and hepatocellular carcinoma
Cedars-Sinai Medical Center|Cedars-Sinai Medical Center|University of Bristol|Tulane University|Cedars-Sinai Medical Center|Cedars-Sinai Medical Center|Cedars-Sinai Medical Center|Cedars-Sinai Medical Center|Cedars-Sinai Medical Center|Cedars-Sinai Medical Center|Cedars-Sinai Medical Center
backgroundaims patients cirrhosis hepatocellular carcinoma hcc require extensive personalized care improve outcomes chatgpt generative pretrained transformer large language model holds potential provide professional yet patientfriendly support aimed examine accuracy reproducibility chatgpt answering questions regarding knowledge management emotional support cirrhosis hccmethods chatgpts responses 164 questions independently graded two transplant hepatologists resolved third reviewer performance chatgpt also assessed using two published questionnaires 26 questions formulated quality measures cirrhosis management finally emotional support capacity testedresults showed chatgpt regurgitated extensive knowledge cirrhosis 791 correct hcc 740 correct small proportions 473 cirrhosis 411 hcc labeled comprehensive performance better basic knowledge lifestyle treatment domains diagnosis preventive medicine quality measures model answered 769 questions correctly failed specify decisionmaking cutoffs treatment durations chatgpt lacked knowledge regional guidelines variations hcc screening criteria however provided practical multifaceted advice patients caregivers regarding next steps adjusting new diagnosisconclusions analyzed areas robustness limitations chatgpts responses management cirrhosis hcc relevant emotional support chatgpt may role adjunct informational tool patients physicians improve outcomes