Lucy Beasant, Jenny Ingram, Pauline M Emmett, Janet E Cade, Caroline M Taylor
Adherence to the national guidance on foods and drinks to limit or avoid during pregnancy in England: the PEAR Study
Public health nutrition
benign prostatic hyperplasia bph common condition yet challenging average bph patient find credible accurate information bph goal evaluate compare accuracy reproducibility large language models llms including chatgpt35 chatgpt4 new bing chat responding bph frequently asked questions faqs questionnaire total 45 questions related bph categorized basic professional knowledge three llmchatgpt35 chatgpt4 new bing chatwere utilized generate responses questions responses graded comprehensive correct inadequate mixed incorrectoutdated data completely incorrect reproducibility assessed generating two responses question responses reviewed judged experienced urologists three llms exhibited high accuracy generating responses questions accuracy rates ranging 867 100 however statistically significant difference response accuracy among three p 0017 comparisons additionally accuracy llms responses basic knowledge questions roughly equivalent specialized knowledge questions showing difference less 35 gpt35 90 vs 867 gpt4 967 vs 956 new bing 967 vs 933 furthermore three llms demonstrated high reproducibility rates ranging 933 978 chatgpt35 chatgpt4 new bing chat offer accurate reproducible responses bphrelated questions establishing valuable resources enhancing health literacy supporting bph patients conjunction healthcare professionals