Hamna Mukhtar Tarar, Ayesha Azhar, Kiran Ismail, Malik Olatunde Oduoye, Omama Asim, Rida Omer
The influence of sociodemographic factors on parental health-seeking behavior for illnesses among the pediatric age group in Karachi: A cross-sectional study
Health science reports
increasing utilization large language models llms generative artificial intelligence across various medical dental fields specifically orthodontics raises questions accuracy study aimed assess compare answers offered four llms googles bard openais chatgpt35 chatgpt4 microsofts bing response clinically relevant questions within field orthodontics ten opentype clinical orthodonticsrelated questions posed llms responses provided llms assessed scale ranging 0 minimum 10 maximum points benchmarked robust scientific evidence including consensus statements systematic reviews using predefined rubric 4week interval initial evaluation answers reevaluated gauge intraevaluator reliability statistical comparisons conducted scores using friedmans wilcoxons tests identify model providing answers comprehensiveness scientific accuracy clarity relevance overall statistically significant differences scores given two evaluators scoring occasions detected average score every llm computed llm answers scoring highest microsoft bing chat average score 71 followed chatgpt 4 average score 47 google bard average score 46 finally chatgpt 35 average score 38 microsoft bing chat statistically outperformed chatgpt35 pvalue 0017 google bard pvalue 0029 well chat gpt4 outperformed chat gpt35 pvalue 0011 models occasionally produced answers lack comprehensiveness scientific accuracy clarity relevance questions asked indicative cover entire field orthodontics language models llms show great potential supporting evidencebased orthodontics however current limitations pose potential risk making incorrect healthcare decisions utilized without careful consideration consequently tools cannot serve substitute orthodontists essential critical thinking comprehensive subject knowledge effective integration practice research clinical validation enhancements models essential clinicians must mindful limitations llms imprudent utilization could adverse effects patient care