Stephen Gilbert|Alicia Mehl|Adel Baluch|Caoimhe Cawley|Jean Challiner|Hamish Fraser|Elizabeth Millen|Maryam Montazeri|Jan Multmeier|Fiona Pick|Claudia Richter|Ewelina Türk|Shubhanan Upadhyay|Vishaal Virani|Nicola Vona|Paul Wicks|Claire Novorol
How accurate are digital symptom assessment apps for suggesting conditions and urgency advice? A clinical vignettes comparison to GPs
objectives compare breadth condition coverage accuracy suggested conditions appropriateness urgency advice eight popular symptom assessment apps design vignettes study setting 200 primary care vignettes interventioncomparator eight apps seven general practitioners gps breadth coverage conditionsuggestion urgency advice accuracy measured vignettes goldstandard primary outcome measures 1 proportion conditions covered app excluded user youngold pregnant modelled 2 proportion vignettes correct primary diagnosis among top 3 conditions suggested 3 proportion safe urgency advice ie gold standard level conservative one level less conservative results conditionsuggestion coverage highly variable apps offering suggestion many users alphabetical order ada 990 babylon 515 buoy 885 k health 745 mediktor 805 symptomate 615 yourmd 645 webmd 930 top3 suggestion accuracy gps average 82152 ada 705 babylon 320 buoy 430 k health 360 mediktor 360 symptomate 275 webmd 355 yourmd 235 apps excluded certain user demographics conditions performance generally greater exclusion corresponding vignettes safe urgency advice tested gps average 97025 vignettes advice provided three apps safety performance within 1 sd gpsada 970 babylon 951 symptomate 978 one app safety performance within 2 sds gpsyourmd 926 three apps safety performance outside 2 sds gpsbuoy 800 plt0001 k health 813 plt0001 mediktor 873 p1310 3 conclusions utility digital symptom assessment apps relies coverage accuracy safety digital tool outperformed gps came close nature iterative improvements software offers scalable improvements care