text:
Scroll to content Scroll To Top about-our-school attendance awards-illustration awards boy1 boy2 boy3 boy4 calendar email contact-details girl1 girl3 girl4 girl2 housepoints-illustration housepoints-icon links latestnews login map newsletters Twitter phone pop-out-arrow related-nav-arrow school-updates search translate Twitter Illustration usefullink log-out blog-watermark
St John the Baptist Church of England Primary School
I will shine"Let your light shine before others, that they may see your good deeds and glorify your father in heaven."Matthew 5:16
Being a Church School
Vision Summer Holiday Project
How do I know how my child is progressing?
What do I do if I have a concern about my child?
More information about support and intervention.
More information about the work of our pupil mentor.
More information about the SEND process.
Assessing your child's needs.
Using assessments to plan your child's support.
Planning and giving additional support.
Next steps if things still your child still doesn't make progress.
More information about our pupil mentor.
How will the school support SEND children?
What other support might be availabe for my child?
What to do if you have a complaint
Who's Who on the Governing Body
Governor Newsletters
Broadening Horizons - Picture News
Working Together - Helpful Information
Outdoor Learning at Home!
Year 5 Curriculum Overview
Homework Diaries
TIC TOC - Do you know how to protect children using it?
Momo Advice
Fortnite warning
New information sheet about YouTube
Warnings over Doki Doki Game
Keeping safe at Halloween and on Bonfire Night
Help understanding Fortnite
Set up You Tube in safety mode
Fortnite Advice Sheet for Parents
Support for e-Safety from O2
Outdoor Learning at Home
Summer Holiday Outdoor Adventures
Lockdown Time Capsule
Winter Safety Presentation
Cloakroom Care
Shoe Box appeal
Introducing our Police Cadets
School Council elections
Saint John's Ambassadors
Open Morning 2021
Well-Being at St Johns
School Money Payment System
We are committed to safeguarding the privacy of our website visitors and service users.
This policy applies where we are acting as a data controller with respect to the personal data of our website visitors and service users; in other words, where we determine the purposes and means of the processing of that personal data.
Our website incorporates privacy controls which affect how we will process your personal data.
In this policy, "we", "us" and "our" refers to our above school name only.
This document was created using a template from SEQ Legal (https://seqlegal.com).
In this Section we have set out:
We may process data about your use of our website. The usage data may include your IP address, geographical location, browser type and version, operating system, referral source, length of visit, page views and website navigation paths, as well as information about the timing, frequency and pattern of your service use. This usage data may be processed for the purposes of analysing the use of the website. The legal basis for this processing our legitimate interests, namely monitoring and improving our website.
We may process information that you provide to us for the purpose of subscribing to our email notifications and/or newsletters. The notification data may be processed for the purposes of sending you the relevant notifications and/or newsletters. The legal basis for this processing is our legitimate interests, namely the proper administration of our communications with users.
We may process information contained in or relating to any communication that you send to us. The correspondence data may include the communication content. The correspondence data may be processed for the purposes of communicating with you and record-keeping. The legal basis for this processing is our legitimate interests, namely the proper administration of our communications with users.
We may process any of your personal data identified in this policy where necessary for the establishment, exercise or defense of legal claims, whether in court proceedings or in an administrative or out-of-court procedure. The legal basis for this processing is necessary for compliance with a legal obligation to which the controller is subject.
We may process any of your personal data identified in this policy where necessary for the purposes of obtaining or maintaining insurance coverage, managing risks, or obtaining professional advice. The legal basis for this processing is our legal obligation to protect our school against risks.
Retaining and deleting personal data
This Section sets out our data retention policies and procedure, which are designed to help ensure that we comply with our legal obligations in relation to the retention and deletion of personal data.
Personal data that we process for any purpose or purposes shall not be kept for longer than is necessary for that purpose or those purposes.
In this Section, we have summarised the rights that you have under data protection law. Some of the rights are complex and not all of the details have been included in our summaries. Accordingly, you should read the relevant laws and guidance from the regulatory authorities for a full explanation of these rights.
You have the right to confirmation as to whether or not we process your personal data and, where we do, access to the personal data, together with certain additional information. That additional information includes details of the purposes of the processing, the categories of personal data concerned and the recipients of the personal data. Providing the rights and freedoms of others are not affected, we will supply to you a copy of your personal data.
In some circumstances you have the right to the erasure of your personal data without undue delay. Those circumstances include: the personal data are no longer necessary in relation to the purposes for which they were collected or otherwise processed; you object to the processing under certain rules of applicable data protection law. However, there are exclusions of the right to erasure. The general exclusions include where processing is necessary: for exercising the right of freedom of expression and information; for compliance with a legal obligation; or for the establishment, exercise or defence of legal claims.
You may exercise any of your rights in relation to your personal data by contacting us.
About cookies and web storage
A cookie is a file containing an identifier (a string of letters and numbers) that is sent by a web server to a web browser and is stored on your computer/device by the browser. The identifier is then sent back to the server each time the browser requests a page from the server.
Web storage, is a file containing an identifier (a string of letters and numbers) that is sent by a web server to a web browser and is stored on your computer/device by the browser. Web storage supports persistent data storage, similar to cookies but with a greatly enhanced capacity and is more secure
Cookies and web storage that we use
Authentication - we use cookies to identify you when you visit our website and as you navigate our website (cookies used for this purpose is: sessionid)
Status - we use cookies [to help us to determine if you are logged into our website (cookies used for this purpose is: sessionid)
Security - we use cookies as an element of the security measures used to protect user accounts, including preventing fraudulent use of login credentials, and to protect our website and services generally (cookies used for this purpose is: csrftoken)
Analysis - we use cookies to help us to analyse the use and performance of our website and services (cookies used for this purpose are: style and piwik visitor)
Cookie consent - we use web storage to store your preferences in relation to the use of cookies more generally (web storage used for this purpose is: cookiecheck)
We use Twitter to supply your twitter feed. This service uses cookies to allow the Twitter module to function correctly. You can view the privacy policy of this service provider at https://help.twitter.com/en/rules-and-policies/twitter-cookies The relevant cookies are: guest id and k
We use YouTube to embed YouTube videos. This service uses cookies for YouTube embedded videos to run correctly. You can view the privacy policy of this service provider at https://policies.google.com/technologies/cookies
https://support.apple.com/en-gb/guide/safari/manage-cookies-and-website-data-sfri11471/ (Safari); and
All website content copyright © St John the Baptist Spalding


Posted on August 29, 2014 at 10:00 am, filed under Food and Drink, PieHole, red bank, Sandwiches, What's For Lunch and tagged jamian's, nj, piehole, red bank, what's for lunch. Bookmark the permalink. Follow any comments here with the RSS feed for this post. Trackbacks are closed, but you can post a comment. Email this story.


text:
Representative Joan Meschino Democrat - 3rd Plymouth
Joan.Meschino@mahouse.gov
Select Court 191st (Current) 190th (2017 - 2018)
H.147 HD.1149 By Ms. Meschino of Hull, a petition (accompanied by bill, House, No. 147) of Joan Meschino and others for legislation relative to the placement of foster children with their siblings. Children, Families and Persons with Disabilities.
H.148 HD.1154 By Ms. Meschino of Hull, a petition (accompanied by bill, House, No. 148) of Joan Meschino and others for legislation to require the Department of Children and Families to provide notice to counsel of changes in a child's or a young adult's placement and other events. Children, Families and Persons with Disabilities.
H.306 HD.1742 By Representative Meschino of Hull and Senator O'Connor, a joint petition (accompanied by bill, House, No. 306) of Joan Meschino and Patrick M. O'Connor (by vote of the town) relative to authorizing certain officials in the town of Hull to issue 1-day licenses for the sale of alcoholic beverages and common victualler and entertainment licenses. Consumer Protection and Professional Licensure. [Local Approval Received.]
H.307 HD.3232 By Ms. Meschino of Hull, a petition (accompanied by bill, House, No. 307) of Joan Meschino and others relative to the motor vehicle right to repair law and consumer rights. Consumer Protection and Professional Licensure.
H.530 HD.1740 By Representative Meschino of Hull and Senator O'Connor, a joint petition (accompanied by bill, House, No. 530) of Joan Meschino, Patrick M. O'Connor and others for legislation to establish a special commission (including members of the General Court) to study minimum and maximum allowable air temperatures in public school classrooms and facilities. Education.
H.531 HD.2800 By Ms. Meschino of Hull, a petition (accompanied by bill, House, No. 531) of Joan Meschino and others relative to school policies for students found with certain weapons or charged with certain violations. Education.
H.639 HD.530 By Representatives Connolly of Cambridge and Meschino of Hull, a petition (accompanied by bill, House, No. 639) of Mike Connolly, Joan Meschino and others relative to child care expenses for candidates while performing work or attending certain campaign events. Election Laws.
H.832 HD.3577 By Ms. Meschino of Hull, a petition (accompanied by bill, House, No. 832) of Joan Meschino and others for legislation to address climate protection, green economy and global warming solutions. Environment, Natural Resources and Agriculture.
H.1233 HD.2356 By Ms. Meschino of Hull, a petition (accompanied by bill, House, No. 1233) of Joan Meschino and others relative to establishing a community college campus hunger pilot program to address food insecurity on community college campuses . Higher Education.
H.1508 HD.1150 By Ms. Meschino of Hull, a petition (accompanied by bill, House, No. 1508) of Joan Meschino and others for legislation to rescind an order terminating parental rights. The Judiciary.
H.1509 HD.1152 By Ms. Meschino of Hull, a petition (accompanied by bill, House, No. 1509) of Joan Meschino and others relative to the definition of custody in care and protection of children proceedings. The Judiciary.
H.1510 HD.1155 By Ms. Meschino of Hull, a petition (accompanied by bill, House, No. 1510) of Joan Meschino and others for legislation to expedite the reunification of children under temporary custody with family members. The Judiciary.
H.1511 HD.1156 By Ms. Meschino of Hull, a petition (accompanied by bill, House, No. 1511) of Joan Meschino and others relative to privileged abuse and protection communications. The Judiciary.
H.1512 HD.1162 By Ms. Meschino of Hull, a petition (accompanied by bill, House, No. 1512) of Joan Meschino and others relative to the enforcement of certain civil rights laws. The Judiciary.
H.1513 HD.1684 By Ms. Meschino of Hull, a petition (accompanied by bill, House, No. 1513) of Joan Meschino, Colleen M. Garry and Kay Khan relative to the appointment of court investigators and the admissibility of certain reports in care and protection cases. The Judiciary.
H.1514 HD.1685 By Ms. Meschino of Hull, a petition (accompanied by bill, House, No. 1514) of Joan Meschino and others relative to juvenile or youthful offenders. The Judiciary.
H.1970 HD.1746 By Representatives Meschino of Hull and Cutler of Duxbury, a petition (accompanied by bill, House, No. 1970) of Joan Meschino and others for legislation to authorize the Department of Public Health to make assessments against power plants. Public Health.
H.2569 HD.1158 By Ms. Meschino of Hull, a petition (accompanied by bill, House, No. 2569) of Joan Meschino and others relative to the taxation of condominiums. Revenue.
H.2899 HD.1159 By Ms. Meschino of Hull, a petition (accompanied by bill, House, No. 2899) of Joan Meschino and others relative to conservation and natural gas infrastructure. Telecommunications, Utilities and Energy.
H.2900 HD.2570 By Ms. Meschino of Hull, a petition (accompanied by bill, House, No. 2900) of Joan Meschino and others relative to municipal ratepayers, low-income ratepayers, community solar ratepayers, and owners of small-scale solar projects. Telecommunications, Utilities and Energy.
H.3653 HD.2084 By Ms. Meschino of Hull, a petition (accompanied by bill, House, No. 3653) of Joan Meschino and others relative to surcharges on motor vehicle insurance premiums. Financial Services.
H.3869 HD.4297 By Representative Meschino of Hull and Senator O'Connor, a joint petition (subject to Joint Rule 12) of Joan Meschino and Patrick M. O'Connor relative to the authorities of municipal light boards. Telecommunications, Utilities and Energy.

redpajama_set_name: RedPajamaCommonCrawl


text:
Symptom Checkers (18) Digital Health Reviews (742) New Methods (649) Use and User Demographics of mHealth (271) Mobile Health (mhealth) (1852) mHealth in a Clinical Setting (483)
Published on 17.11.2022 in Vol 24 , No 11 (2022) :November
Digital Tools Designed to Obtain the History of Present Illness From Patients: Scoping Review
Carl T Berdahl 1 ; Andrew J Henreid 1 ; Joshua M Pevnick 1 ; Kai Zheng 2 ; Teryl K Nuckols 1
Carl T Berdahl1, MD, MS ;
Andrew J Henreid1, BA ;
Joshua M Pevnick1, MD, MSHS ;
Kai Zheng2, PhD ;
Teryl K Nuckols1, MD, MSHS
1Cedars-Sinai Medical Center, Los Angeles, CA, United States
2University of California Irvine Donald Bren School of Information and Computer Sciences, Irvine, CA, United States
Carl T Berdahl, MD, MS
8700 Beverly Blvd
Email: Carl.Berdahl@csmc.edu
Background: Many medical conditions, perhaps 80% of them, can be diagnosed by taking a thorough history of present illness (HPI). However, in the clinical setting, situational factors such as interruptions and time pressure may cause interactions with patients to be brief and fragmented. One solution for improving clinicians' ability to collect a thorough HPI and maximize efficiency and quality of care could be to use a digital tool to obtain the HPI before face-to-face evaluation by a clinician.
Objective: Our objective was to identify and characterize digital tools that have been designed to obtain the HPI directly from patients or caregivers and present this information to clinicians before a face-to-face encounter. We also sought to describe outcomes reported in testing of these tools, especially those related to usability, efficiency, and quality of care.
Methods: We conducted a scoping review using predefined search terms in the following databases: MEDLINE, CINAHL, PsycINFO, Web of Science, Embase, IEEE Xplore Digital Library, ACM Digital Library, and ProQuest Dissertations & Theses Global. Two reviewers screened titles and abstracts for relevance, performed full-text reviews of articles meeting the inclusion criteria, and used a pile-sorting procedure to identify distinguishing characteristics of the tools. Information describing the tools was primarily obtained from identified peer-reviewed sources; in addition, supplementary information was obtained from tool websites and through direct communications with tool creators.
Results: We identified 18 tools meeting the inclusion criteria. Of these 18 tools, 14 (78%) used primarily closed-ended and multiple-choice questions, 1 (6%) used free-text input, and 3 (17%) used conversational (chatbot) style. More than half (10/18, 56%) of the tools were tailored to specific patient subpopulations; the remaining (8/18, 44%) tools did not specify a target subpopulation. Of the 18 tools, 7 (39%) included multilingual support, and 12 (67%) had the capability to transfer data directly into the electronic health record. Studies of the tools reported on various outcome measures related to usability, efficiency, and quality of care.
Conclusions: The HPI tools we identified (N=18) varied greatly in their purpose and functionality. There was no consensus on how patient-generated information should be collected or presented to clinicians. Existing tools have undergone inconsistent levels of testing, with a wide variety of different outcome measures used in evaluation, including some related to usability, efficiency, and quality of care. There is substantial interest in using digital tools to obtain the HPI from patients, but the outcomes measured have been inconsistent. Future research should focus on whether using HPI tools can lead to improved patient experience and health outcomes, although surrogate end points could instead be used so long as patient safety is monitored.
J Med Internet Res 2022;24(11):e36074
anamnesis; informatics; emergency medicine; human-computer interaction; medical history taking; mobile phone
Many medical conditions, perhaps 80% of them, can be diagnosed by taking a thorough history of present illness (HPI) [1]. However, in the clinical setting, situational factors such as interruptions and time pressure may cause interactions with patients to be brief and fragmented [2]. One solution for improving clinicians' ability to collect a thorough HPI and maximize efficiency and quality of care could be to use a digital tool to obtain the HPI before face-to-face evaluation by a clinician.
The concept of using a computer to aid in history taking or diagnosis is not new. In fact, some clinicians entered data into computers as early as the 1940s and used software to generate differential diagnoses [3]. In the 1980s, a small minority of clinicians began asking patients to interact with computers directly to enter their own histories, but the process was cumbersome in many cases because patients had to answer dozens or even hundreds of questions [4]. In the early 2000s, investigators tried new methods to decrease the number of required questions, but such tools did not become popular—perhaps because they were not well integrated into emerging electronic health record (EHR) systems [5].
In the contemporary digital age, software developers and research groups in the health sector are developing tools to engage patients in diagnosis and management of their health problems [6-8]. Patients are becoming accustomed to collecting health-related information on their own devices and submitting it to their clinicians. Moreover, starting in 2011, the US federal government began to encourage clinicians and health care systems to collect such information, called patient-generated health data (PGHD), and use it in a meaningful manner. Examples of commonly submitted PGHD include blood pressure measurements, blood glucose measurements, and patient-reported outcome measures for chronic conditions [9,10]. Patient-generated HPI is a less ubiquitous form of PGHD but leveraging it could improve the efficiency and quality of patient care if it is done thoughtfully.
In this scoping review, our objective was to identify and characterize patient-facing digital tools that obtain the HPI and present it to clinicians before an in-person encounter. We also sought to describe outcomes reported in studies of these tools, especially those related to usability, efficiency, and quality of care.
In consultation with a medical librarian, we developed search terms designed to identify HPI tools of interest from peer-reviewed sources. We then searched the following databases: MEDLINE, CINAHL, PsycINFO, Web of Science, Embase, IEEE Xplore Digital Library, ACM Digital Library, and ProQuest Dissertations & Theses Global. The search was performed in November 2019, and it included all original research and commentary articles that were available in English (for more details of the search strategy, refer to Multimedia Appendix 1).
Article Selection
Titles and abstracts that resulted from the literature search were imported into DistillerSR (Evidence Partners) to facilitate screening. Two independent reviewers (CTB and AJH) evaluated all titles and abstracts for relevance based on the inclusion criteria: (1) patient-facing digital tools that obtain the HPI directly from patients or caregivers and (2) present this information to clinicians before a face-to-face encounter. Tools were excluded if they were administered by the clinician rather than the patient, designed to track symptoms over time rather than make a new diagnosis, designed to screen for only one diagnosis (eg, COVID-19 infection), or if there was no mention of outcome measures in any literature describing the tool. Next, in a full-text–review stage, both reviewers reviewed the full text to determine whether the article met the inclusion and exclusion criteria. If there was any disagreement about whether the tool should be included, it was resolved by consensus.
Data Extraction and Synthesis
To obtain information characterizing each tool, a member of the research team (AJH) reviewed the original source material that identified the tool, any other cited references in the original source, and relevant websites of the tool identified through web searches. We developed narrative descriptions of the tools and maintained this information in a data spreadsheet along with their associated references.
To develop a taxonomy of the tools identified, 2 reviewers (CTB and AJH) used a qualitative pile-sorting method [11]. We started by writing the names of tools on small pieces of paper and arranging them into groups that were qualitatively similar. Next, we discussed what qualities the tools shared and which ones made them different from one another. Once we had compiled a list of these defining characteristics, we used them to categorize the tools in our sample.
Subsequently, we held a discussion among the research team to review characteristics of the various tools. Informed by this discussion and our newly developed taxonomy, a member of the research team (AJH) reviewed all available materials once again and performed targeted data extraction, including tool name, name of vendor or developer, availability of multilingual support, year of initial development or mention, intended patient user population (eg, pediatric, chest pain, or pulmonary), modality of query delivery (eg, narrative vs structured), decision support capability (patients, clinicians, or both), integration with clinical information systems such as EHRs (yes or no), and outcome measures used in evaluation. A second member of the research team (CTB) reviewed all available materials to verify the accuracy of extracted data. After these steps were completed, we cowrote brief narratives to describe each tool. Finally, we contacted the developer or vendor for each tool to verify the information we had collected.
This study followed the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines for scoping reviews [12,13]. The PRISMA-ScR flow diagram is presented in Figure 1.
Figure 1. Flowchart demonstrating article inclusion and exclusion for our scoping review according to PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines [12,13].
Our literature search identified 2569 publications of potential interest. After duplicates were removed and titles and abstracts were screened, 557 articles underwent full-text assessment for eligibility. A total of 141 articles met inclusion criteria and were included in our qualitative synthesis. We encountered a total of 18 unique tools to include in our review, which were described by 52 data sources that included outcome measures. For a comparison of individual tools and their characteristics, refer to Table 1, We also compiled a list of synonyms for the process of obtaining the HPI from patients or caregivers using a digital tool, which may be a helpful reference for future investigators (Multimedia Appendix 2).
Table 1. Data extraction table for tools used to obtain the history of present illness.
Name Developer Year Outcome measures Interaction Lingual support Data entry Patient subpopulation Delivery Decision support
Instant Medical History [14-16] Primetime Medical Software 1985 Completion rate, completion time, and patient usability Multiple choice English Patient and clinician All Import to EHRa Clinician
HELP System [17,18] LDS Hospital 1986 Diagnostic agreement (physician vs tool) Multiple-choice, open-ended free text English Patient Pulmonary Import to EHR Clinician
AIDA [19,20] Erasmus University 1987 Patient usability, completion time, and complaint agreement and diagnostic agreement (physician vs tool) Multiple-choice, open-ended free text Dutch Patient Respiration, circulation, gastrointestinal, genitourinary, nervous system, skin, and general disorders Text-based report Patient and clinician
ParentLink [21,22] Blackboard 1989 Completion rate of critical history elements (physician vs tool) and completion time Multiple-choice, open-ended free text English Patient Pediatrics, emergency, allergy, and trauma Import to EHR Clinician
CIDI-Auto [23-26] Canberra Hospital (computerized version of the World Health Organization's Composite International Diagnostic Interview) 1997 Patient acceptability and diagnostic agreement (physician vs tool) Multiple-choice, open-ended free text Multiple languages Patient and clinician Psychiatry Text-based report Clinician
MEDoctor [27,28] MEDoctor Systems, Inc 1999 Diagnostic agreement (vignettes vs tool) Multiple choice English Patient All Text-based report Patient
Clinical Expert Operating System (CLEOS) [29,30] Karolinska Institutet 2008 Patient satisfaction, percentage agreement of symptoms (physician vs tool), and accuracy in excluding acute coronary syndrome Multiple choice English, German, and Swedish Patient Cardiology Import to EHR Clinician
Mediktor [31-36] Teckel Medical 2011 Diagnostic agreement (physician vs tool) Conversational, multiple choice Many languages (>180) Patient All Text-based report Patient
DocResponse [37-40] DocResponse 2012 Diagnostic agreement (vignettes vs tool) Multiple choice English Patient and clinician All Import to her Patient and clinician
Digivey [41] Creoso, in collaboration with researchers at Johns Hopkins University 2013 Patient usability, time to completion, and data entry error rate Multiple choice English Patient Emergency Import to her Clinician
PatientTouch [42] PatientSafe Solutions Inc 2014 Patient usability and satisfaction Multiple choice English, and Spanish Patient Emergency Import to EHR Clinician
OurNotes [43-45] OpenNotes 2015 Patient experience and clinician workload (qualitative study) Open-ended free text English Patient and clinician All Import to EHR None
FirstHx [46,47] FirstHx Corp 2016 Time to completion, patient usability, and number of questions asked (physician vs tool) Multiple choice Multiple languages (10) Patient All Import to EHR Clinician
Automated Evaluation of Gastrointestinal Symptoms (AEGIS) [48,49] My Total Health 2016 Rating of tool note quality (comparing physician note vs tool note) and agreement of alarm features (physician vs tool) Multiple choice English Patient Gastroenterology Text-based report Clinician
Digital Communication Assistance Tool (DCAT) [50-53] aidminutes GmbH 2017 Completion time, patient and physician usability, percentage agreement in symptoms reported, and repeat clinic visits Multiple choice Multiple languages (21) Patient All Import to EHR Clinician
Quro [54-56] Medius Health 2017 Diagnostic agreement (vignette vs tool) Conversational, open-ended free text Multiple languages Patient All Text-based report Patient
Mandy [57] Precision Driven Health 2017 Diagnostic agreement (vignette vs tool) Conversational, open-ended free text English Patient All Import to EHR Clinician
Diagnosis and Anamnesis Automated Medical History–Taking Device (DIAANA AMHTD) [58] Logic-Based Medicine Sàrl, in collaboration with Lausanne University Hospital 2019 Diagnostic agreement (physician vs tool) Multiple choice German Patient Musculoskeletal Import to EHR Clinician
aEHR: electronic health record.
Narrative Descriptions of Tools
As the tools we identified differed in many ways (eg, stated purpose, intended setting of use, and outcome measures), we developed a narrative description of each tool (Textbox 1).
Narrative descriptions of the tools used to obtain the history of present illness from patients.
Digital tools used to obtain the history of present illness and their descriptions
Instant Medical History
General description: Instant Medical History is a tool that was developed by Primetime Medical Software in 1985 to obtain comprehensive information about the history of present illness while also saving physician time and making documentation more complete. The tool has evolved over the last several decades, and it is still in use today.
Design: patients are invited to select a chief complaint through a web-based portal from home or in a medical office waiting room. They are then presented with a multiple-choice–question set about their symptom severity, duration, timing, context, modifying factors, and associated signs of illness. This information is next submitted to the electronic health record through an application programming interface for review before the patient visit and additionally for inclusion in the physician's note, if desired [14].
Outcomes measured: the company reports that the tool may save up to 6 minutes per clinical encounter [15,16].
Extent of use: the tool is currently being used in 7 countries by 44,500 physicians. The vendor estimates that it will be used in 80 million visits in 2020 (email communication with Matthew Ferrante, Primetime Medical Software, July 21, 2020).
General description: the HELP System, programmed on the Microsoft Query driver, was described in a 1987 publication by Haug et al [17] titled "A Decision-Driven System to Collect the Patient History." Informaticists at the University of Utah described a computer-administered history-taking system with decision-driven questions designed to create a differential diagnosis for hospital inpatients with pulmonary disease.
Design: the system used a cognitive model of question selection along with a Bayesian scoring algorithm that led to targeted question selection using modular diagnostic frames within a program called QUERY. The program contained yes-or-no questions for up to 182 symptoms; however, using the decision-driven system, patients in the study were asked to answer a mean of 51 (SD 31) questions. The program's response report was a list of top 5 differential diagnoses, with accompanying likelihood ranging from 0 to 1.
Outcomes measured: when compared with documented discharge diagnoses in a sample of 27 study participants, the tool's list of 5 differential diagnoses included the principal discharge diagnosis for 85% of the patients.
Extent of use: the tool was also integrated into the hospital's HELP hospital information system, which pioneered clinical decision support. A subsequent set of tests with an updated diagnostic system and a modified approach to questioning was tested later and reported in the American Association for Medical Systems and Informatics proceedings, including several refinements to the data collection process. Although the tool is no longer in use within the hospital setting, it formed the basis for a subsequent diagnostic application, Iliad, that has been used in medical education [18].
General description: AIDA is a software package developed by the department of medical informatics at Erasmus University, Rotterdam, The Netherlands. Its capability to automate medical history taking was described in 1987 by Quaak et al [19] in a special issue of Computer Methods and Programs in Biomedicine. The tool's stated purpose was to elicit a comprehensive history and aid physicians in arriving at an accurate diagnosis.
Design: patients were asked to read questions on a screen and press keys corresponding with their answers. The system contained >400 questions relating to 179 different items. Regarding acute complaints, the patient was asked system by system about whether symptoms existed (using a 7-point scale from never to always). If the patient indicated the presence of a symptom, the system asked more questions about frequency, severity, intensity, duration, onset, and location. The final report was displayed to physicians and patients in a narrative format that was designed to mirror how physicians wrote notes.
Outcomes measured: the investigators studied the tool's performance compared with the gold standard of a physician interview and found agreement to be 25%. They ultimately found that the tool led to a higher number of diagnostic hypotheses and higher diagnostic certainty compared with physician interview alone. Of note, patients required an average of 66 minutes to complete the computerized interview, but their reports of the experience were favorable (92% rated the tool useful) [20].
Extent of use: the tool was never further developed into a product used in routine care.
General description: ParentLink is a tool designed to obtain information from parents to describe their children's symptoms in the pediatric emergency department setting. ParentLink, the company, was founded in 1989 and acquired by Blackboard in 2014, and the earliest clinical publication was authored by Porter [21] of Boston Children's Hospital in 1999.
Design: parents accompanying children with nontraumatic complaints were invited to submit data describing the history of present illness. Parents were asked to independently answer questions on an electronic terminal regarding structured question pathways for fever, respiratory symptoms, or gastrointestinal symptoms. If the reason for the visit was not listed, the parent was invited to select other, and they were then shown a textbox for entering open-ended free text. For structured question pathways, parents were invited to answer prompts such as their children's activity level, fluid intake, and urine output.
Outcomes measured: parental data entry took a mean time of 5 minutes, and data were not shown to treating physicians. The investigators measured the validity of content entered by parents and found it to be comparable with information documented by physicians with improved sensitivity of parental documentation for hydration status. In a related study from 2002 characterizing the free-response pathway, parents entered between 1 and 142 words to describe the reason for the visit (when presented with a character limit of 2048, which is approximately 350-400 words). Most parents described the chief complaint and elements of the history of present illness, and some asked specific questions and added information about the past medical history. When the parents' text input and physicians' histories in the electronic health record were compared, 23% (7/30) of the parents' entries noted details or observations that were not documented by the physicians [21].
Extent of use: subsequent studies of ParentLink have included pediatric patients with other complaints, including head trauma, ear pain, and dysuria [22].
CIDI-Auto
General description: CIDI-Auto is a computerized version of the World Health Organization's Composite International Diagnostic Interview (CIDI). The tool's intended purpose is to allow patients to privately answer a series of questions that lead to the automatic generation of a list of psychiatric differential diagnoses. The computerized version was first described and evaluated by investigators at Canberra Hospital in Canberra, Australia, in 1997 [23].
Design: patients were asked to sit at a computer workstation during an acute psychiatric hospital admission and answer yes-or-no questions about psychiatric symptoms. The core module of the instrument (CIDI-Core) contained 20 major questions and 59 subquestions, which took approximately 75 minutes to administer [24]. Each patient's responses were organized into a report of diagnosis and symptoms that was given to a physician. The report consisted of a summary of active International Classification of Diseases, Tenth Revision, diagnoses (active in the last 30 days); lifetime diagnoses, which were active >1 month ago; and symptoms in major diagnostic areas.
Outcomes measured: psychiatric physicians (the gold standard) agreed with 50% of the CIDI-Auto current diagnoses and indicated that only 22% of the CIDI-Auto reports provided useful new diagnoses, although 63% helped to clarify diagnoses, and 58% could save clinicians some time. They endorsed the CIDI-Auto as a possible aid to indirect or remote diagnosis where histories would be taken by nonexpert staff. With regard to patients, 94% liked the computerized interview, 83% understood the questions without difficulty, and 60% felt more comfortable with the computerized interview than with a physician. Education and previous computer experience promoted positive attitudes and satisfaction with the computerized interview [25].
Extent of use: the CIDI-Auto has now evolved into the World Health Organization World Mental Health-CIDI Instrument, which is now administered by computer in diverse settings across the world [26].
MEDoctor
General description: MEDoctor is a commercially produced symptom checker designed to produce a list of differential diagnoses for users with acute or chronic symptoms [27]. MEDoctor Systems Inc, the developer of the tool, was founded in 1999, and the company's renewed mission statement since 2017 defines its goal as providing patients access to "actionable medical information...before seeing the clinician" so that patients can make cost-effective decisions about their health.
Design: the MEDoctor tool uses a rule out basis that includes the value of negative symptom answers (no input) to rule out disease probabilities. The engine navigates through >4200 symptoms using Bayesian statistics to produce each interview item based upon numerous factors accumulated, such as sex, onset, and yes-or-no responses. The patient interface consists of drop-down menus and yes-or-no questions to characterize their symptoms. At the end of the process, patients are presented with a list of the top 3 differential diagnoses, and they are offered an opportunity to view a text-based report that displays all completed responses and can be sent to a clinician [28].
Outcomes measured: diagnostic agreement between the tool and vignettes is measured.
Extent of use: The diagnostic tool has been used worldwide for >5 years. As of July 2020, according to the chief executive officer, it has been completed 36,860 times by users in the United States, the United Kingdom, South Africa, and the Philippines (email communication with Charles Kelly, MEDoctor Systems Inc, July 21, 2020).
Clinical Expert Operating System
General description: Clinical Expert Operating System (CLEOS) is a tool created in 2008 by Zakim [29] that is currently being tested in a clinical trial at Karolinska Institutet in Stockholm, Sweden. The tool is designed to facilitate thorough history taking from patients, and it also includes capabilities for decision support of diagnosis, management, and risk stratification for clinicians.
Design: the history-taking program is based on the principles of pathophysiology formalized as software algorithms representing medical knowledge as 450 decision trees. A gating mechanism plus feed-forward and feedback loops enable the tool to perform detailed explorations of any aspects of the history that are significant while also avoiding issues of medical redundancy. The data obtained via CLEOS can be formatted into a narrative summary of the most pertinent history findings similar to that of a physician's note.
Outcomes measured: in a study of 45 patients published in 2008 in which patients underwent usual care and completed a CLEOS interview, the tool detected 3.5 additional problems per patient, some of which were deemed to be clinically significant, such as unrecognized transient ischemic attacks [29]. Currently, the tool is being used in a clinical trial at Karolinska University Hospital in Stockholm, Sweden, for evaluation of patients with chest pain. After initial triage by a physician in the emergency department, patients are invited to answer questions within CLEOS on a tablet computer. Data about pain in the context of the differential diagnoses for chest pain are contained within 29 decision graphs presenting questions that are a mixture of yes-or-no, multiple-choice, and image-based question types. The arrangement of questions for these patients is based on principles of cardiovascular pathophysiology and includes ratings of symptom severity, nature, pain location and radiation, associated cardiac or vagal symptoms, and precipitators of pain. The primary outcome measure is the successful exclusion of acute coronary syndrome at 7 days (using physician diagnosis as the comparator). Secondary outcomes include the ability to calculate risk scores for acute coronary syndrome; exclusion of acute coronary syndrome for 30 days and 1 year; direct costs and resource use; and patient experience regarding feasibility, acceptance, comprehensibility, and technical aspects such as usability [30].
Extent of use: in the clinical trial, CLEOS is being used at a single hospital: Danderyd University Hospital in Stockholm, Sweden.
Mediktor
General description: Mediktor is a symptom-checker tool developed in 2011 by Teckel Medical and StartUp Health, an IBM affiliate. The developers describe Mediktor as "an interactive tool that can analyze users' symptoms and evaluate their state of health" [31]. Mediktor is available for consumers to use for free on its website as well as major smartphone and tablet systems in the form of a downloadable mobile app [32,33].
Design: the tool presents users with either multiple-choice questions or conversational-style prompts. After a series of questions and responses, users are provided with an assessment of triage urgency, a summary sheet denoting inputted responses and possible diagnoses, and an opportunity to pay for a telemedicine visit with a licensed clinician. Accessible to patients in >180 supported languages, the tool is powered by artificial intelligence and natural language processing.
Outcomes measured: according to an academic study conducted in Spain, Mediktor's diagnostic accuracy was tested against the gold standard of physician diagnosis, and its primary list of diagnoses matched in 91% of the cases [36].
Extent of use: the tool has become available through Amazon's Alexa as a skill that can be enabled for free [34] and through Telegram as a chatbot messaging feature [35]. According to the developer, the tool is currently being used at 3 clinical sites in Europe and the United States with 1.2 million user evaluations in 2019 (email communication with Fabiana Rojas, Mediktor, July 21, 2020).
DocResponse
General description: DocResponse is a clinical workflow, patient intake, and documentation tool launched in 2012 that engages users electronically to schedule visits and enter previsit data about past medical history and acute complaints before their face-to-face encounter with a clinician. The tool was developed by a team of technology experts and physicians from various specialties [37]. The tool's stated goal is to reduce data entry by front desk reception personnel, medical assistants, and clinicians.
Design: patients are invited to enter data on any hospital-provided or personal smart device. The user can complete consent forms; enter data describing past medical, family, surgical, and social histories; complete the review of systems; and use an assessment tool that populates the history of present illness in the medical record before the patient's arrival. Clinicians are then provided with clinical decision support, including a preliminary differential diagnosis and treatment recommendation. At the end of the visit, the tool can also generate relevant education materials for the patient to review [38].
Outcomes measured: in a 2015 study, DocResponse was found to be the symptom checker most likely to arrive at the correct principal diagnosis out of a sample of 23 similar tools (although its diagnostic accuracy was 18 out of 36 [50% CI 33%-67%]) [39,40].
Extent of use: the tool is currently being used at >170 clinical sites in many care settings such as urgent care, primary care, orthopedics, pediatrics, gastroenterology, multispecialty, and federally qualified health centers throughout the United States. Per vendor report, the tool was used for >225,000 encounters in 2019 (email communication with Tarek Fahl, MD, DocResponse, July 16, 2020).
Digivey
General description: Digivey is a self-administered computer-assisted interview tool (delivered on Digivey survey software) that was designed to improve diagnostic accuracy and patient safety.
Design: A 2013 academic publication from Newman-Toker's research group at Johns Hopkins University School of Medicine described the design of this tool [41]. Digivey delivered adaptive questionnaires with approximately 40 items to emergency department patients to elicit clinical history information about their individual symptom presentations. Participants used one of three electronic devices: mobile kiosk, touch-screen monitor, or laptop computer.
Outcomes measured: all 3 electronic device interfaces were deemed to be usable, there were low rates of user error, and administration required approximately 6 minutes [41].
Extent of use: Newman-Toker has continued to use the system extensively in research studies, including for data collection from patients in an ongoing 5-site multicenter clinical trial that screened >3000 patient encounters using the tool. The Johns Hopkins department of neurology is working to deploy the system in several clinical areas, including via mobile platforms where patients will be able to consistently self-administer their medical data (email communication with David Newman-Toker, MD, July 7, 2020).
PatientTouch
General description: PatientTouch is a tool created by PatientSafe Solutions Inc to elicit patients to use an electronic questionnaire to describe their symptoms. In a pilot study published in 2014, investigators at Los Angeles County+USC Medical Center described the tool's use among adult medically stable patients presenting to the emergency department.
Design: patients were asked to use a handheld touch-screen tablet and complete an electronic questionnaire in either English or Spanish before contact with their physician. First, eligible patients were prompted to select one of six chief complaints: low back pain, upper extremity injury, lower extremity injury, abdominal pain, headache, or motor vehicle collision. Next, they were guided through chief complaint–specific algorithms based in questions provided in multiple-choice or point-and-click format.
Outcomes measured: users were asked to rate their experience, usability, and satisfaction with the technology. Patients reported feeling that the device would help them better communicate with their physician and improve their overall quality of care [42].
Extent of use: the tool is not presently being used at any clinical sites, according to its developer.
OurNotes
General description: OurNotes is a tool developed in 2015 by the OpenNotes movement in which the patient is invited to contribute information to their own ambulatory visit notes [43]. The developers' stated goal is to enhance patient-clinician communication, support patients' engagement in their care, and save clinician time.
Design: a pilot study publication described the enrollment of primary care clinicians and patients who were already registered to use an institutional messaging portal. A few days before a scheduled visit, the patient was asked to submit answers to two open-ended free-text questions: "How have you been since your last visit?" "What are the most important things you would like to discuss at your visit?" Before the visit, the patient's answers to these inquiries were routed to the clinician who could then incorporate them into the visit note. The patient could view the note by logging in to the patient portal after the visit [44].
Outcomes measured: patient experience and clinician workload were assessed in a qualitative study, with patients supporting the idea and clinicians thinking it was possible that their workload could decrease if patients helped to produce their own visit notes [44].
Extent of use: 4 academic medical centers participated in the pilot study, with 160 primary care clinicians and 2500 patients participating between 2018 and 2020. Evaluation of the pilot is underway, and pilot sites are considering expansions of the program [45].
FirstHx
General description: FirstHx is a patient intake tool founded in 2016 and developed by physicians in Toronto, Ontario, Canada, that collects information describing a patient's symptoms and generates focused medical histories in advance of an acute care visit. The developer's stated goals include a dedication to improving physician-patient communication, reducing documentation time, mitigating medical error, and improving the quality of care [46].
Design: it is built specifically for use in emergency departments, urgent care, and telemedicine. The tool is designed to use a line of questioning similar to that of physicians and generate a history of present illness report covering >240 presenting complaints in up to 10 supported patient languages.
Outcomes measured: the company's website reports that patients can complete the 3- to 6-minute digital intake using either their personal smartphone, provided tablet device, or through a dedicated kiosk [47].
Extent of use: the developers state that it is available in the Epic App Store. It has undergone pilot testing at >10 sites, and its estimated use will be 600,000 visits per year (email communication with Mark Benaroia, MD, FirstHx, January 27, 2022).
Automated Evaluation of Gastrointestinal Symptoms
General description: Automated Evaluation of Gastrointestinal Symptoms (AEGIS) is a tool developed in 2016 by researchers in Los Angeles, California, United States, and Ann Arbor, Michigan, United States, to automatically obtain reports of symptoms from patients in the gastroenterology clinic and transform them into a coherent history of present illness.
Design: patients are invited to answer questions through a web-based portal to characterize symptoms as delineated by the Patient-Reported Outcomes Measurement Information System framework. If a patient reports several symptoms, the AEGIS system prompts the user to select the most bothersome symptom. An algorithm generates a physician-facing report that is designed to look like a physician-generated history of present illness.
Outcomes measured: in 1 peer-reviewed publication, patients underwent both computer-generated history taking and usual care, and blinded ratings compared the quality of both sets of documentation. Computer-generated histories were found to be more complete, more useful, better organized, more succinct, and more comprehensible [48]. Another peer-reviewed publication focused on the AEGIS system's ability to detect alarm features and found its performance to be superior to physician detection (alarm features detected in 53% vs 27%, respectively) [49].
Extent of use: AEGIS has not been used in routine patient care outside of the aforementioned studies (email communication with Christopher Almario, MD, Cedars-Sinai Medical Center, July 19, 2020).
General description: DCAT, created in 2017 by German research and technology experts at aidminutes GmbH, is an anamnesis tool that facilitates communication between patients and health care providers in primary care settings, with particular attention to refugee care sites in Germany that experienced an influx of Syrian patients. Aidminutes, which is affiliated with the department of general practice at the University Medical Center Göttingen in Göttingen, Germany, refers to the tool as a digital communication assistance tool that aims to improve diagnostic accuracy by improving medical history taking [50].
Design: once patients arrive at the outpatient clinic waiting room, they are given tablet devices that allow them to enter information describing their symptoms. The tool also facilitates entry of data describing past medical history, current medications, allergies, and any psychological comorbid conditions. To facilitate use by patients with limited literacy, the tool is designed to be visually intuitive, and it also includes audio prompts. After patients enter their data, responses are translated into the clinician's preferred native language and presented as a data synopsis, including alerts regarding red flags in the history that have been discovered [51].
Outcomes measured: use of the tool has been described in peer-reviewed publications, including a recent study demonstrating good usability and acceptance by patients speaking Levantine Arabic, Modern Standard Arabic, Egyptian Arabic, Farsi, Sorani Kurdish, and Turkish [52]. In 1 study, patients successfully completed their assessments in an average time of 13 minutes [53].
Extent of use: the tool was used in approximately 10,000 multilingual visits in urgent care and family medicine clinics during 2021 (email communication with Frank Muller and Andreas Lippke, May 3, 2022).
Quro
General description: Quro is a chatbot health assistant created in 2017 by Medius Health (Sydney, New South Wales, Australia) that uses machine learning artificial intelligence to deliver health assessments to users [54]. Patients can access the tool through a desktop web browser or smartphone.
Design: users are invited to answer a set of free-response and multiple-choice prompts generated by the back-end sequential question prediction algorithm using a large-scale clinical knowledge graph to mimic the taking of a medical history. Each new question is predicted based on previous user-chat context. After completion, the patient is provided a list of differential diagnoses with interpretations, nearby health services, recommendations about the urgency of their condition, and a detailed report that displays the answers to their individual set of questions. The tool's website advertises a built-in medical dictionary of >7 million disease and illness presentation patterns, scored against content sourced from "trusted sources like medical journals" to produce its personalized clinical assessments [55].
Outcomes measured: in an article published by Quro's developers, the tool's triage accuracy was assessed using 30 case-based scenarios (10 for emergency care, 10 for general practitioner care, and 10 for self-care) and found to be accurate in 83% (25/30) of the cases [56].
Extent of use: Quro is marketed to, and used by, several health and wellness service providers to engage with, and onboard, patients remotely (email communication with Shameek Ghosh, founder and chief technology officer, September 1, 2020).
General description: Mandy is a primary care conversational-style dialogue system developed in 2017 by a public-private research partnership of computer scientists at the University of Auckland in Auckland, New Zealand, funded by Precision Driven Health and Orion Health, aimed at improving health outcomes through data science. The tool is designed to assist health care staff by automating the patient intake process.
Design: patients interact with the tool by answering the conversational-style prompts with open-ended free-text responses. An analytic engine uses natural language processing to interpret the patient's text, queries a symptom-to-cause mapper for reasoning about potential diagnostic causes, and then generates further interview questions. Once the system has obtained sufficient information from the patient, it reports a differential diagnosis for the clinician to consider.
Outcomes measured: in a proof-of-concept paper, the developers reported on the application's question accuracy (ability to generate key follow-up questions after an initial chief complaint) and diagnosis prediction accuracy (ability to generate relevant differential diagnoses after obtaining responses to its questions) by using gold-standard cases from a medical textbook. Out of 6 cases, the tool generated appropriate questions in 5 cases and had case-by-case prediction accuracy ranging from 14% to 100% [57].
Diagnosis and Anamnesis Automated Medical History–Taking Device
General description: Diagnosis and Anamnesis Automated Medical History–Taking Device (DIAANA AMHTD) was developed by Logic-Based Medicine Sàrl in collaboration with Adrien Schwitzguebel of Lausanne University Hospital in Lausanne, Switzerland, to improve diagnostic accuracy through helping physicians to generate more comprehensive differential diagnoses. To date, the tool exclusively addresses musculoskeletal complaints.
Design: in a pilot study published in 2019, the developer and coinvestigators tested DIAANA AMHTD at a teaching hospital in Geneva, Switzerland. Patients were eligible if they were waiting to be seen at an ambulatory clinic for evaluation of musculoskeletal symptoms. Patients in the experimental group were asked to complete a digital form on a touch pad before the resident physician's evaluation, including questions about specific symptoms and risk factors. Through the completion of an adaptive questionnaire that draws from a data set of 269 questions, DIAANA AMHTD then generated a comprehensive anamnesis summary and a list of top differential diagnoses. The list of differential diagnoses (selected from 126 possibilities) was then presented to medical residents for consideration before the face-to-face evaluation.
Outcomes measured: residents who used the tool were found to be more likely to have included the final diagnosis from the list of initial differential diagnoses than those residents who did not use the tool (75% vs 59%, respectively) [58].
Extent of use: the tool is currently being used regularly by a single physician with 250 patient encounters in 2019 and has also been implemented by a Swiss telemedicine system called Soignez-Moi in Biel, Switzerland (Email communication with Adrien Schwitzguebel, MD, July 2020).
Textbox 1. Narrative descriptions of the tools used to obtain the history of present illness from patients.
Descriptions of Tool Characteristics in the Taxonomy
As a result of our pile-sorting procedure, we developed an HPI tool taxonomy that includes the following categories: interaction modality, lingual support, patient versus caregiver data entry, patient subpopulation (by age, chief complaint, or body system), modality of result delivery, and decision support target (patient or clinician). The resulting taxonomy is reported in Textbox 2.
Taxonomy of characteristics describing the tools used for obtaining the history of present illness in the study sample.
Query style
Open-ended free text
Conversational style (chatbot)
Language capability
Single language only
Discordant language support
Tasked to perform data entry
Patient subpopulation
Limited by patient age, care setting, or body system
Text-based report
Data imported to electronic health record
Patient facing
Clinician facing
Textbox 2. Taxonomy of characteristics describing the tools used for obtaining the history of present illness in the study sample.
Interaction Modality
Among the 18 tools reviewed, 1 (6%) used exclusively open-ended free-text interaction (OurNotes [43]), whereas 3 (17%) used a conversational style of interaction (ie, a chatbot style) simulating a human text-message interaction (Mediktor [31], Quro [55], and Mandy [57]). The remaining tools (14/18, 78%) used either an entirely multiple-choice format or used primarily a multiple-choice format with some open-ended free-text components.
Lingual Support
Of the 18 tools, 1 (6%) was developed specifically to address language barriers in Germany, and it was deployed especially to assist Syrian refugees with communication (DCAT [50]), whereas 1 (6%) specifically reported the capability to facilitate clinical communication between patients and clinicians in language-discordant encounters (FirstHx [46]); 5 (28%) other tools reported the ability to capture the HPI in English as well as other languages (CIDI-Auto [25], Clinical Expert Operating System (CLEOS) [30], Mediktor [31], PatientTouch [42], and Quro [55]), 1 (6%) was Dutch only (AIDA [19]), and 1 (6%) was German only (Diagnosis and Anamnesis Automated Medical History–Taking Device [DIAANA AMHTD] [58]). The remaining tools (9/18, 50%) were English only [16,20,21,27,40,41,46,51,57].
Of the 18 tools, 10 (56%) were tailored to specific patient populations by reason for visit or body system (HELP System: pulmonary [20]; AIDA: multiple specific body systems [19]; ParentLink: pediatric emergency, allergy, and trauma [21,22]; CIDI-Auto: psychiatry [26]; CLEOS: cardiology [29]; Digivey: emergency [41]; PatientTouch: emergency [42]; Automated Evaluation of Gastrointestinal Symptoms (AEGIS): gastroenterology [51]; and DIAANA AMHTD: musculoskeletal [58]). The remaining tools (8/18, 44%) did not specify a target subpopulation of patients [14,27,31,40,46,49,53,56,57].
Modality of Delivery
Of the 18 tools, 12 (67%) reported the capacity to import patient data directly into the clinician's EHR system [14,20,21,29,40-42,46,49,53,57,58], and the other 6 (33%) provided users a text-based report of patients' responses to prompts or a list of top differential diagnoses [19,26,27,34,51,56]. It is possible that some of the tools with text-based reports have back-end functionality that allows for transmission of information to partnering clinicians, although we are unable to ascertain which tools can do this based on review of tool web sites and articles in our sample.
Of the 18 tools, 5 (28%) offered patient-facing decision support that came either in the form of a triage acuity level or a list of differential diagnoses that was displayed for patients to read [19,27,34,40,56], whereas 15 (83%) offered clinician-facing decision support, which was displayed to clinicians as a list of differential diagnoses with or without links to evidence-based management recommendations [14,19-21,26,29,40-42,49,51,53,57,58].
There was a wide range of outcome measures reported among the tools in the sample. Outcome measures were categorized as being related to the domains of tool usability, efficiency of care, and quality of care.
Tool Usability
Patient usability was studied for 33% (6/18) of the tools (Instant Medical History [14], AIDA [19], Digivey [41], PatientTouch [42], FirstHx [49], and DCAT [53]). Other related constructs were measured for several (5/18, 28%) of the other tools, including patient acceptability (CIDI-Auto [23-26]), patient satisfaction (PatientTouch [42] and CLEOS [29]), and patient experience (CLEOS [29] and OurNotes [46]). Completion rate was studied for 11% (2/18) of the tools (Instant Medical History [14] and AIDA [19]), and data entry error rate was studied for 6% (1/18) of the tools (Digivey [41]). Clinician usability was only reported for 6% (1/18) of the tools (DCAT [50,51,53,59]), although a concern about clinician workload was mentioned in the qualitative study of OurNotes [44].
Efficiency of Care
Time to completion was the most commonly reported measure of efficiency, used in studies of 33% (6/18) of the tools (Instant Medical History [14], AIDA [19,20], ParentLink [21,22], Digivey [41], FirstHx [46,47], and DCAT [50,51,53,59]). A study of FirstHx compared the number of questions asked by the tool and the clinician. There was no report of any research related to the impact on length of the visit or time spent by clinicians on direct or indirect care [46,47]. The protocol describing a currently ongoing clinical trial of CLEOS reported a plan to measure direct costs and resource use for patients in the intervention group versus a control group (refer to the next section [Quality of Care] for additional details) [30]. The protocol of another clinical trial reported a plan to measure the rate of repeat visits to a clinic as a proxy measure for improved patient-clinician communication at a refugee clinic (DCAT) [53].
There were a wide variety of measures that have implications for quality of care. A study of 6% (1/18) of the tools reported agreement of the patient's chief complaint between the tool and a physician (AIDA) [20]. Another study reported agreement in the questions asked (FirstHx) [47], and articles describing 11% (2/18) of the tools reported agreement in the symptoms reported between the tool and those the physician documented (CLEOS [30] and DCAT [53]). A study of AEGIS reported agreement in alarm features reported via the tool or in physician documentation [49], and a study of ParentLink reported completion rate of critical history elements for histories acquired via the tool and a physician [21]. Another study of AEGIS compared the quality of documentation produced by the tool with that produced by treating physicians by having blinded physicians rate the quality of documentation produced by both sources [48].
Diagnostic agreement was the most commonly reported measure related to quality of care. Studies of 22% (4/18) of the tools reported on agreement between tool-produced diagnoses and vignettes with prespecified diagnoses (MEdoctor [28], DocResponse [39,40], Quro [56], and Mandy [57]). Studies of 28% (5/18) of the tools reported agreement between physician-generated diagnoses in health care environments and diagnoses generated by the tools (HELP System [17], AIDA [19], CIDI-Auto [25], Mediktor [36], and DIAANA-AMHTD [58]). The research protocol for an ongoing study of CLEOS was the only article describing measurement of patients' health outcomes. In the study, the primary outcome was reported to be the tool's ability to exclude acute coronary syndrome at 7 days for patients presenting to the emergency department for chest pain, and secondary outcomes were the ability to exclude acute coronary syndrome at 30 days and 1 year [30].
In this scoping review, we identified 18 digital tools that have been used to collect HPI information about patients' symptoms and communicate it to clinicians. These tools varied widely in their stated purposes (eg, to improve patient-clinician communication, to enhance patient engagement, to save clinician time, to improve diagnostic accuracy, and to exclude acute coronary syndrome). They also varied widely in their interaction modality (open-ended free text vs multiple choice vs conversational style), modality of results delivery (text-based report vs EHR integration), and decision support capability (patient facing vs clinician facing). There did not seem to be any consensus on how information should be collected or how it should be presented to patients or clinicians.
For the tools identified in this review, peer-reviewed publications describing empirical evaluation findings were somewhat limited. However, results from several studies provide preliminary evidence that implementation of such tools is acceptable to patients; for example, a well-designed usability study demonstrated that patients found the precursor to Digivey easy to use [41]; a multi-institutional survey revealed that 2 out of 3 clinicians who had used OurNotes supported continued coauthorship of visit notes with patients [45]; and studies of ParentLink and AEGIS found that both tools improved documentation of critical elements of patients' histories [21,22,49,60]. In the coming years, investigators in Europe will determine, through a clinical trial of CLEOS, whether use of the tool can predict adverse clinical outcomes more accurately than clinicians among a sample of 2000 patients evaluated for acute chest pain. As these tools are studied more intensively, we recommend that academic evaluators should adopt one of several recently published frameworks to design comparative effectiveness studies of multiple tools [61-63]. However, although the rigorous randomized controlled trial of CLEOS is underway, other investigators and tool developers may not be willing to spend the time and resources to follow patients through the many steps in their journeys and measure health outcomes in a controlled fashion. Instead, surrogate outcomes may be considered so long as measures are in place to ensure that patients are not being harmed by HPI-tool implementation. In the emergency department work environment, for example, reducing documentation time for clinicians and improving satisfaction for patients could be adequate primary outcomes so long as there is no evidence of health outcome inferiority, such as increased length of stay for inpatients or increased return emergency department visits for discharged patients. Future investigators should consider prioritizing the following measures for patients: usability, documentation time, accuracy of the history, and satisfaction with the visit. For clinicians, we recommend prioritizing usability, documentation time, accuracy and completeness of the history (including elicitation of red flags for certain chief complaints), and satisfaction with the visit. For the visit overall, measures could include patient-clinician interaction time and emergency department length of stay (measured from the time the clinician signs up for the patient until the disposition decision).
Although academic investigators are carrying out such studies to test HPI tools, vendors of commercial products are already implementing their products in clinical environments across the world; for example, the vendor of Instant Medical History reported that it would be used in an estimated 80 million visits in 2020. To our knowledge, this tool has not been rigorously studied in peer-reviewed literature; however, it has been in use for decades, and its recent, rapid real-world implementation may indeed lead to important advances in the field of informatics.
On the basis of our review of the literature and our experience in the field, there are several barriers to the adoption of digital HPI tools by clinicians and patients. First, selecting 1 tool for testing and implementation is nontrivial because there is a lack of consensus on which features would make care more efficient and higher quality. Second, clinicians may not be interested in adopting new technology before a careful study of workflow is undertaken. Third, integration of a tool into a clinician's EHR system may require substantial time and effort. Fourth, clinicians may fear that storing patient-generated information may increase the risk of malpractice litigation. Fifth, asking patients to use technology may exacerbate already existing health disparities for vulnerable patients. Sixth, and last, there is no clear evidence that adopting digital HPI tools leads to improved health outcomes—although evidence will likely be forthcoming in the next few years.
After evaluating all the tools described in this review, our opinion is that patients can successfully and safely be engaged to compose their own HPI information. We believe that both patients and clinicians would benefit from a tool with an intuitive design that allows patients to create a history through a combination of unstructured and structured prompts and then transforms this history into a narrative that is cohesive and communicates the key elements of the history to clinicians so that the differential diagnosis can be narrowed appropriately. We believe that the ideal tool would begin with a patient-generated narrative and then ask patients to complete a sequence of closed-ended questions to narrow the differential diagnosis. This is the sequence that clinicians are trained to use because patients can offer information that they believe is relevant, and then clinicians can use closed-ended questions to fill in gaps in knowledge and narrow the differential diagnosis [64]. For blocks of text generated by patients, natural language processing can be used to add structure [65] and feed analyses that can determine which closed-ended questions should be administered to obtain a complete history in a reasonable amount of time. This approach is similar to the one used by Quro, and it avoids the need for extremely long question chains that were used in older rule-based tools such as AIDA. This text-based approach could additionally be supplemented by touch-based graphical items so that patients would be able to signal the location of their symptoms [66]. Alternatively, it is possible that rule-based decision trees could be adequate for certain conditions in certain clinical settings. In the emergency department setting in particular, patients can present with any complaint, which makes flexibility essential for any HPI tool.
There are several limitations to this study. First, although we developed our search terms in consultation with a medical librarian and among a multidisciplinary research team, it is possible that the failure to include certain search terms or databases could have led us to miss key publications. Second, tools such as those we have reviewed tend to evolve over time, which may have limited our ability to characterize them accurately based on the published literature. Third, and last, our review of tools included several sources of information such as peer-reviewed literature, non–peer-reviewed articles, and websites of for-profit entities. Although we have tried to verify the accuracy of the information we obtained, it is possible that information from some sources is biased.
Many HPI tools with various features are available to aid in obtaining the HPI. Future research should examine which tools improve patients' health outcomes and which design features are pivotal to improving communication, diagnosis, and, subsequently, patient health outcomes. We recommend that future tools use a combination of narrative text, closed-ended questions, and graphical items so that the histories obtained can successfully communicate the patients' symptoms to clinicians and narrow the differential diagnosis.
This research was supported by internal funding from Cedars-Sinai Medical Center. The funding source did not play any role in study design; in the collection, analysis, and interpretation of data; in the writing of the report; or in the decision to submit the article for publication. The authors thank Caroline Marshall, MLS, AHIP, for assisting with development of the search strategy.
CTB conceptualized the study. CTB and AJH conducted the literature search and data analysis and drafted the article. CTB is responsible for the integrity of the work. All authors participated in writing and revising the article. All aspects of the study (including design; collection, analysis, and interpretation of data; writing of the report; and decision to publish) were led by the authors.
List of synonyms for digital tools designed to obtain the history of present illness from patients.
Hampton JR, Harrison MJ, Mitchell JR, Prichard JS, Seymour C. Relative contributions of history-taking, physical examination, and laboratory investigation to diagnosis and management of medical outpatients. Br Med J 1975 May 31;2(5969):486-489 [FREE Full text] [CrossRef] [Medline]
Slade D, Chandler E, McGregor J, Scheeres H, Chandler E, Stein-Parbury J, et al. Communicating in Hospital Emergency Departments. Heidelberg, Germany: Springer; 2015.
Brodman K, Erdmann Jr AJ, Lorge I, Wolff HG, Broadbent TH. The Cornell medical index: an adjunct to medical interview. J Am Med Assoc 1949 Jun 11;140(6):530-534. [CrossRef] [Medline]
Evans RS. Electronic health records: then, now, and in the future. Yearb Med Inform 2016 May 20;Suppl 1:S48-S61 [FREE Full text] [CrossRef] [Medline]
Ajami S, Bagheri-Tadi T. Barriers for adopting Electronic Health Records (EHRs) by physicians. Acta Inform Med 2013;21(2):129-134 [FREE Full text] [CrossRef] [Medline]
Torous J, Friedman R, Keshavan M. Smartphone ownership and interest in mobile applications to monitor symptoms of mental health conditions. JMIR Mhealth Uhealth 2014 Jan 21;2(1):e2 [FREE Full text] [CrossRef] [Medline]
Fox S, Duggan M. Mobile Health 2012: half of smartphone owners use their devices to get health informationone-fifth of smartphone owners have health apps. Pew Research Center and American Life Project. 2017. URL: http://www.pewinternet.org/2012/11/08/mobile-health-2012/ webcite [accessed 2022-11-02]
Mobile fact sheet. Pew Research Center. 2021 Apr 7. URL: https://www.pewresearch.org/internet/fact-sheet/mobile/ [accessed 2021-12-30]
Patient-Generated Health Data. HelathIT.gov. URL: https://www.healthit.gov/topic/scientific-initiatives/patient-generated-health-data [accessed 2021-12-30]
Deering M. Issue Brief: Patient-Generated Health DataHealth IT. The Office of the National Coordinator for Health Information Technology. 2013 Dec 20. URL: https://www.healthit.gov/sites/default/files/pghd_brief_final122013.pdf [accessed 2021-12-30]
Ryan GW, Bernard HR. Techniques to identify themes. Field Methods 2003 Feb;15(1):85-109. [CrossRef]
Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med 2018 Oct 02;169(7):467-473 [FREE Full text] [CrossRef] [Medline]
Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 2009 Jul 21;6(7):e1000097 [FREE Full text] [CrossRef] [Medline]
Bachman J. Improving care with an automated patient history. Fam Pract Manag 2007;14(7):39-43 [FREE Full text] [Medline]
Wenner AR, Ferrante M, Belser D. Instant medical history. Proc Annu Symp Comput Appl Med Care 1994:1036 [FREE Full text] [Medline]
Instant medical history homepage. Instant Medical History. URL: https://www.interviewsoftware.com/instant-medical-history-imh [accessed 2021-12-30]
Haug PJ, Warner HR, Clayton PD, Schmidt CD, Pearl JE, Farney RJ, et al. A decision-driven system to collect the patient history. Comput Biomed Res 1987 Apr;20(2):193-207. [CrossRef] [Medline]
Haug P, Rowe K, Rich T, Famey R, Pearl J, Schmidt CD. A comparison of computer-administered histories. In: Proceedings of the American Association of Medical System Informatics. 1988 Presented at: AAMSI '88; 1988; New York, NY, USA.
Quaak MJ, van der Voort PJ, van Bemmel JH. AIDA for the automation of the patient history. Comput Methods Programs Biomed 1987;25(3):297-304. [CrossRef] [Medline]
Quaak MJ, Westerman R, Schouten JA, Hasman A, Van Bemmel JH. Appraisal of computerized medical histories: comparisons between computerized and conventional records. Comput Biomed Res 1986 Dec;19(6):551-564. [CrossRef]
Porter SC. Data acquisition in emergency medicine: electronic communication using free text. Pediatr Emerg Care 2002 Feb;18(1):15-18. [CrossRef] [Medline]
Porter SC, Forbes P, Manzi S, Kalish LA. Patients providing the answers: narrowing the gap in data quality for emergency care. Qual Saf Health Care 2010 Oct;19(5):e34. [CrossRef] [Medline]
Rosenman SJ, Levings CT, Korten AE. Clinical utility and patient acceptance of the computerized Composite International Diagnostic Interview. Psychiatr Serv 1997 Jun;48(6):815-820. [CrossRef] [Medline]
Robins LW, Wittchen H, Helzer J, Babor T, Burke J, Farmer A, et al. Composite international diagnostic interview. APA PsycTests. 1988. URL: https://psycnet.apa.org/doiLanding?doi=10.1037%2Ft02121-000 [accessed 2021-12-30]
The World Health Organization World Mental Health Composite International Diagnostic Interview (WHO WMH-CIDI). Harvard University Department of Health Care Policy. 2017. URL: https://www.hcp.med.harvard.edu/wmhcidi/about-the-who-wmh-cidi/ [accessed 2021-12-30]
Download the WHO WMH-CIDI Instruments. Harvard University Department of Health Care Policy. 2017. URL: https://www.hcp.med.harvard.edu/wmhcidi/download-the-who-wmh-cidi-instruments/ [accessed 2021-12-30]
MEDOCTOR homepage. MEDOCTOR. URL: https://www.medoctor.com/ [accessed 2021-12-30]
MEDoctor - Immediate Doctor's Attention. YouTube. 2018 Mar 7. URL: https://youtu.be/SjOvqx-cQI8 [accessed 2021-12-30]
Zakim D, Braun N, Fritz P, Alscher MD. Underutilization of information and knowledge in everyday medical practice: evaluation of a computer-based solution. BMC Med Inform Decis Mak 2008 Nov 05;8:50 [FREE Full text] [CrossRef] [Medline]
Brandberg H, Kahan T, Spaak J, Sundberg K, Koch S, Adeli A, et al. A prospective cohort study of self-reported computerised medical history taking for acute chest pain: protocol of the CLEOS-Chest Pain Danderyd Study (CLEOS-CPDS). BMJ Open 2020 Jan 21;10(1):e031871 [FREE Full text] [CrossRef] [Medline]
Mediktor. Teckel Medical. URL: https://www.mediktor.com/en [accessed 2021-12-30]
Teckel Medical. Mediktor - Symptom Checker. App Store. URL: https://apps.apple.com/us/app/mediktor-symptom-checker/id725611856 [accessed 2021-12-30]
Teckel Medical. Mediktor. Google Play. URL: https://play.google.com/store/apps/details?id=com.teckelmedical.mediktor&hl=en_US [accessed 2021-12-30]
Teckel Solutions. Mediktor. Amazon. URL: https://www.amazon.com/Teckel-Solutions-S-L-Mediktor/dp/B075XRN21X [accessed 2021-12-30]
Mediktor. Telegram. URL: https://t.me/Mediktor_bot [accessed 2021-12-30]
Moreno Barriga E, Pueyo Ferrer I, Sánchez Sánchez M, Martín Baranera M, Masip Utset J. [A new artificial intelligence tool for assessing symptoms in patients seeking emergency department care: the Mediktor application]. Emergencias 2017;29(6):391-396 [FREE Full text] [Medline]
DocResponse About Us. DocResponse. URL: https://www.docresponse.com/about/ [accessed 2021-12-30]
DocResponse - Medical digital check-in made simple. YouTube. 2019 Sep 27. URL: https://www.youtube.com/watch?v=qj4yvf_ETZQ [accessed 2021-12-30]
Digital patient check-in. DocResponse. URL: https://www.docresponse.com/digital-check-in/ [accessed 2021-12-30]
The athenahealth Marketplace. Athena Health. URL: https://marketplace.athenahealth.com/product/docresponse-inc [accessed 2021-12-30]
Herrick DB, Nakhasi A, Nelson B, Rice S, Abbott PA, Saber Tehrani AS, et al. Usability characteristics of self-administered computer-assisted interviewing in the emergency department: factors affecting ease of use, efficiency, and entry error. Appl Clin Inform 2013;4(2):276-292 [FREE Full text] [CrossRef] [Medline]
Arora S, Goldberg AD, Menchine M. Patient impression and satisfaction of a self-administered, automated medical history-taking device in the Emergency Department. West J Emerg Med 2014 Feb;15(1):35-40 [FREE Full text] [CrossRef] [Medline]
OpenNotes. OpenNotes. URL: https://www.opennotes.org/ [accessed 2021-12-30]
Mafi JN, Gerard M, Chimowitz H, Anselmo M, Delbanco T, Walker J. Patients contributing to their doctors' notes: insights from expert interviews. Ann Intern Med 2018 Feb 20;168(4):302-305 [FREE Full text] [CrossRef] [Medline]
Kriegel G, Bell S, Delbanco T, Walker J. Covid-19 as innovation accelerator: cogenerating telemedicine visit notes with patients. NEJM Catalyst. 2022 May 12. URL: https://tinyurl.com/5h7y6d72 [accessed 2022-11-02]
FirstHx. URL: https://www.firsthx.com/ [accessed 2021-12-30]
Benaroia M, Elinson R, Zarnke K. Patient-directed intelligent and interactive computer medical history-gathering systems: a utility and feasibility study in the emergency department. Int J Med Inform 2007 Apr;76(4):283-288. [CrossRef] [Medline]
Almario CV, Chey W, Kaung A, Whitman C, Fuller G, Reid M, et al. Computer-generated vs. physician-documented history of present illness (HPI): results of a blinded comparison. Am J Gastroenterol 2015 Jan;110(1):170-179 [FREE Full text] [CrossRef] [Medline]
Almario CV, Chey WD, Iriana S, Dailey F, Robbins K, Patel AV, et al. Computer versus physician identification of gastrointestinal alarm features. Int J Med Inform 2015 Dec;84(12):1111-1117 [FREE Full text] [CrossRef] [Medline]
Furaijat G, Kleinert E, Simmenroth A, Müller F. Implementing a digital communication assistance tool to collect the medical history of refugee patients: DICTUM Friedland - an action-oriented mixed methods study protocol. BMC Health Serv Res 2019 Feb 06;19(1):103 [FREE Full text] [CrossRef] [Medline]
Kerby LR. Founders. In: Saving History: How White Evangelicals Tour the Nation's Capital and Redeem a Christian America. Chapel Hill, NC, USA: North Carolina Scholarship Online; Apr 2020.
Kleinert E, Müller F, Kruse S, Furaijat G, Simmenroth A. [Usability and efficiency of a digital communication assistance tool to obtain medical history from non-German-speaking patients]. Gesundheitswesen 2021 Jul;83(7):531-537. [CrossRef] [Medline]
Müller F, Chandra S, Furaijat G, Kruse S, Waligorski A, Simmenroth A, et al. A digital communication assistance tool (DCAT) toobtain medical history from foreign-languagepatients: development and pilot testing in a primaryhealth care center for refugees. Int J Environ Res Public Health 2020 Feb 20;17(4):1368 [FREE Full text] [CrossRef] [Medline]
Unravel the mystery of Health Data. Medius Health. URL: https://mediushealth.org/ [accessed 2021-12-30]
Medius Health. Quro Dictionary. URL: https://www.quro.ai/dictionary/ [accessed 2021-12-30]
Ghosh S, Bhatia S, Bhatia A. Quro: facilitating user symptom check using a personalised chatbot-oriented dialogue system. Stud Health Technol Inform 2018;252:51-56. [Medline]
Ni L, Lu C, Liu N, Liu J. MANDY: towards a smart primary care chatbot application. In: Proceedings of the 18th International Symposium on Knowledge and Systems Sciences. Singapore, Singapore: Springer; 2017 Presented at: KSS '17; November 17–19, 2017; Bangkok, Thailand p. 38-52. [CrossRef]
Schwitzguebel AJ, Jeckelmann C, Gavinio R, Levallois C, Benaïm C, Spechbach H. Differential diagnosis assessment in ambulatory care with an automated medical history-taking device: pilot randomized controlled trial. JMIR Med Inform 2019 Nov 04;7(4):e14044 [FREE Full text] [CrossRef] [Medline]
DesRoches CM, Leveille S, Bell SK, Dong ZJ, Elmore JG, Fernandez L, et al. The views and experiences of clinicians sharing medical record notes with patients. JAMA Netw Open 2020 Mar 02;3(3):e201753 [FREE Full text] [CrossRef] [Medline]
Nouri R, R Niakan Kalhori S, Ghazisaeedi M, Marchand G, Yasini M. Criteria for assessing the quality of mHealth apps: a systematic review. J Am Med Inform Assoc 2018 Aug 01;25(8):1089-1098 [FREE Full text] [CrossRef] [Medline]
Levine DM, Co Z, Newmark LP, Groisser AR, Holmgren AJ, Haas JS, et al. Design and testing of a mobile health application rating tool. NPJ Digit Med 2020;3:74 [FREE Full text] [CrossRef] [Medline]
Henson P, David G, Albright K, Torous J. Deriving a practical framework for the evaluation of health apps. Lancet Digit Health 2019 Jun;1(2):e52-e54 [FREE Full text] [CrossRef] [Medline]
Bickley L, Szilagyi P, Bates B. Bates' Guide to Physical Examination and History-Taking. 11th edition. Philadelphia, PA, USA: Lippincott Williams & Wilkins; 2013.
Nair N, Narayanan S, Achan P, Soman KP. Clinical note section identification using transfer learning. In: Proceedings of 6th International Congress on Information and Communication Technology. Singapore, Singapore: Springer; 2021 Presented at: ICICT '21; February 25–26, 2021; London, UK p. 533-542. [CrossRef]
Calisto F, Ferreira A, Nascimento J, Gonçalves D. Towards touch-based medical image diagnosis annotation. In: Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces. 2017 Presented at: ISS '17; October 17-20, 2017; Brighton, UK. [CrossRef]
AEGIS: Automated Evaluation of Gastrointestinal Symptoms
CLEOS: Clinical Expert Operating System
DIAANA AMHTD: Diagnosis and Anamnesis Automated Medical History–Taking Device
EHR: electronic health record
HPI: history of present illness
PGHD: patient-generated health data
PRISMA-ScR: Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews
Edited by G Eysenbach; submitted 31.12.21; peer-reviewed by A Joseph, SS Amritphale, EM Noack, D Schlossman, FM Calisto; comments to author 23.02.22; revised version received 25.05.22; accepted 19.10.22; published 17.11.22
©Carl T Berdahl, Andrew J Henreid, Joshua M Pevnick, Kai Zheng, Teryl K Nuckols. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 17.11.2022.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.
Berdahl CT, Henreid AJ, Pevnick JM, Zheng K, Nuckols TK


Plyos gained its fame and popularity thanks to artists like Isaac Levitan, who were inspired by some of its amazingly scenic spots.
Every year some 150,000 tourists visit the town of Plyos, which is known as the Pearl of the Volga. The first mention of this town, as a fortress on the Volga, dates back to the 12th century. However, despite its military history, the city gained its fame and popularity thanks to artists – for its amazingly scenic spots.
Plyos, built beside a straight and deep-water stretch of the river bed (this is what the name of the city suggests: plyos in Russian means a stretch of river), was founded as a fortress. High hills provided ideal observation points to spot the emergence of possible enemies from far away – it was for this purpose that protective ramparts and watchtowers were built. Remains of the fortress rampart are still visible on Sobornaya Hill (Cathedral Hill), or Soborka in local slang. A monument to the city's founder, Vasily the First, and the Uspensky Cathedral built in 1699 stand right outside.
If you walk up this hill towards the Volga, you can get to an observation point which offers a beautiful view of the river – fortress watchtowers used to stand here in the past.
All the historical sites in Plyos are easily in view from the perimeter of Cathedral Hill. An embankment and the streets parallel to it (Gorky Street and Lenin Street with Bazarnaya Square between them) as well as the Posad, which was the craft and trading quarter of the town, are located just beneath the hills. In the centre of the Posad, on Bazarnaya Square, Voskresenkaya Church (Resurrection Church), built in 1817, rises half way up the hill. It can be viewed particularly well if you walk up to the top of Voskresenkaya Hill.
Plyos became wealthy in the 19th century and brick buildings were built there when the small town on the Volga became a centre for bread and fish trade in Russia. The mansions of past merchants are still a delight to the eye of the leisurely tourist on the embankment walkway. The streets of the town are a nice place to buy souvenirs, have a cup of coffee, and enjoy life with a 19th century backdrop.
In the 19th century, Plyos had already become a favourite destination as a retreat for the nobility, artists and other holidaymakers from Moscow on hot summer days. It was at this time, when Plyos was a holiday town that the painter Isaac Levitan came here with his friends. Plyos' themes were reflected in Levitan's paintings called Quiet Abode and Evening Bells as well as in many others.
One of his most famous works, Over Eternal Peace, was painted on the mountain which is now called Levitan's Mount. The Voskreseniya Church (Resurrection Church) was moved here from the village of Bilyukovo, and built in 1700. It is very similar to the one painted by Levitan (Petropavlovskaya Church or St. Peter's and St. Paul's Church, which burnt down in 1903). There is also a monument to the painter showing Levitan at work.
The arrival of Levitan to Plyos contributed greatly to the revival of the town but in its new role as a resort. Plyos is still a quiet town, the main attraction of which is its amazing "living pictures" which make it look like a true open-air museum. The main street of the town is the embankment. In the past, all business life was concentrated here.
The embankment stretches along the Volga for nearly 2 kilometres. Most of the buildings on it were merchant houses with living rooms on the first floor while offices and storage rooms occupied the ground floor.
A small brick house in which Levitan stayed during his visits is also located on the embankment. His companion, the artist Sofya Kuvshinnikova, also rented a room in this house. Today, this house is the Levitan museum. Sofya was the wife of a police physician, an extraordinary pianist, a gifted artist and the hostess of a salon where celebrities regularly gathered. She accompanied Levitan on his visits to Plyos for several years. Now her name has become a kind of brand for the city. The historic Flour Trading Aisles Building houses Sofya Petrovna Kuvshynnykova's Cafe where "Levitan's favourite cookies" are baked today according to an old recipe.
Over three summers spent in Plyos, Levitan painted as many as nearly two hundred works, including more than twenty paintings and numerous sketches, studies, drawings and drafts. Vasily Vereshchagin and Ilya Repin also came to Plyos at different times, and the town was visited by Fyodor Shalyapin (also spelled Feodor Chaliapin) who built his own cottage a few kilometres away from it.
Today, the town provides an amazing combination of a quiet and leisurely provincial town on the Volga and a vibrant cultural life. If you go on a long walk through Plyos, you will discover more and more views and spaces and meet people with easels and canvases here and there. These people include both students and schoolchildren, and venerable and famous artists who follow Levitan's way to Plyos, this Mecca for landscape painters.
Every summer, the town hosts a large number of international festivals and competitions: the Andrey Tarkovsky Zerkalo (Mirror) International Film Festiv, the Levitan Music Festival, the International Youth Festival of Photography, the Plyos on the Volga Festival, the Linen Palette and many other events. All this, just as in the nineteenth century, attracts artists, actors, writers and people who are not indifferent to the beauty of Russian nature.