## SaludConectaMX: Lessons Learned from Deploying a Cooperative Mobile Health System for Pediatric Cancer Care in Mexico

JENNIFERJ. SCHNUR ∗ , ANGÉLICA GARCIA-MARTÍNEZ ∗ , PATRICK SOGA ∗ , KARLA BADILLO-URQUIOLA ∗ , ALEJANDRA J. BOTELLO, ANA CALDERON RAISBECK, SUGANA CHAWLA, JOSEF ERNST, WILLIAM GENTRY, RICHARD P. JOHNSON, MICHAEL KENNEL, JESÚS ROBLES, MADISON WAGNER, and ELIZABETH MEDINA, University of Notre Dame, United States JUAN GARDUÑO ESPINOSA, HORACIO MÁRQUEZ-GONZÁLEZ, VICTOR OLIVAR-LÓPEZ, LUIS E. JUÁREZ-VILLEGAS, MARTHA AVILÉS-ROBLES, ELISA DORANTES-ACOSTA, VIRIDIA AVILA, GINA CHAPA-KOLOFFON, ELIZABETH CRUZ, LETICIA LUIS, and CLARA QUEZADA, Hospital Infantil de México Federico Gómez (HIMFG), Mexico EMANUEL OROZCO and EDSON SERVÁN-MORI, Instituto Nacional de Salud Pública, Mexico

MARTHA CORDERO, Instituto Nacional De Psiquiatría Ramón De La Fuente Muñiz, Mexico RUBÉN MARTÍN PAYO, Universidad de Oviedo, España, Spain NITESH V. CHAWLA † , University of Notre Dame, United States

We developed SaludConectaMX as a comprehensive system to track and understand the determinants of complications throughout chemotherapy treatment for children with cancer in Mexico. SaludConectaMX is unique in that it integrates patient clinical indicators with social determinants and caregiver mental health, forming a social-clinical perspective of the patient's evolving health trajectory. The system is composed of a web application (for hospital staff) and a mobile application (for family caregivers), providing the opportunity for cooperative patient monitoring in both hospital and home settings. This paper presents the system's preliminary design and usability evaluation results from a 1.5-year pilot study. Our findings indicate that while the hospital web app demonstrates high completion rates and user satisfaction, the family mobile app requires additional improvements for optimal accessibility; statistical and qualitative data analysis illuminate pathways for system improvement. Based on this evidence, we formalize suggestions for health system development in LMICs, which HCI researchers may leverage in future work.

CCS Concepts: · Applied computing → Health care information systems ; · Human-centered computing → Interactive systems and tools .

Additional Key Words and Phrases: Health Equity, Mobile Health (mHealth), Pediatric Cancer, Childhood Cancer, Mobile App, Web App in low- and middle-income countries (LMICs) by 2024 [21]. On top of this, the fragmentation of health services in LMICs generates delays in diagnosis and treatment for children with cancer, reducing chances of survival [29]. Mexico, a middle-income country with cancer as the 3rd leading cause of death [18], is ranked 5th and 6th for pediatric cancer incidence (16 per 100,000) and mortality (5 per 100,000), respectively, out of 32 Latin American countries [11]. Meanwhile, Mexico faces significant challenges in the health system. For example, over 56% of youth do not have access to any type of social security program [22]. Moreover, significant diagnosis and treatment delays have been well documented in vulnerable groups of the population [15]. In this context, mobile health (mHealth) tools [17] may play a pivotal role in providing better healthcare access and cooperative health monitoring opportunities within patients' care teams; specifically, facilitating real-time data flow between caregivers and healthcare providers may inform prompt decisions that minimize the risk of complications, which can save lives and reduce financial burden for both health systems and families [16].

## 1 INTRODUCTION

Cancer is a rising public health issue across the globe, impacting countries across the Human Development Index (HDI) spectrum [5]. However, more than two-thirds of the world's cancers will occur

∗ Authors contributed equally to this paper.

† Corresponding author. Email: nchawla@nd.edu.

Authors' addresses: Jennifer J. Schnur; Angélica Garcia-Martínez; Patrick Soga; Karla Badillo-Urquiola; Alejandra J. Botello; Ana Calderon Raisbeck; Sugana Chawla; Josef Ernst; William Gentry; Richard P. Johnson; Michael Kennel; Jesús Robles; Madison Wagner; Elizabeth Medina, University of Notre Dame, South Bend, United States; Juan Garduño Espinosa; Horacio Márquez-González; Victor Olivar-López; Luis E. Juárez-Villegas; Martha Avilés-Robles; Elisa Dorantes-Acosta; Viridia Avila; Gina Chapa-Koloffon; Elizabeth Cruz; Leticia Luis; Clara Quezada, Hospital Infantil de México Federico Gómez (HIMFG), Mexico City, Mexico; Emanuel Orozco; Edson Serván-Mori, Instituto Nacional de Salud Pública, Mexico City, Mexico; Martha Cordero, Instituto Nacional De Psiquiatría Ramón De La Fuente Muñiz, Mexico City, Mexico; Rubén Martín Payo, Universidad de Oviedo, España, Oviedo, , Spain; Nitesh V. Chawla, University of Notre Dame, South Bend, United States.

Often, mHealth tools serve as supplementary resources to complement in-person clinic visits and address diverse patient needs [7], especially for those in under-served areas [27] or with socioeconomic limitations [2]. These tools help bridge health gaps by improving healthcare access, alleviating financial and transportation burdens, enhancing health education, addressing cultural and linguistic sensitivities, and offering culturally relevant interfaces [26]. They also promote the adoption of digital health records and standardized protocols, improving continuity of care and associated clinical decision-making [9]. While evidence shows that mHealth systems were successfully implemented during the COVID-19 pandemic in LMICs like India, China, Brazil, and Pakistan [4, 6, 21], none facilitate the care of children with cancer. Meanwhile, within the Human-Computer Interaction (HCI) community, several research studies have been conducted in related areas like breast cancer [12, 14], and chronic illnesses [13] more generally; however, these are focused on adult patients living outside of LMIC contexts. Previous HCI research on designing technology for childhood cancer,

specifically, has focused on promoting positive experiences during treatment [23] and identifying and supporting patient needs within the parent-child dyad [28]. While pediatric cancer care coordination using communication technology has been studied [20], this work focuses on balancing role responsibilities and tasks within families, rather than supporting patient monitoring between caregivers and healthcare providers. To the best of our knowledge, no comprehensive tool has been implemented toward this end.

In this work, we partnered with Hospital Infantil de México Federico Gómez (HIMFG) and Instituto Nacional de Salud Pública (INSP) to develop the SaludConectaMX system as a holistic approach to healthcare access and cooperative monitoring for children with cancer in Mexico. This mHealth tool supports clinicians and families collaboratively track signs and symptoms of complications, social determinants of health (SDOH), and caregiver mental health throughout the patient's treatment. This paper presents a preliminary design of our system ( artifact contribution ) and key findings from a 1.5-year pilot study ( empirical contribution ). The evidence demonstrates that SaludConectaMX has the potential to be a trusted and useful system in the Mexican context, as long as certain design and accessibility factors are addressed. The insights provided in this paper may be leveraged by HCI researchers for mHealth development, particularly within LMICs.

## 2 SYSTEM DESIGN

The SuladConectaMX system tracks clinical indicators (i.e., standard medical information, treatment, signs and symptoms of complications, etc.), caregiver attributes (i.e. mental health and substance use), and social determinants of health (SDOH) of pediatric oncology patients served by HIMFG over time. The system consists of two main components: (1) the hospital web application (HWA) for data collection by clinical and social services staff in the hospital setting and (2) the family mobile application (FMA) for data collection by patient caregivers in the home setting and during hospitalizations. Visuals of both interfaces are shown in Figure 1. Meanwhile, Figure 2 displays the interactions between all components of the system. To follow, we describe these system components and how data is collected and shared between them.

## 2.1 Hospital Web Application

The HWA is designed for hospital staff (e.g., physicians, social workers, psychiatrists, etc.) to collect pertinent information about the patient in the clinical setting (i.e., during an outpatient oncology appointment, an emergency department visit, and throughout hospitalization). Hospital staff members sign into the HWA via username and password, bringing them to the landing dashboard where all logged patients are listed (Figure 1). Staff are able to access a particular patient record via the search bar at the top of the page. If the patient is not listed in the dashboard, the staff can navigate to the Registrar Niño Nuevo (Register A New Child) tab to add the patient to the system. Each patient's record consists of a series of electronic forms, which were adapted from the existing paper data collection tools used by HIMFG staff; clicking the Crear nuevo formulario (Create a new form) button allows hospital staff to add a new form entry for a patient. The following information is collected through the HWA:

- · General Patient Information : Family demographics, beneficiary information, and housing characteristics.
- · Clinical Information : Patient medical history, oncology treatments, emergency visits, alarm signs and symptoms, infection information, and clinical outcomes.
- · SDOH : Social &amp; economic conditions, e.g., food security, expenses, difficulties receiving medical attention, etc.

## 2.2 Family Mobile Application

The FMA is designed with three main goals in mind: (1) to monitor the patient's clinical condition both at home and throughout hospitalization for potential complications post-chemotherapy treatment, (2) to assess the mental health and substance use patterns of the primary caregivers, and (3) contemporaneous sharing of SDOH variables by the primary caregiver. Families download the app at the hospital with the support of the social work team, who provide a short training using infographic materials. Support service is also provided by engineers from Monday to Saturday: 8:00 A.M. to 8:00 P.M. The FMA includes the following features:

- · Inicio (Home) : At the home page, caregivers can contact hospital app support by clicking the WhatsApp button. This sends a WhatsApp message to the IT team who assists with any technical issue.
- · Síntomas (Symptoms) : Caregivers monitor the patient at home using the signs and symptoms form. Signs include but are not limited to heart rate, temperature, respiratory rate, attitude/behavior, etc. The app is programmed to alert the user to go to the Emergency Room if certain symptoms arise.
- · Formularios (Questionnaires) : Under this tab, caregivers will find two questionnaires. The SDOH questionnaire collects data about the family's social and economic conditions that affect their ability to receive care. The bienestar del cuidador (mental health of the primary caregiver) questionnaire collects data about stress, depression, substance use, and burden via the Perceived Stress Scale (PSS) [25], Center for Epidemiological Studies-Depression Scale (CES-D-7) [10], World Health Organization's ASSIST tool [8], and Zarit Burden Interview (ZBI) [3], respectively.
- · Condiciones (Study Information) : Since the information collected from families is used for research purposes, caregivers can refer to the study information under this tab.

## 2.3 Technical Implementation

Our web and mobile applications share a common API backend written in Python as a Flask web service hosted in a secure AWS EC2 instance configured to host patient-identifiable information. Access to the EC2 instance is restricted using Okta authentication via Amazon AppStream. Calls to the API are further secured by ensuring the call originated from a logged in user from the web or mobile app. We use PostgreSQL for our database which stores

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00881v1-figure-924f6dfa-e592-45d5-a3f9-5dc0d472eaf7.jpg)

(a) Hospital web app (HWA)

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00881v1-figure-2aed0c2d-40aa-46ca-9158-896d15d5ddfe.jpg)

(b) Family mobile app (FMA) login page patient form dashboard.

and 'Signs &amp; Symptoms' form.

Fig. 1. Visuals of the SaludConectaMX Hospital Web Application (left) and Family Mobile Application (right).

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00881v1-figure-793692dd-9805-487c-8169-ab0971ff615e.jpg)

Fig. 2. SuladConectaMX system organization (top) and documentation throughout the patient trajectory (bottom). Colors indicate matchings between high-level data categories captured by the system and relevant forms completed over time.

all form data across the patient trajectory (Figure 2). The patientfacing mobile portion of the application was built with the crossplatform framework Flutter using the Dart programming language and communicates with the same Flask API as the HWA. We chose Flutter to be able to write applications for both iOS and Android.

## 3 PILOT STUDY FINDINGS

We conducted a preliminary usability evaluation of the SaludConectaMX system focusing on two key elements: (1) the success of practical system use and (2) user satisfaction via surveys and interviews.

## 3.1 System Use

Between June 6th, 2022 and November 21st, 2023 (17.53 months), 310 patients presented to HIMFG for oncology services. Of these patients, 274 (88.4%) enrolled in the SaludConectaMX system, 21 (6.8%) rejected participation, 12 (3.9%) lacked internet access, 6 (1.9%) were lost during follow-up, and 3 (0.97%) lacked appropriate technology. Of the 274 enrolled patients, 165 (60.2%) were male and 109 (39.8%) were female. The age range of patients at enrollment was between 0.10 and 19.76 years (IQR: 4.95 - 12.34 years).

System usage results (i.e., the percentage of patients with at least one documented required form type at the relevant time points) are shown in Table 1. Over the course of the pilot phase, HWA forms achieved completion rates between 88 2% . -100%, indicating successful use of the system by healthcare professionals. Meanwhile, caregiver form completion rates within the FMA are notably lower (57 7% . -63 9%), with 162 (59 1%) patients missing at least one out of . . six FMA forms. In order to account for potential barriers, a multidisciplinary team (consisting of medical residents, social workers, and psychologists) began to assist caregivers in downloading the app and completing forms (starting March, 2023); however, there was no statistical difference in the average number of FMA forms completed per patient pre- vs. post-assistance ( 𝑝 = 0 815, via permutation test), . motivating further investigation into observed missingness. Initial hypotheses included:

- (1) Caregiver sensitivities toward reporting poor mental health. For each of the mental health forms (depression, stress, and burden), we compared the mean scores observed in our population of caregivers to the scores observed in the populations in which the original surveys were developed. We do not find a statistically significant difference in means for stress ( 𝑝 = 0 567) or burden ( . 𝑝 = 0 199); however, a signif-. icant difference for depression scores was noted ( 𝑝 &lt; 0 001), . as well as strong right-skew ( 𝑝 = 0 008), which may indicate . under-reported depression cases (i.e., data may be 'missing not at random'). Additional support from Psychiatric specialists may mitigate this missingness in the future.
- (2) Social, economic, &amp; demographic characteristics of the caregivers. Using observed variables within the HWA (SDOH, History, and Social Work forms), we investigate associations with FMA missingness. In addition to various associations with caregiver occupations, marital status, and roles, there were statistically significant differences in the mean number of FMA forms completed for those living at residences with and without internet access ( 𝑝 = 0 019 , gas . )

Table 1. System usage results, summarized for each form and system section. Cells are highlighted using a continuous red-yellow-green gradient associated with a 0 -100% completion scale. Note: the denominator 𝑁 drops from 274 to 169 for forms that are only required following Emergency visits.

| Form Name                     | Completion Time                                                              |   N | Completed at least once (%)   |
|-------------------------------|------------------------------------------------------------------------------|-----|-------------------------------|
| Medical History (HWA)         | Enrollment (1x)                                                              | 274 | 274 (100%)                    |
| Social Work (HWA)             | Enrollment (plus annually)                                                   | 274 | 250 (95.1%)                   |
| SDOH (HWA)                    | Enrollment (1x)                                                              | 274 | 253 (96.2%)                   |
| Oncology (HWA)                | Oncology Appts.                                                              | 274 | 263 (96.0%)                   |
| Caregiver Burden (FMA)        | Enrollment (1x)                                                              | 274 | 171 (62.4%)                   |
| Caregiver Stress (FMA)        | Enrollment (1x)                                                              | 274 | 175 (63.9%)                   |
| Caregiver Depression (FMA)    | Enrollment (1x)                                                              | 274 | 175 (63.9%)                   |
| Caregiver Substance Use (FMA) | Enrollment (1x)                                                              | 274 | 175 (63.9%)                   |
| SDOH (FMA)                    | Oncology appts.                                                              | 274 | 158 (57.7%)                   |
| S&S (FMA)                     | Every 8 Hours                                                                | 274 | 165 (60.2%)                   |
| Emergency (HWA)               | Emergency Visits (hospitalization day 1)                                     | 274 | 169 (61.7%)                   |
| Infectiology (HWA)            | At least once during hospitalizations (+ optional during oncology appts.)    | 169 | 160 (94.7%)                   |
| Clinical Alarm Signs (HWA)    | Days 1 and 3 of hospitalizations (+ optional during oncology appts.)         | 169 | 151 (89.3%)                   |
| S&S (HWA)                     | Every 6 hours during Oncology appts. & Every 4 hours during hospitalizations | 169 | 158 (93.5%)                   |
| Outcomes (HWA)                | Once during hospitalizations                                                 | 169 | 149 (88.2%)                   |

( 𝑝 = 0 024 , and street lighting . ) ( 𝑝 = 0 048 . Similarly, the . ) mother's education level was correlated with the number of FMAformscompleted ( 𝑝 = 0 012 . These findings illuminate . ) the need to design a more accessible system.

## 3.2 User Satisfaction

User satisfaction was studied in two ways. First, healthcare personnel were asked to complete the Mobile Application Rating Scale (MARS) survey [24, 30], which measures an health app's engagement, functionality, aesthetics, and information quality, as evaluated by the user on 5-point rating scales. This tool has been previously validated for pediatric oncology patients in the Spanish context [1, 19], which translated well to the Mexican context without adaptation. Then, our research team selected a small group of healthcare personnel and caregivers to participate in unstructured interviews regarding their experiences with the system. The findings are summarized as follows.

- 3.2.1 MARS Survey Results. Between July 17, 2023 and October 12, 2023, 18 health personnel completed the MARS survey, of which 4

Table 2. Hospital Web App for Health Personnel, user satisfaction (MARS) survey results, summarized within survey subcategories across respondents. Cells are colored using a continuous red-yellow-green gradient associated with the 1-5 rating scale values (1 = inadequate; 5 = excellent).

| MARS Category       | MARS Subcategory        |   N |   Mean |   Median |   IQR |   IQR |
|---------------------|-------------------------|-----|--------|----------|-------|-------|
| Aesthetics          | Graphics                |  18 |   3.83 |        4 |  3.25 |  4.75 |
| Aesthetics          | Layout                  |  18 |   3.44 |        4 |  2    |  4    |
| Aesthetics          | Visual Appeal           |  18 |   3.67 |        4 |  4    |  4    |
| Engagement          | Fun                     |  18 |   2.11 |        2 |  1    |  3    |
| Engagement          | Individual Adaptability |  18 |   1.83 |        1 |  1    |  3    |
| Engagement          | Interactivity           |  18 |   2.44 |        3 |  2    |  3    |
| Engagement          | Interest                |  18 |   3.61 |        3 |  3    |  4.75 |
| Engagement          | Target Group            |  18 |   3.94 |        4 |  3.25 |  4    |
| Functionality       | Gestural Design         |  18 |   3.33 |        4 |  2.25 |  4    |
| Functionality       | Navigation              |  18 |   4.11 |        4 |  4    |  4.75 |
| Functionality       | Performance             |  18 |   3.83 |        4 |  3.25 |  4    |
| Functionality       | Usability               |  18 |   3.56 |        4 |  3    |  4    |
| Information Quality | Description Accuracy    |  18 |   3.89 |        4 |  4    |  4    |
| Information Quality | Credibility             |  18 |   4.28 |        4 |  4    |  4.75 |
| Information Quality | Evidence Base           |  10 |   3.5  |        4 |  3    |  4    |
| Information Quality | Goals                   |  16 |   3.75 |        4 |  3    |  4    |
| Information Quality | Info Quality            |  18 |   4.06 |        4 |  4    |  4.75 |
| Information Quality | Info Quantity           |  17 |   3.88 |        4 |  4    |  4    |
| Information Quality | Visual Info Quality     |  16 |   3.94 |        4 |  4    |  4    |

(22.2%) were male and 14 (77.8%) were female. The average age of the survey respondents was 24.4 years (IQR: 24.0 - 25.0). Of the 18 respondents, 1 (5.6%) completed their master's degree, 1 (5.6%) has an incomplete master's degree, 8 (44.4%) completed their bachelor's degree, 6 (33.3%) have an incomplete bachelor's degree, and 2 (11.1%) completed high school. The survey results are shown in Table 2.

For most survey subcategories, the average rating was at least 3.33 (median at least 4.0), exhibiting acceptable-to-good quality system design. In particular, 'Credibility,' 'Navigation,' and 'Information Quality,' all averaged above a 4.0 rating, emphasizing the professional and comprehensive nature of the HWA, which inspires confidence that future data analysis will provide meaningful insights to the care team. The exceptions were the 'Engagement' subcategories labeled 'Fun,' 'Individual Adaptability,' and 'Interactivity.' While engagement is important for general system design, we argue that including 'Fun' aspects may not be appropriate within a health monitoring system for chronically ill children. Similarly, 'Individual Adaptability' was not a priority for this system, as standardized data collection was required across all patients. However, 'Interactivity' components, such as notifications, reminders, or sharing options, may improve communication and data quality, and we plan to implement these features in future work.

•

3.2.2 Unstructured Interview Results. Two members of our research team conducted open-ended interviews to identify barriers experienced by system users. Participants included 1 social worker, 6 medical residents, 1 family who participated in the system, and 1 family who elected not to participate. Detailed findings from these interviews are provided in Table 3. Key problems and actionable change recommendations are summarized as follows:

- · Additional Resources &amp; Helpful Functionalities: Hospital staff noted that inconsistent internet availability within the hospital contributes to form submission difficulties, which may be resolved with additional modems; meanwhile, caregivers noted that limited mobile credit combined with a lack of perceived benefit (often due to limited health and tech literacy) prevented frequent use of the FMA. Participants also expressed that the system could benefit from functionalities that produce more direct value and incentivize use, such as plan of care notes, reminders, appointment scheduling, chat bots to resolve doubts [31], emergency event communication, and elimination of factors that contribute to documentation fatigue. These improvements will be made in future work.
- · Intuitive Design &amp; Training: Participants indicated that app usage was not always intuitive (e.g., understanding inclusion criteria, to whom questions pertain, when to submit forms, whether or not forms were properly submitted, etc.). Caregivers noted that these difficulties were compounded by insufficient explanation at the hospital. Therefore, the research team will provide more instructive detail within the system and ensure more robust training for healthcare staff, as well as educational supplements for caregivers, targeting both health and tech literacy.

## 4 CONCLUSION

SaludConectaMX is a comprehensive pediatric cancer monitoring tool that facilitates collaboration between caregivers and healthcare professionals through dual interfaces. Although successful engineering of mHealth systems in LMICs faces multiple challenges, the work reported in this paper represents good progress toward a practical system that addresses health disparities through technological intervention. We distill the lessons learned from our pilot phase into three key takeaways to inspire future HCI research geared toward similar goals:

- (1) Health monitoring tools must not contribute to care team burden or confusion; instead, consistent use should be incentivized via intuitive design and helpful functionalities.
- (2) System roll-out must incorporate extensive training to ensure that healthcare professionals can confidently use the system and communicate instructions to caregivers for successful use at home. Similarly, robust education for caregivers is needed with respect to health and tech literacy.
- (3) Sustainable solutions are needed for long-term adoption of mHealth interventions, especially for those with socioeconomic limitations who stand to benefit the most. Thus, focus groups and ethnographic studies are required to effectively identify barriers and facilitate co-created (re-)design of said

Table 3. Barrier findings and suggested system improvements from unstructured interviews with healthcare staff and caregivers.

| Interviewee                   | Barrier Description                                                                                                                                                                                            | Barrier Classification                        | System Recommendation                                                                                                                                                                                            |
|-------------------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|-----------------------------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| Social Worker                 | (HWA) A limited number of healthcare staff are available for data collection; those with little system experience were recruited.                                                                              | Training / Education                          | More thorough training for system users will help reduce data collection challenges and biases.                                                                                                                  |
| Social Worker                 | (FMA) Caregivers experience fatigue and confusion when filling out forms repeatedly throughout the system.                                                                                                     | Design / Functionality                        | More user-friendly and instructive design adjustments will be made in future work.                                                                                                                               |
| Social Worker                 | (FMA) Caregivers are less interested in participating if they have had poor experiences / interactions with physicians.                                                                                        | Training / Education                          | Healthcare staff will help build positive rapport with families and introduce them to the benefits of the system for their child's wellbeing.                                                                    |
| Social Worker                 | (FMA) Caregivers are reluctant to use the app, as they do not perceive any direct benefits.                                                                                                                    | Design / Functionality + Training / Education | Develop more helpful app features (e.g., reminders, appointment scheduling, chatbot), as well as health literacy education.                                                                                      |
| Social Worker                 | (FMA) Caregivers often answer questions that pertain to the family unit only with respect to the patient (e.g., food security responses often do not reflect sacrifices that parents make for their children). | Design / Functionality + Training / Education | Adding further specifications for certain form questions will ensure better data quality. These details can also be reinforced through training.                                                                 |
| Medical Residents             | (HWA + FMA) Internet access is often limited both inside and outside the hospital, making it difficult to submit forms.                                                                                        | Resources                                     | Adding modems within the hospital may resolve this issue for the hospital staff.                                                                                                                                 |
| Medical Residents             | (FMA) Caregivers often forget to fill out forms and attend appointments. Others only use the app when they perceive that their child is at risk for a complication event.                                      | Design / Functionality + Training / Education | Additional features may assist and incentivize use (e.g., reminders, appointment scheduling, chat bots to resolve doubts, educational videos to enhance health literacy, etc.).                                  |
| Medical Residents             | (HWA + FMA) Patients and their caregivers often require medical assistance during the journey to the hospital once symptoms of a complication begin.                                                           | Design / Functionality                        | Additional features that support communication between caregivers & hospital staff will assist with emergency events (e.g., an emergency button to notify the hospital about incoming patients, WhatsApp, etc.). |
| Medical Residents             | (HWA) Some fields are left blank in the emergency forms and are only filled at a later time, introducing data bias.                                                                                            | Design / Functionality + Training / Education | Instructional design improvements and additional training for healthcare staff may ensure that fields are completed at the proper time points.                                                                   |
| Medical Residents             | (FMA) Caregivers expressed they they feel uncomfortable taking vital signs and do not collect this data as a result.                                                                                           | Training / Education                          | Additional education and training is needed to support caregivers with at-home monitoring.                                                                                                                       |
| Participating Caregivers      | (FMA) Caregivers reflect that they did not consider using the app until their child experienced an emergency event.                                                                                            | Training / Education                          | Improve communication between healthcare staff and families via additional training.                                                                                                                             |
| Participating Caregivers      | (FMA) Caregivers express uncertainty as to whether or not data has been properly logged in the system.                                                                                                         | Design / Functionality                        | More intuitive app design is needed to confirm that data has been logged properly by the user.                                                                                                                   |
| Participating Caregivers      | (FMA) Insufficient mobile credit prevents frequent data collection.                                                                                                                                            | Resources                                     | Focus groups and ethnographic studies may reveal sustainable solutions that ensure accessibility.                                                                                                                |
| Participating Caregivers      | (FMA) Most app functionalities are not explained at the time the app is downloaded at the hospital (e.g., some caregivers were unaware of mental health resources available within the app).                   | Design / Functionality + Training / Education | Caregivers may benefit from an in-app walkthrough to see available features. Additional training is also needed to improve communication between healthcare staff and caregivers.                                |
| Non- Participating Caregivers | (FMA) Caregivers express that they understand what an emergency event looks like and do not believe the app will provide added support.                                                                        | Design / Functionality + Training / Education | Add functionalities that incentivize use of the app beyond emergency event recognition (see above), as well as education to increase health literacy.                                                            |
| Non- Participating Caregivers | (FMA) Caregivers express that instructions for care at home are not always clear.                                                                                                                              | Design / Functionality                        | Provide functionality that allows physicians to record plan of care instructions for caregivers to reference.                                                                                                    |
| Non- Participating Caregivers | (FMA) Some caregivers had no knowledge of the app until late in their child's diagnosis / treatment.                                                                                                           | Training / Education                          | Provide hospital staff with clarification on patient inclusion criteria for system use.                                                                                                                          |

systems to optimally serve users from diverse backgrounds. We plan to implement these studies in future work.

## REFERENCES

## ACKNOWLEDGMENTS

We thank the Lucy Family Institute for Data and Society, the University of Notre Dame, the National Institute of Pediatrics 'Hospital Infantil de México Federico Gómez', and Mexico's National Institute of Public Health for supporting this research. Special thanks to HIMFG staff and the participating patients and their families.

- [1] Miguel Ángel Amor-García, Roberto Collado-Borrell, Vicente Escudero-Vilaplana, Alejandra Melgarejo-Ortuño, Ana Herranz-Alonso, José Ángel Arranz Arija, and María Sanjurjo-Sáez. 2020. Assessing apps for patients with genitourinary tumors using the mobile application rating scale (MARS): systematic search in app stores and content analysis. JMIR mHealth and uHealth 8, 7 (2020), e17609.
- [2] Amelia Barwise, Todd Huschka, Cecelia Woo, Jason Egginton, Lily Huang, JaySheree Allen, Matthew Johnson, Kathryn Hamm, Wendy Wolfersteig, Sean Phelan, et al. 2023. Perceptions and Use of Telehealth Among Diverse Communities: Multisite Community-Engaged Mixed Methods Study. Journal of medical Internet research 25 (2023), e44242.

- [3] Michel Bédard, D William Molloy, Larry Squire, Sacha Dubois, Judith A Lever, and Martin O'Donnell. 2001. The Zarit Burden Interview: a new short version and screening version. The gerontologist 41, 5 (2001), 652-657.
- [4] Karthik S Bhat, Mohit Jain, and Neha Kumar. 2021. Infrastructuring Telehealth in (In)Formal Patient-Doctor Contexts. Proc. ACM Hum.-Comput. Interact. 5, CSCW2, Article 323 (oct 2021), 28 pages. https://doi.org/10.1145/3476064
- [5] Freddie Bray, Mathieu Laversanne, Hyuna Sung, Jacques Ferlay, Rebecca L. Siegel, Isabelle Soerjomataram, and Ahmedin Jemal. 2024. Global cancer statistics 2022: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA: A Cancer Journal for Clinicians 74, 3 (2024), 229-263. https://doi.org/10.3322/caac.21834 arXiv:https://acsjournals.onlinelibrary.wiley.com/doi/pdf/10.3322/caac.21834
- [6] Bruna Santana Capeleti, Gustavo Lopes Dominguete, Marluce Rodrigues Pereira, and André Pimenta Freire. 2021. Interactive Emergency TeleHealth Systems in Pandemic Times: a Usability Evaluation in the Interior of Brazil. In Proceedings of the XX Brazilian Symposium on Human Factors in Computing Systems (Virtual Event, Brazil) (IHC '21) . Association for Computing Machinery, New York, NY, USA, Article 31, 7 pages. https://doi.org/10.1145/3472301.3484337
- [7] Shilpa N Gajarawala and Jessica N Pelkowski. 2021. Telehealth benefits and barriers. The Journal for Nurse Practitioners 17, 2 (2021), 218-221.
- [8] WHOASSIST Working Group. 2002. The alcohol, smoking and substance involvement screening test (ASSIST): development, reliability and feasibility. Addiction 97, 9 (2002), 1183-1194.
- [9] Abid Haleem, Mohd Javaid, Ravi Pratap Singh, and Rajiv Suman. 2021. Telemedicine for healthcare: Capabilities, features, barriers, and applications. Sensors international 2 (2021), 100117.
- [10] Juan Herrero and Enrique Gracia. 2007. A brief measure of depressive symptomatology (CESD-7). Salud Mental 30, 5 (2007), 40-46.
- [11] World Health Organization International Agency for Research on Cancer. 2022. Crude rate per 100 000, Incidence and Mortality, Both sexes, age [0-19], in 2022 . World Health Organization.
- [12] Maia Jacobs, James Clawson, and Elizabeth D. Mynatt. 2016. A Cancer Journey Framework: Guiding the Design of Holistic Health Technology. In Proceedings of the 10th EAI International Conference on Pervasive Computing Technologies for Healthcare (Cancun, Mexico) (PervasiveHealth '16) . ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), Brussels, BEL, 114-121.
- [13] Maia Jacobs, Galina Gheihman, Krzysztof Z Gajos, and Anoopum S Gupta. 2019. " I think we know more than our doctors" How Primary Caregivers Manage Care Teams with Limited Disease-related Expertise. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1-22.
- [14] Maia Jacobs, Jeremy Johnson, and Elizabeth D. Mynatt. 2018. MyPath: Investigating Breast Cancer Patients' Use of Personalized Health Information. Proc. ACM Hum.-Comput. Interact. 2, CSCW, Article 78 (nov 2018), 21 pages.
- [15] Felicia Marie Knaul, Hector Arreola-Ornelas, Michael Touchton, Tim McDonald, Merike Blofield, Leticia Avila Burgos, Octavio Gómez-Dantés, Pablo Kuri, Adolfo Martinez-Valle, Oscar Méndez-Carniado, et al. 2023. Setbacks in the quest for universal health coverage in Mexico: Polarised politics, policy upheaval, and pandemic disruption. The Lancet 402, 10403 (2023), 731-746.
- [16] Dorothy Lall, Nora Engel, Narayanan Devadasan, Klasien Horstman, and Bart Criel. 2018. Models of care for chronic conditions in low/middle-income countries: a 'best fit'framework synthesis. BMJ Global Health 3, 6 (2018), e001077.
- [17] Judith McCool, Rosie Dobson, Robyn Whittaker, and Chris Paton. 2022. Mobile health (mHealth) in low-and middle-income countries. Annual Review of Public Health 43 (2022), 525-539.
- [31] Yuan-Chi Tseng, Weerachaya Jarupreechachan, and Tuan-He Lee. 2023. Understanding the Benefits and Design of Chatbots to Meet the Healthcare Needs of Migrant Workers. Proc. ACM Hum.-Comput. Interact. 7, CSCW2, Article 315 (oct 2023), 34 pages. https://doi.org/10.1145/3610106

| [18]   | Alejandro Mohar-Betancourt, Nancy Reynoso-Noverón, Daniel Armas-Texta, Cristina Gutiérrez-Delgado, and Juan A Torres-Domínguez. 2017. Cancer trends in Mexico: essential data for the creation and follow-up of public policies. Journal of global oncology 3, 6 (2017), 740-748.                                                                                                                                                             |
|--------|-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| [19]   | Álvaro Narrillos-Moraza, Patricia Gómez-Martínez-Sagrera, Miguel Ángel Amor- García, Vicente Escudero-Vilaplana, Roberto Collado-Borrell, Cristina Villanueva- Bueno, Ignacio Gómez-Centurión, Ana Herranz-Alonso, and María Sanjurjo-Sáez. 2022. Mobile apps for hematological conditions: review and content analysis using the mobile app rating scale. JMIR mHealth and uHealth 10, 2 (2022), e32826.                                     |
| [20]   | Sarah Nikkhah, Swaroop John, Krishna Supradeep Yalamarti, Emily L. Mueller, and Andrew D. Miller. 2022. Family Care Coordination in the Children's Hospital: Phases and Cycles in the Pediatric Cancer Caregiving Journey. Proc. ACM Hum.- Comput. Interact. 6, CSCW2, Article 296 (nov 2022), 30 pages. https://doi.org/10. 1145/3555187                                                                                                     |
| [21]   | Global Burden of Disease 2019 Cancer Collaboration. 2022. Cancer Incidence, Mortality, Years of Life Lost, Years Lived With Disability, and Disability-Adjusted Life Years for 29 Cancer Groups From 2010 to 2019: A Systematic Analysis for the Global Burden of Disease Study 2019. JAMA Oncology 8, 3 (03 2022), 420-444.                                                                                                                  |
| [22]   | Centro Nacional para la Salud de la Infancia y Adolescencia. 2019. https: //www.gob.mx/salud%7Ccensia/articulos/cancer-infantil-en-mexico-130956                                                                                                                                                                                                                                                                                              |
| [23]   | Sun Young Park, Woosuk Seo, Andrew B.L. Berry, Hyeryoung Kim, Sanya Verma, Sung Won Choi, and Ayse G. Buyuktur. 2020. Learning from Positive Adaptations of Pediatric Cancer Patients to Design Health Technologies. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (, Honolulu, HI, USA,) (CHI '20) . Association for Computing Machinery, New York, NY, USA, 1-12. https://doi.org/10.1145/3313831.3376397 |
| [24]   | R Martin Payo, MM Fernandez Álvarez, M Blanco Díaz, M Cuesta Izquierdo, Stoyan R Stoyanov, and E Llaneza Suárez. 2019. Spanish adaptation and validation of the Mobile Application Rating Scale questionnaire. International Journal of Medical Informatics 129 (2019), 95-99.                                                                                                                                                                |
| [25]   | Mónica Teresa González Ramírez and René Landero Hernández. 2007. Factor structure of the Perceived Stress Scale (PSS) in a sample from Mexico. The Spanish journal of psychology 10, 1 (2007), 199-206.                                                                                                                                                                                                                                       |
| [26]   | Wayne J Riley. 2012. Health disparities: gaps in access, quality and affordability of medical care. Transactions of the American Clinical and Climatological Association 123 (2012), 167.                                                                                                                                                                                                                                                     |
| [27]   | Carmelle V Romain, Stephen Trinidad, and Meera Kotagal. 2022. The effect of social determinants of health on telemedicine access during the COVID-19 pandemic. Pediatric Annals 51, 8 (2022), e311-e315.                                                                                                                                                                                                                                      |
| [28]   | Woosuk Seo, Ayse G. Buyuktur, Sung Won Choi, Laura Sedig, and Sun Young Park. 2021. Challenges in the Parent-Child Communication of Health-related Information in Pediatric Cancer Care. Proc. ACM Hum.-Comput. Interact. 5, CSCW1, Article 110 (apr 2021), 24 pages. https://doi.org/10.1145/3449184                                                                                                                                         |
| [29]   | Marina Siqueira, Maíra Coube, Christopher Millett, Rudi Rocha, and Thomas Hone. 2021. The impacts of health systems financing fragmentation in low-and middle-income countries: a systematic review protocol. Systematic reviews 10, 1 (2021), 1-8.                                                                                                                                                                                           |
| [30]   | Yannik Terhorst, Paula Philippi, Lasse B Sander, Dana Schultchen, Sarah Paganini, Marco Bardus, Karla Santo, Johannes Knitza, Gustavo C Machado, Stephanie Schoeppe, et al. 2020. Validation of the mobile application rating scale (MARS). Plos one 15, 11 (2020), e0241480.                                                                                                                                                                 |
Jennifer J. Schnur Angélica Garcia-Martínez Patrick Soga Karla Badillo-Urquiola Alejandra J. Botello Ana Calderon Raisbeck Sugana Chawla Josef Ernst William Gentry Richard P. Johnson Michael Kennel Jesús Robles Madison Wagner Elizabeth Medina Juan Garduño Espinosa Horacio Márquez-González Victor Olivar-López Luis E. Juárez-Villegas Martha Avilés-Robles Elisa Dorantes-Acosta Viridia Avila Gina Chapa-Koloffon Elizabeth Cruz Leticia Luis Clara Quezada Emanuel Orozco Edson Serván-Mori Martha Cordero Rubén Martín Payo Nitesh V. Chawla
SaludConectaMX: Lessons Learned from Deploying a Cooperative Mobile Health System for Pediatric Cancer Care in Mexico
We developed SaludConectaMX as a comprehensive system to track and understand
the determinants of complications throughout chemotherapy treatment for
children with cancer in Mexico. SaludConectaMX is unique in that it integrates
patient clinical indicators with social determinants and caregiver mental
health, forming a social-clinical perspective of the patient's evolving health
trajectory. The system is composed of a web application (for hospital staff)
and a mobile application (for family caregivers), providing the opportunity for
cooperative patient monitoring in both hospital and home settings. This paper
presents the system's preliminary design and usability evaluation results from
a 1.5-year pilot study. Our findings indicate that while the hospital web app
demonstrates high completion rates and user satisfaction, the family mobile app
requires additional improvements for optimal accessibility; statistical and
qualitative data analysis illuminate pathways for system improvement. Based on
this evidence, we formalize suggestions for health system development in LMICs,
which HCI researchers may leverage in future work.