Predictors of Engagement in Multiple Modalities of Digital Mental Health Treatments: Longitudinal Study
Mental health and substance use disorders are leading causes of disease burden in the United States . However, while nearly 25% of adults experience a mental disorder at any given time , less than a quarter (21.7%) of individuals with a mental disorder receives treatment from a licensed mental health clinician . This discrepancy between the prevalence of mental health disorders and rates of mental health service use is largely attributed to barriers to health care access, such as not being able to schedule an appointment in a timely manner  and persistent shortages in the mental health workforce—especially in rural communities and for people with serious mental illness . As the demand for psychological services outpaces the supply of mental health providers, innovative mental health care delivery models are increasingly needed. Digital mental health (digital health) platforms represent a promising approach to deliver accessible, scalable, and timely mental health care. These platforms often provide care through multiple modalities with varying intensities (eg, traditional one-on-one telepsychotherapy or telecoaching, asynchronous self-guided treatments, and telegroup-based treatments). As digital health platforms can be equipped to provide a range of treatments to patients, they have the potential to dismantle key barriers to patient care, including mental health provider shortages and inequitable access to mental health treatment . However, digital health platforms can be challenging to implement, largely because user adoption and continued engagement are relatively low . While traditional psychotherapy also struggles with early dropout rates ranging between 8% and 20% , digital health historically has seen much higher rates of discontinuation . As a result, while they hold the potential to promote increased, equitable access to mental health care, additional research is needed to determine how to facilitate increased engagement in mental health care from digital health platforms. Recent research investigating engagement in digital health applications after initial adoption suggests that several factors, including user attributes (eg severity of depressive symptoms), technology issues (eg concerns about anonymity and privacy), components of user experience (eg, interface design of a digital health application)  and motivation to engage in the health goal of interest, are associated with continued use . Other research indicates that users’ beliefs about the severity of their health conditions may also be associated with digital health adoption and continued use  and that improvement in psychological outcomes of interest during early treatment may predict continued engagement . Finally, it is important to understand the appropriate level of engagement in different services given a user’s needs and preferences. Not all users will need long-term unlimited engagement with a digital health platform, and engagement likely involves evaluating the need for continued use . As the number of digital mental health platforms continues to grow and more modalities of digital mental health care (eg, podcasts, online courses, meditations, discussion boards, etc.) become available to consumers, it is critical to understand predictors of engagement in digital mental health care. Elucidating the range of factors that predict initial and continued use of digital health services for mental health will support these platforms in further customizing care approaches to maximize user engagement, and ultimately, optimize personalized mental health treatment. The purpose of this study was to identify predictors of engagement in multiple modalities of mental health treatments offered on an employer-sponsored digital mental health care benefit. 

Design and Participants This investigation was part of a prospective, longitudinal, observational study of individuals who received services through an employer-sponsored digital mental health benefits platform (Modern Health Inc). The study timeframe was from September 20, 2021, to May 31, 2022. Eligible participants were 18 years or older, based in the United States, registered for the benefit, and had access to a smartphone, tablet, or computer. Procedures Eligible employees registered for a Modern Health account through a mobile app or website and completed several onboarding assessments, which asked about areas of focus, care modality preferences, and clinical symptoms. The platform’s proprietary algorithm recommended an initial care pathway to participants based on this information. Recommendations used a stratified stepped care model, meaning that patients with higher acuity and with certain areas of focus were more likely to be recommended to more intensive care options (eg, one-on-one teletherapy) (more details in ). Participants could use their recommended care or self-refer or be referred by a provider to any combination of care. Members who matched with a provider or used at least 1 digital resource after onboarding were invited by email to complete a screening questionnaire within 2 weeks of onboarding, which contained questions about demographics. We used the demographic screening information for purposeful recruitment to ensure representation in racial and ethnic identities, gender identities, socioeconomic status, age groups, and mental health symptoms at baseline. After the screening questionnaire, eligible participants were directed to a consent form to provide informed consent. Consenting participants were sent the baseline survey asking questions about their mental, social, and physical health by email along with instructions and compensation. Participants were sent a follow-up survey at 12 weeks post baseline that contained the same mental, social, and physical health questions. All forms and surveys were hosted on Qualtrics’ online survey platform. Digital Mental Health Services Individuals in this study were able to engage in all of the following digital mental health services, within the limits of their employer-covered sessions for 1:1 care modalities. Self-directed digital resources had no limits. Digital Resources Participants had access to a digital library of programs and resources they could use in unlimited quantities at any time. These included daily meditative exercises, interactive programs and podcasts, mindfulness exercises like meditations and breathing exercises, and self-paced structured educational lessons (similar to self-help workbooks). All digital materials were developed and designed by an in-house team of clinical psychologists. Digital health programs were designed to cover topics such as emotions, relationships, professional life, healthy lifestyles, and finances. Engagement across all digital resources was combined in analyses to represent total digital program engagement. Telecoaching Coaches were certified by an International Coaching Federation accredited program and underwent a careful screening process by Modern Health. They provided 30-minute telecoaching services to eligible employees through a videoconferencing platform (Zoom; Zoom Video Communications). Coaches and participants were also able to communicate by messaging within the app. All coaches had at least 150 hours of coaching experience in addition to completing additional training in evidence-based techniques and Modern Health’s proprietary model of care. Rather than being confined to any specific protocol, coaches were encouraged to implement evidence-based techniques where appropriate. The number of coaching sessions attended by participants depended on the number of sessions covered by their employer, as well as on personal preferences and their level of need. Teletherapy Furthermore, 50 minutes one-on-one teletherapy sessions were provided through a videoconferencing platform (Zoom) by licensed and vetted therapists who had an advanced degree in clinical psychology or a related field (eg, PhD, PsyD, LCSW, LMFT, or LPC). Similar to telecoaching, therapists and participants were able to communicate through messaging in-app. All therapists were skilled in evidence-based practices, such as cognitive behavioral therapy, acceptance and commitment therapy, and dialectical behavior therapy and had completed additional training in Modern Health’s proprietary model of care. Similar to telecoaching, the number of therapy sessions attended by participants depended on the number of sessions covered by their employer, as well as on personal preferences and their level of need . Outcome Measures Engagement in digital mental health services: We created 4 outcome variables to capture engagement in platform services. First, we created a 4-level categorical variable to represent use of the digital health services: (1) only self-directed digital resource use, (2) only telecoach or teletherapist use, (3) use of both digital and telecoach or teletherapist modalities, and (4) no use of any modality. Second, we created a binary variable (0/1) indicating whether participants used at least 1 service within the platform (inclusive of self-directed digital resources, one-on-one telecoaching visits, and one-on-one teletherapy visits). Third, we created a binary variable (0/1) indicating whether participants used at least one of the self-directed digital resources collapsed across resource types: meditative exercises, programs, meditations, and podcasts. Fourth, we created a count of the number of self-directed digital resources each participant used. The use of both self-directed digital resources and 1:1 modalities was collected automatically by the digital mental health platform. Engagement data during the study period (between the baseline and follow-up surveys) was extracted from the platform for analysis. Predictor Measures Demographics Participants self-identified their age, race and ethnicity (American Indian or Alaskan Native, Asian, Black or African American, Hawaiian or Pacific Islander, Hispanic, Latino, or Spanish origin, non-Hispanic white, prefer to self-describe, multiracial; collapsed to non-Hispanic White vs non-White), gender identity (man, woman, non-binary), and educational attainment (less than a bachelors’ degree, bachelors’ degree, and more than a bachelors’ degree). Depression The 9-item Patient Health Questionnaire (PHQ-9)  was used to assess the presence of depression symptoms over the past 2 weeks. Participants responded on a 4-point scale (0= “Not at all,” 3= “Nearly every day”), and total scores were categorized into 1 of 5 severity ratings: none, minimal, mild, moderate, or moderately severe. Higher scores indicate higher severity of depression symptomatology. Anxiety Symptoms The 7-item Generalized Anxiety Disorder Questionnaire (GAD-7)  was used to assess the presence of anxiety symptoms over the past 2 weeks. Participants responded on a 4-point scale (0=“Not at all,” 3=“Nearly every day”) and total scores were categorized into 1 of 4 severity ratings: minimal, mild, moderate, or severe. Higher scores indicate higher severity of anxiety symptomatology. Well-Being The 5-item World Health Organization Well-Being Index (WHO-5)  was used to assess well-being over the past 2 weeks. This construct was assessed during the onboarding process, approximately 2 weeks before the baseline assessment. Participants responded on a 6-point scale (0=“At no time,” 5=“All of the time”). Higher scores indicate greater subjective well-being. Patient Activation The 13-item Patient Activation Measure for Mental Health (PAM-MH) was used . Participants chose from 5 possible response options ranging from 1=Strongly Disagree to 4=Strongly Agree to 5=Not Applicable. Higher scores indicate higher patient activation. Mental Health Literacy Mental health literacy was measured using 13 items from the Mental Health Literacy Scale (MHLS) . Response options ranged from 1=Strongly Disagree to 5=Strongly Agree. Area of Focus Participants were able to choose from over 40 topics of focus, or reasons for registering for the platform, during the onboarding process. These topics were wide-ranging and organized by the following well-being dimensions: “my emotions,” “my professional life,” “my physical well-being,” “my relationships,” and “my finances.” One-on-One Care Engagement Variables indicating whether participants had used at least telecoaching (0/1) or teletherapy (0/1) sessions within the platform were also included as predictors in analyses predicting the use of self-directed digital resources. Statistical Analyses We conducted 4 sets of analyses examining the association between all the predictors and each engagement in digital mental health services outcome. First, we used descriptive analyses to investigate differences in predictor variables across the 4-level categorical variable of use, with ANOVA performed for continuous predictors and chi-square tests for categorical predictors. Second, we examined predictors of any digital health service use in the app using logistic regression. The outcome variable was the binary variable representing if participants had used at least 1 service. In this regression model, we included age, race and ethnicity (non-White as reference group), gender identity (man as reference group), educational attainment (less than bachelor’s degree completion as reference group), patient activation, mental health literacy, well-being, area of focus (“my emotions” as reference group), baseline depression (entered as a linear predictor), and baseline anxiety (entered as a linear predictor) as predictors. Third, we examined predictors of any digital health self-directed digital resource use in the app using logistic regression. The outcome variable was the binary variable representing if participants had at least one self-directed digital resource in the 3-month follow-up period. In this regression, we included age, race and ethnicity, gender identity, educational attainment, patient activation, mental health literacy, well-being, primary concern, baseline depression (entered as a linear predictor), and baseline anxiety (entered as a linear predictor) as predictors, with the same reference groups as in the previous analysis. Fourth, using Poisson regression, we examined if the use of any telecoaching or teletherapy visits was associated with the number of self-directed digital resources used. We created binary variables for both telecoaching and teletherapy, reflecting any use of each modality in the follow-up period. We used both unadjusted and adjusted approaches to investigate this association. In the unadjusted model, we only included the telecoaching and teletherapy visit variables as predictors. In the adjusted model, we additionally included age, race and ethnicity, gender identity, educational attainment, patient activation, mental health literacy, well-being, and area of focus, with reference groups mirroring the previous analyses. We also performed the same adjusted Poisson regression analyses on a subgroup of our sample: those with elevated GAD-7 or PHQ-9 scores (scores on either scale above 9 indicating moderate symptoms ) at baseline. Ethical Considerations All participants provided informed consent, and this study protocol was reviewed and approved by the Western Clinical Group institutional review board (protocol #1316167). Compensation for this study was a US $25 digital gift card per completed survey. All data were deidentified. 

This investigation was part of a prospective, longitudinal, observational study of individuals who received services through an employer-sponsored digital mental health benefits platform (Modern Health Inc). The study timeframe was from September 20, 2021, to May 31, 2022. Eligible participants were 18 years or older, based in the United States, registered for the benefit, and had access to a smartphone, tablet, or computer. 

Eligible employees registered for a Modern Health account through a mobile app or website and completed several onboarding assessments, which asked about areas of focus, care modality preferences, and clinical symptoms. The platform’s proprietary algorithm recommended an initial care pathway to participants based on this information. Recommendations used a stratified stepped care model, meaning that patients with higher acuity and with certain areas of focus were more likely to be recommended to more intensive care options (eg, one-on-one teletherapy) (more details in ). Participants could use their recommended care or self-refer or be referred by a provider to any combination of care. Members who matched with a provider or used at least 1 digital resource after onboarding were invited by email to complete a screening questionnaire within 2 weeks of onboarding, which contained questions about demographics. We used the demographic screening information for purposeful recruitment to ensure representation in racial and ethnic identities, gender identities, socioeconomic status, age groups, and mental health symptoms at baseline. After the screening questionnaire, eligible participants were directed to a consent form to provide informed consent. Consenting participants were sent the baseline survey asking questions about their mental, social, and physical health by email along with instructions and compensation. Participants were sent a follow-up survey at 12 weeks post baseline that contained the same mental, social, and physical health questions. All forms and surveys were hosted on Qualtrics’ online survey platform. 

Individuals in this study were able to engage in all of the following digital mental health services, within the limits of their employer-covered sessions for 1:1 care modalities. Self-directed digital resources had no limits. 

Participants had access to a digital library of programs and resources they could use in unlimited quantities at any time. These included daily meditative exercises, interactive programs and podcasts, mindfulness exercises like meditations and breathing exercises, and self-paced structured educational lessons (similar to self-help workbooks). All digital materials were developed and designed by an in-house team of clinical psychologists. Digital health programs were designed to cover topics such as emotions, relationships, professional life, healthy lifestyles, and finances. Engagement across all digital resources was combined in analyses to represent total digital program engagement. 

Coaches were certified by an International Coaching Federation accredited program and underwent a careful screening process by Modern Health. They provided 30-minute telecoaching services to eligible employees through a videoconferencing platform (Zoom; Zoom Video Communications). Coaches and participants were also able to communicate by messaging within the app. All coaches had at least 150 hours of coaching experience in addition to completing additional training in evidence-based techniques and Modern Health’s proprietary model of care. Rather than being confined to any specific protocol, coaches were encouraged to implement evidence-based techniques where appropriate. The number of coaching sessions attended by participants depended on the number of sessions covered by their employer, as well as on personal preferences and their level of need. 

Furthermore, 50 minutes one-on-one teletherapy sessions were provided through a videoconferencing platform (Zoom) by licensed and vetted therapists who had an advanced degree in clinical psychology or a related field (eg, PhD, PsyD, LCSW, LMFT, or LPC). Similar to telecoaching, therapists and participants were able to communicate through messaging in-app. All therapists were skilled in evidence-based practices, such as cognitive behavioral therapy, acceptance and commitment therapy, and dialectical behavior therapy and had completed additional training in Modern Health’s proprietary model of care. Similar to telecoaching, the number of therapy sessions attended by participants depended on the number of sessions covered by their employer, as well as on personal preferences and their level of need . 

Engagement in digital mental health services: We created 4 outcome variables to capture engagement in platform services. First, we created a 4-level categorical variable to represent use of the digital health services: (1) only self-directed digital resource use, (2) only telecoach or teletherapist use, (3) use of both digital and telecoach or teletherapist modalities, and (4) no use of any modality. Second, we created a binary variable (0/1) indicating whether participants used at least 1 service within the platform (inclusive of self-directed digital resources, one-on-one telecoaching visits, and one-on-one teletherapy visits). Third, we created a binary variable (0/1) indicating whether participants used at least one of the self-directed digital resources collapsed across resource types: meditative exercises, programs, meditations, and podcasts. Fourth, we created a count of the number of self-directed digital resources each participant used. The use of both self-directed digital resources and 1:1 modalities was collected automatically by the digital mental health platform. Engagement data during the study period (between the baseline and follow-up surveys) was extracted from the platform for analysis. 

Demographics Participants self-identified their age, race and ethnicity (American Indian or Alaskan Native, Asian, Black or African American, Hawaiian or Pacific Islander, Hispanic, Latino, or Spanish origin, non-Hispanic white, prefer to self-describe, multiracial; collapsed to non-Hispanic White vs non-White), gender identity (man, woman, non-binary), and educational attainment (less than a bachelors’ degree, bachelors’ degree, and more than a bachelors’ degree). Depression The 9-item Patient Health Questionnaire (PHQ-9)  was used to assess the presence of depression symptoms over the past 2 weeks. Participants responded on a 4-point scale (0= “Not at all,” 3= “Nearly every day”), and total scores were categorized into 1 of 5 severity ratings: none, minimal, mild, moderate, or moderately severe. Higher scores indicate higher severity of depression symptomatology. Anxiety Symptoms The 7-item Generalized Anxiety Disorder Questionnaire (GAD-7)  was used to assess the presence of anxiety symptoms over the past 2 weeks. Participants responded on a 4-point scale (0=“Not at all,” 3=“Nearly every day”) and total scores were categorized into 1 of 4 severity ratings: minimal, mild, moderate, or severe. Higher scores indicate higher severity of anxiety symptomatology. Well-Being The 5-item World Health Organization Well-Being Index (WHO-5)  was used to assess well-being over the past 2 weeks. This construct was assessed during the onboarding process, approximately 2 weeks before the baseline assessment. Participants responded on a 6-point scale (0=“At no time,” 5=“All of the time”). Higher scores indicate greater subjective well-being. Patient Activation The 13-item Patient Activation Measure for Mental Health (PAM-MH) was used . Participants chose from 5 possible response options ranging from 1=Strongly Disagree to 4=Strongly Agree to 5=Not Applicable. Higher scores indicate higher patient activation. Mental Health Literacy Mental health literacy was measured using 13 items from the Mental Health Literacy Scale (MHLS) . Response options ranged from 1=Strongly Disagree to 5=Strongly Agree. Area of Focus Participants were able to choose from over 40 topics of focus, or reasons for registering for the platform, during the onboarding process. These topics were wide-ranging and organized by the following well-being dimensions: “my emotions,” “my professional life,” “my physical well-being,” “my relationships,” and “my finances.” One-on-One Care Engagement Variables indicating whether participants had used at least telecoaching (0/1) or teletherapy (0/1) sessions within the platform were also included as predictors in analyses predicting the use of self-directed digital resources. 

Participants self-identified their age, race and ethnicity (American Indian or Alaskan Native, Asian, Black or African American, Hawaiian or Pacific Islander, Hispanic, Latino, or Spanish origin, non-Hispanic white, prefer to self-describe, multiracial; collapsed to non-Hispanic White vs non-White), gender identity (man, woman, non-binary), and educational attainment (less than a bachelors’ degree, bachelors’ degree, and more than a bachelors’ degree). 

The 9-item Patient Health Questionnaire (PHQ-9)  was used to assess the presence of depression symptoms over the past 2 weeks. Participants responded on a 4-point scale (0= “Not at all,” 3= “Nearly every day”), and total scores were categorized into 1 of 5 severity ratings: none, minimal, mild, moderate, or moderately severe. Higher scores indicate higher severity of depression symptomatology. 

The 7-item Generalized Anxiety Disorder Questionnaire (GAD-7)  was used to assess the presence of anxiety symptoms over the past 2 weeks. Participants responded on a 4-point scale (0=“Not at all,” 3=“Nearly every day”) and total scores were categorized into 1 of 4 severity ratings: minimal, mild, moderate, or severe. Higher scores indicate higher severity of anxiety symptomatology. 

The 5-item World Health Organization Well-Being Index (WHO-5)  was used to assess well-being over the past 2 weeks. This construct was assessed during the onboarding process, approximately 2 weeks before the baseline assessment. Participants responded on a 6-point scale (0=“At no time,” 5=“All of the time”). Higher scores indicate greater subjective well-being. 

The 13-item Patient Activation Measure for Mental Health (PAM-MH) was used . Participants chose from 5 possible response options ranging from 1=Strongly Disagree to 4=Strongly Agree to 5=Not Applicable. Higher scores indicate higher patient activation. 

Mental health literacy was measured using 13 items from the Mental Health Literacy Scale (MHLS) . Response options ranged from 1=Strongly Disagree to 5=Strongly Agree. 

Participants were able to choose from over 40 topics of focus, or reasons for registering for the platform, during the onboarding process. These topics were wide-ranging and organized by the following well-being dimensions: “my emotions,” “my professional life,” “my physical well-being,” “my relationships,” and “my finances.” 

Variables indicating whether participants had used at least telecoaching (0/1) or teletherapy (0/1) sessions within the platform were also included as predictors in analyses predicting the use of self-directed digital resources. 

We conducted 4 sets of analyses examining the association between all the predictors and each engagement in digital mental health services outcome. First, we used descriptive analyses to investigate differences in predictor variables across the 4-level categorical variable of use, with ANOVA performed for continuous predictors and chi-square tests for categorical predictors. Second, we examined predictors of any digital health service use in the app using logistic regression. The outcome variable was the binary variable representing if participants had used at least 1 service. In this regression model, we included age, race and ethnicity (non-White as reference group), gender identity (man as reference group), educational attainment (less than bachelor’s degree completion as reference group), patient activation, mental health literacy, well-being, area of focus (“my emotions” as reference group), baseline depression (entered as a linear predictor), and baseline anxiety (entered as a linear predictor) as predictors. Third, we examined predictors of any digital health self-directed digital resource use in the app using logistic regression. The outcome variable was the binary variable representing if participants had at least one self-directed digital resource in the 3-month follow-up period. In this regression, we included age, race and ethnicity, gender identity, educational attainment, patient activation, mental health literacy, well-being, primary concern, baseline depression (entered as a linear predictor), and baseline anxiety (entered as a linear predictor) as predictors, with the same reference groups as in the previous analysis. Fourth, using Poisson regression, we examined if the use of any telecoaching or teletherapy visits was associated with the number of self-directed digital resources used. We created binary variables for both telecoaching and teletherapy, reflecting any use of each modality in the follow-up period. We used both unadjusted and adjusted approaches to investigate this association. In the unadjusted model, we only included the telecoaching and teletherapy visit variables as predictors. In the adjusted model, we additionally included age, race and ethnicity, gender identity, educational attainment, patient activation, mental health literacy, well-being, and area of focus, with reference groups mirroring the previous analyses. We also performed the same adjusted Poisson regression analyses on a subgroup of our sample: those with elevated GAD-7 or PHQ-9 scores (scores on either scale above 9 indicating moderate symptoms ) at baseline. 

All participants provided informed consent, and this study protocol was reviewed and approved by the Western Clinical Group institutional review board (protocol #1316167). Compensation for this study was a US $25 digital gift card per completed survey. All data were deidentified. 

In total, 950 individuals were enrolled in this study. More than half of participants (n=531, 55.9%) engaged with at least 1 service within the platform (eg, self-directed digital resource, telecoach, or teletherapist session); 44.1% (n=419) did not engage in any service. Among engagers, 44.3% (n=235) used both self-directed digital resources and 1:1 care (teletherapy or telecoaching), 32% (n=170) used only 1:1 care, and 23.7% (n=126) used only self-directed digital resources. At baseline, these engagement groups statistically significantly differed in age, depressive symptoms, anxiety symptoms, health literacy, and area of focus . Among participants who only used self-directed digital resources, the average number of digital engagements was 2.0 (median 1.0). Among those using both 1:1 care and self-directed digital resources, the average number of digital engagements was 3.4 (median 2.0). In the logistic regression analysis predicting engagement in any service, only higher educational attainment was associated with increased odds of engaging in at least 1 service . Relative to participants without a bachelor’s degree, those with a bachelor’s had 54.5% ( P=. 03) higher odds of engaging, and those with education greater than a bachelor’s had 56.2% ( P=. 05) higher odds of engaging. No other variables in the model were statistically significant. In our logistic regression analysis predicting engagement in any self-directed digital resources, certain demographic characteristics were associated with an increased likelihood of engagement. For every year of increasing age, subjects were 2.6% more likely to have used any self-directed resources ( P=. 003). Relative to men, women had 45.4% higher odds of using any self-directed resources ( P=. 01). Finally, educational attainment was also significantly associated with self-directed resource use, such that those with bachelor’s degrees (odds ratio 1.56 95% CI 1.026-2.414; P=. 04) and with education higher than a bachelor’s degree (odds ratio 1.65 95% CI 1.045-2.625; P=. 03) had higher odds of self-directed resource engagement than those with less than a bachelor’s degree . In an unadjusted Poisson regression examining if engagement in at least 1 telecoaching or teletherapy was associated with self-directed digital resources use, engagement in any telecoach sessions was associated with a 71.6% increase in the number of self-directed digital resources used, while engagement in any teletherapy sessions was associated with a 41.4% increase in the number of digital resources used . After adjusting for the additional predictor variables described above, engagement in any telecoaching sessions was associated with an 82% increase in the number of self-directed resources used, and engagement in any teletherapy sessions was associated with a 79.5% increase in the number of digital resources used. In the adjusted analysis, age was a significant predictor of engagement, with each additional year of age associated with a 3.9% increase in the number of self-directed digital resources used. Relative to men, those identifying as women used 23% more digital resources and non-binary individuals did not statistically significantly differ. The primary topic of focus was also a significant predictor of self-directed resource engagement, with finances (relative risk [RR] 1.46, P= .02), physical well-being (RR 2.28 P <.001), professional life (RR 1.71, P <.001), and relationships (RR 1.37, P <.001) all being associated with increased digital resource use as compared with those who chose emotions. In the subgroup analysis conducted in participants with an elevated GAD-7 or PHQ-9 score, engagement in any telecoaching was associated with a 101% increase in the number of self-directed digital resources used ( P < . 001), and engagement in any teletherapist visit was associated with a 77.8% increase in the number of digital resources used ( P < . 001) . 

Principal Findings Our study aimed to evaluate predictive factors of engagement in multiple digital health modalities offered by a digital mental health employer-based benefit. Over half of the participants (55.9%, 531/950) used at least 1 component of the digital mental health platform at least once. It is important to note that due to the nature of employer benefits programs, employers often choose to market their mental health services benefit at specific time points, such as open enrollment periods, which leads to an increase in sign-ups. However, not everyone needs or wants mental health care at the time they receive the email advertising the benefit. Thus, it is possible that people initiate with a mental health digital platform before they need or are ready to engage in care. Or, if they do not sign up at the time of the email, they may forget about the program at a time when they do need care. These findings underscore the need to continue adapting digital health and other digital resources in ways that engage broader populations of users curious about mental health resources and ensure that people know how to access care if they need it. Our study did identify several factors that were associated with increased use of the platform, including the use of a coach or therapist, older age, identifying as a woman, baseline symptom severity, and presenting primary concerns of finances, physical well-being, professional life, and relationships. A key finding of our study was that the use of coaching or therapy was associated with increased self-directed digital resource use. This relationship was even stronger for individuals with elevated GAD-7 and PHQ-9 scores. Higher self-directed use in this population may be the result of provider encouragement. Coaches and therapists seeing participants with elevated GAD-7 and PHQ-9 scores might be inclined to recommend additional use of digital health resources outside of one-on-one sessions, resulting in more self-directed use for those groups. Thus, additional education for platform mental health coaches and therapists about available digital support tools and their quality and effectiveness might facilitate greater user engagement in app-based resources. Training for the network of platform providers could also include information on the barriers and facilitators that sustain engagement in digital resources. Indeed, previous research has highlighted the impact clinicians can have on digital health interest, use, and engagement . While clinicians may be recommending self-directed strategies and driving use, alternatively, it may be that when a participant engages in 1 modality of the platform, they are more likely to become “super users” across multiple modalities. Future research is needed to disentangle the relationship between live support and self-directed resource engagement. Furthermore, certain topics of focus were more associated with self-directed resource use, including finances, physical well-being, professional life, and relationships. Participants whose primary chosen topic was “[their] emotions” were less likely to engage with self-directed digital resources, though almost half (48.1%, n=224) of this group used one-on-one modalities. Given that higher baseline depression was also associated with less self-directed digital engagement, perhaps features of depression, such as lack of motivation, energy, or concentration, could decrease the likelihood of using these resources, even when the need for them is higher. This result is consistent with findings from a systematic review that human factors, such as severe mental health symptoms, can be a barrier to engagement . This may also be a feature of the personalized care recommendations, which were more likely to suggest users work with a provider one-on-one if they were experiencing higher levels of distress. Future research may be helpful in determining how to make digital health self-directed resources more appealing for individuals struggling with low mood who are not already engaging in therapy or coaching. Research is also needed to better determine the circumstances when self-guided care is a clinically effective stand-alone approach for people with depressive symptoms. Several sociodemographic characteristics, including identifying as a woman, higher education, and older age, were also associated with greater self-guided resource use. The extant literature has demonstrated that women are more likely to receive mental health treatment in general  and to use digital mental health resources specifically . Our finding extends previous literature by revealing that at the intersection of digital health and mental health treatment, women users are more likely to engage with the technology than men. Higher education was also related to increased use of self-directed resources, as well as overall increased use of the platform more generally. Some research indicates that education is a significant predictor of mental health service use . Finally, older age was associated with more self-directed resource use, though given the restricted age range of this sample, this result may be more challenging to interpret. It is possible that people in their 30s and 40s are more time-constrained by career and caregiving responsibilities and may be more likely to engage in mental health services they can access when it is convenient to them. This study had several limitations with regard to the sample and restrictions of data. First, participants were eligible for the study if they had matched with a provider or used at least 1 digital mental health resource. This inclusion criteria likely selected participants who were more predisposed to engaging with digital mental health resources, possibly biasing our sample to more resource use. In addition, the digital mental health resource use that made participants eligible for inclusion in the study is included in the total number of times a participant used these resources, likely inflating the count of times used. Next, our sample may not be generalizable to other samples, given that we used participants from companies that were contracted with 1 mental health platform. Thus, the sample was limited to working adults with benefits-eligible positions, which skews towards a higher level of socioeconomic status. Another limitation of this study was our inability to determine the sequence of events for each participant, for example, whether they engaged in a coaching session and then self-directed resource use or vice versa. This information would be helpful in further breaking down predictors of digital health use. For example, do sessions with a coach then lead to subsequent self-directed resource use, or does an attempt at self-directed resources lead to a request for additional live support by coaching or therapy? Future research can disentangle the timing of the use of various modalities. Third, the platform design and user experience may have driven engagement to some extent, and future research is needed to explore intervention-level factors (eg, ease of use, perceived effectiveness) that may affect treatment engagement. Next, we used a definition of engagement based on the number of times a participant used the self-directed digital mental health resources. In addition to the volume of care used, it is important to understand whether users are engaging in the right level of care based on their needs. Although we found alignment between self-guided resource use and user needs (eg, users with lower depression symptoms and less mental health-focused topics of concern engaged in resources on their own, while users with higher depression and anxiety were more likely to engage with resources in combination with one-on-one care), additional data could provide a more nuanced look at engagement. For example, future studies could examine whether users engaged in their recommended care pathway and if they saw improved mental health outcomes as a result of engaging. Conclusion Digital mental health platforms, including those using a stepped-care model, have the potential to deliver appropriate and evidence-based care to large populations of individuals in need. However, these platforms are affected by similar challenges related to engagement that plague many of the high-quality, evidence-based psychological treatment modalities currently available. This study revealed that users were more likely to use self-directed digital mental health resources if they were also engaged in at least 1 coaching or therapy session, which suggests that the key to successful engagement with digital therapeutics may lie in additional live support. 

Our study aimed to evaluate predictive factors of engagement in multiple digital health modalities offered by a digital mental health employer-based benefit. Over half of the participants (55.9%, 531/950) used at least 1 component of the digital mental health platform at least once. It is important to note that due to the nature of employer benefits programs, employers often choose to market their mental health services benefit at specific time points, such as open enrollment periods, which leads to an increase in sign-ups. However, not everyone needs or wants mental health care at the time they receive the email advertising the benefit. Thus, it is possible that people initiate with a mental health digital platform before they need or are ready to engage in care. Or, if they do not sign up at the time of the email, they may forget about the program at a time when they do need care. These findings underscore the need to continue adapting digital health and other digital resources in ways that engage broader populations of users curious about mental health resources and ensure that people know how to access care if they need it. Our study did identify several factors that were associated with increased use of the platform, including the use of a coach or therapist, older age, identifying as a woman, baseline symptom severity, and presenting primary concerns of finances, physical well-being, professional life, and relationships. A key finding of our study was that the use of coaching or therapy was associated with increased self-directed digital resource use. This relationship was even stronger for individuals with elevated GAD-7 and PHQ-9 scores. Higher self-directed use in this population may be the result of provider encouragement. Coaches and therapists seeing participants with elevated GAD-7 and PHQ-9 scores might be inclined to recommend additional use of digital health resources outside of one-on-one sessions, resulting in more self-directed use for those groups. Thus, additional education for platform mental health coaches and therapists about available digital support tools and their quality and effectiveness might facilitate greater user engagement in app-based resources. Training for the network of platform providers could also include information on the barriers and facilitators that sustain engagement in digital resources. Indeed, previous research has highlighted the impact clinicians can have on digital health interest, use, and engagement . While clinicians may be recommending self-directed strategies and driving use, alternatively, it may be that when a participant engages in 1 modality of the platform, they are more likely to become “super users” across multiple modalities. Future research is needed to disentangle the relationship between live support and self-directed resource engagement. Furthermore, certain topics of focus were more associated with self-directed resource use, including finances, physical well-being, professional life, and relationships. Participants whose primary chosen topic was “[their] emotions” were less likely to engage with self-directed digital resources, though almost half (48.1%, n=224) of this group used one-on-one modalities. Given that higher baseline depression was also associated with less self-directed digital engagement, perhaps features of depression, such as lack of motivation, energy, or concentration, could decrease the likelihood of using these resources, even when the need for them is higher. This result is consistent with findings from a systematic review that human factors, such as severe mental health symptoms, can be a barrier to engagement . This may also be a feature of the personalized care recommendations, which were more likely to suggest users work with a provider one-on-one if they were experiencing higher levels of distress. Future research may be helpful in determining how to make digital health self-directed resources more appealing for individuals struggling with low mood who are not already engaging in therapy or coaching. Research is also needed to better determine the circumstances when self-guided care is a clinically effective stand-alone approach for people with depressive symptoms. Several sociodemographic characteristics, including identifying as a woman, higher education, and older age, were also associated with greater self-guided resource use. The extant literature has demonstrated that women are more likely to receive mental health treatment in general  and to use digital mental health resources specifically . Our finding extends previous literature by revealing that at the intersection of digital health and mental health treatment, women users are more likely to engage with the technology than men. Higher education was also related to increased use of self-directed resources, as well as overall increased use of the platform more generally. Some research indicates that education is a significant predictor of mental health service use . Finally, older age was associated with more self-directed resource use, though given the restricted age range of this sample, this result may be more challenging to interpret. It is possible that people in their 30s and 40s are more time-constrained by career and caregiving responsibilities and may be more likely to engage in mental health services they can access when it is convenient to them. This study had several limitations with regard to the sample and restrictions of data. First, participants were eligible for the study if they had matched with a provider or used at least 1 digital mental health resource. This inclusion criteria likely selected participants who were more predisposed to engaging with digital mental health resources, possibly biasing our sample to more resource use. In addition, the digital mental health resource use that made participants eligible for inclusion in the study is included in the total number of times a participant used these resources, likely inflating the count of times used. Next, our sample may not be generalizable to other samples, given that we used participants from companies that were contracted with 1 mental health platform. Thus, the sample was limited to working adults with benefits-eligible positions, which skews towards a higher level of socioeconomic status. Another limitation of this study was our inability to determine the sequence of events for each participant, for example, whether they engaged in a coaching session and then self-directed resource use or vice versa. This information would be helpful in further breaking down predictors of digital health use. For example, do sessions with a coach then lead to subsequent self-directed resource use, or does an attempt at self-directed resources lead to a request for additional live support by coaching or therapy? Future research can disentangle the timing of the use of various modalities. Third, the platform design and user experience may have driven engagement to some extent, and future research is needed to explore intervention-level factors (eg, ease of use, perceived effectiveness) that may affect treatment engagement. Next, we used a definition of engagement based on the number of times a participant used the self-directed digital mental health resources. In addition to the volume of care used, it is important to understand whether users are engaging in the right level of care based on their needs. Although we found alignment between self-guided resource use and user needs (eg, users with lower depression symptoms and less mental health-focused topics of concern engaged in resources on their own, while users with higher depression and anxiety were more likely to engage with resources in combination with one-on-one care), additional data could provide a more nuanced look at engagement. For example, future studies could examine whether users engaged in their recommended care pathway and if they saw improved mental health outcomes as a result of engaging. 

Digital mental health platforms, including those using a stepped-care model, have the potential to deliver appropriate and evidence-based care to large populations of individuals in need. However, these platforms are affected by similar challenges related to engagement that plague many of the high-quality, evidence-based psychological treatment modalities currently available. This study revealed that users were more likely to use self-directed digital mental health resources if they were also engaged in at least 1 coaching or therapy session, which suggests that the key to successful engagement with digital therapeutics may lie in additional live support. 

