Mental health apps within the healthcare system: associations with stigma and mental health literacy.

BACKGROUND: Mental health apps (MHA) as a new form of self-help have gained popularity over the last years. Tentative evidence has suggested that MHA might also present a first step into the help-seeking process, because their anonymity circumvents stigma. Using MHA might also increase mental health literacy and reduce stigma through psychoeducation, which could encourage formal help-seeking. To date, it remains unclear how MHA usage relates to stigma, mental health literacy, and utilization of professional help within the public healthcare system. METHODS: We conducted a cross-sectional survey with N = 1,263 individuals from the general population (mean age 32.56 ± 11.51, 58.2% female) and employed structural equation modeling to investigate associations between stigma (against individuals with psychological disorders and against help-seeking), mental health literacy, MHA usage, and service utilization within the public healthcare system for mental health problems. RESULTS: MHA usage is high within the general population (40.5% of participants). Results indicate that higher stigma against help-seeking is associated with and increased likelihood of MHA usage, which in turn is positively associated with increased likelihood of service utilization. Symptoms of psychological disorder were associated with higher likelihood of service utilization, but not MHA usage. CONCLUSIONS: It can be concluded that MHA appeal especially to individuals with higher stigma against help-seeking and therefore might provide an opportunity to reach underserviced individuals. At the current time, MHA usage appears to take place mostly in a preventative manner or as a supplement to treatment. Better integration into the public healthcare system might help to exploit both preventative and interventional benefits of MHA.

A Process Evaluation of a Mobile App for Medical Students Aimed at Increasing Resilience and Decreasing Stigma in Mental Health.

OBJECTIVE: The purpose of this pilot study was to conduct a process evaluation of a mental health and wellness mobile health (mHealth) application for medical students designed to increase resilience and decrease mental health stigma. METHODS: The customized application, MindfulMEDS, was developed with peer-focused interactive modules specific to medical students within an existing system called Sharpen®. The Sharpen® system contains an extensive library of didactic and experiential mental health and wellness content built specifically to promote evidence-based protective factors for resilience. A mixed-methods approach including surveys and focus groups assessed participant resiliency, perception of mental health within the context of medical school, and evaluation of the app. Assessments were conducted at baseline (n = 66), six months (n = 30), and one year (n = 24). Demographic information was collected once at baseline as a part of the initial survey.  Results: A total of 215 users were registered in MindfulMEDS, consumed 83 courses, and engaged in 1,428 "connect clicks" to community resources and crisis-response supports. Resilience levels did not change significantly between surveys; however, a significant decrease in the perception of mental health stigma associated with utilizing mental health resources was observed. Focus group participants (n = 11) reported the screening tools to be useful, encouraged expansion, and suggested additional reminders to access the app to increase engagement. CONCLUSION: Findings of this pilot study demonstrate the feasibility of implementing MindfulMEDS (an mHealth app focused on mental health and wellness) among medical students. Students found the app experience valuable, accessed mental health screeners embedded within the app, utilized the app to seek help, and engaged with the app to learn more about mental health. There was also a decrease in mental health stigma observed during the course of the study. Based on these results, we propose that medical schools incorporate mobile-based technology into their mental health support programs.

Exploring perceptions of psychology students in Delhi-NCR Region towards using mental health apps to promote resilience: a qualitative study.

BACKGROUND: Mental health apps (MHapps) have the potential to become an essential constituent for addressing mental health disparities and influencing the psychological outcomes of students in India. Though lauded as a practical approach to preventing various mental health issues, there are concerns that developing and utilizing MHapps standardized on Western populations produce ineffective results for the natives of Asian countries such as India due to a wide range of cultural differences. This research was conducted on psychology students living in the Delhi-NCR region of the Indian subcontinent. The study explored psychology students' perceptions, needs, and preferences regarding mental health apps that promote resilience, identified barriers and facilitators for developing effective mental health apps, and explored the cultural relevance of the development of MHapps in India. METHODS: This was an exploratory study utilizing focus group discussions among psychology students. Psychology students were sampled using snowball sampling from Delhi-NCR region colleges to participate in FGDs. We conducted six focus groups, which included a representation of 30 psychology students from full-time UG/PG courses. The study used a reflexive thematic analysis framework using the six-step Braun and Clarke process to develop themes. RESULTS: Psychology students valued MHapps for their easy accessibility, 24*7 functionality, affordable costs, highly engaging features, and the option of being anonymous. However, students preferred the apps based on established psychological frameworks with strong empirical evidence and the availability of remote mental health professionals with relevant qualifications and training. The main barriers to using MHapps identified by students included difficulties in differentiating between real and fake MHapps, lack of progress tracking of the users due to minimal human interactions, and ethical and data privacy concerns. Students also emphasized the cultural relevance of MHapps. The interpretation of our findings indicates that students demanded transparency regarding the authenticity of MHapps. CONCLUSION: The findings of this exploratory investigation offer a better understanding of how college students perceive the usage of MHapps to improve resilience. This study highlights that further research should explore the specific needs and preferences of university students for developing and implementing effective MHapps for different contexts.

The Digital Navigator: Standardizing Human Technology Support in App-Integrated Clinical Care.

Background: Mental health apps offer scalable care, yet clinical adoption is hindered by low user engagement and integration challenges into clinic workflows. Human support staff called digital navigators, trained in mental health technology, could enhance care access and patient adherence and remove workflow burdens from clinicians. While the potential of this role is clear, training staff to become digital navigators and assessing their impact are primary challenges. Methods: We present a detailed manual/framework for implementation of the Digital Navigator within a short-term, cognitive-behavioral therapy-focused hybrid clinic. We analyze patient engagement, satisfaction, and digital phenotyping data quality outcomes. Data from 83 patients, for the period spanning September 2022 to September 2023, included Digital Navigator satisfaction, correlated with demographics, mindLAMP app satisfaction, engagement, and passive data quality. Additionally, average passive data across 33 clinic patients from November 2023 to January 2024 were assessed for missingness. Results: Digital Navigator satisfaction averaged 18.8/20. Satisfaction was not influenced by sex, race, gender, or education. Average passive data quality across 33 clinic patients was 0.82 at the time this article was written. Digital Navigator satisfaction scores had significant positive correlation with both clinic app engagement and perception of that app. Conclusions: Results demonstrate preliminary support and patient endorsement for the Digital Navigator role and positive outcomes around digital engagement and digital phenotyping data quality. Through sharing training resources and standardizing the role, we aim to enable clinicians and researchers to adapt and utilize the Digital Navigator for their own needs.

Availability of Internet-Based Cognitive-Behavioral Therapies for Depression: A Systematic Review.

We examined the availability and components of internet-based cognitive-behavioral therapies (iCBTs) for depression tested in randomized-controlled trials (RCTs). The objectives of this literature review were to determine the extent to which research-validated iCBTs were available to the public, as well as to determine their therapeutic content. A literature review of RCTs for iCBTs was conducted on July 30, 2021. For each iCBT, interventions were rated by content and compared to commercially available smartphone apps. Our search yielded 80 studies using 41 unique iCBTs. Of these, only 6 (15%) were completely available to the public, more than half were not publicly available (46%), and the remaining 39% were available to the public with some restrictions (e.g., those based on the user's geographical location). When comparing iCBTs evaluated in RCTs to commercially available smartphone apps, we found that iCBTs were more likely to contain psychoeducation, cognitive restructuring, behavioral activation, problem solving, and interpersonal communication components. iCBTs from RCTs contain evidence-based content but few are available to the public. Extending beyond efficacy, attention should be paid to the dissemination of iCBTs.

Characterising use of recovery record among a large, transdiagnostic sample of adults with eating disorders across higher levels of care.

OBJECTIVE: Smartphone applications (i.e., apps) designed to target mental health symptoms have received increasing public and empirical attention, including in eating disorder|eating disorders (EDs) treatment. While some data have begun to characterise app users in non-controlled settings, there is limited information on use of apps in higher levels of care (e.g., partial hospitalisation or residential treatment programs) for EDs. METHOD: This study aimed to explore metrics of use while in treatment for a commonly used ED-focused mobile app (Recovery Record) among individuals enroled in intensive outpatient, partial hospitalisation, residential, or inpatient treatments (N = 2042). RESULTS: Results indicated that older individuals and participants with binge eating disorder demonstrated more frequent app engagement compared to younger participants and other ED diagnoses, respectively. Individuals entering at intensive outpatient and partial hospitalisation levels of care, as well as those with routine discharges engaged more frequently with RR compared to individuals entering in inpatient or residential treatment, and those with non-routine discharges. CONCLUSIONS: Our data provide initial descriptions of how RR may be used within higher levels of care for adults with EDs. Further work is needed to establish the benefit of these apps in clinical settings for EDs over and above standard treatment, better characterise for whom these apps provide benefit, and identify how best to tailor the experience to promote engagement across the full spectrum of ED patients.

Self-Guided Mental Health Apps Targeting Racial and Ethnic Minority Groups: Scoping Review.

BACKGROUND: The use of mental health apps (MHAs) is increasing rapidly. However, little is known about the use of MHAs by racial and ethnic minority groups. OBJECTIVE: In this review, we aimed to examine the acceptability and effectiveness of MHAs among racial and ethnic minority groups, describe the purposes of using MHAs, identify the barriers to MHA use in racial and ethnic minority groups, and identify the gaps in the literature. METHODS: A systematic search was conducted on August 25, 2023, using Web of Science, Embase, PsycINFO, PsycArticles, PsycExtra, and MEDLINE. Articles were quality appraised using the Mixed Methods Appraisal Tool, and data were extracted and summarized to form a narrative synthesis. RESULTS: A total of 15 studies met the inclusion criteria. Studies were primarily conducted in the United States, and the MHAs designed for racial and ethnic minority groups included ¡Aptívate!, iBobbly, AIMhi- Y, BRAVE, Build Your Own Theme Song, Mindful You, Sanadak, and 12 more MHAs used in 1 study. The MHAs were predominantly informed by cognitive behavioral therapy and focused on reducing depressive symptoms. MHAs were considered acceptable for racial and ethnic minority groups; however, engagement rates dropped over time. Only 2 studies quantitatively reported the effectiveness of MHAs among racial and ethnic minority groups. Barriers to use included the repetitiveness of the MHAs, stigma, lack of personalization, and technical issues. CONCLUSIONS: Considering the growing interest in MHAs, the available evidence for MHAs for racial and ethnic minority groups appears limited. Although the acceptability seems consistent, more research is needed to support the effectiveness of MHAs. Future research should also prioritize studies to explore the specific needs of racial and ethnic minority groups if MHAs are to be successfully adopted.

Willing and unwilling digital cyborg assemblages: University students talk about mental health apps.

Objective: Explore how students talk about mental health mobile applications (i.e., apps). Methods: Data collected in focus group interviews with 51 students (all self-identifying as having mental health problems) and analysed using inductive thematic content analysis. Results: Participants describe mental health apps as an anti-dote to the loss of control, vulnerability, helplessness, impotence, isolation, conspicuousness, and shame which characterise their experience of mental illness. They describe the on-campus clinic as inaccessible and associated with "serious" problems, while configuring psychologists and psychotherapy as out of reach, scarce, formal, structured and anxiety provoking. In contrast, they imagine mental health apps as informal, relaxed, inviting, and accessible. Participants expressed openness and optimism about using apps to improve their mental health. They idealise technology as a means to connect effortlessly, anonymously, and informally, as well as learn skills, assert agency, and act responsibly. They also articulate reluctance to trust technology, show cognisance of participating in a capitalist economy, demonstrate scepticism about the legitimacy of mental health apps, and call for regulation, thereby resisting the position of responsible neoliberal subjects. Conclusion: Participants express ambivalence towards mental health apps without surrendering to either technophobia or technophilia. They express faith in technologies' potential to support mental health while questioning the implicit assumption that people are competent to manage their own mental health. In talking about mental health apps students reproduce broader cultural discourses (including techno-optimism, techno-solutionism, somatopiamism, neo-liberalism, responsibilisationism, technoscepticism, and discourses about neuroplasticity and self-help) thus presenting themselves as both willing and unwilling digital cyborgs.

Cognitive reappraisal in mHealth interventions to foster mental health in adults: a systematic review and meta-analysis.

Background: An increasing number of mHealth interventions aim to contribute to mental healthcare of which interventions that foster cognitive reappraisal may be particularly effective. Objectives: To evaluate the efficacy of mHealth interventions enhancing cognitive reappraisal to improve mental health in adult populations. Methods: The literature search (four databases) yielded 30 eligible randomized controlled trials (comprising 3,904 participants). We performed a multi-level meta-analysis to examine differences between intervention and comparator conditions at post-intervention assessment. Moderator analyses were conducted for potential moderator variables (e.g., type of comparators). Results: Most interventions were CBT-based with other training components in addition to cognitive reappraisal. We found preliminary evidence for a small to medium effect favouring mHealth interventions to enhance cognitive reappraisal over comparators, M(SMD) = 0.34, p = .002. When analysing single symptoms, there was evidence for a small to medium effect of mHealth interventions on anxiety and depressive symptoms, but not for psychological distress and well-being. All analyses showed substantial heterogeneity. Moderator analyses revealed evidence for more favourable effects in studies with passive comparators. There was an overall high risk of bias in most of the studies. Conclusions: We found preliminary evidence for a small to medium effect of mHealth interventions including a cognitive reappraisal component to improve mental health. However, most of the interventions were complex (i.e., reappraisal was provided alongside other components), which prevents us from examining reappraisal-specific effects beyond general mental health promotion in mHealth. Dismantling studies examining the effects of single intervention components are warranted to corroborate these promising results. Systematic Review Registration: https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=142149, identifier [CRD42019142149].

Governance of research and product improvement studies in consumer mental health apps. Interviews with researchers and app developers.

Consumer mental health apps (MHAs) collect and generate mental health-related data on their users, which can be leveraged for research and product improvement studies. Such studies are associated with ethical issues that may be difficult for researchers and app developers to assess. To improve ethical study conduct, governance through rules, agreements and customs could be relied upon, but their translation into practice is subject to barriers. This qualitative interview study with 17 researchers and app developers looked into the role and impact of governance standards on consumer MHA studies. Interviewees experienced a significant number of rules, agreements and customs, although not all of the governance standards that can potentially be applicable. Standards did have an impact on the interests of researchers and app developers, app users and society, but this impact was mediated by several barriers related to their conceptualization and implementation. Conceptualization barriers impacted the development of a standard, the inclusion of relevant concepts and the coordination between standards. Implementation barriers concerned the resource cost of understanding a standard, as well as suboptimal enforcement. The framework developed in this study can support more effective efforts to improve the governance of future consumer MHA studies.

German Version of the Mobile Agnew Relationship Measure: Translation and Validation Study.

BACKGROUND: The mobile Agnew Relationship Measure (mARM) is a self-report questionnaire for the evaluation of digital mental health interventions and their interactions with users. With the global increase in digital mental health intervention research, translated measures are required to conduct research with local populations. OBJECTIVE: The aim of this study was to translate and validate the original English version of the mARM into a German version (mARM-G). METHODS: A total of 2 native German speakers who spoke English as their second language conducted forward translation of the original items. This version was then back translated by 2 native German speakers with a fluent knowledge of English. An independent bilingual reviewer then compared these drafts and created a final German version. The mARM-G was validated by 15 experts in the field of mobile app development and 15 nonexperts for content validity and face validity; 144 participants were recruited to conduct reliability testing as well as confirmatory factor analysis. RESULTS: The content validity index of the mARM-G was 0.90 (expert ratings) and 0.79 (nonexperts). The face validity index was 0.89 (experts) and 0.86 (nonexperts). Internal consistency for the entire scale was Cronbach α=.91. Confirmatory factor analysis results were as follows: the chi-square statistic to df ratio was 1.66. Comparative Fit Index was 0.87 and the Tucker-Lewis Index was 0.86. The root mean square error of approximation was 0.07. CONCLUSIONS: The mARM-G is a valid and reliable tool that can be used for future studies in German-speaking countries.

An Overview of Chatbot-Based Mobile Mental Health Apps: Insights From App Description and User Reviews.

BACKGROUND: Chatbots are an emerging technology that show potential for mental health care apps to enable effective and practical evidence-based therapies. As this technology is still relatively new, little is known about recently developed apps and their characteristics and effectiveness. OBJECTIVE: In this study, we aimed to provide an overview of the commercially available popular mental health chatbots and how they are perceived by users. METHODS: We conducted an exploratory observation of 10 apps that offer support and treatment for a variety of mental health concerns with a built-in chatbot feature and qualitatively analyzed 3621 consumer reviews from the Google Play Store and 2624 consumer reviews from the Apple App Store. RESULTS: We found that although chatbots' personalized, humanlike interactions were positively received by users, improper responses and assumptions about the personalities of users led to a loss of interest. As chatbots are always accessible and convenient, users can become overly attached to them and prefer them over interacting with friends and family. Furthermore, a chatbot may offer crisis care whenever the user needs it because of its 24/7 availability, but even recently developed chatbots lack the understanding of properly identifying a crisis. Chatbots considered in this study fostered a judgment-free environment and helped users feel more comfortable sharing sensitive information. CONCLUSIONS: Our findings suggest that chatbots have great potential to offer social and psychological support in situations where real-world human interaction, such as connecting to friends or family members or seeking professional support, is not preferred or possible to achieve. However, there are several restrictions and limitations that these chatbots must establish according to the level of service they offer. Too much reliance on technology can pose risks, such as isolation and insufficient assistance during times of crisis. Recommendations for customization and balanced persuasion to inform the design of effective chatbots for mental health support have been outlined based on the insights of our findings.

Understanding the Adoption and Use of Digital Mental Health Apps Among College Students: Secondary Analysis of a National Survey.

BACKGROUND: Increasing rates of mental health diagnoses in college students signal the need for new opportunities to support the mental health of this population. With many mental health apps being efficacious, they may be a promising resource for college campuses to provide support to their students. However, it is important to understand why (or why not) students might want to use apps and their desired features. OBJECTIVE: Information on students' interest in mental health apps may inform which apps are to be provided and how campuses can support their use. This study aimed to understand the interest and hesitation in app use and the relationship between mental health needs, as defined by depression, anxiety, and positive mental health, and app use. METHODS: The web-based Healthy Minds Study collected information on mental health needs, perceptions, and service use across colleges and universities. We used a sample of 989 participants who completed the survey between 2018 and 2020 and an elective module on digital mental health. We analyzed the elective module responses using a mixed methods approach, including both descriptive and inferential statistics, along with thematic coding for open text responses. RESULTS: The Results from this study revealed that anxiety (b=-0.07; P<.001), but not depression (b=0.03; P=.12) and positive mental health (b=-0.02; P=.17), was a significant predictor of app adoption. Prominent qualitative findings indicated that the most desired app features included tips and advice, access to resources and information, and on-demand support that involves interaction throughout the day. The participants also suggested an overall desire for human interaction to be integrated into an app. As predicted, hesitancy was encountered, and the qualitative results suggested that there was a lack of interest in the adoption of mental health app and preference. CONCLUSIONS: The findings from this study underscore that simply providing digital mental health apps as tools may be insufficient to support their use in college campuses. Although many students were open to using a mental health app, hesitation and uncertainty were common in the participant responses. Working with colleges and universities to increase digital literacy and provide resources that allow students to gauge when app use is appropriate may be helpful when implementing mental health apps as resources in college campuses.

On the privacy of mental health apps: An empirical investigation and its implications for app development.

An increasing number of mental health services are now offered through mobile health (mHealth) systems, such as in mobile applications (apps). Although there is an unprecedented growth in the adoption of mental health services, partly due to the COVID-19 pandemic, concerns about data privacy risks due to security breaches are also increasing. Whilst some studies have analyzed mHealth apps from different angles, including security, there is relatively little evidence for data privacy issues that may exist in mHealth apps used for mental health services, whose recipients can be particularly vulnerable. This paper reports an empirical study aimed at systematically identifying and understanding data privacy incorporated in mental health apps. We analyzed 27 top-ranked mental health apps from Google Play Store. Our methodology enabled us to perform an in-depth privacy analysis of the apps, covering static and dynamic analysis, data sharing behaviour, server-side tests, privacy impact assessment requests, and privacy policy evaluation. Furthermore, we mapped the findings to the LINDDUN threat taxonomy, describing how threats manifest on the studied apps. The findings reveal important data privacy issues such as unnecessary permissions, insecure cryptography implementations, and leaks of personal data and credentials in logs and web requests. There is also a high risk of user profiling as the apps' development do not provide foolproof mechanisms against linkability, detectability and identifiability. Data sharing among 3rd-parties and advertisers in the current apps' ecosystem aggravates this situation. Based on the empirical findings of this study, we provide recommendations to be considered by different stakeholders of mHealth apps in general and apps developers in particular. We conclude that while developers ought to be more knowledgeable in considering and addressing privacy issues, users and health professionals can also play a role by demanding privacy-friendly apps. Supplementary Information: The online version contains supplementary material available at 10.1007/s10664-022-10236-0.

Understanding Mental Health Apps for Youth: Focus Group Study With Latinx Youth.

BACKGROUND: An increasing number of mental health apps (MHapps) are being developed for youth. In addition, youth are high users of both technologies and MHapps. However, little is known about their perspectives on MHapps. MHapps might be particularly well suited to reach the youth underserved by traditional mental health resources, and incorporating their perspectives is especially critical to ensure such tools are useful to them. OBJECTIVE: The goal of this study was to develop and pilot a process for eliciting youth perspectives on MHapps in a structured and collaborative way. We also sought to generate learnings on the perspectives of Latinx youth on MHapps and their use in ways that might facilitate discovery, activation, or engagement in MHapps, especially in Latinx populations. METHODS: We created a series of focus groups consisting of 5 sessions. The groups introduced different categories of MHapps (cognitive behavioral therapy apps, mindfulness apps, and miscellaneous apps). Within each category, we selected 4 MHapps that participants chose to use for a week and provided feedback through both between-session and in-session activities. We recruited 5 youths ranging in age from 15 to 21 (mean 18, SD 2.2) years. All the participants identified as Hispanic or Latinx. After completing all 5 focus groups, the participants completed a brief questionnaire to gather their impressions of the apps they had used. RESULTS: Our focus group methodology collected detailed and diverse information about youth perspectives on MHapps. However, we did identify some aspects of our methods that were less successful at engaging the youth, such as our between-session activities. The Latinx youth in our study wanted apps that were accessible, relatable, youth centric, and simple and could be integrated with their offline lives. We also found that the mindfulness apps were viewed most favorably but that the miscellaneous and cognitive behavioral therapy apps were viewed as more impactful. CONCLUSIONS: Eliciting youth feedback on MHapps is critical if these apps are going to serve a role in supporting their mental health and well-being. We refined a process for collecting feedback from the youth and identified factors that were important to a set of Latinx youth. Future work could be broader, that is, recruit larger samples of more diverse youth, or deeper, that is, collect more information from each youth around interests, needs, barriers, or facilitators or better understand the various impacts of MHapps by using qualitative and quantitative measures. Nevertheless, this study advances the formative understanding of how the youth, particularly Latinx youth, might be viewing these tools.

Effectiveness of Mental Health Apps for Distress During COVID-19 in US Unemployed and Essential Workers: Remote Pragmatic Randomized Clinical Trial.

BACKGROUND: During the COVID-19 pandemic, the general public was concerned about the mental health impacts of unemployment due to COVID-19 and the stress essential workers experienced during this time. Several reports indicated that people in distress were turning to digital technology, but there was little evidence about the impact of these tools on mitigating distress. OBJECTIVE: This study seeks to determine the acceptability, feasibility, usability, and effectiveness of mobile mental health apps for decreasing mental health symptoms in essential workers and unemployed individuals with suicide risk. METHODS: We recruited participants who indicated that they were unemployed because of COVID-19 or were COVID-19-designated essential workers. Participants were randomized to 1 of 4 free commercial mobile apps for managing distress that were (1) highly rated by PsyberGuide and (2) met the criteria for intervention features these participants indicated were desirable in a previous survey. Participants used the apps for 4 weeks and completed baseline and 4-week self-assessments of depression, anxiety emotional regulation, and suicide risk. RESULTS: We found no differences between the apps in any outcome but did find significant changes in depression and anxiety over time (Patient Health Questionnaire [PHQ]-9: estimate=-1.5, SE 0.2, 95% CI -1.1 to -1.8, P<.001; Generalized Anxiety Disorder Scale [GAD]-7: estimate=-1.3, SE 0.2, 95% CI -1.0 to -1.6, P<.001). We found no significant changes in suicidal behavior (Suicide Behaviors Questionnaire-Revised [SBQ-R]) or emotional regulation (Difficulties in Emotion Regulation Scale - Short Form [DERS-SF]) for the 4 weeks. We did find a significant dose-response pattern for changes in depression and anxiety. Using the app at least once a week resulted in greater improvements in treatment conditions over time on depression (estimate=-0.6, SE 0.2, 95% CI 1.0-0.2, P=.003) and anxiety (estimate=0.1, SE 0.2, 95% CI 0.4-0.6, P=.78). There was no association between app frequency and changes in suicidal behavior (SBQ-R) or emotional regulation (DERS-SF). We further found a significant difference between the conditions with regard to app usability, with the control app being the most usable (meanBeautiful Mood 72.9, SD 16.7; meanCOVID Coach 71.2, SD 15.4; meanCalm 66.8, SD 17.3; mean7 Cups 65.2, SD 17.7). We found no significant differences for app acceptability or appropriateness. CONCLUSIONS: Few studies have evaluated prospectively the utility and usability of commercial apps for mood. This study found that free, self-guided commercial mobile mental health apps are seen as usable, but no one app is superior to the other. Although we found that regular use is indicated for effects on depression and anxiety to occur in those who are more symptomatic, regression to the mean cannot be ruled out. TRIAL REGISTRATION: ClinicalTrials.gov NCT04536935; https://tinyurl.com/mr36zx3s.

Operationalizing Engagement With an Interpretation Bias Smartphone App Intervention: Case Series.

BACKGROUND: Engagement with mental health smartphone apps is an understudied but critical construct to understand in the pursuit of improved efficacy. OBJECTIVE: This study aimed to examine engagement as a multidimensional construct for a novel app called HabitWorks. HabitWorks delivers a personalized interpretation bias intervention and includes various strategies to enhance engagement such as human support, personalization, and self-monitoring. METHODS: We examined app use in a pilot study (n=31) and identified 5 patterns of behavioral engagement: consistently low, drop-off, adherent, high diary, and superuser. RESULTS: We present a series of cases (5/31, 16%) from this trial to illustrate the patterns of behavioral engagement and cognitive and affective engagement for each case. With rich participant-level data, we emphasize the diverse engagement patterns and the necessity of studying engagement as a heterogeneous and multifaceted construct. CONCLUSIONS: Our thorough idiographic exploration of engagement with HabitWorks provides an example of how to operationalize engagement for other mental health apps.

The Effect of Mental Health App Customization on Depressive Symptoms in College Students: Randomized Controlled Trial.

BACKGROUND: Mental health apps have shown promise in improving mental health symptoms, including depressive symptoms. However, limited research has been aimed at understanding how specific app features and designs can optimize the therapeutic benefits and adherence to such mental health apps. OBJECTIVE: The primary purpose of this study is to investigate the effect of avatar customization on depressive symptoms and adherence to use a novel cognitive behavioral therapy (CBT)-based mental health app. The secondary aim is to examine whether specific app features, including journaling, mood tracking, and reminders, affect the usability of the mental health app. METHODS: College students were recruited from a university study recruitment pool website and via flyer advertisements throughout campus. A total of 94 participants completed a randomized controlled trial in which they were randomized to either customization or no customization version of the app. Customization involved personalizing a virtual avatar and a travel vehicle to one's own preferences and use of one's name throughout the app. Participants completed a 14-day trial using a novel CBT-based mental health app called AirHeart. Self-report scores for depressive symptoms, anxiety, and stress were measured at baseline and after the intervention. Postintervention survey measures also included usability and avatar identification questionnaires. RESULTS: Of the 94 enrolled participants, 83 (88%) completed the intervention and postintervention assessments. AirHeart app use significantly reduced symptoms of depression (P=.006) from baseline to the end of the 2-week intervention period for all participants, regardless of the customization condition. However, no differences in depressive symptoms (P=.17) or adherence (P=.80) were observed between the customization (39/83, 47%) and no customization (44/83, 53%) conditions. The frequency of journaling, usefulness of mood tracking, and helpfulness of reminders were not associated with changes in depressive symptoms or adherence (P>.05). Exploratory analyses showed that there were 3 moderate positive correlations between avatar identification and depressive symptoms (identification: r=-0.312, P=.02; connection: r=-0.305, P=.02; and lack of relatability: r=0.338, P=.01). CONCLUSIONS: These results indicate that CBT mental health apps, such as AirHeart, have the potential to reduce depressive symptoms over a short intervention period. The randomized controlled trial results demonstrated that customization of app features, such as avatars, does not further reduce depressive symptoms over and above the CBT modules and standard app features, including journal, reminders, and mood tracking. However, further research elucidating the relationship between virtual avatar identification and mental health systems is needed as society becomes increasingly more digitized. These findings have potential implications for improving the optimization of mental health app designs. TRIAL REGISTRATION: Open Science Framework t28gm; https://osf.io/t28gm.

Mobile Applications in Mood Disorders and Mental Health: Systematic Search in Apple App Store and Google Play Store and Review of the Literature.

OBJECTIVES: The main objective of this work was to explore and characterize the current landscape of mobile applications available to treat mood disorders such as depression, bipolar disorder, and dysthymia. METHODS: We developed a tool that makes both the Apple App Store and the Google Play Store searchable using keywords and that facilitates the extraction of basic app information of the search results. All app results were filtered using various inclusion and exclusion criteria. We characterized all resultant applications according to their technical details. Furthermore, we searched for scientific publications on each app's website and PubMed, to understand whether any of the apps were supported by any type of scientific evidence on their acceptability, validation, use, effectiveness, etc. Results: Thirty apps were identified that fit the inclusion and exclusion criteria. The literature search yielded 27 publications related to the apps. However, these did not exclusively concern mood disorders. 6 were randomized studies and the rest included a protocol, pilot-, feasibility, case-, or qualitative studies, among others. The majority of studies were conducted on relatively small scales and 9 of the 27 studies did not explicitly study the effects of mobile application use on mental wellbeing. CONCLUSION: While there exists a wealth of mobile applications aimed at the treatment of mental health disorders, including mood disorders, this study showed that only a handful of these are backed by robust scientific evidence. This result uncovers a need for further clinically oriented and systematic validation and testing of such apps.

User Experience, Engagement, and Popularity in Mental Health Apps: Secondary Analysis of App Analytics and Expert App Reviews.

BACKGROUND: User experience and engagement are critical elements of mental health apps' abilities to support users. However, work examining the relationships among user experience, engagement, and popularity has been limited. Understanding how user experience relates to engagement with and popularity of mental health apps can demonstrate the relationship between subjective and objective measures of app use. In turn, this may inform efforts to develop more effective and appealing mental health apps and ensure that they reach wide audiences. OBJECTIVE: We aimed to examine the relationship among subjective measures of user experience, objective measures of popularity, and engagement in mental health apps. METHODS: We conducted a preregistered secondary data analysis in a sample of 56 mental health apps. To measure user experience, we used expert ratings on the Mobile App Rating Scale (MARS) and consumer ratings from the Apple App Store and Google Play. To measure engagement, we acquired estimates of monthly active users (MAU) and user retention. To measure app popularity, we used download count, total app revenue, and MAU again. RESULTS: MARS total score was moderately positively correlated with app-level revenue (Kendall rank [T]=0.30, P=.002), MAU (T=0.39, P<.001), and downloads (T=0.41, P<.001). However, the MARS total score and each of its subscales (Engagement, Functionality, Aesthetics, and Information) showed extremely small correlations with user retention 1, 7, and 30 days after downloading. Furthermore, the total MARS score only correlated with app store rating at T=0.12, which, at P=.20, did not meet our threshold for significance. CONCLUSIONS: More popular mental health apps receive better ratings of user experience than less popular ones. However, user experience does not predict sustained engagement with mental health apps. Thus, mental health app developers and evaluators need to better understand user experience and engagement, as well as to define sustained engagement, what leads to it, and how to create products that achieve it. This understanding might be supported by better collaboration between industry and academic teams to advance a science of engagement.