The impact of guided versus supportive coaching on mental health app engagement and clinical outcomes.

Although mobile mental health apps have the unique potential to increase access to care, evidence reveals engagement is low unless coupled with coaching. However, most coaching protocols are limited in their scalability. This study assesses how human support and guidance from a Digital Navigator (DN), a scalable coach, can impact mental health app engagement and effectiveness on anxiety and depressive symptoms. This study aims to detach components of coaching, specifically personalized recommendations versus general support, to inform scalability of coaching models for mental health apps. 156 participants were split into the DN Guide versus DN Support groups for the 6-week study. Both groups utilized the mindLAMP app for the duration of the study and had equal time with the DN, but the Guide group received personalized app recommendations. The Guide group completed significantly more activities than the Support group. 34% (49/139) of all participants saw a 25% decrease in PHQ-9 scores and 38% (53/141) saw a 25% decrease in GAD-7 scores. These findings show mental health apps, especially when supported by DNs, can reduce depression and anxiety symptoms when coupled with coaching, suggesting a feasible path for large-scale deployment.

Smartphone Apps for Smoking Cessation: Systematic Framework for App Review and Analysis.

BACKGROUND: Cigarette smoking is a leading cause of preventable death, and identifying novel treatment approaches to promote smoking cessation is critical for improving public health. With the rise of digital health and mobile apps, these tools offer potential opportunities to address smoking cessation, yet the functionality of these apps and whether they offer scientifically based support for smoking cessation are unknown. OBJECTIVE: The goal of this research was to use the American Psychiatric Association app evaluation model to evaluate the top-returned apps from Android and Apple app store platforms related to smoking cessation and investigate the common app features available for end users. METHODS: We conducted a search of both Android and iOS app stores in July 2021 for apps related to the keywords "smoking," "tobacco," "smoke," and "cigarette" to evaluate apps for smoking cessation. Apps were screened for relevance, and trained raters identified and analyzed features, including accessibility (ie, cost), privacy, clinical foundation, and features of the apps, using a systematic framework of 105 objective questions from the American Psychiatric Association app evaluation model. All app rating data were deposited in mindapps, a publicly accessible database that is continuously updated every 6 months given the dynamic nature of apps available in the marketplace. We characterized apps available in July 2021 and November 2022. RESULTS: We initially identified 389 apps, excluded 161 due to irrelevance and nonfunctioning, and rated 228, including 152 available for Android platforms and 120 available for iOS platforms. Some of the top-returned apps (71/228, 31%) in 2021 were no longer functioning in 2022. Our analysis of rated apps revealed limitations in accessibility and features. While most apps (179/228, 78%) were free to download, over half had costs associated with in-app purchases or full use. Less than 65% (149/228) had a privacy policy addressing the data collected in the app. In terms of intervention features, more than 56% (128/228) of apps allowed the user to set and check in on goals, and more than 46% (106/228) of them provided psychoeducation, although few apps provided evidence-based support for smoking cessation, such as peer support or skill training, including mindfulness and deep breathing, and even fewer provided evidence-based interventions, such as acceptance and commitment therapy or cognitive behavioral therapy. Only 12 apps in 2021 and 11 in 2022 had published studies supporting the feasibility or efficacy for smoking cessation. CONCLUSIONS: Numerous smoking cessation apps were identified, but analysis revealed limitations, including high rates of irrelevant and nonfunctioning apps, high rates of turnover, and few apps providing evidence-based support for smoking cessation. Thus, it may be challenging for consumers to identify relevant, evidence-based apps to support smoking cessation in the app store, and a comprehensive evaluation system of mental health apps is critically important.

Exploring how informed mental health app selection may impact user engagement and satisfaction.

The prevalence of mental health app use by people suffering from mental health disorders is rapidly growing. The integration of mental health apps shows promise in increasing the accessibility and quality of treatment. However, a lack of continued engagement is one of the significant challenges of such implementation. In response, the M-health Index and Navigation Database (MIND)- derived from the American Psychiatric Association's app evaluation framework- was created to support patient autonomy and enhance engagement. This study aimed to identify factors influencing engagement with mental health apps and explore how MIND may affect user engagement around selected apps. We conducted a longitudinal online survey over six weeks after participants were instructed to find mental health apps using MIND. The survey included demographic information, technology usage, access to healthcare, app selection information, System Usability Scale, the Digital Working Alliance Inventory, and the General Self-Efficacy Scale questions. Quantitative analysis was performed to analyze the data. A total of 321 surveys were completed (178 at the initial, 90 at the 2-week mark, and 53 at the 6-week mark). The most influential factors when choosing mental health apps included cost (76%), condition supported by the app (59%), and app features offered (51%), while privacy and clinical foundation to support app claims were among the least selected filters. The top ten apps selected by participants were analyzed for engagement. Rates of engagement among the top-ten apps decreased by 43% from the initial to week two and 22% from week two to week six on average. In the context of overall low engagement with mental health apps, implementation of mental health app databases like MIND can play an essential role in maintaining higher engagement and satisfaction. Together, this study offers early data on how educational approaches like MIND may help bolster mental health apps engagement.

Assessing the Dynamics of the Mental Health Apple and Android App Marketplaces.

Barriers to mental health care, including stigma, costs, and mental health professional shortages, have been exacerbated by the COVID-19 pandemic. Smartphone apps have the potential to increase scalability and improve access to mental health information, support, and interventions. However, evaluating these apps and selecting ones for use in care remain challenging, especially as apps are often updating and changing. Recommending apps requires knowledge of how stable apps are as the experience of one user several months ago may or may not be the same. A sample of 347 apps of the 650 apps on the M-health Index and Navigation Database (MIND) https://mindapps.org were reviewed between September 1, 2021, and January 5, 2022. Apps were selected by time since their last review, with updates occurring on average approximately 4 months from the last review. Eleven trained app evaluators reviewed apps across 105 evaluation criteria in 9 categories. Results were compared to initial ratings, identifying the changes that occurred. The average app updates every 433 days, though 19% were updated in the last 3 months and some nearly weekly. Changes in privacy and features made up the highest percentage of changes, both at 38%. The most frequently observed privacy-related change was increased privacy policy reading level. Functionality parameters changed in 28% of apps. The most common functionality change was the removal of an accessibility feature. Clinical foundations changed in 18% of apps and 9% added supporting studies. Cost structure changed in 17% of apps, with 10% adding a fee for use of the app. Engagement features changed in 17% of the apps, with additions and removals of validated assessments or screeners most common. The dynamic nature of the app stores is reflected in app privacy, features, and functionality. These changes, reflected by the increased reading levels required to understand privacy policies, the decrease in accessibility features, and the additions of fees to access mobile apps, reflect the need to constantly review apps and understand how they are evolving. Patient and clinicians should use the most recent and updated possible when evaluating apps.

Impact of Digital Literacy Training on Outcomes for People With Serious Mental Illness in Community and Inpatient Settings.

OBJECTIVE: The authors explored whether a digital literacy program, Digital Outreach for Obtaining Resources and Skills (DOORS), could improve self-reported functional skills and clinical outcomes among people with serious mental illness. METHODS: The 8-week program was offered to participants receiving treatment in community mental health centers (N=113) and an inpatient psychiatric unit (N=74). Pre- and postintervention self-report surveys were collected. Descriptive statistics and two-tailed t tests were used for analysis. RESULTS: For patients treated in a community center, improvements were observed in 27 of the 29 self-reported functional skills that measured digital literacy. Changes in seven of these skills were statistically significant. Although these participants reported larger improvements in clinical outcomes than did inpatient participants, no statistically significant changes in symptoms were seen in either setting. CONCLUSIONS: Digital skills training is necessary to increase access to care through technology. DOORS can improve self-reported digital literacy, but further research is necessary to determine its immediate impact on symptoms.

Digital phenotyping of student mental health during COVID-19: an observational study of 100 college students.

Objective: This study assessed the feasibility of capturing smartphone based digital phenotyping data in college students during the COVID-19 pandemic with the goal of understanding how digital biomarkers of behavior correlate with mental health. Participants: Participants were 100 students enrolled in 4-year universities. Methods: Each participant attended a virtual visit to complete a series of gold-standard mental health assessments, and then used a mobile app for 28 days to complete mood assessments and allow for passive collection of GPS, accelerometer, phone call, and screen time data. Students completed another virtual visit at the end of the study to collect a second round of mental health assessments. Results: In-app daily mood assessments were strongly correlated with their corresponding gold standard clinical assessment. Sleep variance among students was correlated to depression scores (ρ = .28) and stress scores (ρ = .27). Conclusions: Digital Phenotyping among college students is feasible on both an individual and a sample level. Studies with larger sample sizes are necessary to understand population trends, but there are practical applications of the data today.

Assessment of Mental Health Services Available Through Smartphone Apps.

Importance: As more patients and clinicians are turning to mental health smartphone apps to expand access to services, little is known about the current state of the app marketplaces and what these apps are actually offering in terms of features, privacy, price, and services. Objective: To assess the current state of mental health apps, explore the association between app privacy scores and popularity as measured by star ratings and downloads, and to understand opportunities and challenges facing the commercial app landscape. Design, Setting, and Participants: This cross-sectional study had trained raters using the public-facing M-Health Index and Navigation Database (MIND) to assess and review 578 mental health apps. The sample of apps used in this analysis were pulled from MIND and include apps across various conditions including schizophrenia, eating disorders, sleep, and more. Analysis of these apps was conducted in June 2022. Exposures: There were 578 mental health apps rated across 105 dimensions derived from the American Psychiatric Association's app evaluation framework. Main Outcomes and Measures: App raters assessed each app across 6 categories: (1) app origin and accessibility, (2) privacy and security, (3) clinical foundation, (4) features and engagement, (5) inputs and outputs, and (6) interoperability. Privacy scores were determined by 5 MIND criteria, including (1) having a privacy policy, (2) reporting security measures in place, (3) declaring data use and purpose, (4) allowing for the deletion of data, and (5) allowing users to opt out of data collection. Correlations between privacy scores and popularity metrics (star ratings and number of downloads) were measured. Results: This study included 578 mental health apps that were identified, assessed, and analyzed across 105 MIND dimensions. Psychoeducation, goal setting, and mindfulness were among the top app features. Of the 578 apps analyzed, 443 (77%) had a privacy policy. This analysis of apps with a privacy policy revealed that there was no statistically significant correlation between privacy scores and Apple App Store (r = 0.058, P = .29) or Google Play Store star ratings (r = 0.041; P = .48). The number of app downloads on the Google Play Store, however, was weakly correlated with privacy scores (χ25 = 22.1; P < .001). Conclusions and Relevance: In this cross-sectional study of mental health apps, findings indicate that the current app marketplaces primarily offered basic features such as psychoeducation, goal tracking, and mindfulness but fewer innovative features such as biofeedback or specialized therapies. Privacy challenges remained common, and app popularity metrics provided little help in identifying apps with more privacy.

Assessment of Smartphone Apps for Common Neurologic Conditions (Headache, Insomnia, and Pain): Cross-sectional Study.

BACKGROUND: There are thousands of apps for individuals struggling with headache, insomnia, and pain, but it is difficult to establish which of these apps are best suited for patients' specific needs. If clinicians were to have access to a platform that would allow them to make an informed decision on the efficacy and feasibility of smartphone apps for patient care, they would feel confident in prescribing specific apps. OBJECTIVE: We sought to evaluate the quality of apps for some of the top common, disabling neurologic conditions (headache, insomnia, and pain) based on principles derived from the American Psychiatric Association's (APA) app evaluation model. METHODS: We used the Mobile Health Index and Navigation database and expanded upon the database's current supported conditions by adding 177 new app entries. Each app was rated for consistency with the APA's app evaluation model, which includes 105 objective questions based on the following 5 major classes of consideration: (1) accessibility, (2) privacy and security, (3) clinical foundation, (4) engagement style, and (5) interoperability. These characteristics were evaluated to gain a broader understanding of the significant features of each app category in comparison against a control group. RESULTS: Approximately 90% (187/201) of all apps evaluated were free to download, but only 50% (63/201) of headache- and pain-related apps were truly free. Most (87/106, 81%) sleep apps were not truly free to use. The apps had similar limitations with limited privacy, accessibility, and crisis management resources. For example, only 17% (35/201) of the apps were available in Spanish. The apps offered mostly self-help tools with little tailoring; symptom tracking was the most common feature in headache- (32/48, 67%) and pain-related apps (21/47, 45%), whereas mindfulness was the most common feature in sleep-related apps (73/106, 69%). CONCLUSIONS: Although there are many apps for headache, pain, and insomnia, all 3 types of apps have room for improvement around accessibility and privacy. Pain and headache apps share many common features, whereas insomnia apps offer mostly mindfulness-based resources. Given the many available apps to pick from, clinicians and patients should seek apps that offer the highest-quality features, such as complete privacy, remedial features, and the ability to download the app at no cost. These results suggest that there are many opportunities for the improvement of apps centered on headache, insomnia, and pain.

College student engagement with mental health apps: analysis of barriers to sustained use.

Objective: College students'demand for mental health resources is straining the services offered by colleges. While mobile apps demonstrate potential to help, students' engagement with these apps remains low. This study examines why college students show poor engagement with mental health apps and how apps may be adapted to suit this population. Participants: Participants were a convenience sample of 100 college students. Methods: Qualitative data was gathered through individual online interviews concerningattitudes toward mental health apps, and quantitative data was gathered through a survey about phone and app use. Results: Students were interested in mental health apps. 53% haddownloaded an app at one point, but only 19% currently used a mental health app. Stress and costdrove mental health app choices. Responses around engagement centered on: Data privacy, user interface, credibility, and customization. Conclusions: Students have specific wants for mental health apps including safety, simplicity, credibility, and customizability.

Introducing an implementation framework for augmenting care with digital technology for early psychosis patients: theory and motivation.

BACKGROUND: Treatment programs for early-course psychosis are evidence-based interventions that provide specialty care to improve outcomes in patients. Digital technologies offer the potential to augment services and meet the growing demand for care. AIMS: We introduce a framework to guide the assessment of site readiness for technology and their ability to successfully introduce, implement, and sustain digital technology use. While broader in use that early course psychosis, we focus on this use case to introduce the theory and clinical application. METHODS: Adapting the replicating effective programs framework, we present an early psychosis focused model. Considering the unique opportunities and challenges of these programs, we present a five-stage evaluation framework. Informed by our clinical experience and recent literature, we present tools and examples to help programs plan and execute successful technology implementation. RESULTS: The AACCS framework is comprised of five stages: (1) Access (e.g. identifying access to and comfort with technology), (2) Align (e.g. understanding aspects technology can augment), (3) Connect (e.g. customizing technology to stakeholder needs), (4) Care (e.g. implementing technology into treatment), and (5) Sustain (e.g. creating sustainable services). Site visits revealed patients have access to digital tools and are open to implementation into care, while staff prefers digital skills training. CONCLUSIONS: This framework assists programs in identifying clinical targets to be augmented with technology, stages of implementation, and recommendations for sustaining meaningful technology use.

Marketplace and Literature Review of Spanish Language Mental Health Apps.

Language differences between patients and providers remains a barrier to accessing health care, especially mental health services. One potential solution to reduce inequities for patients that speak different languages and improve their access to care is through the delivery of healthcare through mobile technology. Given that the Latinx community serves as the largest ethnic minority in the United States, this two-phased review examines Spanish app development, feasibility and efficacy. Phase 1 explored the commercial marketplace for apps available in Spanish, while phase 2 involved a literature review of published research centered around the creation, functions, and usability of these apps using the PubMed and Google Scholar electronic databases. Of the apps available on the database, only 14.5% of them had Spanish operability. The literature search uncovered 629 results, of which 12 research articles that tested or described 10 apps met the inclusion criteria. Of the 10 apps studied in this literature review, only four apps were translated to Spanish. Our study reveals that despite increasing interest in Spanish-language apps to address mental health, the commercial marketplace is not currently meeting the demand.

Psychiatric rehabilitation through teaching smartphone skills to improve functional outcomes in serious mental illness.

This study measured the impact of a digital competencies and skills course on participants with serious mental illness. Close to 75% of participants reported an improvement in a smartphone related skill, and the majority of participants that reported improvement in one skill reported improvement in at least one other. Qualitative feedback from participants suggests how digital competencies acquired were used to immediately support functional outcomes. OBJECTIVE: To improve functional outcomes in patients with serious mental illness through a multi-session curriculum designed to improve smartphone skills and engage participants in group learning and problem solving, targeting negative and cognitive symptoms of illness. METHODS: An eight-week smartphone digital competencies and skills course was offered to two distinct groups of youth with serious mental illness. Pre and post self-report measurements were captured for each participant for each session. RESULTS: Group participation varied by session, but overall 28 unique patients attended. From survey results, 75% reported improvement in smartphone related skills because of the groups. Qualitative feedback suggests how skills acquired by patients were immediately utilized to gain insight into health and support functional outcomes. CONCLUSIONS AND IMPLICATIONS FOR PRACTICE: Smartphone skills groups are a means to provide practical psychiatric rehabilitation that may enable some patients to compensate for cognitive and social deficits due to illness. While ensuring groups are responsive to patients with varying degrees of skills remains a challenge, adapting lesson structures and mediums, as well as creating new measurement tools, offers a means to modify the course with the clinical need.

Interest and readiness for digital mental health in coordinate specialty care for early course psychosis: A survey study of 42 programs in 30 states.

AIM: As in-person healthcare services become suspended due to the COVID-19 pandemic, the need for digital technologies to augment early course psychosis care has risen. Although technology offers many benefits including increasing access to care, the advantages of such tools are restricted by their implementation into the program. The goal of this study is to better understand the current usage of technology, clinical needs, and digital literacy in Coordinated Specialty Care (CSC) programs. METHODS: An online survey of CSC staff and clinicians assessed their attitudes, preparedness, and comfort with technology implementation into care. RESULTS: In total, 42 programs from 30 states responded to the web-based survey. Of the six key roles of CSC, the role believed to be most capable for technology to augment was Family Education and Support by 90% (38/42) of participants. Eighty-two per cent (34/42) of clinicians and staff felt that they would benefit from and have interest in receiving digital skills training (41% [17/42] strongly agree, 41% [17/42] agreed). Evaluation of respondent sentiments towards technology revealed that 70 per cent (29/42) ("agree", or "strongly agree") believe that technology can integrate into care easily. CONCLUSIONS: Survey responses show overall positive sentiments towards technology implementation in early psychosis care. Findings also reveal that the digital tool would be better sustained if CSC staff and clinicians received digital skills education. This survey demonstrates that technology can augment early psychosis care while improving quality of care and expanding access to care.

The digital clinic: Implementing technology and augmenting care for mental health.

Increasing both access to and quality of mental healthcare is a global priority. One solution is to integrate technologies such as smartphone apps and sensors directly into care. Acknowledging many prior attempts and barriers, we introduce the Digital Clinic which is an already functioning clinic using smartphone apps to augment and extend care today at Beth Israel Deaconess Medical Center (BIDMC) in Boston, Massachusetts. In this piece, we outline the theoretical foundation of the Digital Clinic and its emphasis on the therapeutic alliance, measurement-based care, and shared decision making. We explore both workflow and engagement challenges as well as solutions including a new care team member, the Digital Navigator, and the customization of technology. Acknowledging that the Digital Clinic is an evolving program, we offer details on our implementation in order to allow others to replicate, expand on, and improve these initial efforts.

Technology Evaluation and Assessment Criteria for Health Apps (TEACH-Apps): Pilot Study.

BACKGROUND: Despite the emergence of app evaluation tools, there remains no well-defined process receptive to diverse local needs, rigorous standards, and current content. The need for such a process to assist in the implementation of app evaluation across all medical fields is evident. Such a process has the potential to increase stakeholder engagement and catalyze interest and engagement with present-day app evaluation models. OBJECTIVE: This study aimed to develop and pilot test the Technology Evaluation and Assessment Criteria for Health apps (TEACH-apps). METHODS: Tailoring a well-known implementation framework, Replicating Effective Programs, we present a new process to approach the challenges faced in implementing app evaluation tools today. As a culmination of our experience implementing this process and feedback from stakeholders, we present the four-part process to aid the implementation of mobile health technology. This paper outlines the theory, evidence, and initial versions of the process. RESULTS: The TEACH-apps process is designed to be broadly usable and widely applicable across all fields of health. The process comprises four parts: (1) preconditions (eg, gathering apps and considering local needs), (2) preimplementation (eg, customizing criteria and offering digital skills training), (3) implementation (eg, evaluating apps and creating educational handouts), and (4) maintenance and evolution (eg, repeating the process every 90 days and updating content). TEACH-apps has been tested internally at our hospital, and there is growing interest in partnering health care facilities to test the system at their sites. CONCLUSIONS: This implementation framework introduces a process that equips stakeholders, clinicians, and users with the foundational tools to make informed decisions around app use and increase app evaluation engagement. The application of this process may lead to the selection of more culturally appropriate and clinically relevant tools in health care.

Smartphone Apps to Support Coordinated Specialty Care for Prodromal and Early Course Schizophrenia Disorders: Systematic Review.

BACKGROUND: Demand for mental health services, especially for clinical high-risk and early psychosis, has increased, creating a need for new solutions to increase access to and quality of care. Smartphones and mobile technology are potential tools to support coordinated specialty care for early psychosis, given their potential to augment the six core roles of care: case management and team leadership, recovery-oriented psychotherapy, medication management, support for employment and education, coordination with primary care services, and family education and support. However, the services smartphones are actually offering specifically for coordinated specialty care and the level of evidence are unknown. OBJECTIVE: This study aimed to review the published literature on smartphone technology to enhance care for patients with prodromal and early course psychosis and schizophrenia and to analyze studies by type, aligned with coordinated specialty care domains. METHODS: A systematic literature search was conducted on August 16 and 17, 2019, using the PubMed, EMBASE, Web of Sciences, and PsycINFO electronic databases. The eligible studies were reviewed and screened based on inclusion and exclusion criteria. RESULTS: The search uncovered 388 unique results, of which 32 articles met the initial inclusion criteria; 21 eligible studies on 16 unique app platforms were identified. Feasibility studies showed a high user engagement and interest among patients, monitoring studies demonstrated a correlation between app assessments and clinical outcomes, and intervention studies indicated that these apps have the potential to advance care. Eighteen studies reported on app use for the case management roles of coordinated specialty care. No app studies focused on employment and education, coordination with primary care services, and family education and support. CONCLUSIONS: Although the published literature on smartphone apps for prodromal and first-episode psychosis is small, it is growing exponentially and holds promise to augment both monitoring and interventions. Although the research results and protocols for app studies are not well aligned with all coordinated specialty care roles today, high rates of adoption and feasibility suggest the potential for future efforts. These results will be used to develop coordinated specialty care-specific app evaluation scales and toolkits.