Technology Evaluation and Assessment Criteria for Health Apps (TEACH-Apps): Pilot Study.

BACKGROUND: Despite the emergence of app evaluation tools, there remains no well-defined process receptive to diverse local needs, rigorous standards, and current content. The need for such a process to assist in the implementation of app evaluation across all medical fields is evident. Such a process has the potential to increase stakeholder engagement and catalyze interest and engagement with present-day app evaluation models. OBJECTIVE: This study aimed to develop and pilot test the Technology Evaluation and Assessment Criteria for Health apps (TEACH-apps). METHODS: Tailoring a well-known implementation framework, Replicating Effective Programs, we present a new process to approach the challenges faced in implementing app evaluation tools today. As a culmination of our experience implementing this process and feedback from stakeholders, we present the four-part process to aid the implementation of mobile health technology. This paper outlines the theory, evidence, and initial versions of the process. RESULTS: The TEACH-apps process is designed to be broadly usable and widely applicable across all fields of health. The process comprises four parts: (1) preconditions (eg, gathering apps and considering local needs), (2) preimplementation (eg, customizing criteria and offering digital skills training), (3) implementation (eg, evaluating apps and creating educational handouts), and (4) maintenance and evolution (eg, repeating the process every 90 days and updating content). TEACH-apps has been tested internally at our hospital, and there is growing interest in partnering health care facilities to test the system at their sites. CONCLUSIONS: This implementation framework introduces a process that equips stakeholders, clinicians, and users with the foundational tools to make informed decisions around app use and increase app evaluation engagement. The application of this process may lead to the selection of more culturally appropriate and clinically relevant tools in health care.

Implementation of a Novel Telehealth Patient Advisory Council.

Patient engagement in healthcare delivery processes has been increasingly emphasized in recent years, which can be accomplished in part by Patient Advisory Councils (PACs). Although well-established in brick-and-mortar facilities, the use of PACs in pure telehealth settings is limited. Bicycle Health, a digital health organization that provides biopsychosocial treatment of opioid use disorder (OUD) via telehealth, sought to increase patient engagement regarding care delivery and innovation, ultimately launching a telehealth Patient Advisory Council. Herein we discuss implementation challenges and iterative changes to address each challenge. Key learnings include the following: Patients with OUD are often subject to significant stigma, including by healthcare professionals. This is a key factor to consider when recruiting and engaging patients; trust building is key and can help to overcome both perceived and actual stigma.Inclusion of core staff persons who have lived experience with the respective health condition-in this case, OUD-is beneficial.Utilizing a formal framework, such as the Model for Improvement (utilized widely by the Institute for Healthcare Improvement), to guide improvement work is helpful for providing structure to feedback conversations, though this framework should be presented to patients in accessible language.

Digital Opportunities for Outcomes in Recovery Services (DOORS): A Pragmatic Hands-On Group Approach Toward Increasing Digital Health and Smartphone Competencies, Autonomy, Relatedness, and Alliance for Those With Serious Mental Illness.

Digital health technologies such as smartphones present the potential for increased access to care and on-demand services. However, many patients with serious mental illnesses (eg, schizophrenia) have not been offered the digital health training necessary to fully utilize these innovative approaches. To bridge this digital divide in knowledge and skills, we created a hands-on and interactive training program grounded in self-determination theory, technology use cases, and the therapeutic alliance. This article introduces the need and theoretical foundation for and the experience of running the resulting Digital Opportunities for Outcomes in Recovery Services (DOORS) group in the setting of 2 programs: a first-episode psychosis program and a clubhouse for individuals with serious mental illness. The experience of running these 2 DOORS groups resulted in 2 publicly available, free training manuals to empower others to run such groups and adapt them for local needs. Future work on DOORS will expand the curriculum to best support digital health needs and increase equity of access to and knowledge and skills related to technology use in serious mental illness.

Augmenting Mental Health in Primary Care: A 1-Year Study of Deploying Smartphone Apps in a Multi-site Primary Care/Behavioral Health Integration Program.

Background: Integrating behavioral health (BH) services into primary care is an evidence-based intervention that can increase access to care, improve patient outcomes, and decrease costs. Digital technology, including smartphone apps, has the potential to augment and extend the reach of these integrated behavioral health services through self-management support impacting lifestyle behaviors. To date, the feasibility and acceptability of using mental health mobile apps within an integrated primary care setting has not yet been explored as part of routine clinical care. Objectives: The objectives of this study were to (a) test the feasibility of using mental health applications to augment integrated primary care services; (b) solicit feedback from patients and providers to guide implementation, and (c) develop a mental health apps toolkit for system-wide dissemination. Methods: Cambridge Health Alliance (CHA) is a safety-net healthcare system that includes three community hospitals and 12 Primary Care (PC) clinics serving nearly 150,000 ethnically and socioeconomically diverse patients around Boston. To select and disseminate mental health apps, a four-phase implementation was undertaken: (1) Evaluation of mental health mobile applications (2) Development of an apps toolkit with stakeholder input, (3) Conducting initial pilot at six primary care locations, and (4) Rolling out the app toolkit across 12 primary care sites and conducting 1-year follow-up survey. Results: Among BH providers, 24 (75%) responded to the follow-up survey and 19 (83%) indicated they use apps as part of their clinical care. Anxiety was the most common condition for which app use was recommended by providers, and 10 (42%) expressed interest in further developing their knowledge of mental health apps. Among patients, 35 (65%) of participants provided feedback; 23 (66%) reported the tools to be helpful, especially for managing stress and anxiety. Conclusions: Our findings indicate mental health apps are applicable and relevant to patients within integrated primary care settings in safety-net health systems. Behavioral health providers perceive the clinical value of using these tools as part of patient care, but require training to increase their comfort-level and confidence applying these tools with patients. To increase provider and patient engagement, mobile apps must be accessible, simple, intuitive and directly relevant to patients' treatment needs.