Defining and Improving Outcomes Measurement for Virtual Care: Report from the VHA State-of-the-Art Conference on Virtual Care.

Virtual care, including synchronous and asynchronous telehealth, remote patient monitoring, and the collection and interpretation of patient-generated health data (PGHD), has the potential to transform healthcare delivery and increase access to care. The Veterans Health Administration (VHA) Office of Health Services Research and Development (HSR&D) convened a State-of-the-Art (SOTA) Conference on Virtual Care to identify future virtual care research priorities. Participants were divided into three workgroups focused on virtual care access, engagement, and outcomes. In this article, we report the findings of the Outcomes Workgroup. The group identified virtual care outcome areas with sufficient evidence, areas in need of additional research, and areas that are particularly well-suited to be studied within VHA. Following a rigorous process of literature review and consensus, the group focused on four questions: (1) What outcomes of virtual care should we be measuring and how should we measure them?; (2) how do we choose the "right" care modality for the "right" patient?; (3) what are potential consequences of virtual care on patient safety?; and (4) how can PGHD be used to benefit provider decision-making and patient self-management?. The current article outlines key conclusions that emerged following discussion of these questions, including recommendations for future research.

Sustainability of the Collaborative Chronic Care Model in Outpatient Mental Health Teams Three Years Post-Implementation: A Qualitative Analysis.

Our goal was to investigate the sustainability of care practices that are consistent with the collaborative chronic care model (CCM) in nine outpatient mental health teams located within US Department of Veterans Affairs (VA) medical centers, three to four years after the completion of CCM implementation. We conducted qualitative interviews (N = 30) with outpatient mental health staff from each of the nine teams. We based our directed content analysis on the six elements of the CCM. We found variable sustainability of CCM-based care processes across sites. Some care processes, such as delivery of evidence-based psychotherapies (EBPs) and use of measurement-based care (MBC) to guide clinic decision-making, were robustly maintained or even expanded within participating teams. In contrast, other care processes-which had in some cases been developed with considerable effort-had not been sustained. For example, care manager roles were diminished in scope or eliminated completely in response to workload pressures, frontline care needs, or the COVID-19 pandemic. Similarly, processes for engaging Veterans more fully in decision-making had generally been scaled back. Leadership support in the form of adequate team staffing and time to conduct team meetings were seen as crucial for sustaining CCM-consistent care. Given the potential impact of leadership turnover on sustainability in mental health, future efforts to implement CCM-based mental health care should strive to involve multiple leaders in implementation and sustainment efforts, lest one key departure undo years of implementation work. Our results also suggest that implementing CCM processes may best be conceptualized as a partnership across multiple levels of medical center leadership.

Getting Connected: a Retrospective Cohort Investigation of Video-to-Home Telehealth for Mental Health Care Utilization Among Women Veterans.

BACKGROUND: Increasingly, women are serving in the military and seeking care at the Veterans Health Administration (VHA). Women veterans face unique challenges and barriers in seeking mental health (MH) care within VHA. VA Video Connect (VVC), which facilitates video-based teleconferencing between patients and providers, can reduce barriers while maintaining clinical effectiveness. OBJECTIVE: Primary aims were to examine gender differences in VVC use, describe changes in VVC use over time (including pre-COVID and 6 months following the beginning of COVID), and determine whether changes over time differed by gender. DESIGN: A retrospective cohort investigation of video-to-home telehealth for MH care utilization among veterans having at least 1 MH visit from October 2019 to September 2020. PARTICIPANTS: Veterans (236,268 women; 1,318,024 men). INTERVENTIONS (IF APPLICABLE): VVC involves face-to-face, synchronous, video-based teleconferencing between patients and providers, enabling care at home or another private location. MAIN MEASURES: Percentage of MH encounters delivered via VA Video Connect. KEY RESULTS: Women veterans were more likely than men to have at least 1 VVC encounter and had a greater percentage of MH care delivered via VVC in FY20. There was an increase in the percentage of MH encounters that were VVC over FY20, and this increase was greater for women than men. Women veterans who were younger than 55 (compared to those 55 and older), lived in urban areas (compared to those in rural areas), or were Asian (compared to other races) had a greater percentage of MH encounters that were VVC since the start of the pandemic, controlling for the mean percentage of VVC MH encounters in the 6 months pre-pandemic. CONCLUSIONS: VVC use for MH care is greater in women veterans compared to male veterans and may reduce gender-specific access barriers. Future research and VVC implementation efforts should emphasize maximizing patient choice and satisfaction.

Provider Perceptions of Virtual Care During the Coronavirus Disease 2019 Pandemic: A Multispecialty Survey Study.

BACKGROUND: The coronavirus disease 2019 (COVID-19) pandemic has led to a dramatic increase in virtual care (VC) across outpatient specialties, but little is known regarding provider acceptance of VC. OBJECTIVE: The objective of this study was to assess provider perceptions of the quality, efficiency, and challenges of VC versus in-person care with masks. DESIGN: This was a voluntary survey. PARTICIPANTS: Mental health (MH), primary care, medical specialty, and surgical specialty providers across the 8 VA New England Healthcare System medical centers. MEASURES: Provider ratings of: (1) quality and efficiency of VC (phone and video telehealth) compared with in-person care with masks; (2) challenges of VC; and (3) percentage of patients that providers are comfortable seeing via VC in the future. RESULTS: The sample included 998 respondents (49.8% MH, 20.6% primary care, 20.4% medical specialty, 9.1% surgical specialty; 61% response rate). Most providers rated VC as equivalent to or higher in quality and efficiency compared with in-person care with masks. Quality ratings were significantly higher for video versus phone (χ2=61.4, P<0.0001), but efficiency ratings did not differ significantly. Ratings varied across specialties (highest in MH, lowest in SS; all χ2s>24.1, Ps<0.001). Inability to conduct a physical examination and patient technical difficulties were significant challenges. MH providers were comfortable seeing a larger proportion of patients virtually compared with the other specialties (all χ2s>12.2, Ps<0.01). CONCLUSIONS: Broad provider support for VC was stratified across specialties, with the highest ratings in MH and lowest ratings in SS. Findings will inform the improvement of VC processes and the planning of health care delivery during the COVID-19 pandemic and beyond.

Digital Clinics and Mobile Technology Implementation for Mental Health Care.

PURPOSE OF REVIEW: Interest in digital mental health, especially smartphone apps, has expanded in light of limited access to mental health services and the need for remote care during COVID-19. Digital clinics, in which apps are blended into routine care, offer a potential solution to common implementation challenges including low user engagement and lack of clinical integration of apps. RECENT FINDINGS: While the number of mental health apps available in commercial marketplaces continues to rise, there are few examples of successful implementation of these apps into care settings. We review one example of a digital clinic created within an academic medical center and another within the Department of Veterans Affairs. We then discuss how implementation science can inform new efforts to effectively integrate mental health technologies across diverse use cases. Integrating mental health apps into care settings is feasible but requires careful attention to multiple domains that will influence implementation success, including characteristics of the innovation (e.g., utility and complexity of the app), the recipients of the technology (e.g., patients and clinicians), and context (e.g., healthcare system buy-in, reimbursement, and regulatory policies). Examples of effective facilitation strategies that can be utilized to improve implementation efforts include co-production of technology involving all end users, specialized trainings for staff and patients, creation of new team members to aid in app usage (e.g., digital navigators), and re-design of clinical workflows.

Rapid Increase in Telemental Health Within the Department of Veterans Affairs During the COVID-19 Pandemic.

Background: The use of telemental health via videoconferencing (TMH-V) became critical during the Coronavirus disease 2019 (COVID-19) pandemic due to restriction of non-urgent in-person appointments. The current brief report demonstrates the rapid growth in TMH-V appointments in the weeks following the pandemic declaration within the Department of Veterans Affairs (VA), the largest healthcare system in the United States. Methods: COVID-19 changes in TMH-V appointments were captured during the six weeks following the World Health Organization's pandemic declaration (March 11, 2020-April 22, 2020). Pre-COVID-19 TMH-V encounters were assessed from October 1, 2017 to March 10, 2020. Results: Daily TMH-V encounters rose from 1,739 on March 11 to 11,406 on April 22 (556% growth, 222,349 total encounters). Between March 11-April 22, 114,714 patients were seen via TMH-V, and 77.5% were first-time TMH-V users. 12,342 MH providers completed a TMH-V appointment between March 11-April 22, and 34.7% were first-time TMH-V users. The percentage growth of TMH-V appointments was higher than the rise in telephone appointments (442% growth); in-person appointments dropped by 81% during this time period. Discussion and Conclusions: The speed of VA's growth in TMH-V appointments in the wake of the COVID-19 pandemic was facilitated by its pre-existing telehealth infrastructure, including earlier national efforts to increase the number of providers using TMH-V. Longstanding barriers to TMH-V implementation were lessened in the context of a pandemic, during which non-urgent in-person MH care was drastically reduced. Future work is necessary to understand the extent to which COVID-19 related changes in TMH-V use may permanently impact mental health care provision.

An Economic Analysis of the Implementation of Team-based Collaborative Care in Outpatient General Mental Health Clinics.

BACKGROUND: Collaborative Chronic Care Models represent an evidence-based way to structure care for chronic conditions, including mental health conditions. Few studies, however, have examined the cost implications of collaborative care for mental health. OBJECTIVE: We aimed to conduct an economic analysis of implementing collaborative care in 9 outpatient general mental health clinics. RESEARCH DESIGN: Analyses were derived from a stepped wedge hybrid implementation-effectiveness trial. We conducted cost-minimization analyses from the health system perspective, incorporating implementation costs, outpatient costs, and inpatient costs for the year before collaborative care implementation and the implementation year. We used a difference-in-differences approach and conducted 1-way sensitivity analyses to determine the robustness of results to variations ±15% in model parameters, along with probabilistic sensitivity analysis using Monte Carlo simulation. SUBJECTS: Our treatment group included 5507 patients who were initially engaged in care within 9 outpatient general mental health teams that underwent collaborative care implementation. We compared costs for this group to 45,981 control patients who received mental health treatment as usual at the same medical centers. RESULTS: Collaborative care implementation cost about $40 per patient and was associated with a significant decrease in inpatient costs and a nonsignificant increase in outpatient mental health costs. This implementation was associated with $78 in cost savings per patient. Monte Carlo simulation suggested that implementation was cost saving in 78% of iterations. CONCLUSIONS: Collaborative care implementation for mental health teams was associated with significant reductions in mental health hospitalizations, leading to substantial cost savings of about $1.70 for every dollar spent for implementation.

Secure Messaging, Diabetes Self-management, and the Importance of Patient Autonomy: a Mixed Methods Study.

BACKGROUND: Diabetes is a complex, chronic disease that requires patients' effective self-management between clinical visits; this in turn relies on patient self-efficacy. The support of patient autonomy from healthcare providers is associated with better self-management and greater diabetes self-efficacy. Effective provider-patient secure messaging (SM) through patient portals may improve disease self-management and self-efficacy. SM that supports patients' sense of autonomy may mediate this effect by providing patients ready access to their health information and better communication with their clinical teams. OBJECTIVE: We examined the association between healthcare team-initiated SM and diabetes self-management and self-efficacy, and whether this association was mediated by patients' perceptions of autonomy support from their healthcare teams. DESIGN: We surveyed and analyzed content of messages sent to a sample of patients living with diabetes who use the SM feature on the VA's My HealtheVet patient portal. PARTICIPANTS: Four hundred forty-six veterans with type 2 diabetes who were sustained users of SM. MAIN MEASURES: Proactive (healthcare team-initiated) SM (0 or ≥ 1 messages); perceived autonomy support; diabetes self-management; diabetes self-efficacy. KEY RESULTS: Patients who received at least one proactive SM from their clinical team were significantly more likely to engage in better diabetes self-management and report a higher sense of diabetes self-efficacy. This relationship was mediated by the patient's perception of autonomy support. The majority of proactive SM discussed scheduling, referrals, or other administrative content. Patients' responses to team-initiated communication promoted patient engagement in diabetes self-management behaviors. CONCLUSIONS: Perceived autonomy support is important for diabetes self-management and self-efficacy. Proactive communication from clinical teams to patients can help to foster a patient's sense of autonomy and encourage better diabetes self-management and self-efficacy.

External facilitators' perceptions of internal facilitation skills during implementation of collaborative care for mental health teams: a qualitative analysis informed by the i-PARIHS framework.

BACKGROUND: Facilitation is a key strategy that may contribute to successful implementation of healthcare innovations. In blended facilitation, external facilitators (EFs) guide and support internal facilitators (IFs) in directing implementation processes. Developers of the i-PARIHS framework propose that successful facilitation requires project management, team/process, and influencing/negotiating skills. It is unclear what IF skills are most important in real-world settings, which could inform recruitment and training efforts. As prior qualitative studies of IF skills have only interviewed IFs, the perspectives of their EF partners are needed. Furthermore, little is known regarding the distribution of implementation tasks between IFs and EFs, which could impact sustainability once external support is removed. In the context of an implementation trial, we therefore: 1) evaluated IFs' use of i-PARIHS facilitation skills, from EFs' perspectives; 2) identified attributes of IFs not encompassed within the i-PARIHS skills; and 3) investigated the relative contributions of IFs and EFs during facilitation. METHODS: Analyses were conducted within a hybrid type II trial utilizing blended facilitation to implement the collaborative chronic care model within mental health teams of nine VA medical centers. Each site committed one team and an IF to weekly process design meetings and additional implementation activities over 12 months. Three EFs worked with three sites each. Following study completion, the EFs completed semi-structured qualitative interviews reflecting on the facilitation process, informed by the i-PARIHS facilitation skill areas. Interviews were analyzed via directed content analysis. RESULTS: EFs emphasized the importance of IFs having strong project management, team/process, and influencing/negotiating skills. Prior experience in these areas and a mental health background were also benefits. Personal characteristics (e.g., flexible, assertive) were described as critical, particularly when faced with conflict. EFs discussed the importance of clear delineation of EF/IF roles, and the need to shift facilitation responsibilities to IFs. CONCLUSIONS: Key IF skills, according to EFs, are aligned with i-PARIHS recommendations, but IFs' personal characteristics were also emphasized as important factors. Findings highlight traits to consider when selecting IFs and potential training areas (e.g., conflict management). EFs and IFs must determine an appropriate distribution of facilitation tasks to ensure long-term sustainability of practices. TRIAL REGISTRATION: Clinicaltrials.gov, September 7, 2015, #NCT02543840.

The Promise of Patient Portals for Individuals Living With Chronic Illness: Qualitative Study Identifying Pathways of Patient Engagement.

BACKGROUND: Patients play a critical role in managing their health, especially in the context of chronic conditions like diabetes. Electronic patient portals have been identified as a potential means to improve patient engagement; that is, patients' involvement in their care. However, little is known about the pathways through which portals may help patients engage in their care. OBJECTIVE: Our objective is to understand how an electronic patient portal facilitates patient engagement among individuals with diabetes. METHODS: This qualitative study employed semistructured telephone interviews of 40 patients living with diabetes since at least 2011, who had experienced uncontrolled diabetes, and had used secure messaging through a portal at least 4 times over 18 months. The interviews were recorded, transcribed, coded, and analyzed using primarily an inductive approach to identify how patients living with diabetes use an online health portal to support diabetes self-management. RESULTS: Overall, patients who used the portal reported feeling engaged in their health care. We identified four pathways by which the portal facilitates patient engagement and some challenges. The portal provides a platform that patients use to (1) better understand their health by asking questions about new symptoms, notes, or labs, (2) prepare for medical appointments by reviewing labs and notes, (3) coordinate care between VA (Veterans Affairs) and non-VA health care teams, and (4) reach out to providers to request help between visits. Several patients reported that the portal helped improve the patient-provider relationship; however, aspects of the portal design may hinder engagement for others. Patients reported challenges with both secure messaging and access to medical records that had negative impacts on their engagement. Benefits for patient engagement were described by many types of portal users with varying degrees of diabetes control. CONCLUSIONS: Patient portals support engagement by facilitating patient access to their health information and by facilitating patient-provider communication. Portals can help a wide range of users engage with their care.

A Longitudinal Investigation of Cognitive Self-schemas across Adolescent Development.

Research in developmental psychology highlights youth's self-schemas as one possible pathway to improve adolescents' functioning and promote positive developmental outcomes. Despite this, the trajectory of positive and negative self-schemas is relatively understudied. This study addresses this limitation by empirically examining the trajectory of self-schemas in a community sample of 623 youth (M = 13.04 years; 54% female; 49% African American, 4% Biracial, 47% European American) who were followed over a seven-year period. Caregivers completed measures of parenting practices, maternal rumination and negative inferential style, and adolescents completed a computerized behavioral task assessing self-schemas (i.e., mental frameworks that guide attention, interpretation, and memory of one's experiences). Multilevel growth curve modeling results demonstrated a quadratic slope for negative self-schemas and no mean-level change for positive self-schemas. These trajectories did not vary by gender or racial group. However, parenting factors differentially influenced the trajectories. Specifically, higher levels of parental involvement at baseline, or an active interest and engagement in a child's experiences and activities, related to lower levels of negative self-schemas during adolescence. Additionally, higher levels of parental rumination and parental negative control at baseline related to lower levels of youth positive self-schemas at baseline. These findings contribute to models of youth cognitive development.

How Do Patients with Mental Health Diagnoses Use Online Patient Portals? An Observational Analysis from the Veterans Health Administration.

Online patient portals may be effective for engaging patients with mental health conditions in their own health care. This retrospective database analysis reports patient portal use among Veterans with mental health diagnoses. Unadjusted and adjusted odds of portal feature use was calculated using logistic regressions. Having experienced military sexual trauma or having an anxiety disorder, post-traumatic stress disorder, or depression were associated with increased odds of portal use; bipolar, substance use, psychotic and adjustment disorders were associated with decreased odds. Future research should examine factors that influence portal use to understand diagnosis-level differences and improve engagement with such tools.

Posttraumatic Stress Disorder Symptoms, Temperament, and the Pathway to Cellular Senescence.

Traumatic stress is thought to be associated with shortened telomere length (TL) in leukocytes, an age-related marker of increased risk for cellular senescence, although findings thus far have been mixed. We assessed associations between posttraumatic stress disorder (PTSD) symptom severity, temperament, and TL in a sample of 453 White, non-Hispanic, middle-aged, trauma-exposed male and female veterans and civilians. Given that prior research has suggested an association between PTSD and accelerated cellular age, we also examined associations between TL and an index of accelerated cellular age derived from DNA methylation data (DNAm age). Analyses revealed that, controlling for chronological age, PTSD was not directly associated with TL but rather this association was moderated by age, ß = -.14, p = .003, ΔR2 = .02. Specifically, PTSD severity evidenced a stronger negative association with TL among relatively older participants (≥ 55 years of age). In a subset of veterans with data pertaining to temperament (n = 150), positive emotionality, and, specifically, a drive toward achievement, ß = .26, p = .002, ΔR2 = .06, were positively associated with TL. There was no evidence of an association between age-adjusted TL and accelerated DNAm age. Collectively, these results indicate that older adults may be more vulnerable to the negative health effects of PTSD but that traits such as achievement, resilience, and psychological hardiness may be protective. These findings underscore the importance of identifying reliable biomarkers of cellular aging and senescence and of determining the biological mechanisms that contribute to stress-related disease and decline.

INFLEXIBLE COGNITION PREDICTS FIRST ONSET OF MAJOR DEPRESSIVE EPISODES IN ADOLESCENCE.

BACKGROUND: Major depressive disorder often is characterized by a lack of cognitive and emotional flexibility, resulting in an impaired ability to adapt to situational demands. Adolescence is an important period of risk for the first onset of depression, yet relatively little is known about whether aspects of inflexibility, such as rumination and deficits in attentional shifting, could confer risk for the development of the disorder during this time. METHOD: In the present study, a sample of 285 never-depressed adolescents completed self-report and behavioral measures of rumination and attentional shifting at a baseline visit, followed by up to 4 years of annual prospective follow-up diagnostic assessments. RESULTS: Survival analyses indicated that adolescents with greater levels of rumination or poorer attentional shifting experienced a shorter time until the first onset of major depressive episodes, even after accounting for baseline symptoms and demographic characteristics. Although girls were twice as likely as boys to experience the first onset of depression, rumination predicted a shorter time until depression onset only for boys. Rumination and attentional shifting were not correlated and predicted time until onset of major depression independently of one another. CONCLUSIONS: These results provide evidence that components of cognition that are characterized by rigidity and perseveration confer risk for the first onset of major depression during adolescence. Evaluating rumination and attentional shifting in adolescence may be useful in identifying individuals who are at risk for depression and who may benefit from interventions that target or alter the development of these characteristics.

Information processing biases concurrently and prospectively predict depressive symptoms in adolescents: Evidence from a self-referent encoding task.

Negative information processing biases have been hypothesised to serve as precursors for the development of depression. The current study examined negative self-referent information processing and depressive symptoms in a community sample of adolescents (N = 291, Mage at baseline = 12.34 ± 0.61, 53% female, 47.4% African-American, 49.5% Caucasian and 3.1% Biracial). Participants completed a computerised self-referent encoding task (SRET) and a measure of depressive symptoms at baseline and completed an additional measure of depressive symptoms nine months later. Several negative information processing biases on the SRET were associated with concurrent depressive symptoms and predicted increases in depressive symptoms at follow-up. Findings partially support the hypothesis that negative information processing biases are associated with depressive symptoms in a nonclinical sample of adolescents, and provide preliminary evidence that these biases prospectively predict increases in depressive symptoms.

Rumination and overgeneral autobiographical memory in adolescents: an integration of cognitive vulnerabilities to depression.

During adolescence, rates of depression dramatically increase and girls become twice as likely as boys to develop depression. Research suggests that overgeneral autobiographical memory and rumination are vulnerability factors for depressive symptoms in adolescence that may be triggered by stressful life events. The current longitudinal study included 160 early adolescents (Mage = 12.44 years, 60.0 % African American, 40.0 % Caucasian, and 56.2 % female). At baseline, adolescents completed measures of current depressive symptoms, rumination, and specificity of autobiographical memories. Approximately 9 months later, the adolescents completed measures of current depressive symptoms and stressful life events that had occurred between baseline and follow-up. Analyses indicated that girls with more overgeneral autobiographical memories in combination with higher levels of rumination were most vulnerable to experiencing increases in depressive symptoms following stressful life events. Additionally, retrieving more specific autobiographical memories appeared to buffer against the impact of negative life events on depressive symptoms among both boys and girls. Memory specificity may play a protective role in depression risk, suggesting that memory specificity training interventions may prove beneficial for adolescents.

Efficacy of life goals collaborative care for bipolar disorder: A systematic review.

BACKGROUND: Bipolar disorder remains a disabling mental health condition despite the availability of effective treatments. Collaborative chronic care models (CCMs) represent an evidence-based way to structure care for conditions like bipolar disorder. Life Goals Collaborative Care (LGCC) was designed specifically for bipolar disorder, featuring psychoeducation alongside collaborative components (e.g. nurse care management or expert psychiatric consultation). Despite the use of Life Goals across health systems, a systematic review summarizing its effectiveness has never been conducted. METHODS: We conducted a systematic review of randomized controlled trials (RCTs) of LGCC through December 2023 to help guide the field in treating bipolar disorder (PROSPERO: #404581). We evaluated study quality and outcomes in several symptom and quality of life domains. RESULTS: Ten articles describing eight studies met inclusion criteria. All studies featured group-based LGCC; most were compared to treatment as usual (TAU). Three of eight studies found LGCC to be associated with statistically significant effects for the prevention of manic episodes. Most studies finding positive effects featured additional collaborative care components beyond psychoeducation and were conducted in capitated healthcare systems. LIMITATIONS: Limitations include: several types of potential bias in included studies; exclusion of observational studies of LGCC; lack of generalizability to pediatric populations; insufficient studies to conduct subgroup analyses; and low confidence in the quality of the evidence. CONCLUSIONS: In this systematic review, group-based LGCC demonstrated some positive effects for reducing mania recurrence; results for other outcome domains were equivocal. Future studies should investigate one-on-one LGCC, both in person and virtually, to enhance well-being for people with bipolar disorder.

Sustaining the collaborative chronic care model in outpatient mental health: a matrixed multiple case study.

BACKGROUND: Sustaining evidence-based practices (EBPs) is crucial to ensuring care quality and addressing health disparities. Approaches to identifying factors related to sustainability are critically needed. One such approach is Matrixed Multiple Case Study (MMCS), which identifies factors and their combinations that influence implementation. We applied MMCS to identify factors related to the sustainability of the evidence-based Collaborative Chronic Care Model (CCM) at nine Department of Veterans Affairs (VA) outpatient mental health clinics, 3-4 years after implementation support had concluded. METHODS: We conducted a directed content analysis of 30 provider interviews, using 6 CCM elements and 4 Integrated Promoting Action on Research Implementation in Health Services (i-PARIHS) domains as codes. Based on CCM code summaries, we designated each site as high/medium/low sustainability. We used i-PARIHS code summaries to identify relevant factors for each site, the extent of their presence, and the type of influence they had on sustainability (enabling/neutral/hindering/unclear). We organized these data into a sortable matrix and assessed sustainability-related cross-site trends. RESULTS: CCM sustainability status was distributed among the sites, with three sites each being high, medium, and low. Twenty-five factors were identified from the i-PARIHS code summaries, of which 3 exhibited strong trends by sustainability status (relevant i-PARIHS domain in square brackets): "Collaborativeness/Teamwork [Recipients]," "Staff/Leadership turnover [Recipients]," and "Having a consistent/strong internal facilitator [Facilitation]" during and after active implementation. At most high-sustainability sites only, (i) "Having a knowledgeable/helpful external facilitator [Facilitation]" was variably present and enabled sustainability when present, while (ii) "Clarity about what CCM comprises [Innovation]," "Interdisciplinary coordination [Recipients]," and "Adequate clinic space for CCM team members [Context]" were somewhat or less present with mixed influences on sustainability. CONCLUSIONS: MMCS revealed that CCM sustainability in VA outpatient mental health clinics may be related most strongly to provider collaboration, knowledge retention during staff/leadership transitions, and availability of skilled internal facilitators. These findings have informed a subsequent CCM implementation trial that prospectively examines whether enhancing the above-mentioned factors within implementation facilitation improves sustainability. MMCS is a systematic approach to multi-site examination that can be used to investigate sustainability-related factors applicable to other EBPs and across multiple contexts.

Adaptation for sustainability in an implementation trial of team-based collaborative care.

Background: Sustaining healthcare interventions once they have been implemented is a pivotal public health endeavor. Achieving sustainability requires context-sensitive adaptations to evidence-based practices (EBPs) or the implementation strategies used to ensure their adoption. For replicability of adaptations beyond the specific setting in question, the underlying logic needs to be clearly described, and adaptations themselves need to be plainly documented. The goal of this project was to describe the process by which implementation facilitation was adapted to improve the uptake of clinical care practices that are consistent with the collaborative chronic care model (CCM). Method: Quantitative and qualitative data from a prior implementation trial found that CCM-consistent care practices were not fully sustained within outpatient general mental health teams that had received 1 year of implementation facilitation to support uptake. We undertook a multistep consensus process to identify adaptations to implementation facilitation based on these results, with the goal of enhancing the sustainability of CCM-based care in a subsequent trial. The logic for these adaptations, and the resulting adaptations themselves, were documented using two adaptation-oriented implementation frameworks (the iterative decision-making for evaluation of adaptations [IDEA] and the framework for reporting adaptations and modifications to evidence-based implementation strategies [FRAME-IS], respectively). Results: Three adaptations emerged from this process and were documented using the FRAME-IS: (a) increasing the scope of implementation facilitation within the medical center, (b) having the internal facilitator take a greater role in the implementation process, and (c) shortening the implementation timeframe from 12 to 8 months, while increasing the intensity of facilitation support during that time. Conclusions: EBP sustainability may require careful adaptation of EBPs or the implementation strategies used to get them into routine practice. Recently developed frameworks such as the IDEA and FRAME-IS may be used to guide decision-making and document resulting adaptations themselves. An ongoing funded study is investigating the utility of the resulting adaptations for improving healthcare.

Evidence-based treatments may not be sustained after they have been implemented in healthcare settings. To address this, treatments and implementation strategies may need to be adapted to fit the local context or the patient population. Maximizing the usefulness of such adaptations requires documenting the decision-making process. Understanding how an implementation strategy has been adapted for a given study or setting is crucial to ensuring that adaptations don't compromise fidelity to the implementation strategy while enabling its replicability in similar settings. This article uses two adaptation frameworks to describe the process by which implementation facilitation, a common implementation strategy, was adapted to help establish and sustain effective mental health clinical teams in VA medical centers. It is our hope that our description of this process may help healthcare researchers, administrators, and policymakers to describe and document adaptations to implementation strategies in their own settings.