Implementation mapping to plan for a hybrid trial testing the effectiveness and implementation of a behavioral intervention for HIV medication adherence and care retention.

Background: Implementation mapping is a systematic, collaborative, and contextually-attentive method for developing implementation strategies. As an exemplar, we applied this method to strategy development for Managed Problem Solving Plus (MAPS+), an adapted evidence-based intervention for HIV medication adherence and care retention that will be delivered by community health workers and tested in an upcoming trial. Methods: In Step 1: Conduct Needs Assessment, we interviewed 31 stakeholders to identify determinants of MAPS+ implementation in 13 clinics serving people with HIV in Philadelphia County. In Step 2: Develop Logic Model, we used these determinants as inputs for a working logic model guided by the Consolidated Framework for Implementation Research. In Step 3: Operationalize Implementation Strategies, our team held a virtual stakeholder meeting to confirm determinants. We synthesized stakeholder feedback, then identified implementation strategies that conceptually matched to determinants using the Expert Recommendations for Implementing Change taxonomy. Next, we operationalized implementation strategies with specific examples for clinic settings. We linked strategies to behavior change theories to allow for a mechanistic understanding. We then held a second virtual stakeholder meeting to present the implementation menu for feedback and glean generalizable insights for how these strategies could be operationalized in each stakeholder's clinic. In Step 4: Protocolize Strategies, we incorporated stakeholder feedback and finalized the implementation strategy menu. Findings: Implementation mapping produced a menu of 39 strategies including revise professional roles, identify and prepare champions, use warm handoffs, and change record systems. The process of implementation mapping generated key challenges for implementation strategy development: lack of implementation strategies targeting the outer setting (i.e., sociopolitical context); tension between a one-size-fits-all and individualized approach for all clinics; conceptual confusion between facilitators and strategies; and challenges in translating the implementation science lexicon for partners. Implications: This case exemplar advances both MAPS+ implementation and implementation science methods by furthering our understanding of the use of implementation mapping to develop strategies that enhance uptake of evidence-based interventions. The implementation menu will inform MAPS+ deployment across Philadelphia in an upcoming hybrid trial. We will carry out Step 5: Test Strategies to test the effectiveness and implementation of MAPS+.

Stakeholder Perspectives on MAPS.

BACKGROUND: Managed problem solving (MAPS) is an evidence-based intervention that can boost HIV medication adherence and increase viral suppression, but it is not widely used in community clinics. Deploying community health workers to deliver MAPS could facilitate broader implementation, in support of the Ending the HIV Epidemic (EHE) initiative's goal of reducing new HIV infections in the US by 90% by 2030. SETTING: Ryan White-funded clinics in Philadelphia, 1 of 48 US counties prioritized in the EHE. METHODS: Semistructured stakeholder interviews were conducted with 13 clinics and 4 stakeholder groups: prescribing clinicians, nonprescribing clinical team members (eg, medical case managers), clinic administrators, and policymakers. Interviews were based on the Consolidated Framework for Implementation Research and investigated perceived barriers to and facilitators of MAPS delivery by community health workers. Rapid qualitative analytic techniques were used to synthesize interview data and identify key categories along an implementation pathway. Core determinants (ie, barriers and facilitators) of MAPS implementation were grouped within each category. RESULTS: Stakeholders were receptive to CHW-delivered MAPS and offered critical information on potential implementation determinants including preferences for identification and referral of patients, and the importance of integration and communication within the care team. CONCLUSIONS: This study elucidates insights regarding barriers and facilitators to delivering an evidence-based behavioral intervention in clinics serving people with HIV (PWH) and extends a rapid qualitative approach to HIV care that rigorously incorporates stakeholder data into the development of implementation strategies. It also offers insights for national implementation efforts associated with EHE.

Implementation of the Wolverine Mental Health Program, Part 3: Sustainment Phase.

Sustaining the implementation of an evidence-based practice (EBP) is the ultimate goal of often years of significant personnel and financial investment. Some conceptualize sustainment as a distinct phase following an active implementation period where the contextual factors, processes, and supports are bolstered to ensure continued EBP delivery. This study provides an overview of the sustainment strategies deployed to embed cognitive-behavioral therapy (CBT) in a Midwestern residential treatment facility serving youth with complex mental health needs. Seven key strategies and their outcomes are described: use of CBT teams, new hire orientation plans, monthly campaigns, change in job descriptions and performance evaluations, development of a behavioral reinforcement system for youth, and a pathway to CBT certification. This study provides a window into how one might sustain an EBP by addressing barriers unique to this phase of work.

Screening Adolescents for Sensitive Health Topics in Primary Care: A Scoping Review.

We sought to aggregate common barriers and facilitators to screening adolescents for sensitive health topics (e.g., depression, chlamydia) in primary care, as well as those that are unique to a given health topic. We conducted a literature search of three databases (PsycInfo, MEDLINE, and CINAHL) and reference lists of included articles. Studies focused on barriers and facilitators to screening adolescents (ages 12-17 years) for sensitive health topics in primary care that are recommended by national guidelines. Articles were peer-reviewed, presented empirical data, and were published in English in 2006-2021. We coded barriers and facilitators using the Consolidated Framework for Implementation Research, a well-established framework within implementation science. In total, 39 studies met inclusion criteria and spanned several health topics: depression, suicide, substance use, HIV, and chlamydia. We found common barriers and facilitators to screening across health topics, with most relating to characteristics of the primary care clinics (e.g., time constraints). Other factors relevant to screening implementation ranged from confidentiality concerns to clinician knowledge. Barriers and facilitators specific to certain health topics, such as the availability of on-site laboratories for HIV screening, were also noted. Findings can guide refinements to screening implementation.

Stakeholder intention to engage in fidelity measurement methods in community mental health settings: A mixed methods study.

Background: The current gold standard for measuring fidelity (specifically, adherence) to cognitive behavioral therapy (CBT) is direct observation, a costly, resource-intensive practice that is not feasible for many community organizations to implement regularly. Recent research indicates that behavioral rehearsal (i.e., role-play between clinician and individual with regard to session delivery) and chart-stimulated recall (i.e., brief structured interview between clinician and individual about what they did in session; clinicians use the client chart to prompt memory) may provide accurate and affordable alternatives for measuring adherence to CBT in such settings, with behavioral rehearsal yielding greater correspondence with direct observation. Methods: Drawing on established causal theories from social psychology and leading implementation science frameworks, this study evaluates stakeholders' intention to use behavioral rehearsal and chart-stimulated recall. Specifically, we measured attitudes, self-efficacy, and subjective norms toward using each, and compared these factors across the two methods. We also examined the relationship between attitudes, self-efficacy, subjective norms, and intention to use each method. Finally, using an integrated approach we asked stakeholders to discuss their perception of contextual factors that may influence beliefs about using each method. These data were collected from community-based supervisors (n = 17) and clinicians (n = 66). Results: Quantitative analyses suggest moderately strong intention to use both methods across stakeholders. There were no differences in supervisors' or clinicians' attitudes, self-efficacy, subjective norms, or intention across methods. More positive attitudes and greater reported subjective norms were associated with greater reported intention to use either measure. Qualitative analyses identified participants' specific beliefs about using each fidelity measure in their organization, and results were organized using the Consolidated Framework for Implementation Research. Conclusions: Strategies are warranted to overcome or minimize potential barriers to using fidelity measurement methods and to further increase the strength of intention to use them.Plain Language Summary: The best way to measure fidelity, or how closely a clinician follows the protocol, to Cognitive Behavioral Therapy (CBT) is watching the session. This is an expensive practice that is not feasible for many community organizations to do regularly. Recent research indicates that behavioral rehearsal, or a role-play between the clinician and individual with regard to session delivery, and chart-stimulated recall, or a brief discussion between an individual and the clinician about what they did in session with the clinician having access to the chart to help them remember, may provide accurate and affordable alternatives for measuring fidelity to CBT. We just completed a study demonstrating that both methods are promising, with behavioral rehearsal offering scores that are the most similar to watching the session. Drawing on established theories from social psychology and leading implementation science frameworks, this study evaluates future supervisor and clinician motivation to use these fidelity measurement methods. Specifically, we measured supervisor (n = 17) and clinician (n = 66) attitudes, norms, self-efficacy, intentions, and anticipated barriers and facilitators to using each of these fidelity measurement tools. Quantitative and qualitative analyses suggest similar intention to use both methods, and concerns about barriers to using each method. Further research is warranted to minimize the burden associated with implementing fidelity measurement methods and deploying strategies to increase use.

The TPOCS-self-reported Therapist Intervention Fidelity for Youth (TPOCS-SeRTIFY): A case study of pragmatic measure development.

Background: Developing pragmatic assessment tools to measure clinician use of evidence-based practices is critical to advancing implementation of evidence-based practices in mental health. This case study details our community-partnered process of developing the Therapy Process Observation Coding Scale-Self-Reported Therapist Intervention Fidelity for Youth (TPOCS-SeRTIFY), a pragmatic, clinician-report instrument to measure cognitive behavioral therapy (CBT) delivery. Approach: We describe a five-step community-partnered development process. Initial goals were to create a self-report instrument that paralleled an existing direct observation measure of clinician delivery of CBT use to facilitate later assessment of measure performance. Cognitive interviews with community clinicians (n = 6) and consultation with CBT experts (n = 6) were used to enhance interpretability and usability as part of an iterative refinement process. The instrument was administered to 247 community clinicians along with an established self-reported measure of clinician delivery of CBT and other treatments to assess preliminary psychometric performance. Preliminary psychometrics were promising. Conclusion: Our community-partnered development process showed promising success and can guide future development of pragmatic implementation measures both to facilitate measurement of ongoing implementation efforts and future research aimed at building learning mental health systems. Plain language summary: Developing brief, user-friendly, and accurate tools to measure how therapists deliver cognitive behavioral therapy (CBT) in routine practice is important for advancing the reach of CBT into community settings. To date, developing such "pragmatic" measures has been difficult. There is little known about how researchers can best develop these types of assessment tools so that they (1) are easy for clinicians in practice to use and (2) provide valid and useful information about implementation outcomes. As a result, there are few well-validated measures in existence that measure therapist use of CBT that are feasible for use in community practice. This paper contributes to the literature by describing our community-partnered process for developing a measure of therapist use of CBT (Therapy Process Observation Coding Scale -Self-Reported Therapist Intervention Fidelity for Youth; TPOCS-SeRTIFY). This descriptive case study outlines the community-partnered approach we took to develop this measure. This case study will contribute to future research by serving as a guide to others aiming to develop pragmatic implementation measures. In addition, the TPOCS-SeRTIFY is a pragmatic measure of clinician use of CBT that holds promise for its use by both researchers and clinicians to measure the success of CBT implementation efforts.