Research and engagement considerations for alcohol use telehealth services within HIV care: a qualitative exploration in federally qualified health centers.

The prevalence of alcohol misuse is high among people with HIV (PWH); however, access to and utilization of evidence-based alcohol misuse interventions remain limited. Telehealth is one treatment approach with the potential for enhancing substance use disorder treatment utilization for PWH served by Federally Qualified Health Centers (FQHCs). However, questions remain regarding barriers to alcohol-focused telehealth service integration and telehealth research in FQHCs. This study employed qualitative methods, guided by the Dynamic Sustainability Framework, to evaluate barriers and cultural factors impacting FQHC telehealth integration. Eighteen qualitative interviews were completed with staff and leaders across four FQHCs. Interviews were analyzed using directed content analysis, and codes were organized into a priori and emergent themes. Key themes included the presence of common workflows for referring clients to substance use disorder treatment; existing research workflows and preferences for active project staff involvement; telehealth barriers including exacerbation of healthcare disparities and high provider turnover; and the importance of cultural humility and telehealth adaptations for sexual, gender, racial and ethnic minority clients. Findings from this study will inform the development of an alcohol-focused telehealth implementation strategy for a Hybrid Type 1 implementation effectiveness trial to enhance FQHC substance use disorder treatment.Trial registration: ClinicalTrials.gov identifier: NCT02563574..

Taking a Magnifying Glass to Measurement-Based Care Consultation Sessions: with What Issues Do Mental Health Clinicians Struggle?

PURPOSE: Ongoing consultation following initial training is one of the most commonly deployed implementation strategies to facilitate uptake of evidence-based practices, such as measurement-based care (MBC). Group consultation provides an interactive experience with an expert and colleagues to get feedback on actual issues faced, yet there is little research that unpacks the questions raised in consultation and what types of issues are important to address. METHODS: The current study characterized the questions and concerns raised by community mental health clinicians (N = 38 across six clinics) during group consultation sessions completed as part of an MBC implementation trial. We conducted a qualitative content analysis of consultation forms completed by clinicians before each MBC consultation session. RESULTS: Clinicians sought MBC consultation for clients across a range of ages and levels of depression severity. Qualitative results revealed five main questions and concerns in consultation sessions: (1) how to administer the PHQ-9, (2) how to review PHQ-9 scores, (3) how to respond to PHQ-9 score, (4) the types of clients for whom MBC would be appropriate, and (5) how MBC could impact a clinician's usual care. CONCLUSION: Findings highlight the need for ongoing consultation and limitations of workshop training alone. Practical recommendations for addressing the common questions and concerns identified are presented to support MBC use.

Pharmacotherapy interventions for adolescent co-occurring substance use and mental health disorders: a systematic review.

BACKGROUND: Co-occurring mental health and substance use (SU) disorders among adolescents are common, with two-thirds of adolescents who seek SU treatment also requiring support for mental health. Primary care physicians play a key role in the pharmacological treatment of mental health disorders among adolescents, however, little is known about the impact of these treatments on SU outcomes. OBJECTIVES: This systematic review summarizes the evidence regarding commonly used pharmacotherapy interventions for mental health and their impact on adolescent SU. METHODS: Literature searches were conducted across five databases as part of a larger systematic review of adolescent SU interventions. Studies were screened for eligibility by two researchers, and study data were extracted regarding study design, patient and treatment characteristics and results. Risk of bias analyses and qualitative syntheses were completed to evaluate the strength of the evidence and the impact of pharmacotherapy on SU outcomes. RESULTS: Ten randomized controlled trials exploring seven pharmacotherapies met criteria for inclusion. All studies had low to moderate risk of bias. Four studies evaluated pharmacotherapy for co-occurring depression and SU, three evaluated attention deficit hyperactivity disorder and SU, and three evaluated bipolar disorder and SU. Five of the 10 studies also included a behavioural intervention. We found no evidence that pharmacotherapy for co-occurring mental health diagnoses impacted SU. CONCLUSION: Family medicine clinicians prescribing pharmacotherapy for mental health should be aware that additional interventions will likely be needed to address co-occurring SU.

Many adolescents have both mental health and substance use problems. Adolescents have difficulty getting effective treatment for both substance use and mental health concerns, in part because these treatments are often offered separately. Primary care physicians, who often care for adolescents with mental health concerns, may prescribe medications for diagnoses such as attention deficit hyperactivity disorder, depression or early symptoms of bipolar disorder. However, there is little research indicating whether these medications are helpful for co-occurring substance use disorder symptoms. This paper presents a review of existing research on medications used to treat common mental health disorders to evaluate their effect on substance use. Ten studies address this question and suggest that medications for mental health are insufficient for helping adolescents with substance use disorders or substance use problems.

Substance use workforce training needs during intersecting epidemics: an analysis of events offered by a regional training center from 2017 to 2020.

BACKGROUND: Intersecting opioid overdose, COVID-19, and systemic racism epidemics have brought unprecedented challenges to the addiction treatment and recovery workforce. From 2017 to 2020, the New England Addiction Technology Transfer Center (ATTC) collected data in real-time on the training and technical assistance (TA) requested and attended by the front-line workforce. This article synthesizes practice-based evidence on the types of TA requests, topics of TA, attendance numbers, and socio-demographics of TA attendees over a 3-year period spanning an unprecedented public health syndemic. METHODS: We assessed TA events hosted by the New England ATTC using SAMHSA's Performance Accountability and Reporting System post-event survey data from 2017 to 2020. Events were coded by common themes to identify the most frequently requested training types/topics and most frequently attended training events. We also evaluated change in training topics and attendee demographics over the three-year timeline. RESULTS: A total of 258 ATTC events reaching 10,143 participants were analyzed. The number of TA events and attendance numbers surged in the 2019-2020 fiscal year as TA events shifted to fully virtual during the COVID-19 pandemic. The absolute number of opioid-related events increased, but the relative proportion remained stable over time. The relative proportions of events and attendance rates focused on evidence-based practice and health equity both increased over the 3-year period, with the largest increase after the onset of the pandemic and the murder of George Floyd. As events shifted to virtual, events were attended by providers with a broader range of educational backgrounds. CONCLUSIONS: Results of the current analysis indicate that the demand for TA increased during the pandemic, with a prioritization of TA focused on evidence-based practice and health equity. The practice-based evidence generated from the New England ATTC may help other training and TA centers to anticipate and nimbly respond to the needs of the workforce in the face of the intersecting epidemics.

Cross-training needs among community-based clinicians in HIV and substance use.

BACKGROUND: People with double burden of HIV and substance use have poorer treatment engagement and worse treatment outcomes. Cross-training of HIV and substance use disorder clinicians can potentially enhance the scale up and quality of integrated care. Research is needed on clinicians' areas of greatest training need in order to inform training development. METHODS: Data from semi-structured individual interviews with 16 HIV and 13 substance use disorder clinicians (N = 29) examining clinician perspectives on their training needs were analyzed using thematic analysis focused on both a priori and emergent subthemes. RESULTS: Several key emergent subthemes were identified across the a priori themes of: 1) past training experiences; 2) gaps in training; and 3) training and supervision format/structure. Both HIV and substance use clinicians reported they had received minimal formal cross-training and had mostly been trained "on the job." Clinicians also emphasized gaps in training regarding sensitivity and anti-stigma, the latest medications for opioid use disorder, and HIV prevention/treatment and referral resources. Regarding training and supervision format, clinicians cited didactic workshops and ongoing supervision as appealing strategies. CONCLUSIONS: Results show that lack of formal and updated training for clinicians is an important gap in providing integrated HIV and substance use treatment. Didactic workshops and ongoing support strategies that address stigma, medications for HIV and substance use disorder, and referral resources are likely to be particularly valuable.

Implementation of the Wolverine Mental Health Program, Part 1: Adoption Phase.

Residential treatment facilities (RTFs) are a first-line treatment option for juvenile justice-involved youth. However, RTFs rarely offer evidence-based interventions for youth with internalizing or externalizing mental health problems. Wolverine Human Services (WHS) is one of the first RTFs in the nation to implement cognitive-behavioral therapy (CBT) to enhance mental health care for their youth. This study outlines the preimplementation phase of a 5-year collaborative CBT implementation effort among WHS, the Beck Institute, and an implementation science research team. The preimplementation phase included a needs assessment across two sites of WHS to identify and prioritize barriers to CBT implementation. Of the 76 unique barriers, 23 were prioritized as important and feasible to address. Implementation teams, consisting of clinician and staff champions and opinion leaders, worked across 8 months to deploy 10 strategies from a collaboratively designed blueprint. Upon reevaluation of the needs assessment domains, all prioritized barriers to CBT implementation were removed and WHS's readiness for CBT implementation was enhanced. This study serves as a model of a preimplementation process that can be employed to enhance the potential for successful evidence-based practice implementation in youth RTFs.

Implementation of the Wolverine Mental Health Program, Part 2: Implementation Phase.

To enhance mental health care for youth in a midwestern residential treatment facility, Wolverine Human Services partnered with the Beck Institute (an intermediary) and an implementation research team to implement cognitive-behavioral therapy (CBT). CBT has strong evidence supporting effectiveness for treating youth internalizing and externalizing problems, but it is a complex psychosocial intervention that demands a thoughtful implementation approach. This study outlines the implementation phase (2.5 years) of a 5-year collaborative effort. The implementation phase focused on (a) adapting CBT to fit the complex youth needs and the roles of the multidisciplinary team members resulting in a new comprehensive and coordinated care model, and (b) the strategies utilized to support its competent integration by all team members. Six blended implementation strategies were deployed in this phase: forging implementation teams, installing progress monitoring, adapting CBT, training, providing supervision and consultation, and training the trainers. A components-based approach to CBT yielded six core skills: active listening, problem solving, mood monitoring and intervention mapping, activity scheduling, distress tolerance, and cognitive restructuring. By the end of this phase, all staff had robust exposure to and experience with the adapted form of CBT. The work of our academic-community partnership has both research and clinical implications, with respect to integrating an adapted version of CBT for residential environments (CBT-RE).

Implementation of the Wolverine Mental Health Program, Part 3: Sustainment Phase.

Sustaining the implementation of an evidence-based practice (EBP) is the ultimate goal of often years of significant personnel and financial investment. Some conceptualize sustainment as a distinct phase following an active implementation period where the contextual factors, processes, and supports are bolstered to ensure continued EBP delivery. This study provides an overview of the sustainment strategies deployed to embed cognitive-behavioral therapy (CBT) in a Midwestern residential treatment facility serving youth with complex mental health needs. Seven key strategies and their outcomes are described: use of CBT teams, new hire orientation plans, monthly campaigns, change in job descriptions and performance evaluations, development of a behavioral reinforcement system for youth, and a pathway to CBT certification. This study provides a window into how one might sustain an EBP by addressing barriers unique to this phase of work.

What parents of adolescents in residential substance use treatment want from continuing care: A content analysis of online forum posts.

Background: Parents of adolescents in residential substance use (SU) treatment face a myriad of barriers to continuing care services. Growing research suggests that mobile health (mHealth) technologies can overcome common barriers to continuing care services, yet no work has addressed parents' needs. To gain insight into parents' continuing care needs, we analyzed online forum posts made by parents who received a novel mHealth intervention. Methods: Thirty parents received access to an online networking forum where they could connect with our adolescent SU expert or the community of parents also navigating their adolescent's post-discharge transition. In real-time, participants could ask questions and share information, experiences, and emotional support. Results: Twenty-one parents (70%) posted at least once; 12 parents made 15 posts to our expert, while 18 parents made 50 posts to the parent community. Thematic analysis uncovered five major themes: parenting skills; parent support; managing the post-discharge transition; adolescent SU; and family functioning. Conclusions: Parents discussed a range of topics directly and indirectly related to their adolescent's treatment. Incorporating networking forums into mHealth continuing care interventions offers parents a secure space to ask questions, share concerns, and gather information needed to support their adolescent's transition home.

Adolescent Behavioral Health Problems are Associated with Parent Perceptions of Evidence-Based Therapy and Preferences when Seeking Therapeutic Support.

Informational materials from psychological associations often encourage parents to seek out "evidence-based therapies" (EBTs) to address their child's behavioral health concerns. This study examined whether parents concerned about their adolescents' substance use had distinct preferences for EBT principles and marketing language based on their adolescent's specific behavioral health problems. Parents (N = 411; 86% female; 88% non-Hispanic White) of adolescents (age 12-19 years) completed an online direct-to-consumer (DTC) marketing survey as part of a larger multi-phase study. Parents reported their adolescents had high rates of current externalizing (66%), internalizing (51%), substance-related (39%), and legal (25%) problems. Parents answered questions about their perceived definition of EBT, whether they valued underlying EBT principles (i.e., reliance on a proven approach vs. a varied approach), their preferred terms for describing EBT, and factors they considered when choosing a therapist. Most parents defined EBT correctly, regardless of their adolescent's behavioral health problems. Parents of adolescents with internalizing or legal problems were less likely to value EBT principles, with legal problems emerging as the more important multivariate predictor. Additionally, parents of adolescents with substance-related or legal problems had distinct preferences for the terms used to describe EBTs. Finally, parents of adolescents with externalizing problems had distinct preferences for factors they considered when choosing a therapist. Psychologists and psychological associations seeking to disseminate information about EBTs to parents can utilize these DTC marketing-informed results to tailor outreach strategies based on adolescent behavioral health problems.

Screening Adolescent Trauma Patients for Substance Use at 10 Pediatric Trauma Centers.

BACKGROUND: The American College of Surgeons Committee on Trauma recommends universal alcohol screening be part of the evaluation of admitted trauma patients. Yet, suboptimal screening rates have been reported for admitted adult and adolescent trauma patients. This lack of screening, in turn, has limited the ability of trauma services to provide patients with brief interventions during their hospital admission and subsequent referrals to treatment after discharge. The primary aim of this study was to examine current rates of alcohol and other drug screening with admitted injured adolescents across a national cohort of 10 pediatric trauma centers. METHODS: This retrospective observational study was nested within a larger adolescent screening, brief intervention, and referral to treatment implementation study (Clinicaltrials.gov NCT03297060). Ten pediatric trauma centers participated in a retrospective chart review of a random sample of adolescent trauma patients presenting for care between March 1, 2018, and November 30, 2018. RESULTS: Three hundred charts were abstracted across the 10 participating trauma centers (n = 30 per site). Screening rates varied substantially across centers from five (16.7%) to 28 (93.3%) of the 30 extracted charts. The most frequent screening type documented was blood alcohol concentration (BAC) (N = 80, 35.2% of all screens), followed by the CRAFFT (N = 79, 26.3%), and then the urine drug screen (UDS) (N = 77, 25.6%). The BAC test identified 11 patients as positive for recent alcohol use. The CRAFFT identified 11 positive patients. CONCLUSIONS: Alcohol and drug screening is underutilized for adolescents admitted to pediatric trauma centers. More research is warranted on how best to utilize the teachable moment of the pediatric trauma visit to ensure comprehensive screening of adolescent alcohol or other drug (AOD) use.

User-centered design of contingency management for implementation in opioid treatment programs: a qualitative study.

BACKGROUND: Contingency management (CM) is one of the only behavioral interventions shown to be effective for the treatment of opioid use disorders when delivered alone and in combination with pharmacotherapy. Despite extensive empirical support, uptake of CM in community settings remains abysmally low. The current study applied user-centered design principles to gather qualitative data on familiarity with CM, current clinical practice, and preferences regarding the implementation of CM in community-based opioid treatment programs. METHODS: Participants were 21 leaders and 22 front-line counselors from 11 community-based opioid treatment programs. Semi-structured interviews were about 45 min long. Transcripts from each interview were coded by independent raters and analyzed using a reflexive team approach. Frequencies of responses were tallied, and queries were run in NVivo to identify exemplar quotes for each code. RESULTS: Results indicated low familiarity with CM, with less than half of the respondents defining CM correctly and over 40% of respondents declining to answer/ did not know. Abstinence was the most commonly recommended CM target, yet over 70% of respondents indicated that urine screens only occurred monthly. Attendance was also a popular recommendation, with respondents suggesting a range of possible indices including counseling, dosing, and/or case management sessions. Regarding the ideal role to administer CM prizes, program directors and supervisors were most commonly recommended, closely followed by front-line counselors. The most commonly suggested strategies to afford CM incentives included soliciting community donations and offering non-financial incentives. CONCLUSIONS: User design principles to understand workflow constraints, target user needs, and simplify the intervention guided this qualitative investigation of CM implementation in opioid treatment programs. Findings highlighted the potential value of flexible, organization-specific definitions of CM attendance and non-financial incentives, as well as active involvement of clinical leaders and supervisors to promote buy in among staff/patients. Respondents were generally optimistic about their ability to fundraise or solicit donations to overcome cost-related barriers of CM. Implications for CM implementation strategies, including the use of targeted leadership coaching focused on sustainability, are explored.

Patterns of practice in community mental health treatment of adult depression.

OBJECTIVE: Community mental health therapists often endorse an eclectic orientation, but few studies reveal how therapists utilize elements of evidence-based psychotherapies. This study aimed to characterize treatment as usual patterns of practice among therapists treating depressed adults in community mental health settings. METHOD: Therapists (N = 165) from the USA's largest not-for-profit provider of community-based mental health services completed surveys assessing their demographics and practice element use with depressed adult clients. Specifically, therapists indicated whether they utilized each of 45 unique practice elements from the following evidence-based psychotherapies: Acceptance and Commitment Therapy, Behavioral Activation, Brief Psychodynamic Therapy, Cognitive Behavioral Therapy (CBT), Interpersonal Therapy, Mindfulness-Based CBT, Problem-Solving Therapy, and Self-Control Therapy. Principal component analysis was employed to identify practice patterns. RESULTS: The principal component analysis included 31 practice elements and revealed a three-factor model with distinct patterns of practice that did not align with traditional evidence-based practice approaches, including: (i) Planning, Practice, and Monitoring; (ii) Cognitive, Didactic, and Interpersonal; and (iii) Between Session Activities. CONCLUSIONS: Therapist-reported practice patterns confirmed an eclectic approach that brought together elements from theoretically distinct evidence-based psychotherapies. Future research is needed to explore how these patterns of practice relate to client outcomes to inform focused training and/or de-implementation efforts.

A meta-analysis of the effect of therapist experience on outcomes for clients with internalizing disorders.

Objective: This meta-analysis synthesized the literature regarding the effect of therapist experience on internalizing client outcomes to evaluate the utility of lay providers in delivering treatment and to inform therapist training. Method: The analysis included 22 studies, contributing 208 effect sizes. Study and client characteristics were coded to examine moderators. We conducted subgroup meta-analyses examining the relationship of therapist experience across a diverse set of internalizing client outcomes. Results: Results demonstrated a small, but significant relationship between therapist experience and internalizing client outcomes. There was no relationship between therapist experience and outcomes in clients with primary anxiety disorders. In samples of clients with primary depressive disorders and in samples of clients with mixed internalizing disorders, there was a significant relationship between experience and outcomes. The relationship between therapist experience and outcomes was stronger when clients were randomized to therapists, treatment was not manualized, and for measures of client satisfaction and "other" outcomes (e.g., dropout). Conclusions: It appears that therapist experience may matter for internalizing clients under certain circumstances, but this relationship is modest. Continuing methodological concerns in the literature are noted, as well as recommendations to address these concerns.

Cognitive Behavioural Therapy Competency: Pilot Data from a Comparison of Multiple Perspectives.

BACKGROUND: Measurement of cognitive behavioural therapy (CBT) competency is often resource intensive. A popular emerging alternative to independent observers' ratings is using other perspectives for rating competency. AIMS: This pilot study compared ratings of CBT competency from four perspectives - patient, therapist, supervisor and independent observer using the Cognitive Therapy Scale (CTS). METHOD: Patients (n = 12, 75% female, mean age 30.5 years) and therapists (n = 5, female, mean age 26.6 years) completed the CTS after therapy sessions, and clinical supervisor and independent observers rated recordings of the same session. RESULTS: Analyses of variance revealed that therapist average CTS competency ratings were not different from supervisor ratings, and supervisor ratings were not different from independent observer ratings; however, therapist ratings were higher than independent observer ratings and patient ratings were higher than all other raters. CONCLUSIONS: Raters differed in competency ratings. Implications for potential use and adaptation of CBT competency measurement methods to enhance training and implementation are discussed.

A conceptual model for generating and validating in-session clinical judgments.

OBJECTIVE: Little attention has been paid to the nuanced and complex decisions made in the clinical session context and how these decisions influence therapy effectiveness. Despite decades of research on the dual-processing systems, it remains unclear when and how intuitive and analytical reasoning influence the direction of the clinical session. METHOD: This paper puts forth a testable conceptual model, guided by an interdisciplinary integration of the literature, that posits that the clinical session context moderates the use of intuitive versus analytical reasoning. RESULTS: A synthesis of studies examining professional best practices in clinical decision-making, empirical evidence from clinical judgment research, and the application of decision science theories indicate that intuitive and analytical reasoning may have profoundly different impacts on clinical practice and outcomes. CONCLUSIONS: The proposed model is discussed with respect to its implications for clinical practice and future research.

What Did They Learn? Effects of a Brief Cognitive Behavioral Therapy Workshop on Community Therapists' Knowledge.

Knowledge gain has been identified as necessary but not sufficient for therapist behavior change. Declarative knowledge, or factual knowledge, is thought to serve as a prerequisite for procedural knowledge, the how to knowledge system, and reflective knowledge, the skill refinement system. The study aimed to examine how a 1-day workshop affected therapist cognitive behavioral therapy declarative knowledge. Participating community therapists completed a test before and after training that assessed cognitive behavioral therapy knowledge. Results suggest that the workshop significantly increased declarative knowledge. However, post-training total scores remained moderately low, with several questions answered incorrectly despite content coverage in the workshop. These findings may have important implications for structuring effective cognitive behavioral therapy training efforts and for the successful implementation of cognitive behavioral therapy in community settings.

Using Measurement-Based Care to Enhance Any Treatment.

Measurement-based care (MBC) can be defined as the practice of basing clinical care on client data collected throughout treatment. MBC is considered a core component of numerous evidence-based practices (e.g., Beck & Beck, 2011; Klerman, Weissman, Rounsaville, & Chevron, 1984) and has emerging empirical support as an evidence-based framework that can be added to any treatment (Lambert et al., 2003, Trivedi et al., 2007). The observed benefits of MBC are numerous. MBC provides insight into treatment progress, highlights ongoing treatment targets, reduces symptom deterioration, and improves client outcomes (Lambert et al., 2005). Moreover, as a framework to guide treatment, MBC has transtheoretical and transdiagnostic relevance with broad reach across clinical settings. Although MBC has primarily focused on assessing symptoms (e.g., depression, anxiety), MBC can also be used to assess valuable information about (a) symptoms, (b) functioning and satisfaction with life, (c) putative mechanisms of change (e.g., readiness to change), and (d) the treatment process (e.g., session feedback, working alliance). This paper provides an overview of the benefits and challenges of MBC implementation when conceptualized as a transtheoretical and transdiagnostic framework for evaluating client therapy progress and outcomes across these four domains. The empirical support for MBC use is briefly reviewed, an adult case example is presented to serve as a guide for successful implementation of MBC in clinical practice, and future directions to maximize MBC utility are discussed.

Implementation of an Interdisciplinary Transfer Huddle Intervention for Prolonged Wait Times During Inter-ICU Transfer.

BACKGROUND: ICU transfers from a regional to a tertiary-level hospital are initiated typically for a higher level of care. Extended transfer wait times can negatively affect survival, length of stay (LOS), and cost. METHODS: In this prospective single-center study, the subjects were adult ICU patients admitted to regional hospitals between January and October 2022, for whom a request was made to transfer to a tertiary-level medical ICU. The authors developed and implemented an interdisciplinary transfer huddle intervention (THI) with the goal of reducing wait times by providing a consistent channel of communication between key stakeholders. The primary outcome was the number of hours elapsed between transfer request and the time of transfer to the tertiary hospital. Secondary outcomes included in-hospital mortality, discharge to home, ICU LOS, and hospital LOS. Data were abstracted from electronic health records and periods before (January to June 2022) and after (June to October 2022) the intervention were compared. Data were analyzed using logistic regression or negative binomial regression, adjusting for patient demographic and clinical characteristics. ICU fellows also completed a daily survey about barriers they perceived to the THI application. RESULTS: During the study period, 76 patients were transferred. The THI was completed 75.0% of the time. There were no statistically significant differences in the primary and secondary outcomes before and after the intervention. The top perceived barriers to transfer were lack of physical beds (50.0%) and staffing limitations (37.5%). CONCLUSION: The authors successfully developed and implemented a transfer huddle to ensure consistent interdisciplinary communication for patients being transferred between ICUs and identified barriers to such transfer. However, transfer times and patient outcomes were not significantly different after the change. Future studies should consider staffing challenges, hospital capacity, and the role of dedicated transfer teams in in decreasing inter-ICU transfer wait times.

What do you think it means? Using cognitive interviewing to improve measurement in implementation science: description and case example.

Pragmatic measures are essential to evaluate the implementation of evidence-based interventions. Cognitive interviewing, a qualitative method that collects partner feedback throughout measure development, is particularly useful for developing pragmatic implementation measures. Measure developers can use cognitive interviewing to increase a measure's fit within a particular implementation context. However, cognitive interviewing is underused in implementation research, where most measures remain "homegrown" and used for single studies. We provide a rationale for using cognitive interviewing in implementation science studies and illustrate its use through a case example employing cognitive interviewing to inform development of a measurement-based care protocol for implementation in opioid treatment programs. Applications of cognitive interviewing, including developing a common language with partners and collecting multi-level feedback on assessment procedures, to improve measurement in implementation science are discussed.