Using Progress Feedback to Enhance Treatment Outcomes: A Narrative Review.

We face increasing demand for greater access to effective routine mental health services, including telehealth. However, treatment outcomes in routine clinical practice are only about half the size of those reported in controlled trials. Progress feedback, defined as the ongoing monitoring of patients' treatment response with standardized measures, is an evidence-based practice that continues to be under-utilized in routine care. The aim of the current review is to provide a summary of the current evidence base for the use of progress feedback, its mechanisms of action and considerations for successful implementation. We reviewed ten available meta-analyses, which report small to medium overall effect sizes. The results suggest that adding feedback to a wide range of psychological and psychiatric interventions (ranging from primary care to hospitalization and crisis care) tends to enhance the effectiveness of these interventions. The strongest evidence is for patients with common mental health problems compared to those with very severe disorders. Effect sizes for not-on-track cases, a subgroup of cases that are not progressing well, are found to be somewhat stronger, especially when clinical support tools are added to the feedback. Systematic reviews and recent studies suggest potential mechanisms of action for progress feedback include focusing the clinician's attention, altering clinician expectations, providing new information, and enhancing patient-centered communication. Promising approaches to strengthen progress feedback interventions include advanced systems with signaling technology, clinical problem-solving tools, and a broader spectrum of outcome and progress measures. An overview of methodological and implementation challenges is provided, as well as suggestions for addressing these issues in future studies. We conclude that while feedback has modest effects, it is a small and affordable intervention that can potentially improve outcomes in psychological interventions. Further research into mechanisms of action and effective implementation strategies is needed.

Data-Informed Communication: How Measurement-Based Care Can Optimize Child Psychotherapy.

Measurement-based care (MBC) research and practice, including clinical workflows and systems to support MBC, are grounded in adult-serving mental health systems. MBC research evidence is building in child and adolescent services, but MBC practice is inherently more complex due to identified client age, the family system and the need to involve multiple reporters. This paper seeks to address a gap in the literature by providing practical guidance for youth-serving clinicians implementing MBC with children and their families. We focus on MBC as a data-informed, client-centered communication process, and present three key strategies to enhance usual care child and adolescent psychotherapy via developmentally-appropriate MBC. These strategies include (1) go beyond standardized measures; (2) lean into discrepancies; and (3) get curious together. Case-based examples drawn from various child-serving settings illustrate these key strategies of MBC in child psychotherapy.

Implementing Measurement-Based Care in a Youth Partial Hospital Setting: Leveraging Feedback for Sustainability.

This paper describes the successful implementation of Measurement-Based Care (MBC) within a Partial Hospitalization Program (PHP) for children and adolescents. Measurement-based care (MBC), the practice of using patient-reported measures routinely to inform decision-making, is associated with improved clinical outcomes for behavioral health patients (Jong et al., Clinical Psychology Review 85, 2021; Fortney & Sladek, 2015). MBC holds great promise in partial hospital programs (PHP) to improve outcomes, yet implementation strategies are as complex as the setting itself. This paper provides a case study example of MBC implementation in a PHP for youth. Over the course of 18 months, an interdisciplinary staff of approximately 20 behavioral health professionals provided partial hospitalization level of care to 633 (39% in-person, 61% telehealth) youth from ages 5 to 18 years old. MBC in this setting incorporated daily patient self-report and weekly caregiver-reported measurements. This descriptive reconstruction, which includes examples of the data that were used during the implementation project, illustrates specific barriers and facilitators in a successful implementation in the local PHP setting. Implementation strategies to address workflow integration, leadership and supervision, and coaching are described, including evolution of these strategies over the course of implementation. Practical considerations for implementing MBC in youth PHP settings are discussed. Finally, the authors explore the potential relationships between the data-driven MBC model of decision making and the development of resilient organizations.

A Clinical Leadership Lens on Implementing Progress Feedback in Three Countries: Development of a Multidimensional Qualitative Coding Scheme.

BACKGROUND: Progress feedback, also known as measurement-based care (MBC), is the routine collection of patient-reported measures to monitor treatment progress and inform clinical decision-making. Although a key ingredient to improving mental health care, sustained use of progress feedback is poor. Integration into everyday workflow is challenging, impacted by a complex interrelated set of factors across patient, clinician, organizational, and health system levels. This study describes the development of a qualitative coding scheme for progress feedback implementation that accounts for the dynamic nature of barriers and facilitators across multiple levels of use in mental health settings. Such a coding scheme may help promote a common language for researchers and implementers to better identify barriers that need to be addressed, as well as facilitators that could be supported in different settings and contexts. METHODS: Clinical staff, managers, and leaders from two Dutch, three Norwegian, and four mental health organizations in the USA participated in semi-structured interviews on how intra- and extra-organizational characteristics interact to influence the use of progress feedback in clinical practice, supervision, and program improvement. Interviews were conducted in the local language, then translated to English prior to qualitative coding. RESULTS: A team-based consensus coding approach was used to refine an a priori expert-informed and literature-based qualitative scheme to incorporate new understandings and constructs as they emerged. First, this hermeneutic approach resulted in a multi-level coding scheme with nine superordinate categories and 30 subcategories. Second-order axial coding established contextually sensitive categories for barriers and facilitators. CONCLUSIONS: The primary outcome is an empirically derived multi-level qualitative coding scheme that can be used in progress feedback implementation research and development. It can be applied across contexts and settings, with expectations for ongoing refinement. Suggestions for future research and application in practice settings are provided. Supplementary materials include the coding scheme and a detailed playbook.

Reporting of Observational Studies Explicitly Aiming to Emulate Randomized Trials: A Systematic Review.

Importance: Observational (nonexperimental) studies that aim to emulate a randomized trial (ie, the target trial) are increasingly informing medical and policy decision-making, but it is unclear how these studies are reported in the literature. Consistent reporting is essential for quality appraisal, evidence synthesis, and translation of evidence to policy and practice. Objective: To assess the reporting of observational studies that explicitly aimed to emulate a target trial. Evidence Review: We searched Medline, Embase, PsycINFO, and Web of Science for observational studies published between March 2012 and October 2022 that explicitly aimed to emulate a target trial of a health or medical intervention. Two reviewers double-screened and -extracted data on study characteristics, key predefined components of the target trial protocol and its emulation (eligibility criteria, treatment strategies, treatment assignment, outcome[s], follow-up, causal contrast[s], and analysis plan), and other items related to the target trial emulation. Findings: A total of 200 studies that explicitly aimed to emulate a target trial were included. These studies included 26 subfields of medicine, and 168 (84%) were published from January 2020 to October 2022. The aim to emulate a target trial was explicit in 70 study titles (35%). Forty-three studies (22%) reported use of a published reporting guideline (eg, Strengthening the Reporting of Observational Studies in Epidemiology). Eighty-five studies (43%) did not describe all key items of how the target trial was emulated and 113 (57%) did not describe the protocol of the target trial and its emulation. Conclusion and Relevance: In this systematic review of 200 studies that explicitly aimed to emulate a target trial, reporting of how the target trial was emulated was inconsistent. A reporting guideline for studies explicitly aiming to emulate a target trial may improve the reporting of the target trial protocols and other aspects of these emulation attempts.

The Connections Matter: Bi-Directional Learning in Program Evaluation and Practice-Oriented Research.

Intended for researchers and clinical leaders, this article suggests that embedded program evaluation is a good fit with the desired features of practice-oriented research. The systematic nature of evaluation that is built into the operational workflow of a practice setting may increase the diversity of methods available to explore processes and outcomes of interest. We propose a novel conceptual framework that uses a human-centered systems lens to foster such embedded evaluation in clinical routine. This approach emphasizes the evaluator-practitioner partnership to build confidence in the bi-directional learning of practice-based evidence with evidence-based practice. The iterative cycles inherent to design thinking are aimed at developing better evaluation questions. The attention to structure and context inherent to systems thinking is intended to support meaningful perspectives in the naturally complex world of health care. Importantly, the combined human-centered systems lens can create greater awareness of the influence of individual and systemic biases that exist in any endeavor or institution that involves people. Recommended tools and strategies include systems mapping, program theory development, and visual facilitation using a logic model to represent the complexity of mental health treatment for communication, shared understanding, and connection to the broader evidence base. To illustrate elements of the proposed conceptual framework, two case examples are drawn from routine outcome monitoring (ROM) and progress feedback. We conclude with questions for future collaboration and research that may strengthen the partnership of evaluators and practitioners as a community of learners in service of local and system-level improvement.

Implementation Science and Practice-Oriented Research: Convergence and Complementarity.

Implementation science is the scientific study of methods to promote the uptake of research findings and other evidence-based practices in routine care, with the goal of improving the quality and effectiveness of health services (Bauer et al., 2015). In addition to this common goal, practice-oriented psychotherapy research (and researchers) and implementation science (and scientists) share a common focus on the people and the places where treatment happens. Thus, there exists strong potential for combining these two approaches. In this article, we provide a primer on implementation science for psychotherapy researchers and highlight important areas and examples of convergence and complementarity between implementation science and practice-oriented psychotherapy research. Specifically, we (a) define and describe the core features of implementation science; (b) discuss similarities and areas of complementarity between implementation science and practice-oriented psychotherapy research; (c) discuss a case example that exemplifies the integration of implementation science and practice-oriented research; and (d) propose directions for future research and collaborations that leverage both implementation science and practice-oriented research.

The need for a measurement-based care professional practice guideline.

Professional practice guidelines (PPGs) are intended to promote a high level of professional practice and serve as an educational resource, providing pragmatic guidance in a clinical area for psychologists. Measurement-based care (MBC) is an evidence-based psychological practice with accumulating empirical support and alignment with patient-centered care. In connection with the American Psychological Association's Advisory Committee for Measurement-based Care and the Mental and Behavioral Health Registry, this article outlines various lines of support for the development and implementation of an MBC PPG. In addition to research evidence, we address the demonstrated need of this guideline across three domains: public benefit, professional guidance, and legal and regulatory issues. Consistent with the aspirational spirit of a PPG, this article proposes a draft PPG statement and highlights how an MBC PPG would improve service delivery, facilitate implementation of an evidence-based practice associated with symptom reduction, improved retention, and greater patient satisfaction, as well as create a framework that will better align changes in reimbursement models with patients' and providers' treatment goals. We also identify key future directions and critical gaps in MBC science and implementation that require attention. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Baseline imbalance and heterogeneity are present in meta-analyses of randomized clinical trials examining the effects of exercise and medicines for blood pressure management.

Randomized clinical trials attempt to reduce bias and create similar groups at baseline to infer causal effects. In meta-analyses, baseline imbalance may threaten the validity of the treatment effects. This meta-epidemiological study examined baseline imbalance in comparisons of exercise and antihypertensive medicines. Baseline data for systolic blood pressure, diastolic blood pressure, and age were extracted from a network meta-analysis of 391 randomized trials comparing exercise types and antihypertensive medicines. Fixed-effect meta-analyses were used to determine the presence of baseline imbalance and/or inconsistency. Meta-regression analyses were conducted on sample size, the risk of bias for allocation concealment, and whether data for all randomized participants were presented at baseline. In one exercise comparison, the resistance group was 0.3 years younger than the control group (95% confidence interval 0.6 to 0.1). Substantial inconsistency was observed in other exercise comparisons. Less data were available for medicines, but there were no occurrences of baseline imbalance and only a few instances of inconsistency. Several moderator analyses identified significant associations. We identified baseline imbalance as well as substantial inconsistency in exercise comparisons. Researchers should consider conducting meta-analyses of key prognostic variables at baseline to ensure balance across trials.

To Utility and Beyond! Specifying and Advancing the Utility of Measurement-Based Care for Youth.

Mental health organizations that serve youth are under pressure to adopt measurement-based care (MBC), defined as the continuous collection of client-report data used to support clinical decision-making as part of standard care. However, few frameworks exist to help leadership ascertain how to select an MBC approach for a clinical setting. This paper seeks to define how an MBC approach can display clinical utility to provide such a framework. Broadly, we define clinical utility as evidence that an MBC approach assists stakeholders in fulfilling clinical goals related to care quality (i.e., improve client-clinician alliance and clinical outcomes) at the client (i.e., youth and caregiver), clinician, supervisor, and administrator levels. More specifically, our definition of clinical utility is divided into two categories relevant to the usability and usefulness of an MBC approach for a specific setting: (a) implementability (i.e., evidence indicating ease of use in a clinical setting) and (b) usefulness in aiding clinical activities (i.e., evidence indicating the potential to improve communication and make clinical activities related to care quality easier or more effective). These categories provide valuable information about how easy an MBC approach is to use and the potential benefits that the MBC data will confer. To detail how we arrived at this definition, we review prior definitions of clinical utility, discuss how previous definitions inform our definition of clinical utility for MBC, and provide examples of how the concept of clinical utility can be applied to MBC. We finish with a discussion of future research directions.

What Gets Measured Gets Done: How Mental Health Agencies can Leverage Measurement-Based Care for Better Patient Care, Clinician Supports, and Organizational Goals.

Mental health clinicians and administrators are increasingly asked to collect and report treatment outcome data despite numerous challenges to select and use instruments in routine practice. Measurement-based care (MBC) is an evidence-based practice for improving patient care. We propose that data collected from MBC processes with patients can be strategically leveraged by agencies to also support clinicians and respond to accountability requirements. MBC data elements are outlined using the Precision Mental Health Framework (Bickman et al. in Adm Policy Mental Health Mental Health Serv Res 43:271-276, 2016), practical guidance is provided for agency administrators, and conceptual examples illustrate strategic applications of one or more instruments to meet various needs throughout the organization.

Comparative performance of different methods for circulating tumor cell enrichment in metastatic breast cancer patients.

The isolation and analysis of circulating tumor cells (CTC) has the potential to provide minimally invasive diagnostic, prognostic and predictive information. Widespread clinical implementation of CTC analysis has been hampered by a lack of comparative investigation between different analytic methodologies in clinically relevant settings. The objective of this study was to evaluate four different CTC isolation techniques-those that rely on surface antigen expression (EpCAM or CD45 using DynaBeads® or EasySep™ systems) or the biophysical properties (RosetteSep™ or ScreenCell®) of CTCs. These were evaluated using cultured cells in order to calculate isolation efficiency at various levels including; inter-assay and inter-operator variability, protocol complexity and turn-around time. All four techniques were adequate at levels above 100 cells/mL which is commonly used for the evaluation of new isolation techniques. Only the RosetteSep™ and ScreenCell® techniques were found to provide adequate sensitivity at a level of 10 cells/mL. These techniques were then applied to the isolation and analysis of circulating tumor cells blood drawn from metastatic breast cancer patients where CTCs were detected in 54% (15/28) of MBC patients using the RosetteSep™ and 75% (6/8) with ScreenCell®. Overall, the ScreenCell® method had better sensitivity.

Festschrift for Leonard Bickman: Introduction to The Future of Children's Mental Health Services Special Issue.

This introductory article describes the genesis of the Festschrift for Leonard Bickman and of this Festschrift special issue entitled, The Future of Children's Mental Health Services. The special issue includes a collection of 11 original children's mental health services research articles, broadly organized in accordance with three themes (i.e., Improving Precision and Use of Service Data to Guide Policy and Practice, Implementation and Dissemination, and Preparing for Innovation), followed by an interview-style article with Bickman. Then follows a featured manuscript by Bickman himself, three invited commentaries, and a compilation of letters and notes in which colleagues reflect on his career and on their experiences of him. The introduction concludes with a few thoughts about the future of children's mental health services portended by the extraordinary scholarly contributions of Bickman and those who have been inspired by him.

An Innovator and a Disruptor: Leonard Bickman on Program Theory, Null Findings, and Advice to Future Child Mental Health Services Researchers.

With a career spanning more than half a century, Leonard Bickman has contributed to improving children's mental health through research on innovative interventions, such as measurement-based care, and service-level initiatives, including systems of care. Len's highly productive career in children's mental health services research is founded in his influence on the science of program evaluation, particularly in the area of program theory. This article provides an abridged and combined version of a video interview with Len dated April 16, 2019 and written responses to a series of questions posed to Len in advance of the festschrift held in his honor at Johns Hopkins Bloomberg School of Public Health on May 11, 2018.

Strategies to enhance communication with telemental health measurement-based care (tMBC).

Telehealth has always held great promise to increase access to mental health care, never more so than in the age of COVID-19, when clients can't or won't come to the clinician's physical location. A feasible and effective alternative to traditional in-person care, telemental health requires that clinicians adopt new strategies to build and maintain communication and the therapeutic relationship. This can be particularly troublesome for clinicians new to the modality, who may feel the loss of the "in-session" experience more acutely. As an evidence-based practice that is transtheoretical and transdiagnostic, telemental health measurement-based care (tMBC) is the ideal complement to enhance systematic ongoing monitoring, treatment engagement, and therapeutic alliance in the context of the virtual encounter. While tMBC mechanisms of actions are still being explored, there is promising evidence that tMBC improves clinician responsivity to acute client concerns. By using client-reported measures, tMBC provides an important pathway for clients to systematically communicate with their clinicians, which can guide therapeutic actions and contribute to shared understanding. This brief report summarizes the evidence for tMBC as a patient-centered communication tool and provides recommendations for evidence-based and practice-informed strategies to integrate tMBC into telehealth solutions, with suggestions for monitoring new concerns related to the COVID-19 crisis.

Measurement-based care as a practice improvement tool: Clinical and organizational applications in youth mental health.

Measurement-based care (MBC) is systematic, ongoing assessment to monitor treatment progress and inform clinical decision-making. MBC is considered an evidence-based practice, with extensive research support in adult clinical populations and emerging evidence in youth populations. This paper describes both clinical (e.g., enhancing therapy alliance, informing case conceptualization) and organizational (e.g., informing quality improvement efforts) applications of MBC, and illustrates the clinical applications through two case examples from publicly-funded mental health agency settings. The paper concludes by detailing future research needed to enhance the clinical and organizational utility of MBC.

Implementing Measurement-Based Care in Behavioral Health: A Review.

Importance: Measurement-based care (MBC) is the systematic evaluation of patient symptoms before or during an encounter to inform behavioral health treatment. Despite MBC's demonstrated ability to enhance usual care by expediting improvements and rapidly detecting patients whose health would otherwise deteriorate, it is underused, with typically less than 20% of behavioral health practitioners integrating it into their practice. This narrative review addresses definitional issues, offers a concrete and evaluable operationalization of MBC fidelity, and summarizes the evidence base and utility of MBC. It also synthesizes the extant literature's characterization of barriers to and strategies for supporting MBC implementation, sustainment, and scale-up. Observations: Barriers to implementing MBC occur at multiple levels: patient (eg, concerns about confidentiality breach), practitioner (eg, beliefs that measures are no better than clinical judgment), organization (eg, no resources for training), and system (eg, competing requirements). Implementation science-the study of methods to integrate evidence-based practices such as MBC into routine care-offers strategies to address barriers. These strategies include using measurement feedback systems, leveraging local champions, forming learning collaboratives, training leadership, improving expert consultation with clinical staff, and generating incentives. Conclusions and Relevance: This narrative review, informed by implementation science, offers a 10-point research agenda to improve the integration of MBC into clinical practice: (1) harmonize terminology and specify MBC's core components; (2) develop criterion standard methods for monitoring fidelity and reporting quality of implementation; (3) develop algorithms for MBC to guide psychotherapy; (4) test putative mechanisms of change, particularly for psychotherapy; (5) develop brief and psychometrically strong measures for use in combination; (6) assess the critical timing of administration needed to optimize patient outcomes; (7) streamline measurement feedback systems to include only key ingredients and enhance electronic health record interoperability; (8) identify discrete strategies to support implementation; (9) make evidence-based policy decisions; and (10) align reimbursement structures.

Efficacy of a Chronic Care-Based Intervention on Secondary Stroke Prevention Among Vulnerable Stroke Survivors: A Randomized Controlled Trial.

BACKGROUND: Disparities of care among stroke survivors are well documented. Effective interventions to improve recurrent stroke preventative care in vulnerable populations are lacking. METHODS AND RESULTS: In a randomized controlled trial, we tested the efficacy of components of a chronic care model-based intervention versus usual care among 404 subjects having an ischemic stroke or transient ischemic attack within 90 days of enrollment and receiving care within the Los Angeles public healthcare system. Subjects had baseline systolic blood pressure (SBP) ≥120 mm Hg. The intervention included a nurse practitioner/physician assistant care manager, group clinics, self-management support, report cards, decision support, and ongoing care coordination. Outcomes were collected at 3, 8, and 12 months, analyzed as intention-to-treat, and used repeated-measures mixed-effects models. Change in SBP was the primary outcome. Low-density lipoprotein reduction, antithrombotic medication use, smoking cessation, and physical activity were secondary outcomes. Average age was 57 years; 18% were of black race; 69% were of Hispanic ethnicity. Mean baseline SBP was 150 mm Hg in both arms. SBP decreased to 17 mm Hg in the intervention arm and 14 mm Hg in the usual care arm; the between-arm difference was not significant (-3.6 mm Hg; 95% confidence interval, -9.2 to 2.2). Among secondary outcomes, the only significant difference was that persons in the intervention arm were more likely to lower their low-density lipoprotein <100 md/dL (2.0 odds ratio; 95% confidence interval, 1.1-3.5). CONCLUSIONS: This intervention did not improve SBP control beyond that attained in usual care among vulnerable stroke survivors. A community-centered component could strengthen the intervention impact. CLINICAL TRIAL REGISTRATION: URL: https://clinicaltrials.gov. Unique identifier: NCT00861081.