Police Involvement in Out-of-Hospital Cardiac Arrest: A Qualitative Exploration of Law Enforcement Roles and Contributing Organizational Factors.

OBJECTIVES: Many American police organizations respond to out-of-hospital cardiac arrest (OHCA). This study sought to: 1) explore variation in the role of police in OHCA across emergency medical systems and 2) identify factors influencing this variation. METHODS: We conducted a qualitative multisite case study analysis using data collected through semi-structured key informant interviews and multidisciplinary focus groups with telecommunicators, fire, police, emergency medical services, and hospital personnel across nine Michigan emergency systems of care. Sites were sampled based on return of spontaneous circulation rates, trauma region, geography, rurality, and population density. Data were analyzed to examine police role in OHCA and the organizational factors that contribute to these roles. Transcripts and coded data were explored using iterative thematic analysis and matrices. RESULTS: Interviews included approximately 160 public safety informants of varying administrative levels (i.e., field staff, mid-level managers, and leadership). Across systems, police played four on-scene roles in OHCA response: 1) early responder, 2) resuscitation team member, 3) security, and 4) information gathering. Less consistently, police performed supplementary roles as telecommunicators and cardiac arrest educators. We found that factors including administrative structure of the police agency, resources (e.g., human and material), organizational culture, medical training, deployment and response policies, nature of response environment, and relationships with other prehospital stakeholders contributed to the degree certain roles were present. CONCLUSIONS: Police serve numerous on-scene and supplementary roles in OHCA response across jurisdictions. Their roles were influenced by multiple factors at each site. Future studies may help to better understand the value of and how to optimize police engagement in OHCA response.

Understanding uptake of information about innovations among emergency department clinicians during the COVID-19 pandemic.

Objectives: Early in the COVID-19 pandemic, little was known about managing sick patients, but emergency department (ED) clinicians had to decide which treatments and care processes to adopt. Our objective was to describe how ED clinicians learned about innovations and how they assessed them for credibility during the pandemic. Methods: We purposively sampled clinicians from hospital-based EDs to conduct focus groups with ED clinicians and staff. We used both inductive and deductive approaches to conduct thematic analysis of transcripts. Results: We conducted focus groups with clinicians from eight EDs across the United States. We found that ED clinicians in our sample relied on friends and colleagues or departmental and institutional leadership for information on innovations. They used social media sources when they came from credible accounts but did not directly seek information from professional societies. Clinicians reported a range of challenges to obtain credible information during the pandemic, including a fractured and changing information environment, policies misaligned across clinical sites or that conflicted with clinical knowledge, high patient volume, fear of harming patients, and untimely information. Facilitators included access to experienced and trusted colleagues and leaders and practicing at multiple EDs. Conclusion: Participants cited anecdotal evidence, institutional practice, and word-of-mouth-rather than peer-reviewed evidence and professional society communications-as their primary sources of information about care innovations during the early phases of the pandemic. These results underscore the importance of developing trusted local mechanisms and wider networks to identify and vet information for frontline clinicians during rapidly emerging public health emergencies.

Changes in perceptions of antibiotic stewardship among neonatal intensive care unit providers over the course of a learning collaborative: a prospective, multisite, mixed-methods evaluation.

OBJECTIVE: To assess clinician perceptions towards the value and implementation of antibiotic stewardship (AS) in neonatal intensive care units (NICU). STUDY DESIGN: We performed a mixed-methods study of AS perceptions (prescribing appropriateness, importance, activity, capacity) using surveys and interviews in 30 California NICUs before and after a multicenter collaborative (Optimizing Antibiotic Use in California NICUs [OASCN]). RESULTS: Pre-OASCN, 24% of respondents felt there was "a lot of" or "some" inappropriate prescribing, often driven by fear of a bad outcome or reluctance to change existing practice. Clinicians reported statistically significant increases in AS importance (71 v 79%), perceived AS activity (67 v 87%), and more openness to change after OASCN (59 v 70%). We identified other concerns that lessen AS effort. CONCLUSION: OASCN increased perceived AS activity and openness to change in AS practices among NICU prescribers. Greater attention to subjective concerns should augment AS improvement.

A cross-stakeholder approach to improving out-of-hospital cardiac arrest survival.

BACKGROUND: Out-of-hospital cardiac arrest (OHCA) affects over 300,000 individuals per year in the United States with poor survival rates overall. A remarkable 5-fold difference in survival-to-hospital discharge rates exist across United States communities. METHODS: We conducted a study using qualitative research methods comparing the system of care across sites in Michigan communities with varying OHCA survival outcomes, as measured by return to spontaneous circulation with pulse upon emergency department arrival. RESULTS: Major themes distinguishing higher performing sites were (1) working as a team, (2) devoting resources to coordination across agencies, and (3) developing a continuous quality improvement culture. These themes spanned the chain of survival framework for OHCA. By examining the unique processes, procedures, and characteristics of higher- relative to lower-performing sites, we gleaned lessons learned that appear to distinguish higher performers. The higher performing sites reported being the most collaborative, due in part to facilitation of system integration by progressive leadership that is willing to build bridges among stakeholders. CONCLUSIONS: Based on the distinguishing features of higher performing sites, we provide recommendations for toolkit development to improve survival in prehospital systems of care for OHCA.

Strategies for Enhancing Prehospital Outcomes for Cardiac Arrest (EPOC).

Out-of-hospital cardiac arrest (OHCA) is a common, life-threatening event that is a leading cause of death in the United States. However, it is unclear how to design strategies that can be successfully implemented in emergency medical services (EMS) agencies and broader emergency response systems (such as fire, police, dispatch, and bystanders to OHCA events) in different communities to help improve daily care processes and outcomes in OHCA. The National Heart, Lung, and Blood Institute-funded Enhancing Prehospital Outcomes for Cardiac Arrest (EPOC) study lays the foundation for future quality improvement efforts in OHCA by identifying, understanding, and validating the best practices adopted within emergency response systems to address these life-threatening events and by addressing potential barriers to implementation of these practices. RAND researchers developed recommendations covering all levels of the prehospital OHCA incident response and the principles of change management necessary to implement those recommendations.

Blood culture procedures and practices in the neonatal intensive care unit: A survey of a large multicenter collaborative in California.

OBJECTIVE: To describe variation in blood culture practices in the neonatal intensive care unit (NICU). DESIGN: Survey of neonatal practitioners involved with blood culturing and NICU-level policy development. PARTICIPANTS: We included 28 NICUs in a large antimicrobial stewardship quality improvement program through the California Perinatal Quality Care Collaborative. METHODS: Web-based survey of bedside blood culture practices and NICU- and laboratory-level practices. We evaluated adherence to recommended practices. RESULTS: Most NICUs did not have a procedural competency (54%), did not document the sample volume (75%), did not receive a culture contamination report (57%), and/or did not require reporting to the provider if <1 mL blood was obtained (64%). The skin asepsis procedure varied across NICUs. Only 71% had a written procedure, but ≥86% changed the needle and disinfected the bottle top prior to inoculation. More than one-fifth of NICUs draw a culture from an intravascular device only (if present). Of 13 modifiable practices related to culture and contamination, NICUs with nurse practitioners more frequently adopted >50% of practices, compared to units without (92% vs 50% of units; P < .02). CONCLUSIONS: In the NICU setting, recommended practices for blood culturing were not routinely performed.

A Process Evaluation of Primary Care Behavioral Health Integration in the Military Health System.

Behavioral health (BH) problems are common in the military and can adversely affect force readiness. Research suggests that primary care-behavioral health (PCBH) integration can improve BH outcomes by making high-quality BH care available in more accessible settings. However, sustaining high-quality implementation of PCBH is challenging. The authors conducted a process evaluation of the PCBH program in the military health system to understand why the program is working as it is and provide recommendations for quality improvement. They conducted semistructured interviews, rigorously coded the qualitative data to identify causal links, and created and validated causal loop diagrams that provide a visualization of how the system is working. Findings fall into four key areas: staffing and capabilities, valued tasks, program stewardship, and fostering program awareness and support. Overall, the authors found that the PCBH program is highly valued by primary care staff. However, the PCBH care model is inconsistently adhered to, owing to a combination of staff preferences, local pressures, and lack of knowledge of PCBH staff roles. Recommendations are offered to improve program implementation.

Health Services and Primary Care Research Study: Comprehensive Report.

This study presents the results of a congressionally mandated, independent assessment of federally funded health services research (HSR) and primary care research (PCR) spanning the U.S. Department of Health and Human Services (HHS) and U.S. Department of Veterans Affairs (VA) from FYs 2012 to 2018. Through technical expert panels, stakeholder interviews, and a systematic environmental scan of research grants and contracts funded by HHS and the VA, the authors characterize the distinct contributions of agencies in these departments to the federal HSR and PCR enterprise. The authors also identify opportunities to improve detection and coordination of overlap in agency research portfolios, the impacts of HSR and PCR and how they cumulate across research portfolios, and gaps in research funding, methods, and dissemination. The authors offer recommendations to maximize the outcomes and value of future investments in federal HSR and PCR to better guide and serve the needs of a complex and rapidly changing U.S. health care system.

Standardized Versus Tailored Implementation of Measurement-Based Care for Depression in Community Mental Health Clinics.

Objective: Measurement-based care (MBC) is an evidence-based practice that is rarely integrated into psychotherapy. The authors sought to determine whether tailored MBC implementation can improve clinician fidelity and depression outcomes compared with standardized implementation. Methods: This cluster-randomized trial enrolled 12 community behavioral health clinics to receive 5 months of implementation support. Clinics randomized to the standardized implementation received electronic health record data captured with the nine-item Patient Health Questionnaire (PHQ-9), a needs assessment, clinical training, guidelines, and group consultation in MBC fidelity. Tailored implementation support included these strategies, but the training content was tailored to clinics' barriers to MBC, and group consultation centered on overcoming these barriers. Clinicians (N=83, tailored; N=71, standardized) delivering individual psychotherapy to 4,025 adults participated. Adult patients (N=87, tailored; N=141, standardized) contributed data for depression outcome analyses. Results: The odds of PHQ-9 completion were lower in the tailored group at baseline (odds ratio [OR]=0.28, 95% CI=0.08­0.96) but greater at 5 months (OR=3.39, 95% CI=1.00­11.48). The two implementation groups did not differ in full MBC fidelity. PHQ-9 scores decreased significantly from baseline (mean±SD=17.6±4.4) to 12 weeks (mean=12.6±5.9) (p<0.001), but neither implementation group nor MBC fidelity significantly predicted PHQ-9 scores at week 12. Conclusions: Tailored MBC implementation outperformed standardized implementation with respect to PHQ-9 completion, but discussion of PHQ-9 scores in clinician-patient sessions remained suboptimal. MBC fidelity did not predict week-12 depression severity. MBC can critically inform collaborative adjustments to session or treatment plans, but more strategic system-level implementation support or longer implementation periods may be needed.

The association of fire or police first responder initiated interventions with out of hospital cardiac arrest survival.

OBJECTIVE: Fire and police first responders are often the first to arrive in medical emergencies and provide basic life support services until specialized personnel arrive. This study aims to evaluate rates of fire or police first responder-initiated cardiopulmonary resuscitation (CPR) and automated external defibrillator (AED) use, as well as their associated impact on out-of-hospital cardiac arrest (OHCA) outcomes. METHODS: We completed a secondary data analysis of the MI-CARES registry from 2014 to 2019. We reported rates of CPR initiation and AED use by fire or police first responders. Multilevel modeling was utilized to evaluate the relationship between fire/police first responder-initiated interventions and outcomes of interest: ROSC upon emergency department arrival, survival to hospital discharge, and good neurologic outcome. RESULTS: Our cohort included 25,067 OHCA incidents. We found fire or police first responders initiated CPR in 31.8% of OHCA events and AED use in 6.1% of OHCA events. Likelihood of sustained ROSC on ED arrival after CPR initiated by a fire/police first responder was not statistically different as compared to EMS initiated CPR (aOR 1.01, CI 0.93-1.11). However, fire/police first responder interventions were associated with significantly higher odds of survival to hospital discharge and survival with good neurologic outcome (aOR 1.25, 95% CI 1.08-1.45 and aOR 1.40, 95% CI 1.18-1.65, respectively). Similar associations were see when examining fire or police initiated AED use. CONCLUSIONS: Fire or police first responders may be an underutilized, potentially powerful mechanism for improving OHCA survival. Future studies should investigate barriers and opportunities for increasing first responder interventions by these groups in OHCA.

Applying Elinor Ostrom's Design Principles to Guide Co-Design in Health(care) Improvement: A Case Study with Citizens Returning to the Community from Jail in Los Angeles County.

INTRODUCTION: Increased interest in collaborative and inclusive approaches to healthcare improvement makes revisiting Elinor Ostrom's 'design principles' for enabling collective management of common pool resources (CPR) in polycentric systems a timely endeavour. THEORY AND METHOD: Ostrom proposed a generalisable set of eight core design principles for the efficacy of groups. To consider the utility of Ostrom's principles for the planning, delivery, and evaluation of future health(care) improvement we retrospectively apply them to a recent co-design project. RESULTS: Three distinct aspects of co-design were identified through consideration of the principles. These related to: (1) understanding and mapping the system (2) upholding democratic values and (3) regulating participation. Within these aspects four of Ostrom's eight principles were inherently observed. Consideration of the remaining four principles could have enhanced the systemic impact of the co-design process. DISCUSSION: Reconceptualising co-design through the lens of CPR offers new insights into the successful system-wide application of such approaches for the purpose of health(care) improvement. CONCLUSION: The eight design principles - and the relationships between them - form a heuristic that can support the planning, delivery, and evaluation of future healthcare improvement projects adopting co-design. They may help to address questions of how to scale up and embed such approaches as self-sustaining in wider systems.

Engaging Community Networks to Improve Depression Services: A Cluster-Randomized Trial of a Community Engagement and Planning Intervention.

This paper explores the effects of a group-randomized controlled trial, Community Partners in Care (CPIC), on the development of interagency networks for collaborative depression care improvement between a community engagement and planning (CEP) intervention and a resources for services (RS) intervention that provided the same content solely via technical assistance to individual programs. Both interventions consisted of a diverse set of service agencies, including health, mental health, substance abuse treatment, social services, and community-trusted organizations such as churches and parks and recreation centers. Participants in the community councils for the CEP intervention reflected a range of agency leaders, staff, and other stakeholders. Network analysis of partnerships among agencies in the CEP versus RS condition, and qualitative analysis of perspectives on interagency network changes from multiple sources, suggested that agencies in the CEP intervention exhibited greater growth in partnership capacity among themselves than did RS agencies. CEP participants also viewed the coalition development intervention both as promoting collaboration in depression services and as a meaningful community capacity building activity. These descriptive results help to identify plausible mechanisms of action for the CPIC interventions and can be used to guide development of future community engagement interventions and evaluations in under-resourced communities.

Variation in pre-hospital outcomes after out-of-hospital cardiac arrest in Michigan.

AIM: Care by emergency medical service (EMS) agencies is critical for optimizing prehospital outcomes following out-of-hospital cardiac arrest (OHCA). We explored whether substantial differences exist in prehospital outcomes across EMS agencies in Michigan-specifically focusing on rates of sustained return of spontaneous circulation (ROSC) upon emergency department (ED) arrival. METHODS: Using data from Michigan Cardiac Arrest Registry to Enhance Survival (MI-CARES) for years 2014-2017, we calculated rates of sustained ROSC upon ED arrival across EMS agencies in Michigan. We used hierarchical logistic regression models that accounted for patient, arrest-, community-, and response-level characteristics to determine adjusted rates of sustained ROSC among EMS agencies. RESULTS: A total of 103 EMS agencies and 20,897 OHCA cases were included. Average age of the cohort was 62.5 years (SD = 19.6), 39.7% were female, and 17.9% had an initial shockable rhythm due to ventricular fibrillation or pulseless ventricular tachycardia. The adjusted rate of sustained ROSC upon ED arrival across all EMS agencies was 23.8% with notable variation across EMS agencies (interquartile range [IQR], 20.5-29.2%). The top five EMS agencies had mean adjusted rates of sustained ROSC upon ED arrival of 42.7% (95% CI: 34.6-51.1%) while the bottom five had mean adjusted rates of 9.8% (95% CI: 7.6-12.7%). CONCLUSIONS: Substantial variation in sustained ROSC upon ED arrival exists across EMS agencies in Michigan after adjusting for patient-, arrest, community-, and response-level features. Such differences suggest opportunities to identify and improve best practices in EMS agencies to advance OHCA care.

Enhancing Prehospital Outcomes for Cardiac Arrest (EPOC) study: sequential mixed-methods study protocol in Michigan, USA.

INTRODUCTION: Out-of-hospital cardiac arrest (OHCA) is a common, life-threatening event encountered routinely by first responders, including police, fire and emergency medical services (EMS). Current literature suggests that there is significant regional variation in outcomes, some of which may be related to modifiable factors. Yet, there is a persistent knowledge gap regarding strategies to guide quality improvement efforts in OHCA care and, by extension, survival. The Enhancing Prehospital Outcomes for Cardiac Arrest (EPOC) study aims to fill these gaps and to improve outcomes. METHODS AND ANALYSIS: This mixed-methods study includes three aims. In aim I, we will define variation in OHCA survival to the emergency department (ED) among EMS agencies that participate in the Michigan Cardiac Arrest Registry to Enhance Survival (CARES) in order to sample EMS agencies with high-survival and low-survival outcomes. In aim II, we will conduct site visits to emergency medical systems-including 911/dispatch, police, non-transport fire, and EMS agencies-in approximately eight high-survival and low-survival communities identified in aim I. At each site, key informant interviews and a multidisciplinary focus group will identify themes associated with high OHCA survival. Transcripts will be coded using a structured codebook and analysed through thematic analysis. Results from aims I and II will inform the development of a survey instrument in aim III that will be administered to all EMS agencies in Michigan. This survey will test the generalisability of factors associated with increased OHCA survival in the qualitative work to ultimately build an EPOC Toolkit which will be distributed to a broad range of stakeholders as a practical 'how-to' guide to improve outcomes. ETHICS AND DISSEMINATION: The EPOC study was deemed exempt by the University of Michigan Institutional Review Board. Findings will be compiled in an 'EPOC Toolkit' and disseminated in the USA through partnerships including, but not limited to, policymakers, EMS leadership and health departments.

Effects of Health Care Payment Models on Physician Practice in the United States: Follow-Up Study.

This study, sponsored by the American Medical Association (AMA), describes how alternative payment models (APMs) affect physicians, physicians' practices, and hospital systems in the United States and also provides updated data to the original 2014 study. Payment models discussed are core payment (fee for service, capitation, episode-based and bundled), supplementary payment (shared savings, pay for performance, retainer-based), and combined payment (medical homes and accountable care organizations). The effects of changes since 2014 in the Affordable Care Act (ACA) and of new alternative payment models (APMs), such as the Medicare Access and CHIP Reauthorization Act of 2015 (MACRA) Quality Payment Program (QPP), are also examined. This project uses the same qualitative multiple-case study method as the 2014 study, relying primarily on semistructured interviews with physician practice leaders, physicians, and other observers. Findings describe the challenges posed by APMs, strategies adopted to deal with APMs, the effects of rapidly changing and increasingly complex payment models, and how risk aversion influences physician practices' decisions to engage in new payment models. Project findings are intended to help guide efforts by the AMA and other stakeholders to improve current and future APMs and help physician practices succeed in them.

Practice Expenses Associated with Comprehensive Primary Care Capabilities.

Through the Comprehensive Primary Care (CPC) and Comprehensive Primary Care Plus (CPC+) programs, the Centers for Medicare & Medicaid Services (CMS) has encouraged primary care practices to invest in "comprehensive primary care" capabilities. Empirical evidence suggests these capabilities are under-reimbursed or not reimbursed under prevailing fee-for-service payment models. To help CMS design alternative payment models (APMs) that reimburse the costs of these capabilities, the authors developed a method for estimating related practice expenses. Fifty practices, sampled for diversity across CPC+ participation status, geographic region, rural status, size, and parent-organization affiliation, completed the study. Researchers developed a mixed-methods strategy, beginning with interviews of practice leaders to identify their capabilities and the types of costs incurred. This was followed by researcher-assisted completion of a workbook tailored to each practice, which gathered related labor and nonlabor costs. In a final interview, practice leaders reviewed cost estimates and made any needed corrections before approval. A main goal was to address a persistent question faced by CMS: When practices reported widely divergent costs for a given capability, was that divergence due to practices having different prices for the same capability or from their having substantially different capabilities? The cost estimation method developed in this project collected detailed data on practice capabilities and their costs. However, the small sample did not allow quantitative estimation of the contributions of service level and pricing to the variation in overall costs. This cost estimation method, deployed on a larger scale, could generate robust data to inform new payment models aimed at incentivizing and sustaining comprehensive primary care.

Congregational involvement in HIV: A qualitative comparative analysis of factors influencing HIV activity among diverse urban congregations.

Religious congregations can potentially reach disproportionately affected populations with HIV programming, however, factors that influence congregational involvement in HIV are not well-studied. Utilizing comparative case methods and in-depth qualitative data from a diverse sample of 14 urban congregations, we examine a range of attitudinal, organizational, resource, and demographic factors to systematically identify different case scenarios-i.e., combinations of characteristics-associated with the level and types of HIV activities in which the congregational cases tended to be involved. For example, White or mixed race congregations with active gay constituencies and an African-American congregation with a strong lay HIV champion were among the high HIV involvement case scenarios, compared to African-American congregations with a health emphasis but no lay HIV champion among the medium HIV involvement scenarios, and fundamentalist African-American and Latino congregations among the low HIV involvement scenarios. Two key factors that appeared influential across case scenarios included the existence of lay champions for HIV activities and the general theological orientation of the congregation.

A scoping review of strategies for financing the implementation of evidence-based practices in behavioral health systems: State of the literature and future directions.

Background: Increased availability of evidence-based practices (EBPs) is essential to alleviating the negative public health and societal effects of behavioral health problems. A major challenge to implementing and sustaining EBPs broadly is the limited and fragmented nature of available funding. Method: We conducted a scoping review that assessed the current state of evidence on EBP financing strategies for behavioral health based on recent literature (i.e., post-Affordable Care Act). We defined financing strategies as techniques that secure and direct financial resources to support EBP implementation. This article introduces a conceptualization of financing strategies and then presents a compilation of identified strategies, following established reporting guidelines for the implementation strategies. We also describe the reported level of use for each financing strategy in the research literature. Results: Of 23 financing strategies, 13 were reported as being used within behavioral health services, 4 had potential for use, 5 had conceptual use only, and 1 was potentially contraindicated. Examples of strategies reported being used include increased fee-for-service reimbursement, grants, cost sharing, and pay-for-success contracts. No strategies had been evaluated in ways that allowed for strong conclusions about their impact on EBP implementation outcomes. Conclusion: The existing literature on EBP financing strategies in behavioral health raises far more questions than answers. Therefore, we propose a research agenda that will help better understand these financing strategies. We also discuss the implications of our findings for behavioral health professionals, system leaders, and policymakers who want to develop robust, sustainable financing for EBP implementation in behavioral health systems. Plain language abstract: Organizations that treat behavioral health problems (mental health and substance use) often seek to adopt and use evidence-based practices (EBPs). A challenge to adopting EBPs broadly is the limited funding available, often from various sources that are poorly coordinated with one another. To help organizations plan effectively to adopt EBPs, we conducted a review of recent evidence (i.e., since the passage of the 2010 Affordable Care Act) on strategies for financing EBP adoption in behavioral health systems. We present definitions of 23 identified strategies and describe each strategy's reported (in the research literature) level of use to fund EBP adoption in behavioral health services. Of the 23 financing strategies, 13 strategies had evidence of use, 4 had potential for use, 5 had conceptual use only, and 1 was potentially contraindicated. Examples of strategies with evidence of use include increased fee-for-service reimbursement, grants, cost sharing, and pay-for-success contracts. This comprehensive list of EBP financing strategies may help guide decision-making by behavioral health professionals, system leaders, and policymakers. The article also presents a research agenda for building on the current research literature by (1) advancing methods to evaluate financing strategies' effects, (2) partnering with stakeholders and decision-makers to examine promising financing strategies, (3) focusing on strategies and service systems with the greatest needs, (4) improving methods to guide the selection of financing strategies, and (5) paying greater attention to sustainable long-term financing of EBPs.

Evaluation of initial progress to implement Common Metrics across the NIH Clinical and Translational Science Awards (CTSA) Consortium.

INTRODUCTION: The Clinical and Translational Science Awards (CTSA) Consortium, about 60 National Institutes of Health (NIH)-supported CTSA hubs at academic health care institutions nationwide, is charged with improving the clinical and translational research enterprise. Together with the NIH National Center for Advancing Translational Sciences (NCATS), the Consortium implemented Common Metrics and a shared performance improvement framework. METHODS: Initial implementation across hubs was assessed using quantitative and qualitative methods over a 19-month period. The primary outcome was implementation of three Common Metrics and the performance improvement framework. Challenges and facilitators were elicited. RESULTS: Among 59 hubs with data, all began implementing Common Metrics, but about one-third had completed all activities for three metrics within the study period. The vast majority of hubs computed metric results and undertook activities to understand performance. Differences in completion appeared in developing and carrying out performance improvement plans. Seven key factors affected progress: hub size and resources, hub prior experience with performance management, alignment of local context with needs of the Common Metrics implementation, hub authority in the local institutional structure, hub engagement (including CTSA Principal Investigator involvement), stakeholder engagement, and attending training and coaching. CONCLUSIONS: Implementing Common Metrics and performance improvement in a large network of research-focused organizations proved feasible but required substantial time and resources. Considerable heterogeneity across hubs in data systems, existing processes and personnel, organizational structures, and local priorities of home institutions created disparate experiences across hubs. Future metric-based performance management initiatives across heterogeneous local contexts should anticipate and account for these types of differences.

Do common metrics add value? Perspectives from NIH Clinical and Translational Science Awards (CTSA) Consortium hubs.

INTRODUCTION: The Clinical and Translational Science Awards (CTSA) Consortium, a network of academic health care institutions with CTSA hubs, is charged with improving the national clinical and translational research enterprise. The CTSA Consortium and the NIH National Center for Advancing Translational Sciences implemented the Common Metrics Initiative comprised of standardized metrics and a shared performance improvement framework. This article summarizes hubs' perspectives on its value during the initial implementation. METHODS: The value was assessed across 58 hubs. Survey items assessed change in perceived ability to manage performance and advance clinical and translational science. Semi-structured interviews elicited hubs' perspectives on meaningfulness and value-added of the Common Metrics Initiative and hubs' recommendations. RESULTS: Hubs considered their abilities to manage performance to have improved, but there was no change in perceived ability to advance clinical and translational science. The initiative added value by providing a formal structured process, enabling strategic conversations, facilitating improvements in processes, providing an external impetus for improvement, and providing justification for funds invested. Hubs were concerned about the usefulness of the metrics chosen and whether the value-added was sufficient relative to the effort required. Hubs recommended useful benchmarking, disseminating best practices and promoting peer-to-peer learning, and expanding the use of data to inform the initiative. CONCLUSIONS: Implementing Common Metrics and a performance improvement framework yielded concrete short-term benefits, but concerns about usefulness remained, particularly considering the effort required. The Common Metrics Initiative should focus on facilitating cross-hub collaboration around metrics that address high-priority impact areas for individual hubs and the Consortium.