Understanding Multilevel Factors Related to Retention Among the Direct Care Workforce: Incorporating Lessons Learned in Considering Innovative Interventions.

GOAL: This article explores how broad, contextual factors may be influential in the retention of direct care workers (DCWs; i.e., entry-level caregivers) who provide vital support to patients in healthcare settings. We reflect on lessons learned from an evaluation of a multisite intervention to improve retention among DCWs employed primarily in hospital settings at three health systems. METHODS: We evaluated a multitiered program for entry-level caregivers that included a risk assessment, a 4-day curriculum, and follow-up sessions, as well as workforce coaching at the three health systems. As part of our evaluation, we collected data on roughly 3,000 DCWs from the three health systems; the information included hiring date, any transfer date, and any termination date for each new DCW, as well as demographic information, position characteristics, and termination status and reasons for any termination. In addition, we collected information about organizational characteristics, including staffing and number of employees. We also conducted interviews with 56 DCWs and 21 staff members who implemented a retention program across each of the three health systems and remotely conducted virtual observations of the curriculum sessions at each system. PRINCIPAL FINDINGS: Although the program we evaluated focused on individual-level factors that may affect retention, our findings revealed other broader, contextual challenges faced by DCWs that they said would have an impact on their willingness to stay in their positions. These challenges included (1) job-related factors including limited compensation, aspects of the job itself, and the inability to advance in one's position; (2) health system challenges including the mission, policies, staffing, and organizational culture; and (3) external factors including federal policies and the ongoing COVID-19 pandemic. PRACTICAL APPLICATIONS: As the direct care workforce continues to grow, interventions to improve retention should consider the interconnectedness of these multilevel factors rather than solely individual-level factors. In addition, further research is needed to rigorously evaluate any potential intervention and consider how such an approach can target DCWs in hospital-based settings who are most affected by the multilevel challenges identified. Finally, any intervention to improve retention must be also aligned to ensure equity, especially in this population of low-wage DCWs, many of whom are marginalized women and individuals of color.

An Ethnography of Parents' Perceptions of Patient Safety in the Neonatal Intensive Care Unit.

BACKGROUND: Parents of neonates are integral components of patient safety in the neonatal intensive care unit (NICU), yet their views are often not considered. By understanding how parents perceive patient safety in the NICU, clinicians can identify appropriate parent-centered strategies to involve them in promoting safe care for their infants. PURPOSE: To determine how parents of neonates conceptualize patient safety in the NICU. METHODS: We conducted qualitative interviews with 22 English-speaking parents of neonates from the NICU and observations of various parent interactions within the NICU over several months. Data were analyzed using thematic content analysis. Findings were critically reviewed through peer debriefing. FINDINGS: Parents perceived safe care through their observations of clinicians being present, intentional, and respectful when adhering to safety practices, interacting with their infant, and communicating with parents in the NICU. They described partnering with clinicians to promote safe care for their infants and factors impacting that partnership. We cultivated a conceptual model highlighting how parent-clinician partnerships can be a core element to promoting NICU patient safety. IMPLICATIONS FOR PRACTICE: Parents' observations of clinician behavior affect their perceptions of safe care for their infants. Assessing what parents observe can be essential to building a partnership of trust between clinicians and parents and promoting safer care in the NICU. IMPLICATIONS FOR RESEARCH: Uncertainty remains about how to measure parent perceptions of safe care, the level at which the clinician-parent partnership affects patient safety, and whether parents' presence and involvement with their infants in the NICU improve patient safety.

A Multi-Stakeholder Consensus-Driven Research Agenda for Better Understanding and Supporting the Emotional Impact of Harmful Events on Patients and Families.

BACKGROUND: The nature and consequences of patient and family emotional harm stemming from preventable medical error, such as losing a loved one or surviving serious medical injury, is poorly understood. Patients and families, clinicians, social scientists, lawyers, and foundation/policy leaders were brought together to establish research priorities for this issue. METHODS: A one-day conference of diverse stakeholder groups to establish a consensus-driven research agenda focused on (1) priorities for research on the short-term and long-term emotional impact of harmful events on patients and families, (2) barriers and enablers to conducting such research, and (3) actionable steps toward better supporting harmed patients and families now. RESULTS: Stakeholders discussed patient and family experiences after serious harmful events, including profound isolation, psychological distress, damaging aspects of medical culture, health care aversion, and negative effects on communities. Stakeholder groups reached consensus, defining four research priorities: (1) Establish conceptual framework and patient-centered taxonomy of harm and healing; (2) Describe epidemiology of emotional harm; (3) Determine how to make emotional harm and long-term impacts visible to health care organizations and society at large; and (4) Develop and implement best practices for emotional support of patients and families. The group also created a strategy for overcoming research barriers and actionable "Do Now" approaches to improve the patient and family experience while research is ongoing. CONCLUSION: Emotional and other long-term impacts of harmful events can have profound consequences for patients and families. Stakeholders designed a path forward to inform approaches that better support harmed patients and families, with both immediately actionable and longer-term research strategies.

Accuracy of the Safer Dx Instrument to Identify Diagnostic Errors in Primary Care.

IMPORTANCE: Diagnostic errors are common and harmful, but difficult to define and measure. Measurement of diagnostic errors often depends on retrospective medical record reviews, frequently resulting in reviewer disagreement. OBJECTIVES: We aimed to test the accuracy of an instrument to help detect presence or absence of diagnostic error through record reviews. DESIGN: We gathered questions from several previously used instruments for diagnostic error measurement, then developed and refined our instrument. We tested the accuracy of the instrument against a sample of patient records (n = 389), with and without previously identified diagnostic errors (n = 129 and n = 260, respectively). RESULTS: The final version of our instrument (titled Safer Dx Instrument) consisted of 11 questions assessing diagnostic processes in the patient-provider encounter and a main outcome question to determine diagnostic error. In comparison with the previous sample, the instrument yielded an overall accuracy of 84 %, sensitivity of 71 %, specificity of 90 %, negative predictive value of 86 %, and positive predictive value of 78 %. All 11 items correlated significantly with the instrument's error outcome question (all p values ≤ 0.01). Using factor analysis, the 11 questions clustered into two domains with high internal consistency (initial diagnostic assessment, and performance and interpretation of diagnostic tests) and a patient factor domain with low internal consistency (Cronbach's alpha coefficients 0.93, 0.92, and 0.38, respectively). CONCLUSIONS: The Safer Dx Instrument helps quantify the likelihood of diagnostic error in primary care visits, achieving a high degree of accuracy for measuring their presence or absence. This instrument could be useful to identify high-risk cases for further study and quality improvement.

Surgical resident education in patient safety: where can we improve?

BACKGROUND: Effective communication and patient safety practices are paramount in health care. Surgical residents play an integral role in the perioperative team, yet their perceptions of patient safety remain unclear. We hypothesized that surgical residents perceive the perioperative environment as more unsafe than their faculty and operating room staff despite completing a required safety curriculum. MATERIALS AND METHODS: Surgeons, anesthesiologists, and perioperative nurses in a large academic children's hospital participated in multifaceted, physician-led workshops aimed at enhancing communication and safety culture over a 3-y period. All general surgery residents from the same academic center completed a hospital-based online safety curriculum only. All groups subsequently completed the psychometrically validated safety attitudes questionnaire to evaluate three domains: safety culture, teamwork, and speaking up. Results reflect the percent of respondents who slightly or strongly agreed. Chi-square analysis was performed. RESULTS: Sixty-three of 84 perioperative personnel (75%) and 48 of 52 surgical residents (92%) completed the safety attitudes questionnaire. A higher percentage of perioperative personnel perceived a safer environment than the surgical residents in all three domains, which was significantly higher for safety culture (68% versus 46%, P = 0.03). When stratified into two groups, junior residents (postgraduate years 1-2) and senior residents (postgraduate years 3-5) had lower scores for all three domains, but the differences were not statistically significant. CONCLUSIONS: Surgical residents' perceptions of perioperative safety remain suboptimal. With an enhanced safety curriculum, perioperative staff demonstrated higher perceptions of safety compared with residents who participated in an online-only curriculum. Optimal surgical education on patient safety remains unknown but should require a dedicated, systematic approach.

Structural social support predicts functional social support in an online weight loss programme.

BACKGROUND: Online weight loss programmes allow members to use social media tools to give and receive social support for weight loss. However, little is known about the relationship between the use of social media tools and the perception of specific types of support. OBJECTIVE: To test the hypothesis that the frequency of using social media tools (structural support) is directly related to perceptions of Encouragement, Information and Shared Experiences support (functional support). DESIGN: Online survey. PARTICIPANTS: Members of an online weight loss programme. METHODS: The outcome was the perception of Encouragement (motivation, congratulations), Information (advice, tips) and Shared Experiences (belonging to a group) social support. The predictor was a social media scale based on the frequency of using forums and blogs within the online weight loss programme (alpha = 0.91). The relationship between predictor and outcomes was evaluated with structural equation modelling (SEM) and logistic regression, adjusted for sociodemographic characteristics, BMI and duration of website membership. RESULTS: The 187 participants were mostly female (95%) and white (91%), with mean (SD) age 37 (12) years and mean (SD) BMI 31 (8). SEM produced a model in which social media use predicted Encouragement support, but not Information or Shared Experiences support. Participants who used the social media tools at least weekly were almost five times as likely to experience Encouragement support compared to those who used the features less frequently [adjusted OR 4.8 (95% CI 1.8-12.8)]. CONCLUSIONS: Using the social media tools of an online weight loss programme at least once per week is strongly associated with receiving Encouragement for weight loss behaviours.

Low Tech, High Potential: Using Technology to Improve Communication across Home Care Workers.

We sought to examine how technology is currently utilized in home care and how the integration of new technologies in the completion of tasks may change the future of work for home care workers (HCWs), including personal care aides and home health aides. We triangulated data from three sources: A scoping review, interviews with HCWs, and monthly stakeholder input from 17 experts in home care and technology. Our findings suggest that while current technology use is limited and rudimentary within home care, technology may be especially beneficial in mitigating challenges around communication handoffs among HCWs. Our study points to the potential for the introduction and integration of technology into home care, particularly for communication to improve direct care worker experiences in providing care to vulnerable clients in their homes.

An Evaluation of a Multisite, Health Systems-Based Direct Care Worker Retention Program: Key Findings and Recommendations.

The U.S. direct care workforce employs nearly 4.6 million people and represents one of the fastest growing occupations in the United States. Direct care workers, or "caregivers," include nursing assistants, home care workers, and residential care aides, all of whom provide basic care to older adults and individuals with disabilities in various health care settings. Despite a growing need for caregivers, supply has not kept up with demand due to high turnover and low wages. In addition, caregivers often face high levels of workplace stress, limited training and growth opportunities, and personal stressors. Ranging from 35 to 90 percent, depending on the health care setting, the turnover rates of direct care workers pose a major challenge for health systems, as well as care recipients and workers themselves. In 2019, the Ralph C. Wilson Jr. Foundation funded three health systems to support the implementation of a new program: Transformational Healthcare Readiness through Innovative Vocational Education (THRIVE). This 12-month program was designed to help address barriers that entry-level caregivers experience and reduce turnover through a comprehensive risk assessment, training, and one-on-one coaching. Researchers from RAND conducted a process and outcome evaluation to determine whether THRIVE was meeting its goals of improving retention and achieving a positive return on investment (ROI). They also examined potential areas for program improvement.

Measuring social support for weight loss in an internet weight loss community.

Although overweight and obese individuals are turning to Internet communities for social support for weight loss, there is no validated online instrument for measuring the subjective social support experiences of participants in these communities. The authors' objective was to determine whether an online version of a validated paper questionnaire, the Weight Management Support Inventory, is appropriate for measuring social support among members of Internet weight loss communities. The authors administered the paper and online versions of the questionnaire in random, counterbalanced fashion to 199 members of a large Internet weight loss community. Scores for the paper and online versions were comparable in between-subjects and within-subjects comparisons. Convergent validity is suggested by the finding that participants who posted messages on Internet forums several times per day reported more social support than those who posted less frequently. However, the instrumental (tangible) support items did not load significantly on the instrumental support factor, suggesting that instrumental support is not relevant to the social support exchanged among participants in these communities. The authors conclude that the online, modified Weight Management Support Inventory, without items for instrumental support, is an appropriate instrument for measuring social support for weight loss among members of Internet weight loss communities.

Measures and measurement of high-performance work systems in health care settings: Propositions for improvement.

BACKGROUND: Given that non-health care research has demonstrated many positive outcomes for organizations using high-performance work systems (HPWSs), a closer examination of HPWSs in health care settings is warranted. PURPOSES: We conducted a narrative review of the literature to understand how previous researchers have measured HPWSs in health care settings and what relationships exist between HPWSs and outcomes. METHODOLOGY/APPROACH: Articles that examined HPWSs in health care settings were identified and summarized. Key discrepancies and agreements in the existing HPWS research, including definitional, conceptual, and analytical areas of interest to health services researchers, are included. FINDINGS: The findings demonstrate that although HPWSs might be a valuable predictor of health care-related outcomes, opportunities exist for improving HPWS measurement in health care settings. PRACTICE IMPLICATION: Suggestions are provided to help guide future health services researchers in conducting research on HPWSs. Practice implications are provided for health care managers.

Trust in experts, not trust in national leadership, leads to greater uptake of recommended actions during the COVID-19 pandemic.

Evidence suggests that people vary in their desire to undertake protective actions during a health emergency, and that trust in authorities may influence decision making. We sought to examine how the trust in health experts and trust in White House leadership during the COVID-19 pandemic impacts individuals' decisions to adopt recommended protective actions such as mask-wearing. A mediation analysis was conducted using cross-sectional U.S. survey data collected between March 27 and 30, 2020, to elucidate how individuals' trust in health experts and White House leadership, their perceptions of susceptibility and severity to COVID-19, and perceived benefits of protecting against COVID-19, influenced their uptake of recommended protective actions. Trust in health experts was associated with greater perceived severity of COVID-19 and benefits of taking action, which led to greater uptake of recommended actions. Trust in White House leadership was associated with lower perceived susceptibility to COVID-19 and was not associated with taking recommended actions. Having trust in health experts is a greater predictor of individuals' uptake of protective actions than having trust in White House leadership. Public health messaging should emphasize the severity of COVID-19 and the benefits of protecting oneself while ensuring consistency and transparency to regain trust in health experts.

La evidencia sugiere que las personas varían en su deseo de emprender acciones de protección durante una emergencia de salud y que la confianza en las autoridades puede influir en la toma de decisiones. Buscamos examinar cómo la confianza en los expertos en salud y la confianza en el liderazgo de la Casa Blanca durante la pandemia de COVID­19 impactan las decisiones de las personas para adoptar las acciones de protección recomendadas, como el uso de máscaras. Se realizó un análisis de mediación utilizando datos de encuestas transversales de EE. UU. Recopilados entre el 27 y el 30 de marzo de 2020 para dilucidar cómo la confianza de las personas en los expertos en salud y el liderazgo de la Casa Blanca, sus percepciones de susceptibilidad y gravedad al COVID­19, y los beneficios percibidos de protegerse contra COVID­19, influyó en su adopción de las acciones de protección recomendadas. La confianza en los expertos en salud se asoció con una mayor gravedad percibida de COVID­19 y los beneficios de tomar medidas, lo que llevó a una mayor aceptación de las acciones recomendadas. La confianza en el liderazgo de la Casa Blanca se asoció con una menor susceptibilidad percibida al COVID­19 y no con la adopción de las acciones recomendadas. Tener confianza en los expertos en salud es un factor de predicción mayor de la adopción de acciones de protección por parte de los individuos que tener confianza en el liderazgo de la Casa Blanca. Los mensajes de salud pública deben enfatizar la gravedad de COVID­19 y los beneficios de protegerse a sí mismo, al tiempo que se garantiza la coherencia y la transparencia para recuperar la confianza en los expertos en salud.

Measurement as a Performance Driver: The Case for a National Measurement System to Improve Patient Safety.

ABSTRACT: Safety metrics in healthcare settings stand apart from those in all other industries. Despite improvements in the measurement and prevention of adverse health outcomes following the 1999 Institute of Medicine report, no fully operational national-level program for monitoring patient harm exists. Here, we review the annual rate of fatal adverse events in healthcare settings in the United States on the basis of previous research, assess the current state of measurements of patient harm, propose a national standard to both quantify harm and act as a performance driver for improved safety, and discuss additional considerations such as accountability and implications for tort reform under this standard. On the basis of experiences in other sectors, we propose a federally mandated, nonpunitive national system that relies on accurate measurement as a driver of performance.

Home Care Aide Safety Concerns and Job Challenges During the COVID-19 Pandemic.

Home care aides are on the frontlines providing care to vulnerable individuals in their homes during the COVID-19 pandemic yet are often excluded from policies to protect health care workers. The goal of this study was to examine experiences of agency-employed home care aides during the COVID-19 pandemic and to identify ways to mitigate concerns. We used an innovative journaling approach with thirty-seven aides as well as in-depth interviews with fifteen aides and leadership representatives from nine home health agencies in New York and Michigan. Workers described a range of concerns around workplace safety including uncertainty around whether a client had COVID-19, inadequate access to personal protective equipment and safe transportation, as well as fundamental changes to interactions with clients. Agencies also faced challenges acquiring personal protective equipment for their aides. This research points to needed resources to support home care aides and home health agencies both during a public health crisis and in the future.

Development and testing of the Stakeholder Quality Improvement Perspectives Survey (SQuIPS).

BACKGROUND: To create a theory-informed survey that quality improvement (QI) teams can use to understand stakeholder perceptions of an intervention. METHOD: We created the survey then performed a cross-sectional survey of QI stakeholders of three QI projects. The projects sought to: (1) reduce unplanned extubations in a neonatal intensive care unit; (2) maintain normothermia during colorectal surgery and (3) reduce specimen processing errors for ambulatory gastroenterology procedures. We report frequencies of responses to survey items, results of exploratory factor analysis, and how QI team leaders used the results. RESULTS: Overall we received surveys from 319 out of 386 eligible stakeholders (83% response rate, range for the three QI projects 57%-86%). The QI teams found that the survey results confirmed existing concerns (eg, the intervention would not make work easier) and revealed unforeseen concerns such as lack of consensus about the overall purpose of the intervention and its importance. The results of our factor analysis indicate that one 7-item scale (Cronbach's alpha 0.9) can efficiently measure important aspects of stakeholder perceptions, and that two additional Likert-type items could add valuable information for leaders. Two QI team leaders made changes to their project based on survey responses that indicated the intervention made stakeholders' jobs harder, and that there was no consensus about the purpose of the intervention. CONCLUSIONS: The Stakeholder Quality Improvement Perspectives Survey was feasible for QI teams to use, and identified stakeholder perspectives about QI interventions that leaders used to alter their QI interventions to potentially increase the likelihood of stakeholder acceptance of the intervention.

Pediatric Trainees' Speaking Up About Unprofessional Behavior and Traditional Patient Safety Threats.

OBJECTIVE: Speaking up is increasingly recognized as essential for patient safety. We aimed to determine pediatric trainees' experiences, attitudes, and anticipated behaviors with speaking up about safety threats including unprofessional behavior. METHODS: Anonymous, cross-sectional survey of 512 pediatric trainees at 2 large US academic children's hospitals that queried experiences, attitudes, barriers and facilitators, and vignette responses for unprofessional behavior and traditional safety threats. RESULTS: Responding trainees (223 of 512, 44%) more commonly observed unprofessional behavior than traditional safety threats (57%, 127 of 223 vs 34%, 75 of 223; P < .001), but reported speaking up about unprofessional behavior less commonly (48%, 27 of 56 vs 79%, 44 of 56; P < .001). Respondents reported feeling less safe speaking up about unprofessional behavior than patient safety concerns (52%, 117 of 223 vs 78%, 173 of 223; P < .001). Respondents were significantly less likely to speaking up to, and use assertive language with, an attending physician in the unprofessional behavior vignette than the traditional safety vignette (10%, 22 of 223 vs 64%, 143 of 223, P < .001 and 12%, 27 of 223 vs 57%, 128 of 223, P < .001, respectively); these differences persisted even among respondents that perceived high potential for patient harm in both vignettes (20%, 16 of 81 vs 69%, 56 of 81, P < .001 and 20%, 16 of 81 vs 69%, 56 of 81, P < .001, respectively). Fear of conflict was the predominant barrier to speaking up about unprofessional behavior and more commonly endorsed for unprofessional behavior than traditional safety threats (67%, 150 of 223 vs 45%, 100 of 223, P < .001). CONCLUSIONS: Findings suggest pediatric trainee reluctance to speak up when presented with unprofessional behavior compared to traditional safety threats and highlight a need to improve elements of the clinical learning environment to support speaking up.

Development of Palliative Care Quality Measures for Outpatients in a Clinic-Based Setting: A Report on Information Gathering Activities.

Palliative care has expanded rapidly in recent years. Hence, there has been a growing awareness of and emphasis on the importance of developing quality measures specific to palliative care. This article describes information-gathering activities conducted by RAND to develop two measures of palliative care quality for patients receiving such care in outpatient, clinic-based settings. The authors describe the consensus that has developed for measurement priorities in the palliative care community, provide a summary of clinical practice guidelines, and review the evidence base for palliative care. The authors also review current relevant regulations, existing measures of patient and caregiver experience, findings from a gap analysis on palliative care assessment, and findings from provider focus groups and interviews with patients and caregivers or family members.

Accuracy of reporting current medications by cancer patients presenting to an emergency center.

BACKGROUND: Due to high coexistence of comorbidity, cancer patients take many medications and are susceptible to negative consequences of polypharmacy. To avoid adverse events during care transitions, patients need to correctly communicate their medications. The emergency center (EC) presents opportunities to assess patients' knowledge of medications and reconcile medication profiles. OBJECTIVE: The purpose was to evaluate the medication knowledge of cancer patients presenting to the EC and to identify factors associated with higher knowledge. DESIGN AND MEASUREMENTS: For the cross-sectional self-administered survey, 254 patients were enrolled and gave name, dose, frequency, route, and indication for medications. Responses were checked for accuracy against outpatient pharmacy dispensing records within or outside M. D. Anderson Cancer Center. Demographic data was obtained from medical records. For each patient, we calculated a patient medication knowledge (PMK-overall) score indicating percentage of correct responses. RESULTS: Median PMK-overall score was 80%. Patients who used a medication aid to fill out the survey were 6.5 times more likely to have a high level of medication knowledge, or PMK-overall score > or = 80%. Predictors of using a medication aid included lower education level, solid tumor, more than five medications, married, and using a medication list at home. CONCLUSIONS: Though our findings may not be generalizable to settings outside the EC, we found cancer patients to have high levels of medication knowledge. Future studies should validate the use of PMK scores to predict medication adherence and other outcomes. Patients should be encouraged to use a medication aid when presenting information to the health care system.

Barriers to Speaking Up About Patient Safety Concerns.

OBJECTIVES: We sought to examine the association between willingness of health-care professionals to speak up about patient safety concerns and their perceptions of two types of organizational culture (ie, safety and teamwork) and understand whether nursing professionals and other health-care professionals reported the same barriers to speaking up about patient safety concerns. METHODS: As part of an annual safety culture survey in a large health-care system, we asked health-care professionals to tell us about the main barriers that prevent them from speaking up about patient safety concerns. Approximately 1341 respondents completed the anonymous, electronic survey. RESULTS: A little more than half (55%) of the participants mentioned leadership (fear of no change or retaliation) and personal (ie, fear of negative feedback or being wrong) barriers concerning why they would not speak up about patient safety concerns. The remaining participants (45%) indicated they would always speak up. These findings about barriers were consistent across nurses and other health-care professionals. Safety culture (SC) and teamwork culture (TC) scores were significantly more positive in those indicating they would always speak up (SC = 89%, TC = 89%) than in those who provided reasons for not speaking up (SC = 63%, TC = 64%) (t1205 = 13.99, P < 0.05, and t1217 = 13.61, P < 0.05, respectively). CONCLUSIONS: Health-care professionals emphasized leadership and personal barriers as reasons for not speaking up. We also demonstrated an association between not speaking up and lower safety and teamwork culture scores.

Practice Expenses Associated with Comprehensive Primary Care Capabilities.

Through the Comprehensive Primary Care (CPC) and Comprehensive Primary Care Plus (CPC+) programs, the Centers for Medicare & Medicaid Services (CMS) has encouraged primary care practices to invest in "comprehensive primary care" capabilities. Empirical evidence suggests these capabilities are under-reimbursed or not reimbursed under prevailing fee-for-service payment models. To help CMS design alternative payment models (APMs) that reimburse the costs of these capabilities, the authors developed a method for estimating related practice expenses. Fifty practices, sampled for diversity across CPC+ participation status, geographic region, rural status, size, and parent-organization affiliation, completed the study. Researchers developed a mixed-methods strategy, beginning with interviews of practice leaders to identify their capabilities and the types of costs incurred. This was followed by researcher-assisted completion of a workbook tailored to each practice, which gathered related labor and nonlabor costs. In a final interview, practice leaders reviewed cost estimates and made any needed corrections before approval. A main goal was to address a persistent question faced by CMS: When practices reported widely divergent costs for a given capability, was that divergence due to practices having different prices for the same capability or from their having substantially different capabilities? The cost estimation method developed in this project collected detailed data on practice capabilities and their costs. However, the small sample did not allow quantitative estimation of the contributions of service level and pricing to the variation in overall costs. This cost estimation method, deployed on a larger scale, could generate robust data to inform new payment models aimed at incentivizing and sustaining comprehensive primary care.

Evaluation of initial progress to implement Common Metrics across the NIH Clinical and Translational Science Awards (CTSA) Consortium.

INTRODUCTION: The Clinical and Translational Science Awards (CTSA) Consortium, about 60 National Institutes of Health (NIH)-supported CTSA hubs at academic health care institutions nationwide, is charged with improving the clinical and translational research enterprise. Together with the NIH National Center for Advancing Translational Sciences (NCATS), the Consortium implemented Common Metrics and a shared performance improvement framework. METHODS: Initial implementation across hubs was assessed using quantitative and qualitative methods over a 19-month period. The primary outcome was implementation of three Common Metrics and the performance improvement framework. Challenges and facilitators were elicited. RESULTS: Among 59 hubs with data, all began implementing Common Metrics, but about one-third had completed all activities for three metrics within the study period. The vast majority of hubs computed metric results and undertook activities to understand performance. Differences in completion appeared in developing and carrying out performance improvement plans. Seven key factors affected progress: hub size and resources, hub prior experience with performance management, alignment of local context with needs of the Common Metrics implementation, hub authority in the local institutional structure, hub engagement (including CTSA Principal Investigator involvement), stakeholder engagement, and attending training and coaching. CONCLUSIONS: Implementing Common Metrics and performance improvement in a large network of research-focused organizations proved feasible but required substantial time and resources. Considerable heterogeneity across hubs in data systems, existing processes and personnel, organizational structures, and local priorities of home institutions created disparate experiences across hubs. Future metric-based performance management initiatives across heterogeneous local contexts should anticipate and account for these types of differences.