Follow-Up Shadow Coaching Improves Primary Care Provider-Patient Interactions and Maintains Improvements When Conducted Regularly: A Spline Model Analysis.

INTRODUCTION: Shadow coaching improves provider-patient interactions, as measured by CG-CAHPS® overall provider rating (OPR) and provider communication (PC). However, these improvements erode over time. AIM: Examine whether a second coaching session (re-coaching) improves and sustains patient experience. SETTING: Large, urban Federally Qualified Health Center PROGRAM: Trained providers observed patient care by colleagues and provided suggestions for improvement. Providers with OPRs<90 (0-100-point scale) were eligible. EVALUATION: We used stratified randomization based on provider type and OPR to assign half of the 40 eligible providers to re-coaching. For OPR and PC, we fit mixed-effects regression models with random-effects for provider (level of treatment assignment) and fixed-effects for time (linear spline with knots and possible "jump" at initial coaching and re-coaching), previous OPR, patient characteristics, and sites. We observed a statistically significant medium jump among re-coached providers after re-coaching on OPR (3.7 points) and PC (3.5 points); differences of 1, 3, and ≥5-points for CAHPS measures are considered small, medium, and large. Improvements from re-coaching persisted for 12 months for OPR and 8 months for PC. DISCUSSION: Re-coaching improved patient experience more than initial coaching, suggesting the reactivation of knowledge from initial coaching. However, re-coaching gains also eroded. Coaching should occur every 6 to 12 months to maintain behaviors and scores.

Preferences of healthcare workers for provider payment systems in The Gambia's National Health Insurance Scheme.

BACKGROUND: The Government of The Gambia introduced a national health insurance scheme (NHIS) in 2021 to promote universal health coverage (UHC). Provider payment systems (PPS) are strategic purchasing arrangements that can enhance provider performance, accountability, and efficiency in the NHIS. This study assessed healthcare workers' (HCWs') preferences for PPS across major service areas in the NHIS. METHODS: A facility-based cross-sectional study was conducted using a probability proportionate to size sampling technique to select an appropriate sample size. Health care workers were presented with options for PPS to choose from across major service areas. Descriptive statistics explored HCW socio-demographic and health service characteristics. Multinomial logistic regressions were used to assess the association between these characteristics and choices of PPS. RESULTS: The majority of HCW did not have insurance coverage, but more than 60% of them were willing to join and pay for the NHIS. Gender, professional cadre, facility level, and region influenced HCW's preference for PPS across the major service areas. The preferred PPS varied among HCW depending on the service area, with capitation being the least preferred PPS across all service areas. CONCLUSION: The National Health Insurance Authority (NHIA) needs to consider HCW's preference for PPS and factors that influence their preferences when choosing various payment systems. Strategic purchasing decisions should consider the incentives these payment systems may create to align incentives to guide provider behaviour towards UHC. The findings of this study can inform policy and decision-makers on the right mix of PPS to spur provider performance and value for money in The Gambia's NHIS.

Examining healthcare purchasing arrangements for strategic purchasing in Nigeria: a case study of the Imo state healthcare system.

BACKGROUND: Strategic healthcare purchasing (SHP), as a critical function of health financing, enhances the optimal attainment of health system goals through the efficient use of financial resources. Countries committed to universal health coverage (UHC) have made progress towards strategic purchasing through relevant reforms in their healthcare financing systems. This study examined the purchasing arrangements and practices in the Imo state healthcare system to track progress towards SHP committed to UHC. METHODS: A critical review and analysis of healthcare financing schemes in Imo state, south-eastern Nigeria, was undertaken to assess their purchasing practices based on a descriptive qualitative case study approach. Relevant documents were collected and reviewed including in-depth interviews with stakeholders. Information was collected on external factors and governance, purchasing practices and other capacities of the state's health financing schemes. The analytical framework was guided by comparing purchasing practices of the financing schemes with the ideal strategic purchasing actions (SPAs) developed by RESYST (Resilient and Responsive Health Systems), based on the three pairs of principal-agent relationships. RESULTS: Healthcare purchasing in the state is dominated by the State Ministry of Health (SMOH) using a general tax-based and public health system, making government revenue a major source of funding and provision of healthcare services. However, purchasing of health services is passive and the stewardship role of government is significantly weak, characterized by substantial insufficient budgetary allocations, inadequate infrastructure and poor accountability. However, the health benefit package significantly reflects the needs of the population. As an integrated system, there is no purchaser-provider split. Provider selection, monitoring and payment processes do not promote quality and efficiency of service delivery. There is very limited institutional and technical capacity for SHP. However, the state recently established the Imo State Health Insurance Agency (IMSHIA), a social agency whose structure and organization support SHP functions, including benefit packages, provider selection processes, appropriate provider payment mechanisms and regulatory controls. CONCLUSION: Healthcare purchasing in Imo state remains mostly passive, with very limited strategic purchasing arrangements. The main challenges stem from the entrenched institutional mechanism of passive purchasing in the government's health budgets that are derived from general tax revenue, lack of purchaser-provider split, and poor provider payment and performance monitoring mechanisms. The establishment of the social insurance agency represents an opportunity for boosting SHP in the state for enhanced progress towards UHC. Building capacity and awareness of the benefits of SHP among policy-makers and programme managers will improve the efficiency and equity of health purchasing in the state.

Association of Provider Performance with Changes in Insurance Networks.

BACKGROUND: Medicaid managed care plans change provider networks frequently, yet there is no evidence about the performance of exiting providers relative to those that remain. OBJECTIVES: To investigate the association between provider cost and quality and network exit. DESIGN: Observational study with provider network directory data linked to administrative claims from managed care plans in Tennessee's Medicaid program during the period 2010-2016. PARTICIPANTS: 1,966,022 recipients assigned to 9593 unique providers. MAIN MEASURES: Exposures were risk-adjusted total costs of care and nine measures from the Healthcare Effectiveness Data and Information Set (HEDIS) were used to construct a composite annual indicators of provider performance on quality. Outcome was provider exit from a Medicaid managed care plan. Differences in quality and cost between providers that exited and remained in managed care networks were estimated using a propensity score model to match exiting to nonexiting providers. KEY RESULTS: Over our study period, we found that 21% of participating providers exited at least one of the Medicaid managed care plans in Tennessee. As compared with providers that remained in networks, those that exited performed 3.8 percentage points [95% CI, 2.3, 5.3] worse on quality as measured by a composite of the nine HEDIS quality metrics. However, 22% of exiting providers performed above average in quality and cost and only 29% of exiting providers had lower than average quality scores and higher than average costs. Overall, exiting providers had lower aggregate costs in terms of the annual unadjusted cost of care per-member-month - $21.57 [95% CI, - $41.02, - $2.13], though difference in annual risk-adjusted cost per-member-month was nonsignificant. CONCLUSIONS: Providers exiting Medicaid managed care plans appear to have lower quality scores in the year prior to their exit than the providers who remain in network. Our study did not show that managed care plans disproportionately drop high-cost providers.

Reforming medical education admission and training in low- and middle-income countries: who gets admitted and why it matters.

Recent studies reveal public-sector healthcare providers in low- and middle-income countries (LMICs) are frequently absent from work, solicit informal payments for service delivery, and engage in disrespectful or abusive treatment of patients. While extrinsic factors may foster and facilitate these negative practices, it is not often feasible to alter the external environment in low-resource settings. In contrast, healthcare professionals with strong intrinsic motivation and a desire to serve the needs of their community are less likely to engage in these negative behaviors and may draw upon internal incentives to deliver a high quality of care. Reforming medical education admission and training practices in LMICs is one promising strategy for increasing the prevalence of medical professionals with strong intrinsic motivation.

Using a quality improvement model to enhance providers' performance in maternal and newborn health care: a post-only intervention and comparison design.

BACKGROUND: The Standards Based Management and Recognition (SBM-R©) approach to quality improvement has been implemented in Ethiopia to strengthen routine maternal and newborn health (MNH) services. This evaluation assessed the effect of the intervention on MNH providers' performance of routine antenatal care (ANC), uncomplicated labor and delivery and immediate postnatal care (PNC) services. METHODS: A post-only evaluation design was conducted at three hospitals and eight health centers implementing SBM-R and the same number of comparison health facilities. Structured checklists were used to observe MNH providers' performance on ANC (236 provider-client interactions), uncomplicated labor and delivery (226 provider-client interactions), and immediate PNC services in the six hours after delivery (232 provider-client interactions); observations were divided equally between intervention and comparison groups. Main outcomes were provider performance scores, calculated as the percentage of essential tasks in each service area completed by providers. Multilevel analysis was used to calculate adjusted mean percentage performance scores and standard errors to compare intervention and comparison groups. RESULTS: There was no statistically significant difference between intervention and comparison facilities in overall mean performance scores for ANC services (63.4% at intervention facilities versus 61.0% at comparison facilities, p = 0.650) or in any specific ANC skill area. MNH providers' overall mean performance score for uncomplicated labor and delivery care was 11.9 percentage points higher in the intervention than in the comparison group (77.5% versus 65.6%; p = 0.002). Overall mean performance scores for immediate PNC were 22.2 percentage points higher at intervention than at comparison facilities (72.8% versus 50.6%; p = 0.001); and there was a significant difference of 22 percentage points between intervention and comparison facilities for each PNC skill area: care for the newborn and health check for the mother. CONCLUSIONS: The SBM-R quality improvement intervention made a significant positive impact on MNH providers' performance during labor and delivery and immediate PNC services, but not during ANC services. Scaling up the intervention to other facilities and regions may increase the availability of good quality MNH services across Ethiopia. The findings will also guide implementation of the government's five-year (2015-2020) health sector transformation plan and health care quality strategies needed to meet the country's MNH goals.

Addressing Missing Data in Patient-Reported Outcome Measures (PROMS): Implications for the Use of PROMS for Comparing Provider Performance.

Patient-reported outcome measures (PROMs) are now routinely collected in the English National Health Service and used to compare and reward hospital performance within a high-powered pay-for-performance scheme. However, PROMs are prone to missing data. For example, hospitals often fail to administer the pre-operative questionnaire at hospital admission, or patients may refuse to participate or fail to return their post-operative questionnaire. A key concern with missing PROMs is that the individuals with complete information tend to be an unrepresentative sample of patients within each provider and inferences based on the complete cases will be misleading. This study proposes a strategy for addressing missing data in the English PROM survey using multiple imputation techniques and investigates its impact on assessing provider performance. We find that inferences about relative provider performance are sensitive to the assumptions made about the reasons for the missing data.

A collaborative learning approach to improving health worker performance in adolescent sexual and reproductive health service provision: a descriptive feasibility study in six health zones in the Democratic Republic of the Congo.

Poor performance among health service providers is a key barrier to high quality, adolescent-responsive health services. Collaborative learning has been shown to strengthen health service provider performance, but few studies have examined its implementation in adolescent health services. In this paper, we describe a collaborative learning approach for adolescent health service providers implemented as part of a project aiming to prevent HIV in adolescent girls and young women in the Democratic Republic of the Congo (DRC) and explore its feasibility, acceptability, benefits and challenges. To do so, we reviewed plans, budgets and progress reports, as well as nested implementation research related to the project. We also carried out a quantitative analysis of the number, location, participants and topics of collaborative learning sessions conducted as part of this initiative, and thematic analysis to synthesise findings on perceived benefits and challenges. Under the project, 32 collaborative learning sessions of approximately two-hour duration were held with up to 15 participants, most of whom were nurses, between June 2018 and May 2019. The project cost was approximately USD 135,000 over three years. Reported benefits included improving health service provider attitudes, knowledge and skills; ensuring delivery of non-judgemental, empathic and confidential health services; and improving communication and collaboration between health services and adolescents together with their parents. While the novelty of the approach in this context presented challenges, our results suggest that collaborative learning in adolescent health services is feasible, acceptable, and inexpensive. It may help strengthen the knowledge and skills of health service providers, build positive attitudes and motivation, and improve their performance and thereby the adolescent-responsiveness of health services. Further research is needed to confirm these results in other settings and to examine the impact of collaborative learning on the acceptability and uptake of health services.

The Association Between Patient Satisfaction and Patient-Reported Health Outcomes.

OBJECTIVE: Although patient satisfaction is increasingly used to rate hospitals, it is unclear how patient satisfaction is associated with health outcomes. We sought to define the relationship of self-reported patient satisfaction and health outcomes. DESIGN: Retrospective cross-sectional analysis using regression analyses and generalized linear modeling. SETTING: Utilizing the Medical Expenditure Panel Survey Database (2010-2014), patients who had responses to survey questions related to satisfaction were identified. PARTICIPANTS: Among the 9166 patients, representing 106 million patients, satisfaction was rated as optimal (28.2%), average (61.1%), and poor (10.7%). Main Outcome Measures: We sought to define the relationship of self-reported patient satisfaction and health outcomes. RESULTS: Patients who were younger, male, black/African American, with Medicaid insurance, as well as patients with lower socioeconomic status were more likely to report poor satisfaction (all P < .001). In the adjusted model, physical health score was not associated with an increased odds of poor satisfaction (1.42 95% confidence interval [CI]: 0.88-2.28); however, patients with a poor mental health score or ≥2 emergency department visits were more likely to report poor overall satisfaction (3.91, 95% CI: 2.34-6.5; 2.24, 95% CI: 1.48-3.38, respectively). CONCLUSION: Poor satisfaction was associated with certain unmodifiable patient-level characteristics, as well as mental health scores. These data suggest that patient satisfaction is a complex metric that can be affected by more than provider performance.

Targets without tolerances: improper evaluation of medical personnel.

BACKGROUND: Mandated assessment of medical personnel by comparing individual performance averages to external targets is standard practice in many health care systems. This method of assessment uses only raw or adjusted averages without considering the associated variation. Failure to correctly incorporate variation in the assessment of medical personnel results in evaluations which are neither accurate nor fair with respect to assessing personnel performance. METHODS: Accepted statistical methods for process evaluation and quality control, including regression, control charts, and adjusted means comparisons will be used to analyze hospital length of stay (LOS) patient data for the period between January and October 2010 for 12 physicians in the Cardiothoracic Surgery service line at the Cleveland Clinic. RESULTS: The analysis and interpretation of physician performance data using both targets and tolerances results in physician performance ratings which differ significantly from performance ratings based only on targets. CONCLUSIONS: Failure to include variation when assessing medical personnel performance results in a system of ranking, rewarding, and punishing based primarily on blind chance instead of one based on actual personnel performance.

Investigating the relationship between costs and outcomes for English mental health providers: a bi-variate multi-level regression analysis.

Provider payment systems for mental health care that incentivize cost control and quality improvement have been a policy focus in a number of countries. In England, a new prospective provider payment system is being introduced to mental health that should encourage providers to control costs and improve outcomes. The aim of this research is to investigate the relationship between costs and outcomes to ascertain whether there is a trade-off between controlling costs and improving outcomes. The main data source is the Mental Health Minimum Data Set (MHMDS) for the years 2011/12 and 2012/13. Costs are calculated using NHS reference cost data while outcomes are measured using the Health of the Nation Outcome Scales (HoNOS). We estimate a bivariate multi-level model with costs and outcomes simultaneously. We calculate the correlation and plot the pairwise relationship between residual costs and outcomes at the provider level. After controlling for a range of demographic, need, social, and treatment variables, residual variation in costs and outcomes remains at the provider level. The correlation between residual costs and outcomes is negative, but very small, suggesting that cost-containment efforts by providers should not undermine outcome-improving efforts under the new payment system.

Relationship Between Physician and Hospital Procedure Volume and Mortality After Carotid Artery Stenting Among Medicare Beneficiaries.

BACKGROUND: Clinical trials demonstrated the efficacy of carotid artery stenting (CAS) relative to carotid endarterectomy when performed by physicians with demonstrated proficiency. It is unclear how CAS performance may be influenced by the diversity in CAS and non-CAS provider volumes in routine clinical practice. METHODS AND RESULTS: We linked Medicare claims to the Centers for Medicare and Medicaid Services' CAS Database (2005-2009). We assessed the association between 30-day mortality and past-year physician (0, 1-4, 5-9, 10-19, ≥20) and hospital (<10, 10-19, 20-39, ≥40) CAS volumes and past-year hospital coronary and peripheral stenting volumes (<200, 200-399, 400-849, ≥850) among beneficiaries at least 66 years of age. Unadjusted 30-day mortality risk was 1.8% (95% confidence interval [CI], 1.6-2.0) for 19 724 patients undergoing CAS by 2045 physicians in 729 hospitals. Median past-year CAS volume was 9 (interquartile range, 4-19) for physicians and 23 (interquartile range, 12-41) for hospitals. Compared to physicians performing ≥20 CAS in the past year, lower CAS volumes were associated with higher adjusted risks of 30-day morality (P value for trend < 0.05): 1.4 (95% CI, 0.9-2.3) for 0 past-year CAS, 1.3 (95% CI, 0.9-1.8) for 1 to 4, 1.1 (95% CI, 0.8-1.6) for 5 to 9, and 0.9 (95% CI, 0.7-1.4) for 10 to 19. An inverse relationship between 30-day mortality and past-year CAS hospital volume as well as past-year hospital non-CAS volume, past-year hospital non-CAS volume, and 30-day mortality was also noted. CONCLUSIONS: Among Medicare patients, an inverse relationship exists between physician and hospital CAS volumes and hospital non-CAS stenting volume and 30-day mortality, even after adjusting for all pertinent patient- and hospital-level factors.

Comparing the performance of English mental health providers in achieving patient outcomes.

Evidence on provider payment systems that incorporate patient outcomes is limited for mental health care. In England, funding for mental health care services is changing to a prospective payment system with a future objective of linking some part of provider payment to outcomes. This research examines performance of mental health providers offering hospital and community services, in order to investigate if some are delivering better outcomes. Outcomes are measured using the Health of the Nation Outcome Scales (HoNOS) - a clinician-rated routine outcome measure (CROM) mandated for national use. We use data from the Mental Health Minimum Data Set (MHMDS) - a dataset on specialist mental health care with national coverage - for the years 2011/12 and 2012/13 with a final estimation sample of 305,960 observations with follow-up HoNOS scores. A hierarchical ordered probit model is used and outcomes are risk adjusted with independent variables reflecting demographic, need, severity and social indicators. A hierarchical linear model is also estimated with the follow-up total HoNOS score as the dependent variable and the baseline total HoNOS score included as a risk-adjuster. Provider performance is captured by a random effect that is quantified using Empirical Bayes methods. We find that worse outcomes are associated with severity and better outcomes with older age and social support. After adjusting outcomes for various risk factors, variations in performance are still evident across providers. This suggests that if the intention to link some element of provider payment to outcomes becomes a reality, some providers may gain financially whilst others may lose. The paper contributes to the limited literature on risk adjustment of outcomes and performance assessment of providers in mental health in the context of prospective activity-based payment systems.