Maintenance versus replacement of medical equipment: a cost-minimization analysis among district hospitals in Nepal.

BACKGROUND: About half of all medical devices in low- and lower-middle-income countries are currently non-operational because equipment maintenance is lacking. Thus, choosing a cost-efficient equipment maintenance approach has the potential to increase both the quantity and quality of important health services. Between 2010 and 2014 Nepal's Ministry of Health chose two of its development regions to pilot the contracting-out of maintenance services to the private sector. We develop a cost model and employ different data to calculate the cost of this contracted-out scheme. The latter we compare with two additional common approaches to maintenance: in-house maintenance and no maintenance. METHODS: We use invoiced pilot program costs, device depreciation estimates from the literature, and hospital case numbers from Nepal's Health Management Information System. We estimate net-present values for a three-year horizon, incorporating both fixed and operational cost. Operational costs include downtime cost measured as lost revenues due to non-working equipment. RESULTS: The contracted-out maintenance scheme shows a strong relative cost performance. Its cost after 3 years amount to 4,501,574 International Dollars Purchasing Power Parity (I$ PPP), only 90% of the cost with no maintenance. The contracted-out scheme incurs 670,288 I$ PPP and 3,765,360 I$ PPP in fixed cost and operational cost, respectively. The cost for replacing broken devices is 1,920,467 I$ PPP lower with maintenance. In addition, after 3 years total cost of contracted-out maintenance is 489,333 I$ PPP (11%) below total cost of decentralized in-house maintenance. After 10 years, contracted-out maintenance saves 2.5 million I$ PPP (18%) compared to no maintenance. CONCLUSIONS: We find that contracted-out maintenance provides cost-efficient medical equipment maintenance in a lower-middle income context. Our findings contrast with studies from high- and upper-middle-income countries, which reflect contexts with more in-house engineering expertise than in our study area. Since the per hospital fixed cost decrease with scheme size, our results lend support to an expansion of contracted-out maintenance to the remaining three development regions in Nepal.

Can Combining Performance-Based Financing With Equity Measures Result in Greater Equity in Utilization of Maternal Care Services? Evidence From Burkina Faso.

BACKGROUND: As countries reform health financing systems towards universal health coverage, increasing concerns emerge on the need to ensure inclusion of the most vulnerable segments of society, working to counteract existing inequities in service coverage. To this end, selected countries in sub-Saharan Africa have decided to couple performance-based financing (PBF) with demand-side equity measures. Still, evidence on the equity impacts of these more complex PBF models is largely lacking. We aimed at filling this gap in knowledge by assessing the equity impact of PBF combined with equity measures on utilization of maternal health services in Burkina Faso. METHODS: Our study took place in 24 districts in rural Burkina Faso. We implemented an experimental design (clusterrandomized trial) nested within a quasi-experimental one (pre- and post-test design with independent controls). Our analysis relied on self-reported data on pregnancy history from 9999 (baseline) and 11 010 (endline) women of reproductive age (15-49 years) on use of maternal healthcare and reproductive health services, and estimated effects using a difference-in-differences (DID) approach, purposely focused on identifying program effects among the poorest wealth quintile. RESULTS: PBF improved the utilization of few selected maternal health services compared to status quo service provision. These benefits, however, were not accrued by the poorest 20%, but rather by the other quintiles. PBF combined with equity measures did not produce better or more equitable results than standard PBF, with specific differences only on selected outcomes. CONCLUSION: Our findings challenge the notion that implementing equity measures alongside PBF is sufficient to produce an equitable distribution in program benefits and point at the need to identify more innovative and contextsensitive measures to ensure adequate access to care for the poorest. Our findings also highlight the importance of considering changing policy environments and the need to assess interferences across policies.

Impact of Performance-Based Financing on effective coverage for curative child health services in Burkina Faso: Evidence from a quasi-experimental design.

OBJECTIVE: To evaluate the impact of Performance-Based Financing (PBF) on effective coverage of child curative health services in primary healthcare facilities in Burkina Faso. METHODS: An impact evaluation of a PBF pilot programme, using an experiment nested within a quasi-experimental design, was carried out in 12 intervention and 12 comparison districts in six regions of Burkina Faso. Across the 24 districts, primary healthcare facilities (537 both at baseline and endline) and households (baseline = 7978 endline = 7898) were surveyed. Within these households, 12 350 and 15 021 under-five-year-olds caretakers were interviewed at baseline and endline respectively. Linking service quality to service utilisation, we used difference-in-differences to estimate the impact of PBF on effective coverage of curative child health services. RESULTS: Our study failed to detect any effect of PBF on effective coverage. Looking specifically into quality of care indicators, we detected a positive effect of PBF on structural elements of quality of care related to general service readiness, but not on the overall facility quality score, capturing both service readiness and the content of childcare. CONCLUSION: The current study makes a unique contribution to PBF literature, as this is the first study assessing PBF impact on effective coverage for curative child health services in low-income settings. The absence of any significant effects of PBF on effective coverage suggests that PBF programmes require a stronger design focus on quality of care elements especially when implemented in a context of free healthcare policy.

What happens when performance-based financing meets free healthcare? Evidence from an interrupted time-series analysis.

In spite of the wide attention performance-based financing (PBF) has received over the past decade, no evidence is available on its impacts on quantity and mix of service provision nor on its interaction with parallel health financing interventions. Our study aimed to examine the PBF impact on quantity and mix of service provision in Burkina Faso, while accounting for the parallel introduction of a free healthcare policy. We used Health Management Information System data from 838 primary-level health facilities across 24 districts and relied on an interrupted time-series analysis with independent controls. We placed two interruptions, one to account for PBF and one to account for the free healthcare policy. In the period before the free healthcare policy, PBF produced significant but modest increases across a wide range of maternal and child services, but a significant decrease in child immunization coverage. In the period after the introduction of the free healthcare policy, PBF did not affect service provision in intervention compared with control facilities, possibly indicating a saturation effect. Our findings indicate that PBF can produce modest increases in service provision, without altering the overall service mix. Our findings, however, also indicate that the introduction of other health financing reforms can quickly crowd out the effects produced by PBF. Further qualitative research is required to understand what factors allow healthcare providers to increase the provision of some, but not all services and how they react to the joint implementation of PBF and free health care.

Correction to: Responding to policy makers' evaluation needs: combining experimental and quasi-experimental approaches to estimate the impact of performance based financing in Burkina Faso.

Due to an error introduced during copyediting of this article [1], there are two corrections about the Figs. 1. The caption of Fig. 1 should be changed to "Study design". 2. The Fig. 2 is missing.

Responding to policy makers' evaluation needs: combining experimental and quasi-experimental approaches to estimate the impact of performance based financing in Burkina Faso.

BACKGROUND: The last two decades have seen a growing recognition of the need to expand the impact evaluation toolbox from an exclusive focus on randomized controlled trials to including quasi-experimental approaches. This appears to be particularly relevant when evaluation complex health interventions embedded in real-life settings often characterized by multiple research interests, limited researcher control, concurrently implemented policies and interventions, and other internal validity-threatening circumstances. To date, however, most studies described in the literature have employed either an exclusive experimental or an exclusive quasi-experimental approach. METHODS: This paper presents the case of a study design exploiting the respective advantages of both approaches by combining experimental and quasi-experimental elements to evaluate the impact of a Performance-Based Financing (PBF) intervention in Burkina Faso. Specifically, the study employed a quasi-experimental design (pretest-posttest with comparison) with a nested experimental component (randomized controlled trial). A difference-in-differences approach was used as the main analytical strategy. DISCUSSION: We aim to illustrate a way to reconcile scientific and pragmatic concerns to generate policy-relevant evidence on the intervention's impact, which is methodologically rigorous in its identification strategy but also considerate of the context within which the intervention took place. In particular, we highlight how we formulated our research questions, ultimately leading our design choices, on the basis of the knowledge needs expressed by the policy and implementing stakeholders. We discuss methodological weaknesses of the design arising from contextual constraints and the accommodation of various interests, and how we worked ex-post to address them to the best extent possible to ensure maximal accuracy and credibility of our findings. We hope that our case may be inspirational for other researchers wishing to undertake research in settings where field circumstances do not appear to be ideal for an impact evaluation. TRIAL REGISTRATION: Registered with RIDIE (RIDIE-STUDY-ID- 54412a964bce8 ) on 10/17/2014.