Monitoring and evaluation of disaster response efforts undertaken by local health departments: a rapid realist review.

BACKGROUND: Local health departments are often at the forefront of a disaster response, attending to the immediate trauma inflicted by the disaster and also the long term health consequences. As the frequency and severity of disasters are projected to rise, monitoring and evaluation (M&E) efforts are critical to help local health departments consolidate past experiences and improve future response efforts. Local health departments often conduct M&E work post disaster, however, many of these efforts fail to improve response procedures. METHODS: We undertook a rapid realist review (RRR) to examine why M&E efforts undertaken by local health departments do not always result in improved disaster response efforts. We aimed to complement existing frameworks by focusing on the most basic and pragmatic steps of a M&E cycle targeted towards continuous system improvements. For these purposes, we developed a theoretical framework that draws on the quality improvement literature to 'frame' the steps in the M&E cycle. This framework encompassed a M&E cycle involving three stages (i.e., document and assess, disseminate and implement) that must be sequentially completed to learn from past experiences and improve future disaster response efforts. We used this framework to guide our examination of the literature and to identify any context-mechanism-outcome (CMO) configurations which describe how M&E may be constrained or enabled at each stage of the M&E cycle. RESULTS: This RRR found a number of explanatory CMO configurations that provide valuable insights into some of the considerations that should be made when using M&E to improve future disaster response efforts. Firstly, to support the accurate documentation and assessment of a disaster response, local health departments should consider how they can: establish a culture of learning within health departments; use embedded training methods; or facilitate external partnerships. Secondly, to enhance the widespread dissemination of lessons learned and facilitate inter-agency learning, evaluation reports should use standardised formats and terminology. Lastly, to increase commitment to improvement processes, local health department leaders should possess positive leadership attributes and encourage shared decision making. CONCLUSION: This study is among the first to conduct a synthesis of the CMO configurations which facilitate or hinder M&E efforts aimed at improving future disaster responses. It makes a significant contribution to the disaster literature and provides an evidence base that can be used to provide pragmatic guidance for improving M&E efforts of local health departments. TRIAL REGISTRATION: PROSPERO 2015: CRD42015023526 .

Utilisation of health services and the poor: deconstructing wealth-based differences in facility-based delivery in the Philippines.

BACKGROUND: Despite achieving some success, wealth-related disparities in the utilisation of maternal and child health services persist in the Philippines. The aim of this study is to decompose the principal factors driving the wealth-based utilisation gap. METHODS: Using national representative data from the 2013 Philippines Demographic and Health Survey, we examine the extent overall differences in the utilisation of maternal health services can be explained by observable factors. We apply nonlinear Blinder-Oaxaca-type decomposition methods to quantify the effect of differences in measurable characteristics on the wealth-based coverage gap in facility-based delivery. RESULTS: The mean coverage of facility-based deliveries was respectively 41.1 % and 74.6 % for poor and non-poor households. Between 67 and 69 % of the wealth-based coverage gap was explained by differences in observed characteristics. After controlling for factors characterising the socioeconomic status of the household (i.e. the mothers' and her partners' education and occupation), the birth order of the child was the major factor contributing to the disparity. Mothers' religion and the subjective distance to the health facility were also noteworthy. CONCLUSIONS: This study has found moderate wealth-based disparities in the utilisation of institutional delivery in the Philippines. The results confirm the importance of recent efforts made by the Philippine government to implement equitable, pro-poor focused health programs in the most deprived geographic areas of the country. The importance of addressing the social determinants of health, particularly education, as well as developing and implementing effective strategies to encourage institutional delivery for higher order births, should be prioritised.

Accelerating Maternal and Child Health Gains in Papua New Guinea: Modelled Predictions from Closing the Equity Gap Using LiST.

BACKGROUND: Many priority countries in the countdown to the millennium development goals deadline are lagging in progress towards maternal and child health (MCH) targets. Papua New Guinea (PNG) is one such country beset by challenges of geographical inaccessibility, inequity and health system weakness. Several countries, however, have made progress through focused initiatives which align with the burden of disease and overcome specific inequities. This study identifies the potential impact on maternal and child mortality through increased coverage of prioritised interventions within the PNG health system. METHODS: The burden of disease and health system environment of PNG was documented to inform prioritised MCH interventions at community, outreach, and clinical levels. Potential reductions in maternal and child mortality through increased intervention coverage to close the geographical equity gap were estimated with the lives saved tool. RESULTS: A set community-level interventions, with highest feasibility, would yield significant reductions in newborn and child mortality. Adding the outreach group delivers gains for maternal mortality, particularly through family planning. The clinical services group of interventions demands greater investment but are essential to reach MCH targets. Cumulatively, the increased coverage is estimated to reduce the rates of under-five mortality by 19 %, neonatal mortality by 26 %, maternal mortality ratio by 10 % and maternal mortality by 33 %. CONCLUSIONS: Modest investments in health systems focused on disadvantaged populations can accelerate progress in maternal and child survival even in fragile health systems like PNG. The critical approach may be to target interventions and implementation appropriately to the sensitive context of lagging countries.

Neonatal Mortality and Inequalities in Bangladesh: Differential Progress and Sub-national Developments.

A rapid reduction in under-five mortality has put Bangladesh on-track to reach Millennium Development Goal 4. Little research, however, has been conducted into neonatal reductions and sub-national rates in the country, with considerable disparities potentially masked by national reductions. The aim of this paper is to estimate national and sub-national rates of neonatal mortality to compute relative and absolute inequalities between sub-national groups and draw comparisons with rates of under-five mortality. Mortality rates for under-five children and neonates were estimated directly for 1980-1981 to 2010-2011 using data from six waves of the Demographic and Health Survey. Rates were stratified by levels of rural/urban location, household wealth and maternal education. Absolute and relative inequalities within these groups were measured by rate differences and ratios, and where possible, slope and relative indices of inequality. National mortality was shown to have decreased dramatically although at differential rates for under-fives and neonates. Across all equity markers, a general pattern of declining absolute but constant relative inequalities was found. For mortality rates stratified by education and wealth mixed evidence suggests that relative inequalities may have also fallen. Although disparities remain, Bangladesh has achieved a rare combination of substantive reductions in mortality levels without increases in relative inequalities. A coalescence of substantial increases in coverage and equitable distribution of key child and neonatal interventions with widespread health sectoral and policy changes over the last 30 years may in part explain this exceptional pattern.

Utilisation of health services and geography: deconstructing regional differences in barriers to facility-based delivery in Nepal.

While established that geographical inaccessibility is a key barrier to the utilisation of health services, it remains unknown whether disparities are driven only by limited access to these services, or are also attributable to health behaviour. Significant disparities exist in health outcomes and the coverage of many critical health services between the mountains region of Nepal and the rest of the country, yet the principal factors driving these regional disparities are not well understood. Using national representative data from the 2011 Nepal Demographic and Health Survey, we examine the extent to which observable factors explain the overall differences in the utilisation of maternal health services. We apply nonlinear Blinder-Oaxaca-type decomposition methods to quantify the effect that differences in measurable characteristics have on the regional coverage gap in facility-based delivery. The mean coverage of facility-based deliveries was 18.6 and 36.3 % in the mountains region and the rest of Nepal, respectively. Between 54.8 and 74.1 % of the regional coverage gap was explained by differences in observed characteristics. Factors influencing health behaviours (proxied by mothers' education, TV viewership and tobacco use, and household wealth) and subjective distance to the health facility were the major factors, contributing between 52.9 and 62.5 % of the disparity. Mothers' birth history was also noteworthy. Policies simultaneously addressing access and health behaviours appear necessary to achieve greater coverage and better health outcomes for women and children in isolated areas.

Provider perspectives on the enabling environment required for skilled birth attendance: a qualitative study in western Nepal.

OBJECTIVES: In Nepal, where difficult geography and an under-resourced health system contribute to poor health care access, the government has increased the number of trained skilled birth attendants (SBAs) and posted them in newly constructed birthing centres attached to peripheral health facilities that are available to women 24 h a day. This study describes their views on their enabling environment. METHODS: Qualitative methods included semi-structured interviews with 22 SBAs within Palpa district, a hill district in the Western Region of Nepal; a focus group discussion with ten SBA trainees, and in-depth interviews with five key informants. RESULTS: Participants identified the essential components of an enabling environment as: relevant training; ongoing professional support; adequate infrastructure, equipment and drugs; and timely referral pathways. All SBAs who practised alone felt unable to manage obstetric complications because quality management of life-threatening complications requires the attention of more than one SBA. CONCLUSIONS: Maternal health guidelines should account for the provision of an enabling environment in addition to the deployment of SBAs. In Nepal, referral systems require strengthening, and the policy of posting SBAs alone, in remote clinics, needs to be reconsidered to achieve the goal of reducing maternal deaths through timely management of obstetric complications.

Cost analysis of the development and implementation of a spatial decision support system for malaria elimination in Solomon Islands.

BACKGROUND: The goal of malaria elimination faces numerous challenges. New tools are required to support the scale up of interventions and improve national malaria programme capacity to conduct detailed surveillance. This study investigates the cost factors influencing the development and implementation of a spatial decision support system (SDSS) for malaria elimination in the two elimination provinces of Isabel and Temotu, Solomon Islands. METHOD: Financial and economic costs to develop and implement a SDSS were estimated using the Solomon Islands programme's financial records. Using an ingredients approach, verified by stakeholders and operational reports, total costs for each province were quantified. A budget impact sensitivity analysis was conducted to investigate the influence of variations in standard budgetary components on the costs and to identify potential cost savings. RESULTS: A total investment of US$ 96,046 (2012 constant dollars) was required to develop and implement the SDSS in two provinces (Temotu Province US$ 49,806 and Isabel Province US$ 46,240). The single largest expense category was for computerized equipment totalling approximately US$ 30,085. Geographical reconnaissance was the most expensive phase of development and implementation, accounting for approximately 62% of total costs. Sensitivity analysis identified different cost factors between the provinces. Reduced equipment costs would deliver a budget saving of approximately 10% in Isabel Province. Combined travel costs represented the greatest influence on the total budget in the more remote Temotu Province. CONCLUSION: This study provides the first cost analysis of an operational surveillance tool used specifically for malaria elimination in the South-West Pacific. It is demonstrated that the costs of such a decision support system are driven by specialized equipment and travel expenses. Such factors should be closely scrutinized in future programme budgets to ensure maximum efficiencies are gained and available resources are allocated effectively.

Socioeconomic and geographical disparities in under-five and neonatal mortality in Uttar Pradesh, India.

As a part of the Millennium Development Goals, India seeks to substantially reduce its burden of childhood mortality. The success or failure of this goal may depend on outcomes within India's most populous state, Uttar Pradesh. This study examines the level of disparities in under-five and neonatal mortality across a range of equity markers within the state. Estimates of under-five and neonatal mortality rates were computed using five datasets, from three available sources: sample registration system, summary birth histories in surveys, and complete birth histories. Disparities were evaluated via comparisons of mortality rates by rural-urban location, ethnicity, wealth, and districts. While Uttar Pradesh has experienced declines in both rates of under-five (162-108 per 1,000 live births) and neonatal (76-49 per 1,000 live births) mortality, the rate of decline has been slow (averaging 2 % per annum). Mortality trends in rural and urban areas are showing signs of convergence, largely due to the much slower rate of change in urban areas. While the gap between rich and poor households has decreased in both urban and rural areas, trends suggest that differences in mortality will remain. Caste-related disparities remain high and show no signs of diminishing. Of concern are also the signs of stagnation in mortality amongst groups with greater ability to access services, such as the urban middle class. Notwithstanding the slow but steady reduction of absolute levels of childhood mortality within Uttar Pradesh, the distribution of the mortality by sub-state populations remains unequal. Future progress may require significant investment in quality of care provided to all sections of the community.

Disparities in child mortality trends: what is the evidence from disadvantaged states in India? the case of Orissa and Madhya Pradesh.

INTRODUCTION: The Millennium Development Goals prompted renewed international efforts to reduce under-five mortality and measure national progress. However, scant evidence exists about the distribution of child mortality at low sub-national levels, which in diverse and decentralized countries like India are required to inform policy-making. This study estimates changes in child mortality across a range of markers of inequalities in Orissa and Madhya Pradesh, two of India's largest, poorest, and most disadvantaged states. METHODS: Estimates of under-five and neonatal mortality rates were computed using seven datasets from three available sources--sample registration system, summary birth histories in surveys, and complete birth histories. Inequalities were gauged by comparison of mortality rates within four sub-state populations defined by the following characteristics: rural-urban location, ethnicity, wealth, and district. RESULTS: Trend estimates suggest that progress has been made in mortality rates at the state levels. However, reduction rates have been modest, particularly for neonatal mortality. Different mortality rates are observed across all the equity markers, although there is a pattern of convergence between rural and urban areas, largely due to inadequate progress in urban settings. Inter-district disparities and differences between socioeconomic groups are also evident. CONCLUSIONS: Although child mortality rates continue to decline at the national level, our evidence shows that considerable disparities persist. While progress in reducing under-five and neonatal mortality rates in urban areas appears to be levelling off, policies targeting rural populations and scheduled caste and tribe groups appear to have achieved some success in reducing mortality differentials. The results of this study thus add weight to recent government initiatives targeting these groups. Equitable progress, particularly for neonatal mortality, requires continuing efforts to strengthen health systems and overcome barriers to identify and reach vulnerable groups.

Disparities in child mortality trends in two new states of India.

BACKGROUND: India has the world's highest total number of under-five deaths of any nation. While progress towards Millennium Development Goal 4 has been documented at the state level, little information is available for greater disaggregation of child health markers within states. In 2000, new states were created within the country as a partial response to political pressures. State-level information on child health trends in the new states of Chhattisgarh and Jharkhand is scarce. To fill this gap, this article examines under-five and neonatal mortality across various equity markers within these two new states, pre-and post-split. METHODS: Both direct and indirect estimation using pooled data from five available sources were undertaken. Inter-population disparities were evaluated by mortality data stratification of rural-urban location, ethnicity, wealth and districts. RESULTS: Both states experienced an overall reduction in under-five and neonatal mortality, however, this has stagnated post-2001 and various disparities persist. In cases where disparities have declined, such as between urban-rural populations and low- and high-income groups, this has been driven by modest declines within the disadvantaged groups (i.e. low-income rural households) and stagnation or worsening of outcomes within the advantaged groups. Indeed, rising trends in mortality are most prevalent in urban middle-income households. CONCLUSIONS: The results suggest that rural health improvements may have come at the expense of urban areas, where poor performance may be attributed to factors such as lack of access to quality private health facilities. In addition, the disparities may in part be associated with geographical access, traditional practices and district-level health resource allocation.

Investment case for improving maternal and child health: results from four countries.

BACKGROUND: Without addressing the constraints specific to disadvantaged populations, national health policies such as universal health coverage risk increasing equity gaps. Health system constraints often have the greatest impact on disadvantaged populations, resulting in poor access to quality health services among vulnerable groups. METHODS: The Investment Cases in Indonesia, Nepal, Philippines, and the state of Orissa in India were implemented to support evidence-based sub-national planning and budgeting for equitable scale-up of quality MNCH services. The Investment Case framework combines the basic setup of strategic problem solving with a decision-support model. The analysis and identification of strategies to scale-up priority MNCH interventions is conducted by in-country planners and policymakers with facilitation from local and international research partners. RESULTS: Significant variation in scaling-up constraints, strategies, and associated costs were identified between countries and across urban and rural typologies. Community-based strategies have been considered for rural populations served predominantly by public providers, but this analysis suggests that the scaling-up of maternal, newborn, and child health services requires health system interventions focused on 'getting the basics right'. These include upgrading or building facilities, training and redistribution of staff, better supervision, and strengthening the procurement of essential commodities. Some of these strategies involve substantial early capital expenditure in remote and sparsely populated districts. These supply-side strategies are not only the 'best buys', but also the 'required buys' to ensure the quality of health services as coverage increases. By contrast, such public supply strategies may not be the 'best buys' in densely populated urbanised settings, served by a mix of public and private providers. Instead, robust regulatory and supervisory mechanisms are required to improve the accessibility and quality of services delivered by the private sector. They can lead to important maternal mortality reductions at relatively low costs. CONCLUSIONS: National strategies that do not take into consideration the special circumstances of disadvantaged areas risk disempowering local managers and may lead to a "business-as-usual" acceptance of unreachable goals. To effectively guide health service delivery at a local level, national plans should adopt typologies that reflect the different problems and strategies to scale up key MNCH interventions.

Supporting local planning and budgeting for maternal, neonatal and child health in the Philippines.

BACKGROUND: Responsibility for planning and delivery of health services in the Philippines is devolved to the local government level. Given the recognised need to strengthen capacity for local planning and budgeting, we implemented Investment Cases (IC) for Maternal, Neonatal and Child Health (MNCH) in three selected sub-national units: two poor, rural provinces and one highly-urbanised city. The IC combines structured problem-solving by local policymakers and planners to identify key health system constraints and strategies to scale-up critical MNCH interventions with a decision-support model to estimate the cost and impact of different scaling-up scenarios. METHODS: We outline how the initiative was implemented, the aspects that worked well, and the key limitations identified in the sub-national application of this approach. RESULTS: Local officials found the structured analysis of health system constraints helpful to identify problems and select locally appropriate strategies. In particular the process was an improvement on standard approaches that focused only on supply-side issues. However, the lack of data available at the local level is a major impediment to planning. While the majority of the strategies recommended by the IC were incorporated into the 2011 plans and budgets in the three study sites, one key strategy in the participating city was subsequently reversed in 2012. Higher level systemic issues are likely to have influenced use of evidence in plans and budgets and implementation of strategies. CONCLUSIONS: Efforts should be made to improve locally-representative data through routine information systems for planning and monitoring purposes. Even with sound plans and budgets, evidence is only one factor influencing investments in health. Political considerations at a local level and issues related to decentralisation, influence prioritisation and implementation of plans. In addition to the strengthening of capacity at local level, a parallel process at a higher level of government to relieve fund channelling and coordination issues is critical for any evidence-based planning approach to have a significant impact on health service delivery.

A scoping review of cost benefit analysis in reproductive, maternal, newborn and child health: What we know and what are the gaps?

Growing evidence suggests that early life investments in health are associated with improved human capital and economic outcomes. Various recent global studies have simulated the expected economic returns from alternative packages of interventions in reproductive, maternal, newborn and child health (RMNCH). However, very little is known about the comparability of estimates of the economic returns of RMNCH interventions across studies in low and middle income countries. Our study aims to fill this gap. We performed a comprehensive scoping review of the recent literature (2000-2013) on the economic returns (i.e. benefit-cost ratios) of RMNCH-related interventions, conducted in low and middle income countries. A total of 36 studies were identified. They were read in full and information was abstracted on both the estimates of benefit-cost ratios, the methodological approach and assumptions used. The estimated economic returns fluctuated considerably across settings as the associated costs of disease patterns, social behaviours and health systems varied. Yet, greater sources of variation stemmed from differences in methodology. The observed methodological inconsistencies limit the accuracy and comparability of the estimated returns across various contexts. The reviewed studies suggest that the benefit-cost ratios are favourable in the majority of cases, providing further support to a growing body of economic literature that suggests investments early in life, such as those interventions related to RMNCH, are good investments. Beyond advocacy purposes, for the reviewed literature to be used by policymakers to inform their decisions on investments, a consistent methodological approach should be adopted.

Measuring Quality of Maternal and Newborn Care in Developing Countries Using Demographic and Health Surveys.

BACKGROUND: One of the greatest obstacles facing efforts to address quality of care in low and middle income countries is the absence of relevant and reliable data. This article proposes a methodology for creating a single "Quality Index" (QI) representing quality of maternal and neonatal health care based upon data collected as part of the Demographic and Health Survey (DHS) program. METHODS: Using the 2012 Indonesian Demographic and Health Survey dataset, indicators of quality of care were identified based on the recommended guidelines outlined in the WHO Integrated Management of Pregnancy and Childbirth. Two sets of indicators were created; one set only including indicators available in the standard DHS questionnaire and the other including all indicators identified in the Indonesian dataset. For each indicator set composite indices were created using Principal Components Analysis and a modified form of Equal Weighting. These indices were tested for internal coherence and robustness, as well as their comparability with each other. Finally a single QI was chosen to explore the variation in index scores across a number of known equity markers in Indonesia including wealth, urban rural status and geographical region. RESULTS: The process of creating quality indexes from standard DHS data was proven to be feasible, and initial results from Indonesia indicate particular disparities in the quality of care received by the poor as well as those living in outlying regions. CONCLUSIONS: The QI represents an important step forward in efforts to understand, measure and improve quality of MNCH care in developing countries.

The Impact of Healthcare Insurance on the Utilisation of Facility-Based Delivery for Childbirth in the Philippines.

OBJECTIVES: In recent years, the government of the Philippines embarked upon an ambitious Universal Health Care program, underpinned by the rapid scale-up of subsidized insurance coverage for poor and vulnerable populations. With a view of reducing the stubbornly high maternal mortality rates in the country, the program has a strong focus on maternal health services and is supported by a national policy of universal facility-based delivery (FBD). In this study, we examine the impact that recent reforms expanding health insurance coverage have had on FBD. RESULTS: Data from the most recent Philippines 2013 Demographic Health Survey was employed. This study applies quasi-experimental methods using propensity scores along with alternative matching techniques and weighted regression to control for self-selection and investigate the impact of health insurance on the utilization of FBD. FINDINGS: Our findings reveal that the likelihood of FBD for women who are insured is between 5 to 10 percent higher than for those without insurance. The impact of health insurance is more pronounced amongst rural and poor women for whom insurance leads to a 9 to 11 per cent higher likelihood of FBD. CONCLUSIONS: We conclude that increasing health insurance coverage is likely to be an effective approach to increase women's access to FBD. Our findings suggest that when such coverage is subsidized, as it is the case in the Philippines, women from poor and rural populations are likely to benefit the most.

Let's Take it to the Clouds: The Potential of Educational Innovations, Including Blended Learning, for Capacity Building in Developing Countries.

In modern decentralised health systems, district and local managers are increasingly responsible for financing, managing, and delivering healthcare. However, their lack of adequate skills and competencies are a critical barrier to improved performance of health systems. Given the financial and human resource, constraints of relying on traditional face-to-face training to upskill a large and dispersed number of health managers, governments, and donors must look to exploit advances in the education sector. In recent years, education providers around the world have been experimenting with blended learning; that is, amalgamating traditional face-to-face education with web-based learning to reduce costs and enrol larger numbers of students. Access to improved information and communication technology (ICT) has been the major catalyst for such pedagogical innovations. We argue that with many developing countries already improving their ICT systems, the question is not whether but how to employ technology to facilitate the continuous professional development of district and local health managers in decentralised settings.

Overcoming Stagnation in the Levels and Distribution of Child Mortality: The Case of the Philippines.

BACKGROUND: Health-related within-country inequalities continue to be a matter of great interest and concern to both policy makers and researchers. This study aims to assess the level and the distribution of child mortality outcomes in the Philippines across geographical and socioeconomic indicators. METHODOLOGY: Data on 159,130 children ever borne were analysed from five waves of the Philippine Demographic and Health Survey. Direct estimation was used to construct under-five and neonatal mortality rates for the period 1980-2013. Rate differences and ratios, and where possible, slope and relative indices of inequality were calculated to measure disparities on absolute and relative scales. Stratification was undertaken by levels of rural/urban location, island groups and household wealth. FINDINGS: National under-five and neonatal mortality rates have shown considerable albeit differential reductions since 1980. Recently released data suggests that neonatal mortality has declined following a period of stagnation. Declines in under-five mortality have been accompanied by decreases in wealth and geography-related absolute inequalities. However, relative inequalities for the same markers have remained stable over time. For neonates, mixed evidence suggests that absolute and relative inequalities have remained stable or may have risen. CONCLUSION: In addition to continued reductions in under-five mortality, new data suggests that the Philippines have achieved success in addressing the commonly observed stagnated trend in neonatal mortality. This success has been driven by economic improvement since 2006 as well as efforts to implement a nationwide universal health care campaign. Yet, such patterns, nonetheless, accorded with persistent inequalities, particularly on a relative scale. A continued focus on addressing universal coverage, the influence of decentralisation and armed conflict, and issues along the continuum of care is advocated.