Countdown to 2015: a decade of tracking progress for maternal, newborn, and child survival.

Conceived in 2003 and born in 2005 with the launch of its first report and country profiles, the Countdown to 2015 for Maternal, Newborn, and Child Survival has reached its originally proposed lifespan. Major reductions in the deaths of mothers and children have occurred since Countdown's inception, even though most of the 75 priority countries failed to achieve Millennium Development Goals 4 and 5. The coverage of life-saving interventions tracked in Countdown increased steadily over time, but wide inequalities persist between and within countries. Key drivers of coverage such as financing, human resources, commodities, and conducive health policies also showed important, yet insufficient increases. As a multistakeholder initiative of more than 40 academic, international, bilateral, and civil society institutions, Countdown was successful in monitoring progress and raising the visibility of the health of mothers, newborns, and children. Lessons learned from this initiative have direct bearing on monitoring progress during the Sustainable Development Goals era.

A qualitative exploration of care-seeking pathways for sick children in the rural Oromia region of Ethiopia.

BACKGROUND: Ethiopia has experienced rapid improvements in its healthcare infrastructure, such as through the recent scale up of integrated community case management (iCCM) delivered by community-based health extension workers (HEWs) targeting children under the age of five. Despite notable improvements in child outcomes, the use of HEWs delivering iCCM remains very low. The aim of our study was to explain this phenomenon by examining care-seeking practices and treatment for sick children in two rural districts in the Oromia Region of Ethiopia. METHODS: Using qualitative methods, we explored perceptions of child illness, influences on decision-making processes occurring over the course of a child's illness and caregiver perceptions of available community-based sources of child illness care. Sixteen focus group discussions (FGDs) and 40 in-depth interviews (IDIs) were held with mothers of children under age five. For additional perspective, 16 IDIs were conducted fathers and 22 IDIs with health extension workers and community health volunteers. RESULTS: Caregivers often described the act of care-seeking for a sick child as a time of considerable uncertainty. In particular, mothers of sick children described the cultural, social and community-based resources available to minimize this uncertainty as well as constraints and strategies for accessing these resources in order to receive treatment for a sick child. The level of trust and familiarity were the most common dynamics noted as influencing care-seeking strategies; trust in biomedical and government providers was often low. CONCLUSIONS: Overall, our research highlights the multiple and dynamic influences on care-seeking for sick children in rural Ethiopia. An understanding of these influences is critical for the success of existing and future health interventions and continued improvement of child health in Ethiopia.

Countdown to 2015 and beyond: fulfilling the health agenda for women and children.

The end of 2015 will signal the end of the Millennium Development Goal era, when the world can take stock of what has been achieved. The Countdown to 2015 for Maternal, Newborn, and Child Survival (Countdown) has focused its 2014 report on how much has been achieved in intervention coverage in these groups, and on how best to sustain, focus, and intensify efforts to progress for this and future generations. Our 2014 results show unfinished business in achievement of high, sustained, and equitable coverage of essential interventions. Progress has accelerated in the past decade in most Countdown countries, suggesting that further gains are possible with intensified actions. Some of the greatest coverage gaps are in family planning, interventions addressing newborn mortality, and case management of childhood diseases. Although inequities are pervasive, country successes in reaching of the poorest populations provide lessons for other countries to follow. As we transition to the next set of global goals, we must remember the centrality of data to accountability, and the importance of support of country capacity to collect and use high-quality data on intervention coverage and inequities for decision making. To fulfill the health agenda for women and children both now and beyond 2015 requires continued monitoring of country and global progress; Countdown is committed to playing its part in this effort.

Diarrhea management in children under five in sub-Saharan Africa: does the source of care matter? A Countdown analysis.

BACKGROUND: Diarrhea remains a high burden disease, responsible for nine percent of deaths in children under five globally. We analyzed diarrhea management practices in young children and their association with the source of care. METHODS: We used Demographic and Health Survey data from 12 countries in sub-Saharan Africa with high burdens of childhood diarrhea. We classified the quality of diarrhea management practices as good, fair, or poor based on mothers' reports for children with diarrhea, using WHO/UNICEF recommendations for appropriate treatment. We described the prevalence of diarrhea management by type and assessed the association between good management and source of care, adjusting for potential confounders. RESULTS: Prevalence of good diarrhea management is low in 11 of the 12 analyzed surveys, varying from 17 % in Cote d'Ivoire to 38 % in Niger. The exception is Sierra Leone, where prevalence of good practice is 67 %. Prevalence of good management was low even among children taken to health facilities [median 52 %, range: 34-64 %]. Diarrhea careseeking from health facilities or community providers was associated with higher odds of good management than care from traditional/informal sources or no care. Careseeking from facilities did not result systematically in a higher likelihood of good diarrhea management than care from community providers. The odds of good diarrhea management were similar for community versus facility providers in six countries, higher in community than facility providers in two countries, and higher in facility than in community providers in four countries. CONCLUSION: Many children's lives can be saved with correct management of childhood diarrhea. Too many children are not receiving adequate care for diarrhea in high-burden sub-Saharan African countries, even among those seen in health facilities. Redoubling efforts to increase careseeking and improve quality of care for childhood diarrhea in both health facilities and at community level is an urgent priority.

Harmful practices in the management of childhood diarrhea in low- and middle-income countries: a systematic review.

BACKGROUND: Harmful practices in the management of childhood diarrhea are associated with negative health outcomes, and conflict with WHO treatment guidelines. These practices include restriction of fluids, breast milk and/or food intake during diarrhea episodes, and incorrect use of modern medicines. We conducted a systematic review of English-language literature published since 1990 to assess the documented prevalence of these four harmful practices, and beliefs, motivations, and contextual factors associated with harmful practices in low- and middle-income countries. METHODS: We electronically searched PubMed, Embase, Ovid Global Health, and the WHO Global Health Library. Publications reporting the prevalence or substantive findings on beliefs, motivations, or context related to at least one of the four harmful practices were included, regardless of study design or representativeness of the sample population. RESULTS: Of the 114 articles included in the review, 79 reported the prevalence of at least one harmful practice and 35 studies reported on beliefs, motivations, or context for harmful practices. Most studies relied on sub-national population samples and many were limited to small sample sizes. Study design, study population, and definition of harmful practices varied across studies. Reported prevalence of harmful practices varied greatly across study populations, and we were unable to identify clearly defined patterns across regions, countries, or time periods. Caregivers reported that diarrhea management practices were based on the advice of others (health workers, relatives, community members), as well as their own observations or understanding of the efficacy of certain treatments for diarrhea. Others reported following traditionally held beliefs on the causes and cures for specific diarrheal diseases. CONCLUSIONS: Available evidence suggests that harmful practices in diarrhea treatment are common in some countries with a high burden of diarrhea-related mortality. These practices can reduce correct management of diarrheal disease in children and result in treatment failure, sustained nutritional deficits, and increased diarrhea mortality. The lack of consistency in sampling, measurement, and reporting identified in this literature review highlights the need to document harmful practices using standard methods of measurement and reporting for the continued reduction of diarrhea mortality.

Fluid curtailment during childhood diarrhea: a countdown analysis.

BACKGROUND: The foundation of recommended diarrhea management in young children is increased fluids and continued feeding. This increase in fluids is necessary to replace those lost during diarrhea and ultimately prevent dehydration. There may be an opportunity to prevent deaths in children under five by discouraging the practice of reducing or curtailing fluids during diarrhea episodes across different settings worldwide. METHODS: We quantify and describe the extent of fluid curtailment in children with diarrhea in a selection of countries (Burkina Faso, Democratic Republic of Congo, Ethiopia, Nigeria, Tanzania, and Uganda) with high burden of diarrhea-related mortality with national cross sectional survey data. We examine the practice of fluid curtailment in these countries and its relationship to child and household traits and to characteristics of diarrhea management. RESULTS: The prevalence of fluid curtailment among children under five with diarrhea is strikingly high in these countries: 55 % in Nigeria, 49 % in Ethiopia, 44 % in Uganda, 37 % in Tanzania, 36 % in DR Congo and 32 % in Burkina Faso. Fluid curtailment is associated with giving less food, potentially worsening the impact of this harmful practice. Children who were reported to have had fluids curtailed during diarrhea episodes were also 3.51 (95 % confidence, 2.66 - 4.64) times more likely to be reported to have food withheld (α = 0.05; p < 0.001). Children who received care from non-governmental providers, and those who were breastfed were more likely to have their fluids curtailed, as were children with an unimproved water source. Children of poorer or less educated mothers and those living in rural areas are more likely to have curtailed fluids, compared to children of less poor or more educated mothers, or those living in urban areas. CONCLUSIONS: The harmful practice of curtailing fluids for a child with diarrhea is highly prevalent, representing an increased risk of dehydration and complications due to diarrhea, including death, especially for children in specific subgroups.

Patterns in coverage of maternal, newborn, and child health interventions: projections of neonatal and under-5 mortality to 2035.

BACKGROUND: Urgent calls have been made for improved understanding of changes in coverage of maternal, newborn, and child health interventions, and their country-level determinants. We examined historical trends in coverage of interventions with proven effectiveness, and used them to project rates of child and neonatal mortality in 2035 in 74 Countdown to 2015 priority countries. METHODS: We investigated coverage of all interventions for which evidence was available to suggest effective reductions in maternal and child mortality, for which indicators have been defined, and data have been obtained through household surveys. We reanalysed coverage data from 312 nationally-representative household surveys done between 1990 and 2011 in 69 countries, including 58 Countdown countries. We developed logistic Loess regression models for patterns of coverage change for each intervention, and used k-means cluster analysis to divide interventions into three groups with different historical patterns of coverage change. Within each intervention group, we examined performance of each country in achieving coverage gains. We constructed models that included baseline coverage, region, gross domestic product, conflict, and governance to examine country-specific annual percentage coverage change for each group of indicators. We used the Lives Saved Tool (LiST) to predict mortality rates of children younger than 5 years (henceforth, under 5) and in the neonatal period in 2035 for Countdown countries if trends in coverage continue unchanged (historical trends scenario) and if each country accelerates intervention coverage to the highest level achieved by a Countdown country with similar baseline coverage level (best performer scenario). RESULTS: Odds of coverage of three interventions (antimalarial treatment, skilled attendant at birth, and use of improved sanitation facilities) have decreased since 1990, with a mean annual decrease of 5·5% (SD 2·7%). Odds of coverage of four interventions--all related to the prevention of malaria--have increased rapidly, with a mean annual increase of 27·9% (7·3%). Odds of coverage of other interventions have slowly increased, with a mean annual increase of 5·3% (3·5%). Rates of coverage change varied widely across countries; we could not explain the differences by measures of gross domestic product, conflict, or governance. On the basis of LiST projections, we predicted that the number of Countdown countries with an under-5 mortality rate of fewer than 20 deaths per 1000 livebirths per year would increase from four (5%) of the 74 in 2010, to nine (12%) by 2035 under the historical trends scenario, and to 15 (20%) under the best performer scenario. The number of countries with neonatal mortality rates of fewer than 11 per 1000 livebirths per year would increase from three (4%) in 2010, to ten (14%) by 2035 under the historical trends scenario, and 67 (91%) under the best performer scenario. The number of under-5 deaths per year would decrease from an estimated 7·6 million in 2010, to 5·4 million (28% decrease) if historical trends continue, and to 2·3 million (71% decrease) under the best performer scenario. INTERPRETATION: Substantial reductions in child deaths are possible, but only if intensified efforts to achieve intervention coverage are implemented successfully within each of the Countdown countries. FUNDING: The Bill & Melinda Gates Foundation.

The unfinished agenda in child survival.

10 years ago, The Lancet published a Series about child survival. In this Review, we examine progress in the past decade in child survival, with a focus on epidemiology, interventions and intervention coverage, strategies of health programmes, equity, evidence, accountability, and global leadership. Knowledge of child health epidemiology has greatly increased, and although more and better interventions are available, they still do not reach large numbers of mothers and children. Child survival should remain at the heart of global goals in the post-2015 era. Many countries are now making good progress and need the time and support required to finish the task. The global health community should show its steadfast commitment to child survival by amassing knowledge and experience as a basis for ever more effective programmes. Leadership and accountability for child survival should be strengthened and shared among the UN system; governments in high-income, middle-income, and low-income countries; and non-governmental organisations.

Measuring coverage in MNCH: evaluation of community-based treatment of childhood illnesses through household surveys.

Community case management (CCM) is a strategy for training and supporting workers at the community level to provide treatment for the three major childhood diseases--diarrhea, fever (indicative of malaria), and pneumonia--as a complement to facility-based care. Many low- and middle-income countries are now implementing CCM and need to evaluate whether adoption of the strategy is associated with increases in treatment coverage. In this review, we assess the extent to which large-scale, national household surveys can serve as sources of baseline data for evaluating trends in community-based treatment coverage for childhood illnesses. Our examination of the questionnaires used in Demographic and Health Surveys (DHS) and Multiple Indicator Cluster Surveys (MICS) conducted between 2005 and 2010 in five sub-Saharan African countries shows that questions on care seeking that included a locally adapted option for a community-based provider were present in all the DHS surveys and in some MICS surveys. Most of the surveys also assessed whether appropriate treatments were available, but only one survey collected information on the place of treatment for all three illnesses. This absence of baseline data on treatment source in household surveys will limit efforts to evaluate the effects of the introduction of CCM strategies in the study countries. We recommend alternative analysis plans for assessing CCM programs using household survey data that depend on baseline data availability and on the timing of CCM policy implementation.

Measuring coverage in MNCH: challenges and opportunities in the selection of coverage indicators for global monitoring.

Global monitoring of intervention coverage is a cornerstone of international efforts to improve reproductive, maternal, newborn, and child health. In this review, we examine the process and implications of selecting a core set of coverage indicators for global monitoring, using as examples the processes used by the Countdown to 2015 for Maternal, Newborn and Child Survival and the Commission on Accountability for Women's and Children's Health. We describe how the generation of data for global monitoring involves five iterative steps: development of standard indicator definitions and measurement approaches to ensure comparability across countries; collection of high-quality data at the country level; compilation of country data at the global level; organization of global databases; and rounds of data quality checking. Regular and rigorous technical review processes that involve high-level decision makers and experts familiar with indicator measurement are needed to maximize uptake and to ensure that indicators used for global monitoring are selected on the basis of available evidence of intervention effectiveness, feasibility of measurement, and data availability as well as programmatic relevance. Experience from recent initiatives illustrates the challenges of striking this balance as well as strategies for reducing the tensions inherent in the indicator selection process. We conclude that more attention and continued investment need to be directed to global monitoring, to support both the process of global database development and the selection of sets of coverage indicators to promote accountability. The stakes are high, because these indicators can drive policy and program development at the country and global level, and ultimately impact the health of women and children and the communities where they live.

Measuring coverage in MNCH: challenges in monitoring the proportion of young children with pneumonia who receive antibiotic treatment.

Pneumonia remains a major cause of child death globally, and improving antibiotic treatment rates is a key control strategy. Progress in improving the global coverage of antibiotic treatment is monitored through large household surveys such as the Demographic and Health Surveys (DHS) and the Multiple Indicator Cluster Surveys (MICS), which estimate antibiotic treatment rates of pneumonia based on two-week recall of pneumonia by caregivers. However, these survey tools identify children with reported symptoms of pneumonia, and because the prevalence of pneumonia over a two-week period in community settings is low, the majority of these children do not have true pneumonia and so do not provide an accurate denominator of pneumonia cases for monitoring antibiotic treatment rates. In this review, we show that the performance of survey tools could be improved by increasing the survey recall period or by improving either overall discriminative power or specificity. However, even at a test specificity of 95% (and a test sensitivity of 80%), the proportion of children with reported symptoms of pneumonia who truly have pneumonia is only 22% (the positive predictive value of the survey tool). Thus, although DHS and MICS survey data on rates of care seeking for children with reported symptoms of pneumonia and other childhood illnesses remain valid and important, DHS and MICS data are not able to give valid estimates of antibiotic treatment rates in children with pneumonia.

Measuring coverage in MNCH: new findings, new strategies, and recommendations for action.

Considerable progress has been made in reducing maternal, newborn, and child mortality worldwide, but many more deaths could be prevented if effective interventions were available to all who could benefit from them. Timely, high-quality measurements of intervention coverage--the proportion of a population in need of a health intervention that actually receives it--are essential to support sound decisions about progress and investments in women's and children's health. The PLOS Medicine "Measuring Coverage in MNCH" Collection of research studies and reviews presents systematic assessments of the validity of health intervention coverage measurement based on household surveys, the primary method for estimating population-level intervention coverage in low- and middle-income countries. In this overview of the Collection, we discuss how and why some of the indicators now being used to track intervention coverage may not provide fully reliable coverage measurements, and how a better understanding of the systematic and random error inherent in these coverage indicators can help in their interpretation and use. We draw together strategies proposed across the Collection for improving coverage measurement, and recommend continued support for high-quality household surveys at national and sub-national levels, supplemented by surveys with lighter tools that can be implemented every 1-2 years and by complementary health-facility-based assessments of service quality. Finally, we stress the importance of learning more about coverage measurement to strengthen the foundation for assessing and improving the progress of maternal, newborn, and child health programs.

Measuring coverage in MNCH: a prospective validation study in Pakistan and Bangladesh on measuring correct treatment of childhood pneumonia.

BACKGROUND: Antibiotic treatment for pneumonia as measured by Demographic and Health Surveys (DHS) and Multiple Indicator Cluster Surveys (MICS) is a key indicator for tracking progress in achieving Millennium Development Goal 4. Concerns about the validity of this indicator led us to perform an evaluation in urban and rural settings in Pakistan and Bangladesh. METHODS AND FINDINGS: Caregivers of 950 children under 5 y with pneumonia and 980 with "no pneumonia" were identified in urban and rural settings and allocated for DHS/MICS questions 2 or 4 wk later. Study physicians assigned a diagnosis of pneumonia as reference standard; the predictive ability of DHS/MICS questions and additional measurement tools to identify pneumonia versus non-pneumonia cases was evaluated. Results at both sites showed suboptimal discriminative power, with no difference between 2- or 4-wk recall. Individual patterns of sensitivity and specificity varied substantially across study sites (sensitivity 66.9% and 45.5%, and specificity 68.8% and 69.5%, for DHS in Pakistan and Bangladesh, respectively). Prescribed antibiotics for pneumonia were correctly recalled by about two-thirds of caregivers using DHS questions, increasing to 72% and 82% in Pakistan and Bangladesh, respectively, using a drug chart and detailed enquiry. CONCLUSIONS: Monitoring antibiotic treatment of pneumonia is essential for national and global programs. Current (DHS/MICS questions) and proposed new (video and pneumonia score) methods of identifying pneumonia based on maternal recall discriminate poorly between pneumonia and children with cough. Furthermore, these methods have a low yield to identify children who have true pneumonia. Reported antibiotic treatment rates among these children are therefore not a valid proxy indicator of pneumonia treatment rates. These results have important implications for program monitoring and suggest that data in its current format from DHS/MICS surveys should not be used for the purpose of monitoring antibiotic treatment rates in children with pneumonia at the present time.

Equity in maternal, newborn, and child health interventions in Countdown to 2015: a retrospective review of survey data from 54 countries.

BACKGROUND: Countdown to 2015 tracks progress towards achievement of Millennium Development Goals (MDGs) 4 and 5, with particular emphasis on within-country inequalities. We assessed how inequalities in maternal, newborn, and child health interventions vary by intervention and country. METHODS: We reanalysed data for 12 maternal, newborn, and child health interventions from national surveys done in 54 Countdown countries between Jan 1, 2000, and Dec 31, 2008. We calculated coverage indicators for interventions according to standard definitions, and stratified them by wealth quintiles on the basis of asset indices. We assessed inequalities with two summary indices for absolute inequality and two for relative inequality. FINDINGS: Skilled birth attendant coverage was the least equitable intervention, according to all four summary indices, followed by four or more antenatal care visits. The most equitable intervention was early initation of breastfeeding. Chad, Nigeria, Somalia, Ethiopia, Laos, and Niger were the most inequitable countries for the interventions examined, followed by Madagascar, Pakistan, and India. The most equitable countries were Uzbekistan and Kyrgyzstan. Community-based interventions were more equally distributed than those delivered in health facilities. For all interventions, variability in coverage between countries was larger for the poorest than for the richest individuals. INTERPRETATION: We noted substantial variations in coverage levels between interventions and countries. The most inequitable interventions should receive attention to ensure that all social groups are reached. Interventions delivered in health facilities need specific strategies to enable the countries' poorest individuals to be reached. The most inequitable countries need additional efforts to reduce the gap between the poorest individuals and those who are more affluent. FUNDING: Bill & Melinda Gates Foundation, Norad, The World Bank.

Millennium Development Goals 4 and 5: progress and challenges.

The Millennium Development Goals have galvanized efforts to improve child survival (MDG-4) and maternal health (MDG-5). There has been important progress on both MDGs at global level, although it now appears that few countries will reach them by the target date of 2015. There are known and efficacious interventions to address most of the major causes of these deaths, but important gaps remain. The biggest challenge is to ensure that all women and children have access to life-saving interventions. Current levels of intervention coverage are too low, representing missed opportunities. Providing services at the community level is an important emerging priority, but preventing maternal and neonatal deaths also requires access to health facilities. Readers of the Medicine for Global Health collection in BMC Medicine are urged to make maternal and child health one of their key concerns, even if they work on other topics.

Monitoring child survival in 'real time' using routine health facility records: results from Malawi.

OBJECTIVES: Few developing countries have the accurate civil registration systems needed to track progress in child survival. However, the health information systems in most of these countries do record facility births and deaths, at least in principle. We used data from two districts of Malawi to test a method for monitoring child mortality based on adjusting health facility records for incomplete coverage. METHODS: Trained researchers collected reports of monthly births and deaths among children younger than 5 years from all health facilities in Balaka and Salima districts of Malawi in 2010-2011. We estimated the proportion of births and deaths occurring in health facilities, respectively, from the 2010 Demographic and Health Survey and a household mortality survey conducted between October 2011 and February 2012. We used these proportions to adjust the health facility data to estimate the actual numbers of births and deaths. The survey also provided 'gold-standard' measures of under-five mortality. RESULTS: Annual under-five mortality rates generated by adjusting health facility data were between 35% and 65% of those estimated by the gold-standard survey in Balaka, and 46% and 50% in Salima for four overlapping 12-month periods in 2010-2011. The ratios of adjusted health facility rates to gold-standard rates increased sharply over the four periods in Balaka, but remained relatively stable in Salima. CONCLUSIONS: Even in Malawi, where high proportions of births and deaths occur in health facilities compared with other countries in sub-Saharan Africa, routine Health Management Information Systems data on births and deaths cannot be used at present to estimate annual trends in under-five mortality.

Using LiST to model potential reduction in under-five mortality in Burkina Faso.

BACKGROUND: Under-five mortality remains high in Burkina Faso with significant reductions required to meet Millennium Development Goal 4. The Acceleration for Maternal, Newborn, and Child Health is being implemented to reduce child mortality in the North and Center North regions of Burkina Faso. METHODS: The Lives Saved Tool was used to determine the percent reduction in child mortality that can be achieved given baseline levels of coverage for interventions targeted by the Acceleration. Data were obtained from the Demographic and Health Survey 2003, the Multiple Indicator Cluster Survey 2006, and the baseline survey for the program from 2010. In addition to the scale up, scenarios were generated to examine the outcome if secular trends in intervention coverage change persisted and if intervention coverage levels remained constant. RESULTS: Scaling up all interventions to their target coverage level showed a potential reduction in under-five mortality of 22 percent, with district specific reductions in mortality ranging from 14 to 25 percent. The percent reduction in under-five mortality that might be attributable to the program was 16 percent and varied between 14 and 19 percent by district. Treatment of diarrhea with ORS and malaria with ACTs accounted for the majority of the reduction in mortality. CONCLUSIONS: These findings suggest that significant reductions in under-five mortality may be achieved through the scale-up of the Acceleration. The Ministry of Health and its partners in Burkina Faso should continue their efforts to scale up these proven interventions to achieve and even exceed target levels for coverage.

A common evaluation framework for the African Health Initiative.

BACKGROUND: The African Health Initiative includes highly diverse partnerships in five countries (Ghana, Mozambique, Rwanda, Tanzania, and Zambia), each of which is working to improve population health by strengthening health systems and to evaluate the results. One aim of the Initiative is to generate cross-site learning that can inform implementation in the five partnerships during the project period and identify lessons that may be generalizable to other countries in the region. Collaborators in the Initiative developed a common evaluation framework as a basis for this cross-site learning. METHODS: This paper describes the components of the framework; this includes the conceptual model, core metrics to be measured in all sites, and standard guidelines for reporting on the implementation of partnership activities and contextual factors that may affect implementation, or the results it produces. We also describe the systems that have been put in place for data management, data quality assessments, and cross-site analysis of results. RESULTS AND CONCLUSIONS: The conceptual model for the Initiative highlights points in the causal chain between health system strengthening activities and health impact where evidence produced by the partnerships can contribute to learning. This model represents an important advance over its predecessors by including contextual factors and implementation strength as potential determinants, and explicitly including equity as a component of both outcomes and impact. Specific measurement challenges include the prospective documentation of program implementation and contextual factors. Methodological issues addressed in the development of the framework include the aggregation of data collected using different methods and the challenge of evaluating a complex set of interventions being improved over time based on continuous monitoring and intermediate results.

Health systems supports for community case management of childhood illness: lessons from an assessment of early implementation in Malawi.

BACKGROUND: National community-based health worker (CBHW) programs often face challenges in ensuring that these remote workers are adequately trained, equipped and supervised. As governments increasingly deploy CBHWs to improve access to primary health care, there is an urgent need to assess how well health systems are supporting CBHWs to provide high quality care. METHODS: This paper presents the results of a mixed-methods assessment of selected health systems supports (supervision, drug supply, and job aids) for a national community case management (CCM) program for childhood illness in Malawi during the first year of implementation. We collected data on the types and levels of drug supply and supervision through a cross-sectional survey of a random sample of Health Surveillance Assistants (HSAs) providing CCM services in six districts. We then conducted in-depth interviews and focus group discussions with program managers and HSAs, respectively, to gain an understanding of the barriers and facilitating factors for delivering health systems supports for CCM. RESULTS: Although the CCM training and job aid were well received by stakeholders, HSAs who participated in the first CCM training sessions often waited up to 4 months before receiving their initial supply of drugs and first supervision visits. One year after training began, 69% of HSAs had all essential CCM drugs in stock and only 38% of HSAs reported a CCM supervision visit in the 3 months prior to the survey. Results of the qualitative assessment indicated that drug supply was constrained by travel distance and stock outs at health facilities, and that the initial supervision system relied on clinicians who were able to spend only limited time away from clinical duties. Proactive district managers trained and enrolled HSAs' routine supervisors to provide CCM supervision. CONCLUSIONS: Malawi's CCM program is promising, but health systems supports must be improved to ensure consistent coverage and quality. Mixed-methods implementation research provided the Ministry of Health with actionable feedback that it is using to adapt program policies and improve performance.

Measuring impact in the Millennium Development Goal era and beyond: a new approach to large-scale effectiveness evaluations.

Evaluation of large-scale programmes and initiatives aimed at improvement of health in countries of low and middle income needs a new approach. Traditional designs, which compare areas with and without a given programme, are no longer relevant at a time when many programmes are being scaled up in virtually every district in the world. We propose an evolution in evaluation design, a national platform approach that: uses the district as the unit of design and analysis; is based on continuous monitoring of different levels of indicators; gathers additional data before, during, and after the period to be assessed by multiple methods; uses several analytical techniques to deal with various data gaps and biases; and includes interim and summative evaluation analyses. This new approach will promote country ownership, transparency, and donor coordination while providing a rigorous comparison of the cost-effectiveness of different scale-up approaches.