Spatial Clustering in Temporal Trends of Female Genital Mutilation Risk: Leveraging Sparse Data in Ethiopia, Kenya, and Somalia.

Female genital mutilation (FGM) is a harmful practice rooted in gender inequality. Its elimination is part of national and international agendas including the Sustainable Development Goals of the United Nations. Understanding its geographical evolution is crucial for targeted programming. However, due to sparse data, it is challenging to establish international comparability and statistical reliability. Data on FGM is observed at different points in time and periodicity across countries and in contexts with varying age-risk patterns, all of which can be a source of inaccurate and biased estimates. We perform an exemplary analysis, drawing on survival and complex survey analysis in Ethiopia, Kenya, and Somalia. This novel approach addresses measurement challenges specific to FGM data and produces an internationally comparable indicator-the probability of not experiencing FGM by age 20. We pinpoint the onset of statistically significant FGM decline at the subnational level from cohorts born in the 1970s until the 1990s. In the same period, we observe no decline in FGM risk across regions clustered around international borders and increasing subnational inequalities within countries. Our methods thus provide crucial insights into the geographical pattern of temporal trends in FGM risk.

Child mortality estimation: consistency of under-five mortality rate estimates using full birth histories and summary birth histories.

BACKGROUND: Given the lack of complete vital registration data in most developing countries, for many countries it is not possible to accurately estimate under-five mortality rates from vital registration systems. Heavy reliance is often placed on direct and indirect methods for analyzing data collected from birth histories to estimate under-five mortality rates. Yet few systematic comparisons of these methods have been undertaken. This paper investigates whether analysts should use both direct and indirect estimates from full birth histories, and under what circumstances indirect estimates derived from summary birth histories should be used. METHODS AND FINDINGS: Usings Demographic and Health Surveys data from West Africa, East Africa, Latin America, and South/Southeast Asia, I quantify the differences between direct and indirect estimates of under-five mortality rates, analyze data quality issues, note the relative effects of these issues, and test whether these issues explain the observed differences. I find that indirect estimates are generally consistent with direct estimates, after adjustment for fertility change and birth transference, but don't add substantial additional insight beyond direct estimates. However, choice of direct or indirect method was found to be important in terms of both the adjustment for data errors and the assumptions made about fertility. CONCLUSIONS: Although adjusted indirect estimates are generally consistent with adjusted direct estimates, some notable inconsistencies were observed for countries that had experienced either a political or economic crisis or stalled health transition in their recent past. This result suggests that when a population has experienced a smooth mortality decline or only short periods of excess mortality, both adjusted methods perform equally well. However, the observed inconsistencies identified suggest that the indirect method is particularly prone to bias resulting from violations of its strong assumptions about recent mortality and fertility. Hence, indirect estimates of under-five mortality rates from summary birth histories should be used only for populations that have experienced either smooth mortality declines or only short periods of excess mortality in their recent past. Please see later in the article for the Editors' Summary.

Population perspectives and demographic methods to strengthen CRVS systems: introduction.

Civil registration and vital statistics (CRVS) systems and legal identity systems have become increasingly recognized as catalytic both for inclusive development and for monitoring population dynamics spanning the entire life course. Population scientists have a long history of contributing to the strengthening of CRVS and legal identity systems and of using vital registration data to understand population and development dynamics. This paper provides an overview of the Genus thematic series on CRVS systems. The series spans 11 research articles that document new insights on the registration of births, marriages, separations/divorces, deaths and legal residency. This introductory article to the series reviews the importance of population perspectives and demographic methods in strengthening CRVS systems and improving our understanding of population dynamics across the lifecourse. The paper highlights the major contributions from this thematic series and discusses emerging challenges and future research directions on CRVS systems for the population science community.

Towards the elimination of FGM by 2030: A statistical assessment.

In 2015, UN member states committed to eliminate female genital mutilation (FGM) by 2030 as part of the Sustainable Development Agenda. To reach this goal, interventions need to be targeted and guided by the best available evidence. To date, however, estimates of the number of girls and women affected by FGM and their trends over time and geographic space have been limited by the availability, specificity and quality of population-level data. We present new estimates based on all publicly available nationally representative surveys collected since the 1990s that contain both information on FGM status and on the age at which FGM occurred. Using survival analysis, we generate estimates of FGM risk by single year of age for all countries with available data, and for rural and urban areas separately. The likelihood of experiencing FGM has decreased at the global level, but progress has been starkly uneven between countries. The available data indicate no progress in reducing FGM risk in Gambia, Guinea-Bissau, Mali and Guinea. In addition, rural and urban areas have diverged over the last two decades, with FGM declining more rapidly in urban areas. We describe limitations in the availability and quality of data on FGM occurrence and age-at-FGM. Based on current trends, the SDG goal of eliminating FGM by 2030 is out of reach, and the pace at which the practice is being abandoned would need to accelerate to eliminate FGM by 2030. The heterogeneity in trends between countries and rural vs urban areas offers an opportunity to contrast countries where FGM is in rapid decline and explore potential policy lessons and programmatic implications for countries where the practice of FGM appears to remain entrenched.

Evaluation of a mHealth Data Quality Intervention to Improve Documentation of Pregnancy Outcomes by Health Surveillance Assistants in Malawi: A Cluster Randomized Trial.

BACKGROUND: While community health workers are being recognized as an integral work force with growing responsibilities, increased demands can potentially affect motivation and performance. The ubiquity of mobile phones, even in hard-to-reach communities, has facilitated the pursuit of novel approaches to support community health workers beyond traditional modes of supervision, job aids, in-service training, and material compensation. We tested whether supportive short message services (SMS) could improve reporting of pregnancies and pregnancy outcomes among community health workers (Health Surveillance Assistants, or HSAs) in Malawi. METHODS AND FINDINGS: We designed a set of one-way SMS that were sent to HSAs on a regular basis during a 12-month period. We tested the effectiveness of the cluster-randomized intervention in improving the complete documentation of a pregnancy. We defined complete documentation as a pregnancy for which a specific outcome was recorded. HSAs in the treatment group received motivational and data quality SMS. HSAs in the control group received only motivational SMS. During baseline and intervention periods, we matched reported pregnancies to reported outcomes to determine if reporting of matched pregnancies differed between groups and by period. The trial is registered as ISCTRN24785657. CONCLUSIONS: Study results show that the mHealth intervention improved the documentation of matched pregnancies in both the treatment (OR 1.31, 95% CI: 1.10-1.55, p<0.01) and control (OR 1.46, 95% CI: 1.11-1.91, p = 0.01) groups relative to the baseline period, despite differences in SMS content between groups. The results should be interpreted with caution given that the study was underpowered. We did not find a statistically significant difference in matched pregnancy documentation between groups during the intervention period (OR 0.94, 95% CI: 0.63-1.38, p = 0.74). mHealth applications have the potential to improve the tracking and data quality of pregnancies and pregnancy outcomes, particularly in low-resource settings.

Strengthening Community-Based Vital Events Reporting for Real-Time Monitoring of Under-Five Mortality: Lessons Learned from the Balaka and Salima Districts in Malawi.

BACKGROUND: Malawi ratified a compulsory birth and death registration system in 2009. Until it captures complete coverage of vital events, Malawi relies on other data sources to calculate mortality estimates. We tested a community-based method to estimate annual under-five mortality rates (U5MR) through the Real-Time Monitoring of Under-Five Mortality (RMM) project in Malawi. We implemented RMM in two phases, and conducted an independent evaluation of phase one after 21 months of implementation. We present results of the phase two validation that covers the full project time span, and compare the results to those of the phase one validation. METHODS AND FINDINGS: We assessed the completeness of the counts of births and deaths and the accuracy of disaggregated U5MR from the community-based method against a retrospective full pregnancy history for rolling twelve-month periods after the independent evaluation. We used full pregnancy histories collected through household interviews carried out between November 2013 and January 2014 as the validation data source. Health Surveillance Agents (HSAs) across the 160 catchment areas submitted routine reports on pregnancies, births, and deaths consistently. However, for the 15-month implementation period post-evaluation, average completeness of birth event reporting was 76%, whereas average completeness of death event reporting was 67% relative to that expected from a comparable pregnancy history. HSAs underestimated the U5MR by an average of 21% relative to that estimated from a comparable pregnancy history. CONCLUSIONS: On a medium scale, the community-based RMM method in Malawi produced substantial underestimates of annualized U5MR relative to those obtained from a full pregnancy history, despite the additional incentives and quality-control activities. We were not able to achieve an optimum level of incentive and support to make the system work while ensuring sustainability. Lessons learned from the implementation of RMM can inform programs supporting community-based interventions through HSAs in Malawi.

Can Community Health Workers Report Accurately on Births and Deaths? Results of Field Assessments in Ethiopia, Malawi and Mali.

INTRODUCTION: Most low-income countries lack complete and accurate vital registration systems. As a result, measures of under-five mortality rates rely mostly on household surveys. In collaboration with partners in Ethiopia, Ghana, Malawi, and Mali, we assessed the completeness and accuracy of reporting of births and deaths by community-based health workers, and the accuracy of annualized under-five mortality rate estimates derived from these data. Here we report on results from Ethiopia, Malawi and Mali. METHOD: In all three countries, community health workers (CHWs) were trained, equipped and supported to report pregnancies, births and deaths within defined geographic areas over a period of at least fifteen months. In-country institutions collected these data every month. At each study site, we administered a full birth history (FBH) or full pregnancy history (FPH), to women of reproductive age via a census of households in Mali and via household surveys in Ethiopia and Malawi. Using these FBHs/FPHs as a validation data source, we assessed the completeness of the counts of births and deaths and the accuracy of under-five, infant, and neonatal mortality rates from the community-based method against the retrospective FBH/FPH for rolling twelve-month periods. For each method we calculated total cost, average annual cost per 1,000 population, and average cost per vital event reported. RESULTS: On average, CHWs submitted monthly vital event reports for over 95 percent of catchment areas in Ethiopia and Malawi, and for 100 percent of catchment areas in Mali. The completeness of vital events reporting by CHWs varied: we estimated that 30%-90% of annualized expected births (i.e. the number of births estimated using a FPH) were documented by CHWs and 22%-91% of annualized expected under-five deaths were documented by CHWs. Resulting annualized under-five mortality rates based on the CHW vital events reporting were, on average, under-estimated by 28% in Ethiopia, 32% in Malawi, and 9% in Mali relative to comparable FPHs. Costs per vital event reported ranged from $21 in Malawi to $149 in Mali. DISCUSSION: Our findings in Mali suggest that CHWs can collect complete and high-quality vital events data useful for monitoring annual changes in under-five mortality rates. Both the supervision of CHWs in Mali and the rigor of the associated field-based data quality checks were of a high standard, and the size of the pilot area in Mali was small (comprising of approximately 53,205 residents in 4,200 households). Hence, there are remaining questions about whether this level of vital events reporting completeness and data quality could be maintained if the approach was implemented at scale. Our experience in Malawi and Ethiopia suggests that, in some settings, establishing and maintaining the completeness and quality of vital events reporting by CHWs over time is challenging. In this sense, our evaluation in Mali falls closer to that of an efficacy study, whereas our evaluations in Ethiopia and Malawi are more akin to an effectiveness study. Our overall findings suggest that no one-size-fits-all approach will be successful in guaranteeing complete and accurate reporting of vital events by CHWs.

Strengthening Community Networks for Vital Event Reporting: Community-Based Reporting of Vital Events in Rural Mali.

BACKGROUND: Like many developing countries, Mali has few sources of mortality data. High quality mortality estimates are available from household surveys, such as the demographic and health surveys (DHS), approximately every five years, making it difficult to track progress in reducing mortality. The Rapid Mortality Monitoring (RMM) project in Mali aimed to address this issue by testing a community-based approach to measuring under-five mortality on a yearly basis. METHODS AND FINDINGS: Seventy-eight community-based workers (relais) were identified in 20 villages comprising approximately 5,300 households. The relais reported pregnancies, births, and under-five deaths from July, 2012 to November, 2013. Data were double-entered, reconciled, cleaned, and analyzed monthly. In November-December 2013, we administered a full pregnancy history (FPH) to women of reproductive age in a census of the households in the project villages. We assessed the completeness of the counts of births and deaths, and the validity of under-five, infant, and neonatal mortality rates from the community-based method against the retrospective FPH for two rolling twelve-month periods. Monthly reporting by relais was high, with reports on pregnancies, births, and deaths consistently provided from all 78 relais catchment areas. Relais reported 1,660 live births and 276 under-five deaths from July, 2012 to November, 2013. The under-five mortality rate calculated from the relais data was similar to that estimated using the validation survey, where the overall ratios of the community-based to FPH-based mortality rates for the reporting periods were 100.4 (95% CI: 80.4, 120.5) and 100.8 (95% CI: 79.5, 122.0). CONCLUSIONS: On a small scale, the community-based method in Mali produced estimates of annualized under-five mortality rates that were consistent with those obtained from a FPH. The community-based method should be considered for scale-up in Mali, with appropriate measures to ensure community engagement, data quality, and cross-validation with comparable FPHs.

Using Health Extension Workers for Monitoring Child Mortality in Real-Time: Validation against Household Survey Data in Rural Ethiopia.

BACKGROUND: Ethiopia has scaled up its community-based programs over the past decade by training and deploying health extension workers (HEWs) in rural communities throughout the country. Consequently, child mortality has declined substantially, placing Ethiopia among the few countries that have achieved the United Nations' fourth Millennium Development Goal. As Ethiopia continues its efforts, results must be assessed regularly to provide timely feedback for improvement and to generate further support for programs. More specifically the expansion of HEWs at the community level provides a unique opportunity to build a system for real-time monitoring of births and deaths, linked to a civil registration and vital statistics system that Ethiopia is also developing. We tested the accuracy and completeness of births and deaths reported by trained HEWs for monitoring child mortality over 15 -month periods. METHODS AND FINDINGS: HEWs were trained in 93 randomly selected rural kebeles in Jimma and West Hararghe zones of the Oromia region to report births and deaths over a 15-month period from January, 2012 to March, 2013. Completeness of number of births and deaths, age distribution of deaths, and accuracy of resulting under-five, infant, and neonatal mortality rates were assessed against data from a large household survey with full birth history from women aged 15-49. Although, in general HEWs, were able to accurately report events that they identified, the completeness of number of births and deaths reported over twelve-month periods was very low and variable across the two zones. Compared to household survey estimates, HEWs reported only about 30% of births and 21% of under-five deaths occurring in their communities over a twelve-month period. The under-five mortality rate was under-estimated by around 30%, infant mortality rate by 23% and neonatal mortality by 17%. HEWs reported disproportionately higher number of deaths among the very young infants than among the older children. CONCLUSION: Birth and death data reported by HEWs are not complete enough to support the monitoring of changes in childhood mortality. HEWs can significantly contribute to the success of a CRVS in Ethiopia, but cannot be relied upon as the sole source for identification of vital events. Further studies are needed to understand how to increase the level of completeness.

Monitoring Change in Child Mortality through Household Surveys.

BACKGROUND: Most low- and middle-income countries lack fully functional civil registration systems. Measures of under-five mortality are typically derived from periodic household surveys collecting detailed information from women on births and child deaths. However, such surveys are expensive and are not appropriate for monitoring short-term changes in child mortality. We explored and tested the validity of two new analysis methods for less-expensive summary histories of births and child deaths for such monitoring in five African countries. METHODS AND FINDINGS: The first method we explored uses individual-level survey data on births and child deaths to impute full birth histories from an earlier survey onto summary histories from a more recent survey. The second method uses cohort changes between two surveys in the average number of children born and the number of children dead by single year of age to estimate under-five mortality for the inter-survey period. The first method produces acceptable annual estimates of under-five mortality for two out of six applications to available data sets; the second method produced an acceptable estimate in only one of five applications, though none of the applications used ideal data sets. CONCLUSIONS: The methods we tested were not able to produce consistently good quality estimates of annual under-five mortality from summary birth history data. The key problem we identified was not with the methods themselves, but with the underlying quality of the summary birth histories. If summary birth histories are to be included in general household surveys, considerable emphasis must be placed on quality control.