Validating the indicator "maternal death review coverage" to improve maternal mortality data: A retrospective analysis of district, facility, and individual medical record data.

BACKGROUND: Understanding causes and contributors to maternal mortality is critical from a quality improvement perspective to inform decision making and monitor progress toward ending preventable maternal mortality. The indicator "maternal death review coverage" is defined as the percentage of maternal deaths occurring in a facility that are audited. Both the numerator and denominator of this indicator are subject to misclassification errors, underreporting, and bias. This study assessed the validity of the indicator by examining both its numerator-the number and quality of death reviews-and denominator-the number of facility-based maternal deaths and comparing estimates of the indicator obtained from facility- versus district-level data. METHODS AND FINDINGS: We collected data on the number of maternal deaths and content of death reviews from all health facilities serving as birthing sites in 12 districts in three countries: Argentina, Ghana, and India. Additional data were extracted from health management information systems on the number and dates of maternal deaths and maternal death reviews reported from health facilities to the district-level. We tabulated the percentage of facility deaths with evidence of a review, the percentage of reviews that met the World Health Organization defined standard for maternal and perinatal death surveillance and response. Results were stratified by sociodemographic characteristics of women and facility location and type. We compared these estimates to that obtained using district-level data. and looked at evidence of the review at the district/provincial level. Study teams reviewed facility records at 34 facilities in Argentina, 51 facilities in Ghana, and 282 facilities in India. In total, we found 17 deaths in Argentina, 14 deaths in Ghana, and 58 deaths in India evidenced at facilities. Overall, >80% of deaths had evidence of a review at facilities. In India, a much lower percentage of deaths occurring at secondary-level facilities (61.1%) had evidence of a review compared to deaths in tertiary-level facilities (92.1%). In all three countries, only about half of deaths in each country had complete reviews: 58.8% (n = 10) in Argentina, 57.2% (n = 8) in Ghana, and 41.1% (n = 24) in India. Dramatic reductions in indicator value were seen in several subnational geographic areas, including Gonda and Meerut in India and Sunyani in Ghana. For example, in Gonda only three of the 18 reviews conducted at facilities met the definitional standard (16.7%), which caused the value of the indicator to decrease from 81.8% to 13.6%. Stratification by women's sociodemographic factors suggested systematic differences in completeness of reviews by women's age, place of residence, and timing of death. CONCLUSIONS: Our study assessed the validity of an important indicator for ending preventable deaths: the coverage of reviews of maternal deaths occurring in facilities in three study settings. We found discrepancies in deaths recorded at facilities and those reported to districts from facilities. Further, few maternal death reviews met global quality standards for completeness. The value of the calculated indicator masked inaccuracies in counts of both deaths and reviews and gave no indication of completeness, thus undermining the ultimate utility of the measure in achieving an accurate measure of coverage.

Validating the implementation of an indicator reporting policies and laws on free public maternal health-related services in the era of universal health coverage: A multi-country cross-sectional study.

BACKGROUND: The concept of universal health coverage (UHC) encompasses both access to essential health services and freedom from financial harm. The World Health Organization's Maternal Newborn Child and Adolescent Health (MNCAH) Policy Survey collects data on policies that have the potential to reduce maternal morbidity and mortality. The indicator, "Are the following health services provided free of charge at point-of-use in the public sector for women of reproductive age?", captures the free provision of 13 key categories of maternal health-related services, to measure the success of UHC implementation with respect to maternal health. However, it is unknown whether it provides a valid measure of the provision of free care. Therefore, this study compared free maternal healthcare laws and policies against actual practice in three countries. METHODS AND FINDINGS: We conducted a cross-sectional study in four districts/provinces in Argentina, Ghana, and India. We performed desk reviews to identify free care laws and policies at the country level and compared those with reports at the global level. We conducted exit interviews with women aged 15-49 years who used a component service or their accompanying persons, as well as with facility chief financial officers or billing administrators, to determine if women had out-of-pocket expenditures associated with accessing services. For designated free services, prevalence of expenditures at the service level for women and reports by financial officers of women ever having expenditures associated with services designated as free were computed. These three sources of data (desk review, surveys of women and administrators) were triangulated, and chi-square analysis was conducted to determine if charges were levied differentially by standard equity stratifiers. Designation of services as free matched what was reported in the MNCAH Policy Survey for Argentina and Ghana. In India, insecticide-treated bed nets and testing and treatment for syphilis were only designated as free for selected populations, differing from the WHO MNCAH Policy Survey. Among 1046, 923, and 1102 women and accompanying persons who were interviewed in Argentina, Ghana, and India, respectively, the highest prevalence of associated expenditures among women who received a component service in each setting was for cesarean section in Argentina (26%, 24/92); family planning in Ghana (78.4%, 69/88); and postnatal maternal care in India (94.4%, 85/90). The highest prevalence of women ever having out of pocket expenditures associated with accessing any free service reported by financial officers was 9.1% (2/22) in Argentina, 64.1% (93/145) in Ghana, and 29.7% (47/158) in India. Across the three countries, self-reports of out of pocket expenditures were significantly associated with district/province and educational status of women. Additionally, wealth quintile in Argentina and age in India were significantly associated with women reporting out of pocket expenditures. CONCLUSIONS: Free care laws were largely accurately reported in the global MNCAH policy database. Notably, we found that women absorbed both direct and indirect costs and made both formal and informal payments for services designated as free. Therefore, the policy indicator does not provide a valid reflection of UHC in the three settings.