ABSTRACT
Despite a general understanding that interviewers might cause measurement errors on sensitive questions in sample surveys, there is relatively little research on interviewer effects on responses to questions on women justifying a woman's refusal to have sex with her husband, women justifying wife beating, women's experience of physical and sexual violence, and whether the woman's father ever beat her mother. This study examines interviewer effects on these indicators that were collected in two large-scale National Family Health Surveys (NFHS) in India (2005-2006 and 2015-2016). We use cross-classified random intercept multivariable multilevel logit models to examine interviewer effects. In both surveys, we find large interviewer effects on questions about the justification of a woman refusing to have sex with her husband (32-33% in NFHS-3 and 45-46% in NFHS-4) and the justification of wife beating (27-28% in NFHS-3 and 33-34% in NFHS-4). The interviewer effects were much larger in the 2015-2016 survey than in the 2005-2006 survey. Such large interviewer effects should be considered when interpreting trends and patterns on these topics, especially since the interviewer effects might have changed between survey rounds. Understanding interviewer effects is important given the wide use of these surveys in policy formulation and monitoring in India.
Subject(s)
Domestic Violence , Spouses , Female , Health Surveys , Humans , India , Surveys and QuestionnairesABSTRACT
BACKGROUND: Worldwide, an estimated 5.1 million stillbirths and neonatal deaths occur annually, 98% in low- and middle-income countries. Limited coverage of civil and vital registration systems necessitates reliance on women's retrospective reporting in household surveys for data on these deaths. The predominant platform, Demographic and Health Surveys (DHS), has evolved over the last 35 years and differs by country, yet no previous study has described these differences and the effects of these changes on stillbirth and neonatal death measurement. METHODS: We undertook a review of DHS model questionnaires, protocols and methodological reports from DHS-I to DHS-VII, focusing on the collection of information on stillbirth and neonatal deaths describing differences in approaches, questionnaires and geographic reach up to December 9, 2019. We analysed the resultant data, applied previously used data quality criteria including ratios of stillbirth rate (SBR) to neonatal mortality rate (NMR) and early NMR (ENMR) to NMR, comparing by country, over time and by DHS module. RESULTS: DHS has conducted >320 surveys in 90 countries since 1984. Two types of maternity history have been used: full birth history (FBH) and full pregnancy history (FPH). A FBH collecting information only on live births has been included in all model questionnaires to date, with data on stillbirths collected through a reproductive calendar (DHS II-VI) or using additional questions on non-live births (DHS-VII). FPH collecting information on all pregnancies including live births, miscarriages, abortions and stillbirths has been used in 17 countries. We found no evidence of variation in stillbirth data quality assessed by SBR:NMR over time for FBH surveys with reproductive calendar, some variation for surveys with FBH in DHS-VII and most variation among the surveys conducted with a FPH. ENMR:NMR ratio increased over time, which may reflect changes in data quality or real epidemiological change. CONCLUSION: DHS remains the major data source for pregnancy outcomes worldwide. Although the DHS model questionnaire has evolved over the last three and half decades, more robust evidence is required concerning optimal methods to obtain accurate data on stillbirths and neonatal deaths through household surveys and also to develop and test standardised data quality criteria.
Subject(s)
Demography/history , Perinatal Death , Stillbirth , Surveys and Questionnaires , Family Characteristics , Female , History, 20th Century , History, 21st Century , Humans , Infant , Infant Mortality , Infant, Newborn , Pregnancy , Retrospective Studies , Stillbirth/epidemiologyABSTRACT
BACKGROUND: Population-based household surveys, notably the Demographic and Health Surveys (DHS) and Multiple Indicator Cluster Surveys (MICS), remain the main source of maternal and newborn health data for many low- and middle-income countries. As part of the Every Newborn Birth Indicators Research Tracking in Hospitals (EN-BIRTH) study, this paper focuses on testing validity of measurement of maternal and newborn indicators around the time of birth (intrapartum and postnatal) in survey-report. METHODS: EN-BIRTH was an observational study testing the validity of measurement for selected maternal and newborn indicators in five secondary/tertiary hospitals in Bangladesh, Nepal and Tanzania, conducted from July 2017 to July 2018. We compared women's report at exit survey with the gold standard of direct observation or verification from clinical records for women with vaginal births. Population-level validity was assessed by validity ratios (survey-reported coverage: observer-assessed coverage). Individual-level accuracy was assessed by sensitivity, specificity and percent agreement. We tested indicators already in DHS/MICS as well as indicators with potential to be included in population-based surveys, notably the first validation for small and sick newborn care indicators. RESULTS: 33 maternal and newborn indicators were evaluated. Amongst nine indicators already present in DHS/MICS, validity ratios for baby dried or wiped, birthweight measured, low birthweight, and sex of baby (female) were between 0.90-1.10. Instrumental birth, skin-to-skin contact, and early initiation of breastfeeding were highly overestimated by survey-report (2.04-4.83) while umbilical cord care indicators were massively underestimated (0.14-0.22). Amongst 24 indicators not currently in DHS/MICS, two newborn contact indicators (kangaroo mother care 1.00, admission to neonatal unit 1.01) had high survey-reported coverage amongst admitted newborns and high sensitivity. The remaining indicators did not perform well and some had very high "don't know" responses. CONCLUSIONS: Our study revealed low validity for collecting many maternal and newborn indicators through an exit survey instrument, even with short recall periods among women with vaginal births. Household surveys are already at risk of overload, and some specific clinical care indicators do not perform well and may be under-powered. Given that approximately 80% of births worldwide occur in facilities, routine registers should also be explored to track coverage of key maternal and newborn health interventions, particularly for clinical care.
Subject(s)
Data Accuracy , Health Surveys/statistics & numerical data , Perinatal Care/statistics & numerical data , Quality Indicators, Health Care/statistics & numerical data , Adult , Bangladesh , Female , Humans , Infant, Newborn , Nepal , Perinatal Care/organization & administration , Pregnancy , TanzaniaABSTRACT
BACKGROUND: Nationally-representative household surveys are the standard approach to monitor access to and treatment with artemisinin-based combination therapy (ACT) among children under 5Ā years (U5), however these indicators are dependent on caregivers' recall of the treatment received. METHODS: A prospective case-control study was performed in Mali to validate caregivers' recall of treatment received by U5s when seeking care for fever from rural and urban public health facilities, community health workers and urban private facilities. Clinician-recorded consultation details were the gold standard. Consenting caregivers were followed-up for interview at home within 2Ā weeks using standard questions from Demographic and Health Surveys and Malaria Indicator Surveys. RESULTS: Among 1602 caregivers, sensitivity of recalling that the child received a finger/heel prick was 91.5%, with specificity 85.7%. Caregivers' recall of a positive malaria test result had sensitivity 96.2% with specificity 59.7%. Irrespective of diagnostic test result, the sensitivity and specificity of caregivers' recalling a malaria diagnosis made by the health worker were 74.3% and 74.9%, respectively. Caregivers' recall of ACT being given had sensitivity of 43.2% and specificity 90.2%, while recall that any anti-malarial was given had sensitivity 59.0% and specificity 82.7%. Correcting caregivers' response of treatment received using a combination of a visual aid with photographs of common drugs for fever, prescription documents and retained packaging changed ACT recall sensitivity and specificity to 91.5% and 71.1%, respectively. CONCLUSIONS: These findings indicate that caregivers' responses during household surveys are valid when assessing if a child received a finger/heel prick during a consultation in the previous 2Ā weeks, and if the malaria test result was positive. Recall of ACT treatment received by U5s was poor when based on interview response only, but was substantially improved when incorporating visual aids, prescriptions and drug packaging review.
Subject(s)
Antimalarials/therapeutic use , Caregivers , Malaria/diagnosis , Malaria/drug therapy , Artemisinins/therapeutic use , Case-Control Studies , Child, Preschool , Drug Therapy, Combination , Family Characteristics , Female , Fever/epidemiology , Fever/etiology , Humans , Infant , Male , Mali , Mental Recall , Patient Acceptance of Health Care , Prospective Studies , Rural Health Services , Sensitivity and Specificity , Surveys and Questionnaires , Urban Health ServicesABSTRACT
BACKGROUND/METHODS: Insecticide-treated nets (ITNs) are the primary tool for malaria vector control in sub-Saharan Africa, and have been responsible for an estimated two-thirds of the reduction in the global burden of malaria in recent years. While the ultimate goal is high levels of ITN use to confer protection against infected mosquitoes, it is widely accepted that ITN use must be understood in the context of ITN availability. However, despite nearly a decade of universal coverage campaigns, no country has achieved a measured level of 80% of households owning 1 ITN for 2 people in a national survey. Eighty-six public datasets from 33 countries in sub-Saharan Africa (2005-2017) were used to explore the causes of failure to achieve universal coverage at the household level, understand the relationships between the various ITN indicators, and further define their respective programmatic utility. RESULTS: The proportion of households owning 1 ITN for 2 people did not exceed 60% at the national level in any survey, except in Uganda's 2014 Malaria Indicator Survey (MIS). At 80% population ITN access, the expected proportion of households with 1 ITN for 2 people is only 60% (p = 0.003 R2 = 0.92), because individuals in households with some but not enough ITNs are captured as having access, but the household does not qualify as having 1 ITN for 2 people. Among households with 7-9 people, mean population ITN access was 41.0% (95% CI 36.5-45.6), whereas only 6.2% (95% CI 4.0-8.3) of these same households owned at least 1 ITN for 2 people. On average, 60% of the individual protection measured by the population access indicator is obscured when focus is put on the household "universal coverage" indicator. The practice of limiting households to a maximum number of ITNs in mass campaigns severely restricts the ability of large households to obtain enough ITNs for their entire family. CONCLUSIONS: The two household-level indicators-one representing minimal coverage, the other only 'universal' coverage-provide an incomplete and potentially misleading picture of personal protection and the success of an ITN distribution programme. Under current ITN distribution strategies, the global malaria community cannot expect countries to reach 80% of households owning 1 ITN for 2 people at a national level. When programmes assess the success of ITN distribution activities, population access to ITNs should be considered as the better indicator of "universal coverage," because it is based on people as the unit of analysis.
Subject(s)
Communicable Disease Control/statistics & numerical data , Insecticide-Treated Bednets/statistics & numerical data , Malaria/prevention & control , Mosquito Control/statistics & numerical data , Africa South of the Sahara , Animals , Communicable Disease Control/methods , Family Characteristics , Humans , Mosquito Control/methods , OwnershipABSTRACT
BACKGROUND: Since 2003 Tanzania has upgraded its approximately 7000 drug stores to Accredited Drug Dispensing Outlets (ADDOs), involving dispenser training, introduction of record keeping and enhanced regulation. Prior to accreditation, drug stores could officially stock over-the-counter medicines only, though many stocked prescription-only antimalarials. ADDOs are permitted to stock 49 prescription-only medicines, including artemisinin combination therapies and one form of quinine injectable. Oral artemisinin monotherapies and other injectables were not permitted at any time. By late 2011 conversion was complete in 14 of 21 regions. We explored variation in malaria-related knowledge and practices of drug retailers in ADDO and non-ADDO regions. METHODS: Data were collected as part of the Independent Evaluation of the Affordable Medicines Facility - malaria (AMFm), involving a nationally representative survey of antimalarial retailers in October-December 2011. We randomly selected 49 wards and interviewed all drug stores stocking antimalarials. We compare ADDO and non-ADDO regions, excluding the largest city, Dar es Salaam, due to the unique characteristics of its market. RESULTS: Interviews were conducted in 133 drug stores in ADDO regions and 119 in non-ADDO regions. Staff qualifications were very similar in both areas. There was no significant difference in the availability of the first line antimalarial (68.9% in ADDO regions and 65.2% in non-ADDO regions); both areas had over 98% availability of non-artemisinin therapies and below 3.0% of artemisinin monotherapies. Staff in ADDO regions had better knowledge of the first line antimalarial than non-ADDO regions (99.5% and 91.5%, pĀ = 0.001). There was weak evidence of a lower price and higher market share of the first line antimalarial in ADDO regions. Drug stores in ADDO regions were more likely to stock ADDO-certified injectables than those in non-ADDO regions (23.0% and 3.9%, pĀ = 0.005). CONCLUSIONS: ADDO conversion is frequently cited as a model for improving retail sector drug provision. Drug stores in ADDO regions performed better on some indicators, possibly indicating some small benefits from ADDO conversion, but also weaknesses in ADDO regulation and high staff turnover. More evidence is needed on the value-added and value for money of the ADDO roll out to inform retail policy in Tanzania and elsewhere.
Subject(s)
Accreditation/statistics & numerical data , Health Knowledge, Attitudes, Practice , Malaria , Pharmacies/statistics & numerical data , Antimalarials/economics , Antimalarials/therapeutic use , Artemisinins/economics , Artemisinins/therapeutic use , Commerce/statistics & numerical data , Health Services Research , Humans , Malaria/drug therapy , Private Sector/statistics & numerical data , Qualitative Research , TanzaniaABSTRACT
OBJECTIVES: To describe the state of the public and private malaria diagnostics market shortly after WHO updated its guidelines for testing all suspected malaria cases prior to treatment. METHODS: Ten nationally representative cross-sectional cluster surveys were conducted in 2011 among public and private health facilities, community health workers and retail outlets (pharmacies and drug shops) in nine countries (Tanzania mainland and Zanzibar surveyed separately). Eligible outlets had antimalarials in stock on the day of interview or had stocked antimalarials in the past 3 months. RESULTS: Three thousand four hundred and thirty-nine rapid diagnostic test (RDT) products from 39 manufacturers were audited among 12,197 outlets interviewed. Availability was typically highest in public health facilities, although availability in these facilities varied greatly across countries, from 15% in Nigeria to >90% in Madagascar and Cambodia. Private for-profit sector availability was 46% in Cambodia, 20% in Zambia, but low in other countries. Median retail prices for RDTs in the private for-profit sector ranged from $0.00 in Madagascar to $3.13 in Zambia. The reported number of RDTs used in the 7 days before the survey in public health facilities ranged from 3 (Benin) to 50 (Zambia). CONCLUSIONS: Eighteen months after WHO updated its case management guidelines, RDT availability remained poor in the private sector in sub-Saharan Africa. Given the ongoing importance of the private sector as a source of fever treatment, the goal of universal diagnosis will not be achievable under current circumstances. These results constitute national baselines against which progress in scaling-up diagnostic tests can be assessed.
Subject(s)
Commerce , Diagnostic Tests, Routine/economics , Malaria/diagnosis , Private Sector/economics , Public Sector/economics , Africa , Asia , Cross-Sectional Studies , Endemic Diseases , Health Services Accessibility , HumansABSTRACT
BACKGROUND: To assess the availability, price and market share of quality-assured artemisinin-based combination therapy (QAACT) in remote areas (RAs) compared with non-remote areas (nRAs) in Kenya and Ghana at end-line of the Affordable Medicines Facility-malaria (AMFm) intervention. METHODS: Areas were classified by remoteness using a composite index computed from estimated travel times to three levels of service centres. The index was used to five categories of remoteness, which were then grouped into two categories of remote and non-remote areas. The number of public or private outlets with the potential to sell or distribute anti-malarial medicines, screened in nRAs and RAs, respectively, was 501 and 194 in Ghana and 9980 and 2353 in Kenya. The analysis compares RAs with nRAs in terms of availability, price and market share of QAACT in each country. RESULTS: QAACT were similarly available in RAs as nRAs in Ghana and Kenya. In both countries, there was no statistical difference in availability of QAACT with AMFm logo between RAs and nRAs in public health facilities (PHFs), while private-for-profit (PFP) outlets had lower availability in RA than in nRAs (Ghana: 66.0 vs 82.2 %, p < 0.0001; Kenya: 44.9 vs 63.5 %, p = <0.0001. The median price of QAACT with AMFm logo for PFP outlets in RAs (USD1.25 in Ghana and USD0.69 in Kenya) was above the recommended retail price in Ghana (US$0.95) and Kenya (US$0.46), and much higher than in nRAs for both countries. QAACT with AMFm logo represented the majority of QAACT in RAs and nRAs in Kenya and Ghana. In the PFP sector in Ghana, the market share for QAACT with AMFm logo was significantly higher in RAs than in nRAs (75.6 vs 51.4 %, p < 0.0001). In contrast, in similar outlets in Kenya, the market share of QAACT with AMFm logo was significantly lower in RAs than in nRAs (39.4 vs 65.1 %, p < 0.0001). CONCLUSION: The findings indicate the AMFm programme contributed to making QAACT more available in RAs in these two countries. Therefore, the AMFm approach can inform other health interventions aiming at reaching hard-to-reach populations, particularly in the context of universal access to health interventions. However, further examination of the factors accounting for the deep penetration of the AMFm programme into RAs is needed to inform actions to improve the healthcare delivery system, particularly in RAs.
Subject(s)
Antimalarials/therapeutic use , Artemisinins/therapeutic use , Health Services Accessibility , Lactones/therapeutic use , Malaria/drug therapy , Cross-Sectional Studies , Drug Therapy, Combination/methods , Geography , Ghana , Humans , KenyaABSTRACT
BACKGROUND: Coverage estimates of insecticide-treated nets (ITNs) are often calculated at the national level, but are intended to be a proxy for coverage among the population at risk of malaria. The analysis uses data for surveyed households, linking survey enumeration areas (clusters) with levels of malaria endemicity and adjusting coverage estimates based on the population at risk. This analysis proposes an approach that is not dependent on being able to identify malaria risk in a location during the survey design (since survey samples are typically selected on the basis of census sampling frames that do not include information on malaria zones), but rather being able to assign risk zones after a survey has already been completed. METHODS: The analysis uses data from 20 recent nationally representative Demographic and Health Survey (DHS), Malaria Indicator Surveys (MIS), an AIDS Indicator Survey (AIS), and an Anemia and Malaria Prevalence Survey (AMP). The malaria endemicity classification was assigned from the Malaria Atlas Project (MAP) 2010 interpolated data layers, using the Geographic Positioning System (GPS) location of the survey clusters. National ITN coverage estimates were compared with coverage estimates in intermediate/high endemicity zones (i.e., the population at risk of malaria) to determine whether the difference between estimates was statistically different from zero (p-value <0.5). RESULTS: Endemicity varies substantially in eight of the 20 studied countries. In these countries with heterogeneous transmission of malaria, stratification of households by endemicity zones shows that ITN coverage in intermediate/high endemicity zones is significantly higher than ITN coverage at the national level (Burundi, Kenya, Namibia, Rwanda, Tanzania, Senegal, Zambia, and Zimbabwe.). For example in Zimbabwe, the national ownership of ITNs is 28%, but ownership in the intermediate/high endemicity zone is 46%. CONCLUSION: Incorporating this study's basic and easily reproducible approach into estimates of ITN coverage is applicable and even preferable in countries with areas at no/low risk of malaria and will help ensure that the highest-quality data are available to inform programmatic decisions in countries affected by malaria. The extension of this type of analysis to other malaria interventions can provide further valuable information to support evidence-based decision-making.
Subject(s)
Endemic Diseases , Insecticide-Treated Bednets/statistics & numerical data , Malaria/epidemiology , Malaria/prevention & control , Topography, Medical , Adolescent , Adult , Africa/epidemiology , Aged , Aged, 80 and over , Child , Child, Preschool , Data Collection , Female , Humans , Infant , Infant, Newborn , Male , Middle Aged , Risk Assessment , Young AdultABSTRACT
BACKGROUND: The Affordable Medicines Facility - malaria (AMFm), implemented at national scale in eight African countries or territories, subsidized quality-assured artemisinin combination therapy (ACT) and included communication campaigns to support implementation and promote appropriate anti-malarial use. This paper reports private for-profit provider awareness of key features of the AMFm programme, and changes in provider knowledge of appropriate malaria treatment. METHODS: This study had a non-experimental design based on nationally representative surveys of outlets stocking anti-malarials before (2009/10) and after (2011) the AMFm roll-out. RESULTS: Based on data from over 19,500 outlets, results show that in four of eight settings, where communication campaigns were implemented for 5-9Ā months, 76%-94% awareness of the AMFm 'green leaf' logo, 57%-74% awareness of the ACT subsidy programme, and 52%-80% awareness of the correct recommended retail price (RRP) of subsidized ACT were recorded. However, in the remaining four settings where communication campaigns were implemented for three months or less, levels were substantially lower. In six of eight settings, increases of at least 10 percentage points in private for-profit providers' knowledge of the correct first-line treatment for uncomplicated malaria were seen; and in three of these the levels of knowledge achieved at endline were over 80%. CONCLUSIONS: The results support the interpretation that, in addition to the availability of subsidized ACT, the intensity of communication campaigns may have contributed to the reported levels of AMFm-related awareness and knowledge among private for-profit providers. Future subsidy programmes for anti-malarials or other treatments should similarly include communication activities.
Subject(s)
Antimalarials , Artemisinins , Communication , Health Services Accessibility/economics , Health Services Accessibility/organization & administration , Private Sector , Africa South of the Sahara , Antimalarials/economics , Antimalarials/supply & distribution , Artemisinins/economics , Artemisinins/supply & distribution , Drug Combinations , Health Knowledge, Attitudes, Practice , Humans , Malaria, Falciparum/drug therapyABSTRACT
Household surveys are the primary data source of coverage indicators for children and women for most developing countries. Most of this information is generated by two global household survey programmes-the USAID-supported Demographic and Health Surveys (DHS) and the UNICEF-supported Multiple Indicator Cluster Surveys (MICS). In this review, we provide an overview of these two programmes, which cover a wide range of child and maternal health topics and provide estimates of many Millennium Development Goal indicators, as well as estimates of the indicators for the Countdown to 2015 initiative and the Commission on Information and Accountability for Women's and Children's Health. MICS and DHS collaborate closely and work through interagency processes to ensure that survey tools are harmonized and comparable as far as possible, but we highlight differences between DHS and MICS in the population covered and the reference periods used to measure coverage. These differences need to be considered when comparing estimates of reproductive, maternal, newborn, and child health indicators across countries and over time and we discuss the implications of these differences for coverage measurement. Finally, we discuss the need for survey planners and consumers of survey results to understand the strengths, limitations, and constraints of coverage measurements generated through household surveys, and address some technical issues surrounding sampling and quality control. We conclude that, although much effort has been made to improve coverage measurement in household surveys, continuing efforts are needed, including further research to improve and refine survey methods and analytical techniques.
Subject(s)
Child Health Services/trends , Developing Countries , Health Care Surveys/trends , Health Services Research/trends , Healthcare Disparities/trends , Maternal Health Services/trends , Child , Child, Preschool , Family Characteristics , Female , Global Health , Health Services Accessibility/trends , Health Services Research/methods , Humans , Infant , Infant, Newborn , Male , Program Evaluation , Research Design , Socioeconomic Factors , Surveys and Questionnaires , Time FactorsABSTRACT
Considerable progress has been made in reducing maternal, newborn, and child mortality worldwide, but many more deaths could be prevented if effective interventions were available to all who could benefit from them. Timely, high-quality measurements of intervention coverage--the proportion of a population in need of a health intervention that actually receives it--are essential to support sound decisions about progress and investments in women's and children's health. The PLOS Medicine "Measuring Coverage in MNCH" Collection of research studies and reviews presents systematic assessments of the validity of health intervention coverage measurement based on household surveys, the primary method for estimating population-level intervention coverage in low- and middle-income countries. In this overview of the Collection, we discuss how and why some of the indicators now being used to track intervention coverage may not provide fully reliable coverage measurements, and how a better understanding of the systematic and random error inherent in these coverage indicators can help in their interpretation and use. We draw together strategies proposed across the Collection for improving coverage measurement, and recommend continued support for high-quality household surveys at national and sub-national levels, supplemented by surveys with lighter tools that can be implemented every 1-2 years and by complementary health-facility-based assessments of service quality. Finally, we stress the importance of learning more about coverage measurement to strengthen the foundation for assessing and improving the progress of maternal, newborn, and child health programs.
Subject(s)
Child Health Services , Developing Countries , Health Care Surveys , Health Services Research/methods , Maternal Health Services , Quality Indicators, Health Care , Adult , Child , Child Health Services/standards , Child Health Services/statistics & numerical data , Child Mortality , Child, Preschool , Data Interpretation, Statistical , Developing Countries/statistics & numerical data , Family Characteristics , Female , Global Health , Health Care Surveys/standards , Health Care Surveys/statistics & numerical data , Health Services Accessibility/standards , Health Services Research/standards , Health Services Research/statistics & numerical data , Healthcare Disparities , Humans , Infant , Infant Mortality , Infant, Newborn , Male , Maternal Health Services/standards , Maternal Health Services/statistics & numerical data , Maternal Mortality , Program Evaluation , Quality Improvement , Quality Indicators, Health Care/standards , Quality Indicators, Health Care/statistics & numerical data , Reproducibility of Results , Research Design , Surveys and QuestionnairesABSTRACT
Nationally representative household surveys are increasingly relied upon to measure maternal, newborn, and child health (MNCH) intervention coverage at the population level in low- and middle-income countries. Surveys are the best tool we have for this purpose and are central to national and global decision making. However, all survey point estimates have a certain level of error (total survey error) comprising sampling and non-sampling error, both of which must be considered when interpreting survey results for decision making. In this review, we discuss the importance of considering these errors when interpreting MNCH intervention coverage estimates derived from household surveys, using relevant examples from national surveys to provide context. Sampling error is usually thought of as the precision of a point estimate and is represented by 95% confidence intervals, which are measurable. Confidence intervals can inform judgments about whether estimated parameters are likely to be different from the real value of a parameter. We recommend, therefore, that confidence intervals for key coverage indicators should always be provided in survey reports. By contrast, the direction and magnitude of non-sampling error is almost always unmeasurable, and therefore unknown. Information error and bias are the most common sources of non-sampling error in household survey estimates and we recommend that they should always be carefully considered when interpreting MNCH intervention coverage based on survey data. Overall, we recommend that future research on measuring MNCH intervention coverage should focus on refining and improving survey-based coverage estimates to develop a better understanding of how results should be interpreted and used.
Subject(s)
Child Health Services , Developing Countries , Health Care Surveys , Health Services Research/methods , Maternal Health Services , Adult , Child , Child Health Services/standards , Child Health Services/statistics & numerical data , Child, Preschool , Confidence Intervals , Data Interpretation, Statistical , Developing Countries/statistics & numerical data , Family Characteristics , Female , Global Health , Health Care Surveys/standards , Health Care Surveys/statistics & numerical data , Health Services Research/standards , Health Services Research/statistics & numerical data , Humans , Infant , Infant, Newborn , Male , Maternal Health Services/standards , Maternal Health Services/statistics & numerical data , Program Evaluation , Reproducibility of Results , Research Design , Selection Bias , Surveys and QuestionnairesABSTRACT
BACKGROUND: Malaria is one of the greatest causes of mortality worldwide. Use of the most effective treatments for malaria remains inadequate for those in need, and there is concern over the emergence of resistance to these treatments. In 2010, the Global Fund launched the Affordable Medicines Facility--malaria (AMFm), a series of national-scale pilot programmes designed to increase the access and use of quality-assured artemisinin based combination therapies (QAACTs) and reduce that of artemisinin monotherapies for treatment of malaria. AMFm involves manufacturer price negotiations, subsidies on the manufacturer price of each treatment purchased, and supporting interventions such as communications campaigns. We present findings on the effect of AMFm on QAACT price, availability, and market share, 6-15 months after the delivery of subsidised ACTs in Ghana, Kenya, Madagascar, Niger, Nigeria, Uganda, and Tanzania (including Zanzibar). METHODS: We did nationally representative baseline and endpoint surveys of public and private sector outlets that stock antimalarial treatments. QAACTs were identified on the basis of the Global Fund's quality assurance policy. Changes in availability, price, and market share were assessed against specified success benchmarks for 1 year of AMFm implementation. Key informant interviews and document reviews recorded contextual factors and the implementation process. FINDINGS: In all pilots except Niger and Madagascar, there were large increases in QAACT availability (25Ā·8-51Ā·9 percentage points), and market share (15Ā·9-40Ā·3 percentage points), driven mainly by changes in the private for-profit sector. Large falls in median price for QAACTs per adult equivalent dose were seen in the private for-profit sector in six pilots, ranging from US$1Ā·28 to $4Ā·82. The market share of oral artemisinin monotherapies decreased in Nigeria and Zanzibar, the two pilots where it was more than 5% at baseline. INTERPRETATION: Subsidies combined with supporting interventions can be effective in rapidly improving availability, price, and market share of QAACTs, particularly in the private for-profit sector. Decisions about the future of AMFm should also consider the effect on use in vulnerable populations, access to malaria diagnostics, and cost-effectiveness. FUNDING: The Global Fund to Fight AIDS, Tuberculosis and Malaria, and the Bill & Melinda Gates Foundation.
Subject(s)
Antimalarials/economics , Artemisinins/economics , Lactones/economics , Malaria/drug therapy , Africa , Antimalarials/standards , Antimalarials/supply & distribution , Artemisinins/standards , Artemisinins/supply & distribution , Drug Costs , Humans , Lactones/standards , Lactones/supply & distribution , Malaria/economics , Marketing of Health Services , Pharmacies/economics , Pharmacies/statistics & numerical data , Pilot Projects , Private Sector/economics , Public Sector/economicsSubject(s)
Antimalarials/economics , Artemisinins/economics , Lactones/economics , Malaria/drug therapy , HumansABSTRACT
BACKGROUND & OBJECTIVE: HIV estimates in India were based on HIV sentinel surveillance (HSS) data and several assumptions. Expansion of sentinel surveillance to all districts and community based HIV prevalence measured by National Family Health Survey-3 (NFHS-3) in 2006 provided opportunity to replace many of the assumptions with evidence based information and improve the HIV estimate closer to reality. This article presents a detailed account of the methodology used for the 2006 HIV burden estimates for India. METHODS: State-wise adult HIV prevalence among different risk groups observed from HSS 2006 was adjusted for site level variations using a random effects model and for the previous four years the same was back calculated using trend equations derived from a mixed effects logistic regression model based on consistent sites prevalence. The adjusted HIV prevalence among the general population was calibrated to the estimates from NFHS-3. Overall point estimates of adult HIV prevalence in each State for 2002-2006 were derived from the UNAIDS Workbook and projected for the period 1985-2010. The results were put into Spectrum to derive estimates of the number of people living with HIV in all ages and other epidemic impacts. RESULTS: National adult HIV prevalence was 0.36 per cent (range 0.29-0.46%) and the estimated number of people living with HIV was 2.47 million (range 2.0-3.1 million) in 2006. The national adult HIV prevalence remains stable around 0.4 per cent between 2002 and 2006. The States with the highest estimated prevalence were Manipur, Nagaland and Andhra Pradesh. The States with the highest burden were Andhra Pradesh, Maharashtra, Karnataka and Tamil Nadu. INTERPRETATION & CONCLUSION: The improvement in the 2006 estimates of the HIV burden in India is attributable to the expanded sentinel surveillance and representative data from the population-based survey in 2006, combined with an improved analysis. Despite the downward revision, India continues to face a formidable challenge to provide prevention, treatment and care to those in need.
Subject(s)
HIV Infections/epidemiology , Sentinel Surveillance , Epidemiologic Methods , Humans , India/epidemiology , Logistic Models , Models, Theoretical , PrevalenceABSTRACT
BACKGROUND: Under-five and maternal mortality were halved in the Millennium Development Goals (MDG) era, with slower reductions for 2.6 million neonatal deaths and 2.6 million stillbirths. The Every Newborn Action Plan aims to accelerate progress towards national targets, and includes an ambitious Measurement Improvement Roadmap. Population-based household surveys, notably Demographic and Health Surveys (DHS) and Multiple Indicator Cluster Surveys, are major sources of population-level data on child mortality in countries with weaker civil registration and vital statistics systems, where over two-thirds of global child deaths occur. To estimate neonatal/child mortality and pregnancy outcomes (stillbirths, miscarriages, birthweight, gestational age) the most common direct methods are: (1) the standard DHS-7 with Full Birth History with additional questions on pregnancy losses in the past 5 years (FBH+) or (2) a Full Pregnancy History (FPH). No direct comparison of these two methods has been undertaken, although descriptive analyses suggest that the FBH+ may underestimate mortality rates particularly for stillbirths. METHODS: This is the protocol paper for the Every Newborn-INDEPTH study (INDEPTH Network, International Network for the Demographic Evaluation of Populations and their Health Every Newborn, Every Newborn Action Plan), aiming to undertake a randomised comparison of FBH+ and FPH to measure pregnancy outcomes in a household survey in five selected INDEPTH Network sites in Africa and South Asia (Bandim in urban and rural Guinea-Bissau; Dabat in Ethiopia; IgangaMayuge in Uganda; Kintampo in Ghana; Matlab in Bangladesh). The survey will reach >68 000 pregnancies to assess if there is ≥15% difference in stillbirth rates. Additional questions will capture birthweight, gestational age, birth/death certification, termination of pregnancy and fertility intentions. The World Bank's Survey Solutions platform will be tailored for data collection, including recording paradata to evaluate timing. A mixed methods assessment of barriers and enablers to reporting of pregnancy and adverse pregnancy outcomes will be undertaken. CONCLUSIONS: This large-scale study is the first randomised comparison of these two methods to capture pregnancy outcomes. Results are expected to inform the evidence base for survey methodology, especially in DHS, regarding capture of stillbirths and other outcomes, notably neonatal deaths, abortions (spontaneous and induced), birthweight and gestational age. In addition, this study will inform strategies to improve health and demographic surveillance capture of neonatal/child mortality and pregnancy outcomes.
Subject(s)
Infant Mortality , Population Surveillance/methods , Stillbirth/epidemiology , Africa/epidemiology , Asia/epidemiology , Family Characteristics , Female , Humans , Infant , Infant, Newborn , Pregnancy , Surveys and QuestionnairesABSTRACT
BACKGROUND: Formal validation studies are of critical importance in determining whether or not household survey questions are providing accurate information on what they intend to measure. These studies supplement an array of methods used to evaluate survey questions. METHODS AND FINDINGS: This paper summarizes the methods used by the two major international household survey programmes - The Demographic and Health Surveys Program (DHS) and the Multiple Indicator Cluster Surveys (MICS) - to decide on possible modifications to the survey questions, nomenclature, tables, and interpretation of findings over time as additional information on the validity of the questions becomes available. CONCLUSIONS: Validation studies are most useful if they are conducted in a variety of different settings in low- and middle-income countries, preferably using representative samples and procedures that replicate DHS and MICS field conditions. Pilot tests, pre-tests in each country, feedback from interviewers and survey staff, and cognitive interviewing provide additional information about how well survey questions are understood and provide accurate information. The paper provides specific examples of changes that have been made in response to findings from validation studies and changes in international recommendations.
Subject(s)
Surveys and Questionnaires/standards , Validation Studies as Topic , Humans , Internationality , Reproducibility of ResultsABSTRACT
OBJECTIVE: To describe an approach for evaluating the impact of malaria control efforts on malaria-associated mortality in sub-Saharan Africa, where disease-specific mortality trends usually cannot be measured directly and most malaria deaths occur among young children. METHODS: Methods for evaluating changes in malaria-associated mortality are examined; advantages and disadvantages are presented. RESULTS: All methods require a plausibility argument-i.e., an assumption that mortality reductions can be attributed to programmatic efforts if improvements are found in steps of the causal pathway between intervention scale-up and mortality trends. As different methods provide complementary information, they can be used together. We recommend following trends in the coverage of malaria control interventions, other factors influencing childhood mortality, malaria-associated morbidity (especially anaemia), and all-cause childhood mortality. This approach reflects decreases in malaria's direct and indirect mortality burden and can be examined in nearly all countries. Adding other information can strengthen the plausibility argument: trends in indicators of malaria transmission, information from demographic surveillance systems and sentinel sites where malaria diagnostics are systematically used, and verbal autopsies linked to representative household surveys. Health facility data on malaria deaths have well-recognized limitations; however, in specific circumstances, they could produce reliable trends. Model-based predictions can help describe changes in malaria-specific burden and assist with program management and advocacy. CONCLUSIONS: Despite challenges, efforts to reduce malaria-associated mortality in Africa can be evaluated with trends in malaria intervention coverage and all-cause childhood mortality. Where there are resources and interest, complementary data on malaria morbidity and malaria-specific mortality could be added.