Human resource challenges in health systems: evidence from ten African countries.

Sub-Saharan Africa has fewer medical workers per capita than any region of the world, and that shortage has been highlighted consistently as a critical constraint to improving health outcomes in the region. This paper draws on newly available, systematic, comparable data from ten countries in the region to explore the dimensions of this shortage. We find wide variation in human resources performance metrics, both within and across countries. Many facilities are barely staffed, and effective staffing levels fall further when adjusted for health worker absences. However, caseloads-while also varying widely within and across countries-are also low in many settings, suggesting that even within countries, deployment rather than shortages, together with barriers to demand, may be the principal challenges. Beyond raw numbers, we observe significant proportions of health workers with very low levels of clinical knowledge on standard maternal and child health conditions. This work demonstrates that countries may need to invest broadly in health workforce deployment, improvements in capacity and performance of the health workforce, and on addressing demand constraints, rather than focusing narrowly on increases in staffing numbers.

Delays in accessing high-quality care for newborns in East Africa: An analysis of survey data in Malawi, Mozambique, and Tanzania.

Background: Despite the existence of evidence-based interventions, substantial progress in reducing neonatal mortality is lagging, indicating that small and sick newborns (SSNs) are likely not receiving the care they require to survive and thrive. The 'three delays model' provides a framework for understanding the challenges in accessing care for SSNs. However, the extent to which each delay impacts access to care for SSNs is not well understood. To fill this evidence gap, we explored the impact of each of the three delays on access to care for SSNs in Malawi, Mozambique, and Tanzania. Methods: Secondary analyses of data from three different surveys served as the foundation of this study. To understand the impact of delays in the decision to seek care (delay 1) and the ability to reach an appropriate point of care (delay 2), we investigated time trends in place of birth disaggregated by facility type. We also explored care-seeking behaviours for newborns who died. To understand the impact of delays in accessing high-quality care after reaching a facility (delay 3), we measured facility readiness to manage care for SSNs. We used this measure to adjust institutional delivery coverage for SSN care readiness. Results: Coverage of institutional deliveries was substantially lower after adjusting for facility readiness to manage SSN care, with decreases of 30 percentage points (pp) in Malawi, 14 pp in Mozambique, and 24 pp in Tanzania. While trends suggest more SSNs are born in facilities, substantial gaps remain in facilities' capacities to provide lifesaving interventions. In addition, exploration of care-seeking pathways revealed that a substantial proportion of newborn deaths occurred outside of health facilities, indicating barriers in the decision to seek care or the ability to reach an appropriate source of care may also prevent SSNs from receiving these interventions. Conclusions: Investments are needed to overcome delays in accessing high-quality care for the most vulnerable newborns, those who are born small or sick. As more mothers and newborns access health services in low- and middle-income countries, ensuring that life-saving interventions for SSNs are available at the locations where newborns are born and seek care after birth is critical.

Association between antenatal care facility readiness and provision of care at the client level and facility level in five low- and middle-income countries.

BACKGROUND: Despite growing interest in monitoring improvements in quality of care, data on service quality in low-income and middle-income countries (LMICs) is limited. While health systems researchers have hypothesized the relationship between facility readiness and provision of care, there have been few attempts to quantify this relationship in LMICs. This study assesses the association between facility readiness and provision of care for antenatal care at the client level and facility level. METHODS: To assess the association between provision of care and various facility readiness indices for antenatal care, we used multilevel, multivariable random-effects linear regression models. We tested an inflection point on readiness scores by fitting linear spline models. To compare the coefficients between models, we used a bootstrapping approach and calculated the mean difference between all pairwise comparisons. Analyses were conducted at client and facility levels. RESULTS: Our results showed a small, but significant association between facility readiness and provision of care across countries and most index constructions. The association was most evident in the client-level analyses that had a larger sample size and were adjusted for factors at the facility, health worker, and individual levels. In addition, spline models at a facility readiness score of 50 better fit the data, indicating a plausible threshold effect. CONCLUSIONS: The results of this study suggest that facility readiness is not a proxy for provision of care, but that there is an important association between facility readiness and provision of care. Data on facility readiness is necessary for understanding the foundations of health systems particularly in countries with the lowest levels of service quality. However, a comprehensive view of quality of care should include both facility readiness and provision of care measures.

Exploring approaches to weighting estimates of facility readiness to provide health services used for estimating input-adjusted effective coverage: a case study using data from Tanzania.

The ideal approach for calculating effective coverage of health services using ecological linking requires accounting for variability in facility readiness to provide health services and patient volume by incorporating adjustments for facility type into estimates of facility readiness and weighting facility readiness estimates by service-specific caseload. The aim of this study is to compare the ideal caseload-weighted facility readiness approach to two alternative approaches: (1) facility-weighted readiness and (2) observation-weighted readiness to assess the suitability of each as a proxy for caseload-weighted facility readiness. We utilised the 2014-2015 Tanzania Service Provision Assessment along with routine health information system data to calculate facility readiness estimates using the three approaches. We then conducted equivalence testing, using the caseload-weighted estimates as the ideal approach and comparing with the facility-weighted estimates and observation-weighted estimates to test for equivalence. Comparing the facility-weighted readiness estimates to the caseload-weighted readiness estimates, we found that 58% of the estimates met the requirements for equivalence. In addition, the facility-weighted readiness estimates consistently underestimated, by a small percentage, facility readiness as compared to the caseload-weighted readiness estimates. Comparing the observation-weighted readiness estimates to the caseload-weighted readiness estimates, we found that 64% of the estimates met the requirements for equivalence. We found that, in this setting, both facility-weighted readiness and observation-weighted readiness may be reasonable proxies for caseload-weighted readiness. However, in a setting with more variability in facility readiness or larger differences in facility readiness between low caseload and high caseload facilities, the observation-weighted approach would be a better option than the facility-weighted approach. While the methods compared showed equivalence, our results suggest that selecting the best method for weighting readiness estimates will require assessing data availability alongside knowledge of the country context.

Development of indicators for integrated antenatal care service provision: a feasibility study in Burkina Faso, Kenya, Malawi, Senegal and Sierra Leone.

OBJECTIVES: While service integration has gained prominence as an objective of many global initiatives, there is no widely recognised single definition of integration nor a clear understanding of how programmes are integrated into health systems to achieve improved health outcomes. This study aims to review measurement approaches for integrated antenatal care (ANC) services, propose and operationalise indicators for measuring ANC service integration and inform an integrated ANC indicator recommendation for use in low-income and middle-income countries (LMICs). DESIGN: Feasibility study. SETTING: Burkina Faso, Kenya, Malawi, Senegal and Sierra Leone. METHODS: Our six-step approach included: (1) conceptualise ANC service integration models; (2) conduct a targeted literature review on measurement of ANC service integration; (3) develop criteria for ANC service integration indicators; (4) propose indicators for ANC service integration; (5) use extant data to operationalise the indicators; and (6) synthesise information to make an integrated ANC indicator recommendation for use in LMICs. RESULTS: Given the multidimensionality of integration, we outlined three models for conceptualising ANC service integration: integrated health systems, continuity of care and coordinated care. Looking across ANC service integration estimates, there were large differences between estimates for ANC service integration depending on the model used, and in some countries, the ANC integration indicator definition within a model. No one integrated ANC indicator was consistently the highest estimate for ANC service integration. However, continuity of care was consistently the lowest estimate for ANC service integration. CONCLUSIONS: Integrated ANC services are foundational to ensuring universal health coverage. However, our findings demonstrate the complexities in monitoring indicators of ANC service quality using extant data in LMICs. Given the challenges, it is recommended that countries focus on monitoring measures of service quality. In addition, efforts should be made to improve data collection tools and routine health information systems to better capture measures of service integration.

The RADAR coverage tool: developing a toolkit for rigorous household surveys for reproductive, maternal, newborn, and child health & nutrition indicators.

Population-based intervention coverage data are used to inform the design of projects, programs, and policies and to evaluate their impact. In low- and middle-income countries (LMICs), household surveys are the primary source of coverage data. Many coverage surveys are implemented by organizations with limited experience or resources in population-based data collection. We developed a streamlined survey and set of supporting materials to facilitate rigorous survey design and implementation. The RADAR coverage survey tool aimed to 1) rigorously measure priority reproductive, maternal, newborn, child health & nutrition coverage indicators, and allow for equity and gender analyses; 2) use standard, valid questions, to the extent possible; 3) be as light as possible; 4) be flexible to address users' needs; and 5) be compatible with the Lives Saved Tool for analysis of program impact. Early interactions with stakeholders also highlighted survey planning, implementation, and analysis as challenging areas. We therefore developed a suite of resources to support implementers in these areas. The toolkit was piloted by implementers in Tanzania and in Burkina Faso. Although the toolkit was successfully implemented in these settings and facilitated survey planning and implementation, we found that implementers must still have access to sufficient resources, time, and technical expertise in order to use the tool appropriately. This potentially limits the use of the tool to situations where high-quality surveys or evaluations have been prioritized and adequately resourced.

Creating a Global Legal and Policy Database and Document Repository: Challenges and Lessons Learned From the World Health Organization Sexual, Reproductive, Maternal, Newborn, Child and Adolescent Health Policy Survey.

The World Health Organization (WHO) has collected information on policies on sexual, reproductive, maternal, newborn, child and adolescent health (SRMNCAH) over many years. Creating a global survey that works for every country context is a well-recognized challenge. A comprehensive SRMNCAH policy survey was conducted by WHO from August 2018 through May 2019. WHO regional and country offices coordinated with Ministries of Health and/or national institutions who completed the questionnaire. The survey was completed by 150 of 194 WHO Member States using an online platform that allowed for submission of national source documents. A validation of the responses for selected survey questions against content of the national source documents was conducted for 101 countries (67%) for the first time in the administration of the survey. Data validation draws attention to survey questions that may have been misunderstood or where there was a lot of missing data, but varying methods for validating survey responses against source documents and separate analysis of laws from policies and guidelines may have hindered the overall conclusions of this process. The SRMNCAH policy survey both provided a platform for countries to track their progress in adopting WHO recommendations in national SRMNCAH-related legislation, policies, guidelines and strategies and was used to create a global database and searchable document repository. The outputs of the SRMNCAH policy survey are resources whose importance will be enriched through policy dialogues and wide utilization. Lessons learned from the methodology used for this survey can help to improve future updates and inform similar efforts.

Advancing nutrition measurement: Developing quantitative measures of nutrition service quality for pregnant women and children in low- and middle-income country health systems.

The health sector plays an important role in the delivery of high-quality nutrition interventions to women and children in low- and middle-income countries (LMICs). However, there are no standardized approaches to defining and measuring nutrition service quality in these contexts. This study aims to systematically develop quality of care indices for direct health systems nutrition interventions using a five-step process: (1) identify recommended interventions for inclusion in indices, (2) extract service readiness, provision of care, and experience of care items from intervention-specific clinical guidelines, (3) map items to data available in global health facility surveys, (4) conduct an expert survey to prioritize interventions and items, and (5) use findings from previous steps to propose quality of care metrics. Thirty-two recommended interventions were identified, for which the guidelines review yielded 763 unique items that were reviewed by experts. The proposed nutrition quality of care indices for pregnant women reflects eight interventions and the indices for children under 5 reflects six interventions. The indices provide a standardized measure for nutrition intervention quality and can be operationalized using existing health facility assessment data, facilitating their use by LMIC decision makers for planning and resource allocation.

The gender and geography of publishing: a review of sex/gender reporting and author representation in leading general medical and global health journals.

INTRODUCTION: Diverse gender and geographical representation matters in research. We aimed to review medical and global health journals' sex/gender reporting, and the gender and geography of authorship. METHODS: 542 research and non-research articles from 14 selected journals were reviewed using a retrospective survey design. Paper screening and systematic data extraction was conducted with descriptive statistics and regression analyses calculated from the coded data. Outcome measures were journal characteristics, the extent to which published articles met sex/gender reporting guidelines, plus author gender and location of their affiliated institution. RESULTS: Five of the fourteen journals explicitly encourage sex/gender analysis in their author instructions, but this did not lead to increased sex/gender reporting beyond the gender of study participants (OR=3.69; p=0.000 (CI 1.79 to 7.60)). Just over half of research articles presented some level of sex/gender analysis, while 40% mentioned sex/gender in their discussion. Articles with women first and last authors were 2.4 times more likely to discuss sex/gender than articles with men in those positions (p=0.035 (CI 1.062 to 5.348)). First and last authors from high-income countries (HICs) were 19 times as prevalent as authors from low-income countries; and women from low-income and middle-income countries were at a disadvantage in terms of the impact factor of the journals they published in. CONCLUSION: Global health and medical research fails to consistently apply a sex/gender lens and remains largely the preserve of authors in HIC. Collaborative partnerships and funding support are needed to promote gender-sensitive research and dismantle historical power dynamics in authorship.

How prepared is Mozambique to treat COVID-19 patients? A new approach for estimating oxygen service availability, oxygen treatment capacity, and population access to oxygen-ready treatment facilities.

BACKGROUND: This study aims to assess the COVID-19 response preparedness of the Mozambican health system by 1) determining the location of oxygen-ready public health facilities, 2) estimating the oxygen treatment capacity, and 3) determining the population coverage of oxygen-ready health facilities in Mozambique. METHODS: This analysis utilizes information on the availability of oxygen sources and delivery apparatuses to determine if a health facility is ready to deliver oxygen therapy to patients in need, and estimates how many patients can be treated with continuous oxygen flow for a 7-day period based on the available oxygen equipment at health facilities. Using GIS mapping software, the study team modeled varying travel times to oxygen-ready facilities to estimate the proportion of the population with access to care. RESULTS: 0.4% of all health facilities in Mozambique are prepared to deliver oxygen therapy to patients, for a cumulative total of 283.9 to 406.0 patients-weeks given the existing national capacity, under varying assumptions including ability to divert oxygen from a single source to multiple patients. 35% of the population in Mozambique has adequate access within one-hour driving time of an oxygen-ready health facility. This varies widely by region; 89.1% of the population of Maputo City was captured by the one-hour driving time network, as compared ot 4.4% of the population of Niassa province. CONCLUSIONS: The Mozambican health system faces the dual challenges of under-resourced health facilities and low geographic accessibility to healthcare as it prepares to confront the COVID-19 pandemic. This analysis also illustrates the disparity between provinces in preparedness to deliver oxygen therapy to patient, with Cabo Delgado and Nampula being particularly under-resourced.

Development of summary indices of antenatal care service quality in Haiti, Malawi and Tanzania.

INTRODUCTION: Measuring quality of care in low-income and middle-income countries is complicated by the lack of a standard, universally accepted definition for 'quality' for any particular service, as well as limited guidance on which indicators to include in measures of quality of care, and how to incorporate those indicators into summary indices. The aim of this paper is to develop, characterise and compare a set of antenatal care (ANC) indices for facility readiness and provision of care. METHODS: We created nine indices for facility readiness using three methods for selecting items and three methods for combining items. In addition, we created three indices for provision of care using one method for selecting items and three methods for combining items. For each index, we calculated descriptive statistics, categorised the continuous index scores using tercile cut points to assess comparability of facility classification, and examined the variability and distribution of scores. RESULTS: Our results showed that, within a country, the indices were quite similar in terms of mean index score, facility classification, coefficient of variation, floor and ceiling effects, and the inclusion of items in an index with a range of variability. Notably, the indices created using principal components analysis to combine the items were the most different from the other indices. In addition, the index created by taking a weighted average of a core set of items had lower agreement with the other indices when looking at facility classification. CONCLUSIONS: As improving quality of care becomes integral to global efforts to produce better health outcomes, demand for guidance on creating standardised measures of service quality will grow. This study provides health systems researchers with a comparison of methodologies commonly used to create summary indices of ANC service quality and it highlights the similarities and differences between methods.

Understanding client and provider perspectives of antenatal care service quality: a qualitative multi-method study from Tanzania.

BACKGROUND: Measures of quality of care in low- and middle-income countries (LMICs) rarely include experience of care. This gap in service quality metrics may be driven by a lack of understanding of client and provider perspectives. Understanding these perspectives is a critical first step in not only improving metrics, but also in improving service delivery. This study identifies the items antenatal care (ANC) clients and health care providers in Tanzania associate with a quality ANC service and explores the experience of care domain from both client and provider perspectives. METHODS: We conducted semi-structured interviews with15 providers and 35 clients in Tanzania that included a free-listing activity to elicit items clients and providers associate with quality ANC services. We analyzed the free-listing for rank order and frequency to identify the most salient items, which were included in the second phase of data collection. We then conducted semi-structured interviews with a pile sort activity with the same 15 providers and 32 new clients to understand the importance of the items identified in the free-listing. We used a thematic analysis driven by the framework approach to analyze interview data. RESULTS: Both clients and providers perceived quality of ANC as being comprised of items related to experience of care, provision of care, and cross-cutting essential physical and human resources. The free-listing findings illuminated that the experience of care was equally important to clients and providers as the availability of physical and human resources and the content of the care delivered. In addition, clients and providers perceived that a positive patient care experience - marked by good communication, active listening, keeping confidentiality, and being spoken to politely - increased utilization of health services and improved health outcomes. CONCLUSIONS: The experience of care in LMICs is an overlooked, yet critically important topic. Understanding the experience of care from those who receive and deliver services is key to measuring and improving the quality of ANC. Our research highlights the importance of incorporating experience of care into future quality improvement activities and quality measures. By doing so, we identify barriers and facilitating factors of practical use to policy-makers and governments in LMICs.

Optimizing data visualization for reproductive, maternal, newborn, child health, and nutrition (RMNCH&N) policymaking: data visualization preferences and interpretation capacity among decision-makers in Tanzania.

BACKGROUND: Reproductive, maternal, newborn, child health, and nutrition (RMNCH&N) data is an indispensable tool for program and policy decisions in low- and middle-income countries. However, being equipped with evidence doesn't necessarily translate to program and policy changes. This study aimed to characterize data visualization interpretation capacity and preferences among RMNCH&N Tanzanian program implementers and policymakers ("decision-makers") to design more effective approaches towards promoting evidence-based RMNCH&N decisions in Tanzania. METHODS: We conducted 25 semi-structured interviews in Kiswahili with junior, mid-level, and senior RMNCH&N decision-makers working in Tanzanian government institutions. We used snowball sampling to recruit participants with different rank and roles in RMNCH&N decision-making. Using semi-structured interviews, we probed participants on their statistical skills and data use, and asked participants to identify key messages and rank prepared RMNCH&N visualizations. We used a grounded theory approach to organize themes and identify findings. RESULTS: The findings suggest that data literacy and statistical skills among RMNCH&N decision-makers in Tanzania varies. Most participants demonstrated awareness of many critical factors that should influence a visualization choice-audience, key message, simplicity-but assessments of data interpretation and preferences suggest that there may be weak knowledge of basic statistics. A majority of decision-makers have not had any statistical training since attending university. There appeared to be some discomfort with interpreting and using visualizations that are not bar charts, pie charts, and maps. CONCLUSIONS: Decision-makers must be able to understand and interpret RMNCH&N data they receive to be empowered to act. Addressing inadequate data literacy and presentation skills among decision-makers is vital to bridging gaps between evidence and policymaking. It would be beneficial to host basic data literacy and visualization training for RMNCH&N decision-makers at all levels in Tanzania, and to expand skills on developing key messages from visualizations.

Methods for analysis of complex survey data: an application using the Tanzanian 2015 Demographic and Health Survey and Service Provision Assessment.

BACKGROUND: Low-income and middle-income countries (LMICs) seek to better utilize household and health facility survey data for monitoring and evaluation, as well as for health program planning. However, analysis of this complex survey data are complicated. In Tanzania, the National Evaluation Platform project sought to analyze Demographic and Health Survey (DHS) data and Service Provision Assessment (SPA) data as part of an evaluation of the national One Plan for Maternal and Child Health. To support this evaluation, we used this survey data to answer two key methodological questions: 1) what are the benefits and costs of using sampling weights in rate estimation; and 2) what is the best method for calculating standard errors in these two surveys? METHODS: We conducted a simulation study for each methodologic question. The first simulation study assessed the benefits and costs of using sampling weights in rate estimation. This simulation used weighted and unweighted estimates and examined bias, variance, and the mean squared error (MSE). The second simulation study assessed the best method for calculating standard errors comparing cluster bootstrapped variance estimation, design based asymptotic variance with one level (svy1), and design based asymptotic variance with three levels (svy3). We compared coverage probability and confidence interval length. RESULTS: Our results showed that although weighted estimates were less biased, unweighted estimates were less variable. The weighted estimates had a lower MSE, indicating that the effect of the bias trade-off was greater than the effect of the variance trade-off for most indicators assessed. The best performer for variance estimation was the cluster bootstrap method, followed by the svy3 method. The svy1 method was the worst performer for most indicators assessed. CONCLUSIONS: As complex survey data become more widely used for policymaking in LMICs, there is a need for guidance on the best methods for analyzing this data. The standard of practice has been a design-based analysis using survey weights and the single-level svy method for calculating standard errors. This study puts forth an alternative approach to analysis. In addition, this study offers practical guidance on determining the best method for analysis of complex survey data.

Use of Service Provision Assessments and Service Availability and Readiness Assessments for monitoring quality of maternal and newborn health services in low-income and middle-income countries.

Improving the quality of maternal and newborn health (MNH) services is key to reducing adverse MNH outcomes in low-income and middle-income countries (LMICs). The Service Provision Assessment (SPA) and Service Availability and Readiness Assessment (SARA) are the most widely employed, standardised tools that generate health service delivery data in LMICs. We ascertained the use of SPA/SARA surveys for assessing the quality of MNH services using a two-step approach: a SPA/SARA questionnaire mapping exercise in line with WHO's Quality of Care (QoC) Framework for pregnant women and newborns and the WHO quality standards for care around the time of childbirth; and a scoping literature review, searching for articles that report SPA/SARA data. SPA/SARA surveys are well suited to assess the WHO Framework's cross-cutting dimensions (physical and human resources); SPA also captures elements in the provision and experience of care domains for antenatal care and family planning. Only 4 of 31 proposed WHO quality indicators around the time of childbirth can be fully generated using SPA and SARA surveys, while 19 and 23 quality indicators can be partially obtained from SARA and SPA surveys, respectively; most of these are input indicators. Use of SPA/SARA data is growing, but there is considerable variation in methods employed to measure MNH QoC. With SPA/SARA data available in 30 countries, MNH QoC assessments could benefit from guidance for creating standard metrics. Adding questions in SPA/SARA surveys to assess the WHO QoC Framework's provision and experience of care dimensions would fill significant data gaps in LMICs.

Quality of clinical care and bypassing of primary health centers in India.

In many low and middle-income countries patients often bypass the nearest government health center offering free or subsidized services and seek more expensive care elsewhere. This study examines the role of quality of care, in particular clinician competence and structural quality of the health center, on bypassing behavior. Data for this study comes from a survey of 136 primary health centers (PHCs) and 3517 individuals living in the PHC's immediate vicinity in rural Chhattisgarh, India. Overall, the majority (67%) of patients bypassed the local PHC when seeking treatment. Bypassing decreased as provider competence increased, up to a point, after which, improvements in competency did not reduce bypassing. The clinical competence of the health care provider had a greater effect on reducing bypassing compared to PHC structural quality such as the building condition and drug stock-outs. However, the regular presence of clinical providers in the PHC was associated with lower bypassing. Patients that visited the local PHC spent half as much out-of-pocket as those that were treated at private clinics. Poor patients were less likely to bypass the local PHC compared to non-poor patients. These findings suggest that improving structural quality is not sufficient to reduce bypassing of PHCs. While better provider competency can substantially reduce bypassing, beyond a threshold competency level there is little effect. Efforts to strengthen facility-based primary care services need to go beyond simply focusing on improving infrastructure or quality of clinical care. There is a need to rethink how PHCs can be made more relevant to the health care needs of the communities they serve.

Monitoring service delivery for universal health coverage: the Service Availability and Readiness Assessment.

OBJECTIVE: To describe the Service Availability and Readiness Assessment (SARA) and the results of its implementation in six countries across three continents. METHODS: The SARA is a comprehensive approach for assessing and monitoring health service availability and the readiness of facilities to deliver health-care interventions, with a standardized set of indicators that cover all main programmes. Standardized data-collection instruments are used to gather information on a defined set of selected tracer items from public and private health facilities through a facility sample survey or census. Results from assessments in six countries are shown. FINDINGS: The results highlight important gaps in service delivery that are obstacles to universal access to health services. Considerable variation was found within and across countries in the distribution of health facility infrastructure and workforce and in the types of services offered. Weaknesses in laboratory diagnostic capacities and gaps in essential medicines and commodities were common across all countries. CONCLUSION: The SARA fills an important information gap in monitoring health system performance and universal health coverage by providing objective and regular information on all major health programmes that feeds into country planning cycles.