Population assessment of health system performance in 16 countries.

Objective: To demonstrate how the new internationally comparable instrument, the People's Voice Survey, can be used to contribute the perspective of the population in assessing health system performance in countries of all levels of income. Methods: We surveyed representative samples of populations in 16 low-, middle- and high-income countries on health-care utilization, experience and confidence during 2022-2023. We summarized and visualized data corresponding to the key domains of the World Health Organization universal health coverage framework for health system performance assessment. We examined correlation with per capita health spending by calculating Pearson coefficients, and within-country income-based inequities using the slope index of inequality. Findings: In the domain of care effectiveness, we found major gaps in health screenings and endorsement of public primary care. Only one in three respondents reported very good user experience during health visits, with lower proportions in low-income countries. Access to health care was rated highest of all domains; however, only half of the populations felt secure that they could access and afford high-quality care if they became ill. Populations rated the quality of private health systems higher than that of public health systems in most countries. Only half of respondents felt involved in decision-making (less in high-income countries). Within countries, we found statistically significant pro-rich inequalities across many indicators. Conclusion: Populations can provide vital information about the real-world function of health systems, complementing other system performance metrics. Population-wide surveys such as the People's Voice Survey should become part of regular health system performance assessments.

Measuring people's views on health system performance: Design and development of the People's Voice Survey.

Todd Lewis and co-authors discuss development and use of the People's Voice Survey for health system assessment.

Improving health and social systems for all children in LMICs: structural innovations to deliver high-quality services.

Despite health gains over the past 30 years, children and adolescents are not reaching their health potential in many low-income and middle-income countries (LMICs). In addition to health systems, social systems, such as schools, communities, families, and digital platforms, can be used to promote health. We did a targeted literature review of how well health and social systems are meeting the needs of children in LMICs using the framework of The Lancet Global Health Commission on high-quality health systems and we reviewed evidence for structural reforms in health and social sectors. We found that quality of services for children is substandard across both health and social systems. Health systems have deficits in care competence (eg, diagnosis and management), system competence (eg, timeliness, continuity, and referral), user experience (eg, respect and usability), service provision for common and serious conditions (eg, cancer, trauma, and mental health), and service offerings for adolescents. Education and social services for child health are limited by low funding and poor coordination with other sectors. Structural reforms are more likely to improve service quality substantially and at scale than are micro-level efforts. Promising approaches include governing for quality (eg, leadership, expert management, and learning systems), redesigning service delivery to maximise outcomes, and empowering families to better care for children and to demand quality care from health and social systems. Additional research is needed on health needs across the life course, health system performance for children and families, and large-scale evaluation of promising health and social programmes.

What can work and how? An overview of evidence-based interventions and delivery strategies to support health and human development from before conception to 20 years.

Progress has been made globally in improving the coverage of key maternal, newborn, and early childhood interventions in low-income and middle-income countries, which has contributed to a decrease in child mortality and morbidity. However, inequities remain, and many children and adolescents are still not covered by life-saving and nurturing care interventions, despite their relatively low costs and high cost-effectiveness. This Series paper builds on a large body of work from the past two decades on evidence-based interventions and packages of care for survival, strategies for delivery, and platforms to reach the most vulnerable. We review the current evidence base on the effectiveness of a variety of essential and emerging interventions that can be delivered from before conception until age 20 years to help children and adolescents not only survive into adulthood, but also to grow and develop optimally, support their wellbeing, and help them reach their full developmental potential. Although scaling up evidence-based interventions in children younger than 5 years might have the greatest effect on reducing child mortality rates, we highlight interventions and evidence gaps for school-age children (5-9 years) and the transition from childhood to adolescence (10-19 years), including interventions to support mental health and positive development, and address unintentional injuries, neglected tropical diseases, and non-communicable diseases.

Associations between the stringency of COVID-19 containment policies and health service disruptions in 10 countries.

BACKGROUND: Disruptions in essential health services during the COVID-19 pandemic have been reported in several countries. Yet, patterns in health service disruption according to country responses remain unclear. In this paper, we investigate associations between the stringency of COVID-19 containment policies and disruptions in 31 health services in 10 low- middle- and high-income countries in 2020. METHODS: Using routine health information systems and administrative data from 10 countries (Chile, Ethiopia, Ghana, Haiti, Lao People's Democratic Republic, Mexico, Nepal, South Africa, South Korea, and Thailand) we estimated health service disruptions for the period of April to December 2020 by dividing monthly service provision at national levels by the average service provision in the 15 months pre-COVID (January 2019-March 2020). We used the Oxford COVID-19 Government Response Tracker (OxCGRT) index and multi-level linear regression analyses to assess associations between the stringency of restrictions and health service disruptions over nine months. We extended the analysis by examining associations between 11 individual containment or closure policies and health service disruptions. Models were adjusted for COVID caseload, health service category and country GDP and included robust standard errors. FINDINGS: Chronic disease care was among the most affected services. Regression analyses revealed that a 10% increase in the mean stringency index was associated with a 3.3 percentage-point (95% CI -3.9, -2.7) reduction in relative service volumes. Among individual policies, curfews, and the presence of a state of emergency, had the largest coefficients and were associated with 14.1 (95% CI -19.6, 8.7) and 10.7 (95% CI -12.7, -8.7) percentage-point lower relative service volumes, respectively. In contrast, number of COVID-19 cases in 2020 was not associated with health service disruptions in any model. CONCLUSIONS: Although containment policies were crucial in reducing COVID-19 mortality in many contexts, it is important to consider the indirect effects of these restrictions. Strategies to improve the resilience of health systems should be designed to ensure that populations can continue accessing essential health care despite the presence of containment policies during future infectious disease outbreaks.

Tracking health system performance in times of crisis using routine health data: lessons learned from a multicountry consortium.

COVID-19 has prompted the use of readily available administrative data to track health system performance in times of crisis and to monitor disruptions in essential healthcare services. In this commentary we describe our experience working with these data and lessons learned across countries. Since April 2020, the Quality Evidence for Health System Transformation (QuEST) network has used administrative data and routine health information systems (RHIS) to assess health system performance during COVID-19 in Chile, Ethiopia, Ghana, Haiti, Lao People's Democratic Republic, Mexico, Nepal, South Africa, Republic of Korea and Thailand. We compiled a large set of indicators related to common health conditions for the purpose of multicountry comparisons. The study compiled 73 indicators. A total of 43% of the indicators compiled pertained to reproductive, maternal, newborn and child health (RMNCH). Only 12% of the indicators were related to hypertension, diabetes or cancer care. We also found few indicators related to mental health services and outcomes within these data systems. Moreover, 72% of the indicators compiled were related to volume of services delivered, 18% to health outcomes and only 10% to the quality of processes of care. While several datasets were complete or near-complete censuses of all health facilities in the country, others excluded some facility types or population groups. In some countries, RHIS did not capture services delivered through non-visit or nonconventional care during COVID-19, such as telemedicine. We propose the following recommendations to improve the analysis of administrative and RHIS data to track health system performance in times of crisis: ensure the scope of health conditions covered is aligned with the burden of disease, increase the number of indicators related to quality of care and health outcomes; incorporate data on nonconventional care such as telehealth; continue improving data quality and expand reporting from private sector facilities; move towards collecting patient-level data through electronic health records to facilitate quality-of-care assessment and equity analyses; implement more resilient and standardized health information technologies; reduce delays and loosen restrictions for researchers to access the data; complement routine data with patient-reported data; and employ mixed methods to better understand the underlying causes of service disruptions.

Implementation research on noncommunicable disease prevention and control interventions in low- and middle-income countries: A systematic review.

BACKGROUND: While the evidence for the clinical effectiveness of most noncommunicable disease (NCD) prevention and treatment interventions is well established, care delivery models and means of scaling these up in a variety of resource-constrained health systems are not. The objective of this review was to synthesize evidence on the current state of implementation research on priority NCD prevention and control interventions provided by health systems in low- and middle-income countries (LMICs). METHODS AND FINDINGS: On January 20, 2021, we searched MEDLINE and EMBASE databases from 1990 through 2020 to identify implementation research studies that focused on the World Health Organization (WHO) priority NCD prevention and control interventions targeting cardiovascular disease, cancer, diabetes, and chronic respiratory disease and provided within health systems in LMICs. Any empirical and peer-reviewed studies that focused on these interventions and reported implementation outcomes were eligible for inclusion. Given the focus on this review and the heterogeneity in aims and methodologies of included studies, risk of bias assessment to understand how effect size may have been compromised by bias is not applicable. We instead commented on the distribution of research designs and discussed about stronger/weaker designs. We synthesized extracted data using descriptive statistics and following the review protocol registered in PROSPERO (CRD42021252969). Of 9,683 potential studies and 7,419 unique records screened for inclusion, 222 eligible studies evaluated 265 priority NCD prevention and control interventions implemented in 62 countries (6% in low-income countries and 90% in middle-income countries). The number of studies published has been increasing over time. Nearly 40% of all the studies were on cervical cancer. With regards to intervention type, screening accounted for 49%, treatment for 39%, while prevention for 12% (with 80% of the latter focusing on prevention of the NCD behavior risk factors). Feasibility (38%) was the most studied implementation outcome followed by adoption (23%); few studies addressed sustainability. The implementation strategies were not specified well enough. Most studies used quantitative methods (86%). The weakest study design, preexperimental, and the strongest study design, experimental, were respectively employed in 25% and 24% of included studies. Approximately 72% of studies reported funding, with international funding being the predominant source. The majority of studies were proof of concept or pilot (88%) and targeted the micro level of health system (79%). Less than 5% of studies report using implementation research framework. CONCLUSIONS: Despite growth in implementation research on NCDs in LMICs, we found major gaps in the science. Future studies should prioritize implementation at scale, target higher levels health systems (meso and macro levels), and test sustainability of NCD programs. They should employ designs with stronger internal validity, be more conceptually driven, and use mixed methods to understand mechanisms. To maximize impact of the research under limited resources, adding implementation science outcomes to effectiveness research and regional collaborations are promising.

Service delivery reform for maternal and newborn health in Kakamega County, Kenya: study protocol for a prospective impact evaluation and implementation science study.

BACKGROUND: Maternal and neonatal mortality remain elevated in low and middle income countries, and progress is slower than needed to achieve the Sustainable Development Goals. Existing strategies appear to be insufficient. One proposed alternative strategy, Service Delivery Redesign for Maternal and Neonatal Health (SDR), centers on strengthening higher level health facilities to provide rapid, definitive care in case of delivery and post-natal complications, and then promoting delivery in these hospitals, rather than in primary care facilities. However to date, SDR has not been piloted or evaluated. METHODS: We will use a prospective, non-randomized stepped-wedge design to evaluate the effectiveness and implementation of Service Delivery Redesign for Maternal and Neonatal Health in Kakamega County, Kenya. DISCUSSION: This protocol describes a hybrid effectiveness/implementation evaluation study with an adaptive design. The impact evaluation ("effectiveness") study focuses on maternal and newborn health outcomes, and will be accompanied by an implementation evaluation focused on program reach, adoption, and fidelity.

Hospital delivery and neonatal mortality in 37 countries in sub-Saharan Africa and South Asia: An ecological study.

BACKGROUND: Widespread increases in facility delivery have not substantially reduced neonatal mortality in sub-Saharan Africa and South Asia over the past 2 decades. This may be due to poor quality care available in widely used primary care clinics. In this study, we examine the association between hospital delivery and neonatal mortality. METHODS AND FINDINGS: We used an ecological study design to assess cross-sectional associations between the share of hospital delivery and neonatal mortality across country regions. Data were from the Demographic and Health Surveys from 2009 to 2018, covering 682,239 births across all regions. We assess the association between the share of facility births in a region that occurred in hospitals (versus lower-level clinics) and early (0 to 7 days) neonatal mortality per 1,000 births, controlling for potential confounders including the share of facility births, small at birth, maternal age, maternal education, urbanicity, antenatal care visits, income, region, and survey year. We examined changes in this association in different contexts of country income, global region, and urbanicity using interaction models. Across the 1,143 regions from 37 countries in sub-Saharan Africa and South Asia, 42%, 29%, and 28% of births took place in a hospital, clinic, and at home, respectively. A 10-percentage point higher share of facility deliveries occurring in hospitals was associated with 1.2 per 1,000 fewer deaths (p-value < 0.01; 95% CI: 0.82 to 1.60), relative to mean mortality of 22. Associations were strongest in South Asian countries, middle-income countries, and urban regions. The study's limitations include the inability to control for all confounding factors given the ecological and cross-sectional design and potential misclassification of facility levels in our data. CONCLUSIONS: Regions with more hospital deliveries than clinic deliveries have reduced neonatal mortality. Increasing delivery in hospitals while improving quality across the health system may help to reduce high neonatal mortality.

Patient volume and quality of primary care in Ethiopia: findings from the routine health information system and the 2014 Service Provision Assessment survey.

BACKGROUND: Several studies have reported inadequate levels of quality of care in the Ethiopian health system. Facility characteristics associated with better quality remain unclear. Understanding associations between patient volumes and quality of care could help organize service delivery and potentially improve patient outcomes. METHODS: Using data from the routine health management information system (HMIS) and the 2014 Ethiopian Service Provision Assessment survey + we assessed associations between daily total outpatient volumes and quality of services. Quality of care at the facility level was estimated as the average of five measures of provider knowledge (clinical vignettes on malaria and tuberculosis) and competence (observations of family planning, antenatal care and sick child care consultations). We used linear regression models adjusted for several facility-level confounders and region fixed effects with log-transformed patient volume fitted as a linear spline. We repeated analyses for the association between volume of antenatal care visits and quality. RESULTS: Our analysis included 424 facilities including 270 health centers, 45 primary hospitals and 109 general hospitals in Ethiopia. Quality was low across all facilities ranging from only 18 to 56% with a mean score of 38%. Outpatient volume varied from less than one patient per day to 581. We found a small but statistically significant association between volume and quality which appeared non-linear, with an inverted U-shape. Among facilities seeing less than 90.6 outpatients per day, quality increased with greater patient volumes. Among facilities seeing 90.6 or more outpatients per day, quality decreased with greater patient volumes. We found a similar association between volume and quality of antenatal care visits. CONCLUSIONS: Health care utilization and quality must be improved throughout the health system in Ethiopia. Our results are suggestive of a potential U-shape association between volume and quality of primary care services. Understanding the links between volume of patients and quality of care may provide insights for organizing service delivery in Ethiopia and similar contexts.

What is the impact of removing performance-based financial incentives on community health worker motivation? A qualitative study from an infant and young child feeding program in Bangladesh.

BACKGROUND: Community health worker (CHW) motivation is an important factor related to health service quality and CHW program sustainability in low- and middle-income countries. Financial and non-financial motivators may influence CHW behavior through two dimensions of motivation: desire to perform and effort expended. The aim of this study was to explore how the removal of performance-based financial incentives impacted CHW motivation after formal funding ceased for Alive and Thrive (A&T), an infant and young child feeding (IYCF) program in Bangladesh. METHODS: This qualitative study included seven focus groups (n = 43 respondents) with paid supervisors of volunteer CHWs tasked with delivering interpersonal IYCF counseling services. Data were transcribed, translated into English, and then analyzed using both a priori themes and a grounded theory approach. RESULTS: Results suggest the removal of financial incentives was perceived to have negatively impacted CHWs' desire to perform in three primary ways: 1) a decreased desire to work without financial compensation, 2) changes in pre- and post-intervention motivation, and 3) household income challenges due to dependence on incentives. Removal of financial incentives was perceived to have negatively impacted CHWs' level of effort expended in four primary ways: 1) a reduction in CHW visits, 2) a reduction in quality of care, 3) CHW attrition, and 4) substitution of other income-generating activities. CONCLUSIONS: This study provides new evidence regarding how removing performance-based financial incentives from a CHW program can negatively impact CHW motivation. The findings suggest that program decision makers should consider how to construct community health work programs such that CHWs may continue to receive performance-based compensation after the original funding ceases.

Predictors of job satisfaction and intention to stay in the job among health-care providers in Uganda and Zambia.

BACKGROUND: A shortage of competent health-care providers is a major contributor to poor quality health care in sub-Saharan Africa. To increase the retention of skilled health-care providers, we need to understand which factors make them feel satisfied with their work and want to stay in their job. This study investigates the relative contribution of provider, facility and contextual factors to job satisfaction and intention to stay on the job among health-care providers who performed obstetric care in Uganda and Zambia. METHODS: This study was a secondary analysis of data from a maternal and newborn health program implementation evaluation in Uganda and Zambia. Using a Likert scale, providers rated their job satisfaction and intention to stay in their job. Predictors included gender, cadre, satisfaction with various facility resources and country. We used the Shapley and Owen decomposition of R2 method to estimate the variance explained by individual factors and groups of factors, adjusting for covariates at the facility and provider levels. RESULTS: Of the 1134 providers included in the study, 68.3% were female, 32.4% were nurses and 77.1% worked in the public sector. Slightly more than half (52.3%) of providers were strongly satisfied with their job and 42.8% strongly agreed that they would continue to work at their facility for some time. A group of variables related to facility management explained most of the variance in both job satisfaction (37.6%) and intention to stay (43.1%). Among these, the most important individual variables were satisfaction with pay (20.57%) for job satisfaction and opinions being respected in the workplace (17.52%) for intention to stay. Doctors reported lower intention to stay than nurses. Provider demographics and facility level and ownership (public/private) were not associated with either outcome. There were also differences in job satisfaction and intention to stay between Ugandan and Zambian health-care providers. CONCLUSION: Our study suggests that managers play a crucial role in retaining a sufficient number of satisfied health-care providers providing obstetric care in two sub-Saharan African countries, Uganda and Zambia. Prioritizing and investing in health management systems and health managers are essential foundations for high-quality health systems.

Assessment of health facility quality improvements, United Republic of Tanzania.

OBJECTIVE: To identify contextual factors associated with quality improvements in primary health-care facilities in the United Republic of Tanzania between two star rating assessments, focusing on local district administration and proximity to other facilities. METHODS: Facilities underwent star rating assessments in 2015 and between 2017 and 2018; quality was rated from zero to five stars. The consolidated framework for implementation research, adapted to a low-income context, was used to identify variables associated with star rating improvements between assessments. Facility data were obtained from several secondary sources. The proportion of the variance in facility improvement observed at facility and district levels and the influence of nearby facilities and district administration were estimated using multilevel regression models and a hierarchical spatial autoregressive model, respectively. FINDINGS: Star ratings improved at 4028 of 5595 (72%) primary care facilities. Factors associated with improvement included: (i) star rating in 2015; (ii) facility type (e.g. hospital) and ownership (e.g. public); (iii) participation in, or eligibility for, a results-based financing programme; (iv) local population density; and (v) distance from a major road. Overall, 20% of the variance in facility improvement was associated with district administration. Geographical clustering indicated that improvement at a facility was also associated with improvements at nearby facilities. CONCLUSION: Although the majority of facilities improved their star rating, there were substantial variations between facilities. Both district administration and proximity to high-performing facilities influenced improvements. Quality improvement interventions should take advantage of factors operating above the facility level, such as peer learning and peer pressure.

Hospital-provision of essential primary care in 56 countries: determinants and quality.

OBJECTIVE: To estimate the use of hospitals for four essential primary care services offered in health centres in low- and middle-income countries and to explore differences in quality between hospitals and health centres. METHODS: We extracted data from all demographic and health surveys conducted since 2010 on the type of facilities used for obtaining contraceptives, routine antenatal care and care for minor childhood diarrhoea and cough or fever. Using mixed-effects logistic regression models we assessed associations between hospital use and individual and country-level covariates. We assessed competence of care based on the receipt of essential clinical actions during visits. We also analysed three indicators of user experience from countries with available service provision assessment survey data. FINDINGS: On average across 56 countries, public hospitals were used as the sole source of care by 16.9% of 126 012 women who obtained contraceptives, 23.1% of 418 236 women who received routine antenatal care, 19.9% of 47 677 children with diarrhoea and 18.5% of 82 082 children with fever or cough. Hospital use was more common in richer countries with higher expenditures on health per capita and among urban residents and wealthier, better-educated women. Antenatal care quality was higher in hospitals in 44 countries. In a subset of eight countries, people using hospitals tended to spend more, report more problems and be somewhat less satisfied with the care received. CONCLUSION: As countries work towards achieving ambitious health goals, they will need to assess care quality and user preferences to deliver effective primary care services that people want to use.

Variation in competent and respectful delivery care in Kenya and Malawi: a retrospective analysis of national facility surveys.

OBJECTIVE: Although substantial progress has been made in increasing access to care during childbirth, reductions in maternal and neonatal mortality have been slower. Poor-quality care may be to blame. In this study, we measure the quality of labour and delivery services in Kenya and Malawi using data from observations of deliveries and explore factors associated with levels of competent and respectful care. METHODS: We used data from nationally representative health facility assessment surveys. A total of 1100 deliveries in 392 facilities across Kenya and Malawi were observed and quality was assessed using two indices: the quality of the process of intrapartum and immediate postpartum care (QoPIIPC) index and a previously validated index of respectful maternity care. Data from standardised observations of care were analysed using descriptive statistics and multivariable random-intercept regression models to examine factors associated with variation in quality of care. We also quantified the variance in quality explained by each domain of covariates (patient-, provider- and facility-level and subnational divisions). RESULTS: Only 61-66% of basic elements of competent and respectful care were performed. In adjusted models, better-staffed facilities, private hospitals and morning deliveries were associated with higher levels of competent and respectful care. In Malawi, younger, primipara and HIV-positive women received higher-quality care. Quality also differed substantially across regions in Kenya, with a 25 percentage-point gap between Nairobi and the Coast region. Quality was also higher in higher-volume facilities and those with caesarean section capacity. Most of the explained variance in quality was due to regions in Kenya and to facility, and patient-level characteristics in Malawi. CONCLUSIONS: Our findings suggest considerable scope for improvement in quality. Increasing staffing and shifting births to higher-volume facilities - along with promotion of respectful care in these facilities - should be considered in sub-Saharan Africa to improve outcomes for mothers and newborns.

OBJECTIF: Bien que des progrès substantiels aient été accomplis dans l'amélioration de l'accès aux soins pendant l'accouchement, les réductions de la mortalité maternelle et néonatale ont été plus lentes. Des soins de mauvaise qualité peuvent être à blâmer. Dans cette étude, nous mesurons la qualité de la main-d'œuvre et des services d'accouchement au Kenya et au Malawi en utilisant les données des observations des accouchements et explorons les facteurs associés aux niveaux de la compétence et du respect dans les soins. MÉTHODES: Nous avons utilisé les données d'enquêtes d'évaluation des établissements de santé représentatives au niveau national. 1100 accouchements dans 392 établissements au Kenya et au Malawi ont été observés et la qualité a été évaluée à l'aide de deux indices: l'indice de qualité du processus de soins intra-partum et postpartum immédiat (QoPIIPC) et un indice précédemment validé de soins maternels respectueux. Les données des observations normalisées des soins ont été analysées à l'aide de statistiques descriptives et de modèles de régression à interceptions aléatoires multivariables pour examiner les facteurs associés à la variation de la qualité des soins. Nous avons également quantifié la variance de la qualité expliquée par chaque domaine de covariables (divisions au niveau des patients, des prestataires et des établissements, et infranationales). RÉSULTATS: Seuls 61% à 66% des éléments de base de soins compétents et respectueux ont été réalisés. Dans les modèles ajustés, des établissements mieux dotés en personnel, des hôpitaux privés et des accouchements le matin étaient associés à des niveaux plus élevés de soins compétents et respectueux. Au Malawi, les femmes plus jeunes, primipares et VIH positives ont reçu des soins de meilleure qualité. La qualité différait également considérablement d'une région à l'autre au Kenya, avec un écart de 25 points de pourcentage entre Nairobi et la région côtière. La qualité était également plus élevée dans les établissements avec un volume plus élevé et ceux ayant une capacité de césarienne. La majeure partie des raisons de la variance dans la qualité était liée aux régions du Kenya et à l'établissement et aux caractéristiques des patients au Malawi. CONCLUSIONS: Nos résultats suggèrent une marge considérable pour l'amélioration de la qualité. L'augmentation du personnel et le déplacement des naissances vers des établissements de plus grand volume - ainsi que la promotion de soins respectueux dans ces établissements - devraient être envisagés en Afrique subsaharienne pour améliorer les résultats pour les mères et les nouveau-nés.

Can complex programs be sustained? A mixed methods sustainability evaluation of a national infant and young child feeding program in Bangladesh and Vietnam.

BACKGROUND: Poor early-life nutrition is a major barrier to good health and cognitive development, and is a global health priority. Alive & Thrive (A&T) was a multi-pronged initiative to improve infant and young child feeding behaviors. It aimed to achieve at-scale child health and nutrition improvements via a comprehensive approach that included nutrition counseling by health workers, policy change, social mobilization and mass media activities. This study evaluated the sustainability of activities introduced during A&T implementation (2009-2014) in Bangladesh and Vietnam. METHODS: This was a mixed methods study that used a quasi-experimental design. Quantitative data (surveys with 668 health workers, and 269 service observations) were collected in 2017; and analysis compared outcomes (primarily dose and fidelity of activities, and capacity) in former A&T intervention areas versus areas that did not receive the full A&T intervention. Additionally, we conducted interviews and focus groups with 218 stakeholders to explore their impressions about the determinants of sustainability, based on a multi-level conceptual framework. RESULTS: After program conclusion, stakeholders perceive declines in mass media campaigns, policy and advocacy activities, and social mobilization activities - but counseling activities were institutionalized and continued in both countries. Quantitative data show a persisting modest intervention effect: health workers in intervention areas had significantly higher child feeding knowledge, and in Bangladesh greater self-efficacy and job satisfaction, compared to their counterparts who did not receive the full package of A&T activities. While elements of the program were integrated into routine services, stakeholders noted dilution of the program focus due to competing priorities. Qualitative data suggest that some elements, such as training, monitoring, and evaluation, which were seen as essential to A&T's success, have declined in frequency, quality, coverage, or were eliminated altogether. CONCLUSIONS: The inclusion of multiple activities in A&T and efforts to integrate the program into existing institutions were seen as crucial to its success but also made it difficult to sustain, particularly given unstable financial support and human resource constraints. Future complex programs should carefully plan for institutionalization in advance of the program by cultivating champions across the health system, and designing unique and complementary roles for all stakeholders including donors.

Determinants of healthcare providers' confidence in their clinical skills to deliver quality obstetric and newborn care in Uganda and Zambia.

BACKGROUND: Poor quality obstetric and newborn care persists in sub-Saharan Africa and weak provider competence is an important contributor. To be competent, providers need to be both knowledgeable and confident in their ability to perform necessary clinical actions. Confidence or self-efficacy has not been extensively studied but may be related to individuals' knowledge, ability to practice their skills, and other modifiable factors. In this study, we investigated how knowledge and scope of practice are associated with provider confidence in delivering obstetric and newborn health services in Uganda and Zambia. METHODS: This study was a secondary analysis of data from an obstetric and newborn care program implementation evaluation. Provider knowledge, scope of practice (completion of a series of obstetric tasks in the past 3 months) and confidence in delivering obstetric and newborn care were measured post intervention in intervention and comparison districts in Uganda and Zambia. We used multiple linear regression models to investigate the extent to which exposure to a wider range of clinical tasks associated with confidence, adjusting for facility and provider characteristics. RESULTS: Of the 574 providers included in the study, 69% were female, 24% were nurses, and 6% were doctors. The mean confidence score was 71%. Providers' mean knowledge score was 56% and they reported performing 57% of basic obstetric tasks in the past 3 months. In the adjusted model, providers who completed more than 69% of the obstetric tasks reported a 13-percentage point (95% CI 0.08, 0.17) higher confidence than providers who performed less than 50% of the tasks. Female providers and nurses were considerably less confident than males and doctors. Provider knowledge was moderately associated with provider confidence. CONCLUSIONS: Our study showed that scope of practice (the range of clinical tasks routinely performed by providers) is an important determinant of confidence. Ensuring that providers are exposed to a variety of services is crucial to support improvement in provider confidence and competence. Policies to improve provider confidence and pre-service training should also address differences by gender and by cadres.

Did a quality improvement intervention improve quality of maternal health care? Implementation evaluation from a cluster-randomized controlled study.

OBJECTIVE: To test the success of a maternal healthcare quality improvement intervention in actually improving quality. DESIGN: Cluster-randomized controlled study with implementation evaluation; we randomized 12 primary care facilities to receive a quality improvement intervention, while 12 facilities served as controls. SETTING: Four districts in rural Tanzania. PARTICIPANTS: Health facilities (24), providers (70 at baseline; 119 at endline) and patients (784 at baseline; 886 at endline). INTERVENTIONS: In-service training, mentorship and supportive supervision and infrastructure support. MAIN OUTCOME MEASURES: We measured fidelity with indictors of quality and compared quality between intervention and control facilities using difference-in-differences analysis. RESULTS: Quality of care was low at baseline: the average provider knowledge test score was 46.1% (range: 0-75%) and only 47.9% of women were very satisfied with delivery care. The intervention was associated with an increase in newborn counseling (ß: 0.74, 95% CI: 0.13, 1.35) but no evidence of change across 17 additional indicators of quality. On average, facilities reached 39% implementation. Comparing facilities with the highest implementation of the intervention to control facilities again showed improvement on only one of the 18 quality indicators. CONCLUSIONS: A multi-faceted quality improvement intervention resulted in no meaningful improvement in quality. Evidence suggests this is due to both failure to sustain a high-level of implementation and failure in theory: quality improvement interventions targeted at the clinic-level in primary care clinics with weak starting quality, including poor infrastructure and low provider competence, may not be effective.

Expectations of healthcare quality: A cross-sectional study of internet users in 12 low- and middle-income countries.

BACKGROUND: High satisfaction with healthcare is common in low- and middle-income countries (LMICs), despite widespread quality deficits. This may be due to low expectations because people lack knowledge about what constitutes good quality or are resigned about the quality of available services. METHODS AND FINDINGS: We fielded an internet survey in Argentina, China, Ghana, India, Indonesia, Kenya, Lebanon, Mexico, Morocco, Nigeria, Senegal, and South Africa in 2017 (N = 17,996). It included vignettes describing poor-quality services-inadequate technical or interpersonal care-for 2 conditions. After applying population weights, most of our respondents lived in urban areas (59%), had finished primary school (55%), and were under the age of 50 (75%). Just over half were men (51%), and the vast majority reported that they were in good health (73%). Over half (53%) of our study population rated the quality of vignettes describing poor-quality services as good or better. We used multilevel logistic regression and found that good ratings were associated with less education (no formal schooling versus university education; adjusted odds ratio [AOR] 2.22, 95% CI 1.90-2.59, P < 0.001), better self-reported health (excellent versus poor health; AOR 5.19, 95% CI 4.33-6.21, P < 0.001), history of discrimination in healthcare (AOR 1.47, 95% CI 1.36-1.57, P < 0.001), and male gender (AOR 1.32, 95% CI 1.23-1.41, P < 0.001). The survey did not reach nonusers of the internet thus only representing the internet-using population. CONCLUSIONS: Majorities of the internet-using public in 12 LMICs have low expectations of healthcare quality as evidenced by high ratings given to poor-quality care. Low expectations of health services likely dampen demand for quality, reduce pressure on systems to deliver quality care, and inflate satisfaction ratings. Policies and interventions to raise people's expectations of the quality of healthcare they receive should be considered in health system quality reforms.

Mortality due to low-quality health systems in the universal health coverage era: a systematic analysis of amenable deaths in 137 countries.

BACKGROUND: Universal health coverage has been proposed as a strategy to improve health in low-income and middle-income countries (LMICs). However, this is contingent on the provision of good-quality health care. We estimate the excess mortality for conditions targeted in the Sustainable Development Goals (SDG) that are amenable to health care and the portion of this excess mortality due to poor-quality care in 137 LMICs, in which excess mortality refers to deaths that could have been averted in settings with strong health systems. METHODS: Using data from the 2016 Global Burden of Disease study, we calculated mortality amenable to personal health care for 61 SDG conditions by comparing case fatality between each LMIC with corresponding numbers from 23 high-income reference countries with strong health systems. We used data on health-care utilisation from population surveys to separately estimate the portion of amenable mortality attributable to non-utilisation of health care versus that attributable to receipt of poor-quality care. FINDINGS: 15·6 million excess deaths from 61 conditions occurred in LMICs in 2016. After excluding deaths that could be prevented through public health measures, 8·6 million excess deaths were amenable to health care of which 5·0 million were estimated to be due to receipt of poor-quality care and 3·6 million were due to non-utilisation of health care. Poor quality of health care was a major driver of excess mortality across conditions, from cardiovascular disease and injuries to neonatal and communicable disorders. INTERPRETATION: Universal health coverage for SDG conditions could avert 8·6 million deaths per year but only if expansion of service coverage is accompanied by investments into high-quality health systems. FUNDING: Bill & Melinda Gates Foundation.