Tracking health system performance in times of crisis using routine health data: lessons learned from a multicountry consortium.

COVID-19 has prompted the use of readily available administrative data to track health system performance in times of crisis and to monitor disruptions in essential healthcare services. In this commentary we describe our experience working with these data and lessons learned across countries. Since April 2020, the Quality Evidence for Health System Transformation (QuEST) network has used administrative data and routine health information systems (RHIS) to assess health system performance during COVID-19 in Chile, Ethiopia, Ghana, Haiti, Lao People's Democratic Republic, Mexico, Nepal, South Africa, Republic of Korea and Thailand. We compiled a large set of indicators related to common health conditions for the purpose of multicountry comparisons. The study compiled 73 indicators. A total of 43% of the indicators compiled pertained to reproductive, maternal, newborn and child health (RMNCH). Only 12% of the indicators were related to hypertension, diabetes or cancer care. We also found few indicators related to mental health services and outcomes within these data systems. Moreover, 72% of the indicators compiled were related to volume of services delivered, 18% to health outcomes and only 10% to the quality of processes of care. While several datasets were complete or near-complete censuses of all health facilities in the country, others excluded some facility types or population groups. In some countries, RHIS did not capture services delivered through non-visit or nonconventional care during COVID-19, such as telemedicine. We propose the following recommendations to improve the analysis of administrative and RHIS data to track health system performance in times of crisis: ensure the scope of health conditions covered is aligned with the burden of disease, increase the number of indicators related to quality of care and health outcomes; incorporate data on nonconventional care such as telehealth; continue improving data quality and expand reporting from private sector facilities; move towards collecting patient-level data through electronic health records to facilitate quality-of-care assessment and equity analyses; implement more resilient and standardized health information technologies; reduce delays and loosen restrictions for researchers to access the data; complement routine data with patient-reported data; and employ mixed methods to better understand the underlying causes of service disruptions.

Equitable Distribution of Poor Quality of Care? Equity in Quality of Reproductive Health Services in Ethiopia.

The Ethiopian health system faces persistent inequities in health-care utilization and outcomes, despite continued efforts to expand health service coverage. There is little evidence in the literature describing the status of equity in the quality of healthcare. This paper aims to understand the disparities in quality of antenatal care (ANC) and family planning (FP) among the poor and non-poor communities. We used the 2016 Ethiopia Demographic and Health Survey (DHS) data to compute a Multidimensional Poverty Index (MPI), and the 2014 Service Provision Assessment (SPA) data to assess quality of ANC and FP services-defined as the level of adherence to World Health Organization (WHO) clinical and service guidelines. We merged the two datasets using geographical coordinates, and aggregated service users into facility catchment area clusters using a 2-km radius for urban and 10-km radius for rural facilities. We computed ANC and FP quality and MPI indices for each facility and assigned these to catchment areas. Using the international cutoff point for deprivation (MPI = 33.3%), we evaluated whether the quality of ANC and FP services varies by poor and non-poor catchment areas. We found that most of catchment areas (75.7%) were deprived. While the overall quality of ANC and FP services are low (33% and 34% respectively), we found little variation in the distribution of the quality of these services between poor and non-poor areas, urban and rural settings, or regionally. The short-term focus needs to be on improving the overall quality of services rather than on its distribution.

Effect of lifting COVID-19 restrictions on utilisation of primary care services in Nepal: a difference-in-differences analysis.

INTRODUCTION: An increasing number of studies have reported disruptions in health service utilisation due to the COVID-19 pandemic and its associated restrictions. However, little is known about the effect of lifting COVID-19 restrictions on health service utilisation. The objective of this study was to estimate the effect of lifting COVID-19 restrictions on primary care service utilisation in Nepal. METHODS: Data on utilisation of 10 primary care services were extracted from the Health Management Information System across all health facilities in Nepal. We used a difference-in-differences design and linear fixed effects regressions to estimate the effect of lifting COVID-19 restrictions. The treatment group included palikas that had lifted restrictions in place from 17 August 2020 to 16 September 2020 (Bhadra 2077) and the control group included palikas that had maintained restrictions during that period. The pre-period included the 4 months of national lockdown from 24 March 2020 to 22 July 2020 (Chaitra 2076 to Ashar 2077). Models included month and palika fixed effects and controlled for COVID-19 incidence. RESULTS: We found that lifting COVID-19 restrictions was associated with an average increase per palika of 57.5 contraceptive users (95% CI 14.6 to 100.5), 15.6 antenatal care visits (95% CI 5.3 to 25.9) and 1.6 child pneumonia visits (95% CI 0.2 to 2.9). This corresponded to a 9.4% increase in contraceptive users, 34.2% increase in antenatal care visits and 15.6% increase in child pneumonia visits. Utilisation of most other primary care services also increased after lifting restrictions, but coefficients were not statistically significant. CONCLUSIONS: Despite the ongoing pandemic, lifting restrictions can lead to an increase in some primary care services. Our results point to a causal link between restrictions and health service utilisation and call for policy makers in low- and middle-income countries to carefully consider the trade-offs of strict lockdowns during future COVID-19 waves or future pandemics.

The road to recovery: an interrupted time series analysis of policy intervention to restore essential health services in Mexico during the COVID-19 pandemic.

Background: Recovery of health services disrupted by the COVID-19 pandemic represents a significant challenge in low- and middle-income countries. In April 2021, the Mexican Institute of Social Security (IMSS), which provides health care to 68.5 million people, launched the National Strategy for Health Services Recovery (Recovery policy). The study objective was to evaluate whether the Recovery policy addressed COVID-related declines in maternal, child health, and non-communicable diseases (NCDs) services. Methods: We analysed the data of 35 IMSS delegations from January 2019 to November 2021 on contraceptive visits, antenatal care consultations, deliveries, caesarean sections, sick children's consultations, child vaccination, breast and cervical cancer screening, diabetes and hypertension consultations, and control. We focused on the period before (April 2020 - March 2021) and during (April 2021 - November 2021) the Recovery policy and used an interrupted time series design and Poisson Generalized Estimating Equation models to estimate the association of this policy with service use and outcomes and change in their trends. Results: Despite the third wave of the pandemic in 2021, service utilization increased in the Recovery period, reaching (at minimum) 49% of pre-pandemic levels for sick children's consultations and (at maximum) 106% of pre-pandemic levels for breast cancer screenings. Evidence for the Recovery policy role was mixed: the policy was associated with increased facility deliveries (IRR = 1.15, 95%CI = 1.11-1.19) with a growing trend over time (IRR = 1.04, 95%CI = 1.03-1.05); antenatal care and child health services saw strong level effects but decrease over time. Additionally, the Recovery policy was associated with diabetes and hypertension control. Services recovery varied across delegations. Conclusions: Health service utilization and NCDs control demonstrated important gains in 2021, but evidence suggests the policy had inconsistent effects across services and decreasing impact over time. Further efforts to strengthen essential health services and ensure consistent recovery across delegations are warranted.

Improving health and social systems for all children in LMICs: structural innovations to deliver high-quality services.

Despite health gains over the past 30 years, children and adolescents are not reaching their health potential in many low-income and middle-income countries (LMICs). In addition to health systems, social systems, such as schools, communities, families, and digital platforms, can be used to promote health. We did a targeted literature review of how well health and social systems are meeting the needs of children in LMICs using the framework of The Lancet Global Health Commission on high-quality health systems and we reviewed evidence for structural reforms in health and social sectors. We found that quality of services for children is substandard across both health and social systems. Health systems have deficits in care competence (eg, diagnosis and management), system competence (eg, timeliness, continuity, and referral), user experience (eg, respect and usability), service provision for common and serious conditions (eg, cancer, trauma, and mental health), and service offerings for adolescents. Education and social services for child health are limited by low funding and poor coordination with other sectors. Structural reforms are more likely to improve service quality substantially and at scale than are micro-level efforts. Promising approaches include governing for quality (eg, leadership, expert management, and learning systems), redesigning service delivery to maximise outcomes, and empowering families to better care for children and to demand quality care from health and social systems. Additional research is needed on health needs across the life course, health system performance for children and families, and large-scale evaluation of promising health and social programmes.

COVID-19 and resilience of healthcare systems in ten countries.

Declines in health service use during the Coronavirus Disease 2019 (COVID-19) pandemic could have important effects on population health. In this study, we used an interrupted time series design to assess the immediate effect of the pandemic on 31 health services in two low-income (Ethiopia and Haiti), six middle-income (Ghana, Lao People's Democratic Republic, Mexico, Nepal, South Africa and Thailand) and high-income (Chile and South Korea) countries. Despite efforts to maintain health services, disruptions of varying magnitude and duration were found in every country, with no clear patterns by country income group or pandemic intensity. Disruptions in health services often preceded COVID-19 waves. Cancer screenings, TB screening and detection and HIV testing were most affected (26-96% declines). Total outpatient visits declined by 9-40% at national levels and remained lower than predicted by the end of 2020. Maternal health services were disrupted in approximately half of the countries, with declines ranging from 5% to 33%. Child vaccinations were disrupted for shorter periods, but we estimate that catch-up campaigns might not have reached all children missed. By contrast, provision of antiretrovirals for HIV was not affected. By the end of 2020, substantial disruptions remained in half of the countries. Preliminary data for 2021 indicate that disruptions likely persisted. Although a portion of the declines observed might result from decreased needs during lockdowns (from fewer infectious illnesses or injuries), a larger share likely reflects a shortfall of health system resilience. Countries must plan to compensate for missed healthcare during the current pandemic and invest in strategies for better health system resilience for future emergencies.

How does the effectiveness of strategies to improve healthcare provider practices in low-income and middle-income countries change after implementation? Secondary analysis of a systematic review.

BACKGROUND: A recent systematic review evaluated the effectiveness of strategies to improve healthcare provider (HCP) performance in low-income and middle-income countries. The review identified strategies with varying effects, including in-service training, supervision and group problem-solving. However, whether their effectiveness changed over time remained unclear. In particular, understanding whether effects decay over time is crucial to improve sustainability. METHODS: We conducted a secondary analysis of data from the aforementioned review to explore associations between time and effectiveness. We calculated effect sizes (defined as percentage-point (%-point) changes) for HCP practice outcomes (eg, percentage of patients correctly treated) at each follow-up time point after the strategy was implemented. We estimated the association between time and effectiveness using random-intercept linear regression models with time-specific effect sizes clustered within studies and adjusted for baseline performance. RESULTS: The primary analysis included 37 studies, and a sensitivity analysis included 77 additional studies. For training, every additional month of follow-up was associated with a 0.19 %-point decrease in effectiveness (95% CI: -0.36 to -0.03). For training combined with supervision, every additional month was associated with a 0.40 %-point decrease in effectiveness (95% CI: -0.68 to -0.12). Time trend results for supervision were inconclusive. For group problem-solving alone, time was positively associated with effectiveness, with a 0.50 %-point increase in effect per month (95% CI: 0.37 to 0.64). Group problem-solving combined with training was associated with large improvements, and its effect was not associated with time. CONCLUSIONS: Time trends in the effectiveness of different strategies to improve HCP practices vary among strategies. Programmes relying solely on in-service training might need periodical refresher training or, better still, consider combining training with group problem-solving. Although more high-quality research is needed, these results, which are important for decision-makers as they choose which strategies to use, underscore the utility of studies with multiple post-implementation measurements so sustainability of the impact on HCP practices can be assessed.

Effect of the COVID-19 pandemic on health service utilization across regions of Ethiopia: An interrupted time series analysis of health information system data from 2019-2020.

The spread of COVID-19 and associated deaths have remained low in Ethiopia. However, the pandemic could pose a public health crisis indirectly through disruptions in essential health services. The aim of this study was to examine disruptions in health service utilization during the first nine months of the COVID-19 pandemic across 10 regions in Ethiopia. We analyzed utilization of 21 different health services across all of Ethiopia (except the Tigray region) for the period of January 2019 to December 2020. Data were extracted from the Ethiopian district health information system (DHIS2). Monthly visits in 2020 were graphed relative to the same months in 2019. Interrupted time series analysis was used to estimate the effect of the pandemic on service utilization in each region. We found that disruptions in health services were generally higher in urban regions which were most affected by COVID. Outpatient visits declined by 52%, 54%, and 58%, specifically in Dire Dawa, Addis Ababa and Harari, the three urban regions. Similarly, there was a 47% reduction in inpatient admissions in Addis Ababa. In agrarian regions, the pandemic caused an 11% to 17% reduction in outpatient visits and a 10% to 27% decline in inpatient admissions. Visits for children with diarrhea, pneumonia and malnutrition also declined substantially while maternal health services were less affected. Our study indicates that disruptions in health services were more pronounced in areas that were relatively harder hit by the pandemic. Our results show that the Ethiopian health system has a limited capacity to absorb shocks. During future waves of COVID or future pandemics, the Ethiopian health system must be better prepared to maintain essential services and mitigate the indirect impact of the pandemic on public health, particularly in urban areas.

Measuring effective coverage of maternal and child health services in Cambodia: a retrospective analysis of Demographic and Health Surveys from 2005 to 2014.

OBJECTIVE: To investigate effective, quality-adjusted, coverage and inequality of maternal and child health (MCH) services to assess progress in improving quality of care in Cambodia. DESIGN: A retrospective secondary analysis using the three most recent (2005, 2010 and 2014) Demographic and Health Surveys. SETTING: Cambodia. PARTICIPANTS: 53 155 women aged 15-49 years old and 23 242 children under 5 years old across the three surveys. OUTCOME MEASURES: We estimated crude coverage, effective coverage and inequality in effective coverage for five MCH services over time: antenatal care (ANC), facility delivery and sick childcare for diarrhoea, pneumonia and fever. Quality was defined by the proportion of care seekers who received a set of interventions during healthcare visits. Effective coverage was estimated by combining crude coverage and quality. We used equiplots and risk ratios, to assess patterns in inequality in MCH effective coverage across wealth quintile, urban-rural and women's education levels and over time. RESULTS: In 2014, crude and effective coverage was 80.1% and 56.4%, respectively, for maternal health services (ANC and facility delivery) and 59.1% and 26.9%, respectively, for sick childcare (diarrhoea, pneumonia and fever). Between 2005 and 2014, effective coverage improved for all services, but improvements were larger for maternal healthcare than for sick child care. In 2014, poorer children were more likely to receive oral rehydration solution for diarrhoea than children from richer households. Meanwhile, women from urban areas were more likely to receive a postnatal check before getting discharged. CONCLUSIONS: Effective coverage has generally improved in Cambodia but efforts remain to improve quality for all MCH services. Our results point to substantial gaps in curative sick child care, a large share of which is provided by unregulated private providers in Cambodia. Policymakers should focus on improving effective coverage, and not only crude coverage, to achieve the health-related Sustainable Development Goals by 2030.

Using health management information system data: case study and verification of institutional deliveries in Ethiopia.

Health management information systems (HMIS) are a crucial source of timely health statistics and have the potential to improve reporting in low-income countries. However, concerns about data quality have hampered their widespread adoption in research and policy decisions. This article presents results from a data verification study undertaken to gain insights into the quality of HMIS data in Ethiopia. We also provide recommendations for working with HMIS data for research and policy translation. We linked the HMIS to the 2016 Emergency Obstetric and Newborn Care Assessment, a national census of all health facilities that provided maternal and newborn health services in Ethiopia. We compared the number of visits for deliveries and caesarean sections (C-sections) reported in the HMIS in 2015 (January-December) to those found in source documents (paper-based labour and delivery and operating theatre registers) in 2425 facilities across Ethiopia. We found that two-thirds of facilities had 'good' HMIS reporting for deliveries (defined as reporting within 10% of source documents) and half had 'very good' reporting (within 5% of source documents). Results were similar for reporting on C-section deliveries. We found that good reporting was more common in urban areas (OR: 1.30, 95% CI 1.06 to 1.59), public facilities (OR: 2.95, 95% CI 1.38 to 6.29) and in hospitals compared with health centres (OR: 1.71, 95% CI 1.13 to 2.61). Facilities in the Somali and Afar regions had the lowest odds of good reporting compared with Addis Ababa and were more likely to over-report deliveries in the HMIS. Further work remains to address remaining discrepancies in the Ethiopian HMIS. Nonetheless, our findings corroborate previous data verification exercises in Ethiopia and support greater use and uptake of HMIS data for research and policy decisions (particularly, greater use of HMIS data elements (eg, absolute number of services provided each month) rather than coverage indicators). Increased use of these data, combined with feedback mechanisms, is necessary to maintain data quality.

Patient volume and quality of primary care in Ethiopia: findings from the routine health information system and the 2014 Service Provision Assessment survey.

BACKGROUND: Several studies have reported inadequate levels of quality of care in the Ethiopian health system. Facility characteristics associated with better quality remain unclear. Understanding associations between patient volumes and quality of care could help organize service delivery and potentially improve patient outcomes. METHODS: Using data from the routine health management information system (HMIS) and the 2014 Ethiopian Service Provision Assessment survey + we assessed associations between daily total outpatient volumes and quality of services. Quality of care at the facility level was estimated as the average of five measures of provider knowledge (clinical vignettes on malaria and tuberculosis) and competence (observations of family planning, antenatal care and sick child care consultations). We used linear regression models adjusted for several facility-level confounders and region fixed effects with log-transformed patient volume fitted as a linear spline. We repeated analyses for the association between volume of antenatal care visits and quality. RESULTS: Our analysis included 424 facilities including 270 health centers, 45 primary hospitals and 109 general hospitals in Ethiopia. Quality was low across all facilities ranging from only 18 to 56% with a mean score of 38%. Outpatient volume varied from less than one patient per day to 581. We found a small but statistically significant association between volume and quality which appeared non-linear, with an inverted U-shape. Among facilities seeing less than 90.6 outpatients per day, quality increased with greater patient volumes. Among facilities seeing 90.6 or more outpatients per day, quality decreased with greater patient volumes. We found a similar association between volume and quality of antenatal care visits. CONCLUSIONS: Health care utilization and quality must be improved throughout the health system in Ethiopia. Our results are suggestive of a potential U-shape association between volume and quality of primary care services. Understanding the links between volume of patients and quality of care may provide insights for organizing service delivery in Ethiopia and similar contexts.

Disruption in essential health services in Mexico during COVID-19: an interrupted time series analysis of health information system data.

INTRODUCTION: The COVID-19 pandemic has disrupted health systems around the world. The objectives of this study are to estimate the overall effect of the pandemic on essential health service use and outcomes in Mexico, describe observed and predicted trends in services over 24 months, and to estimate the number of visits lost through December 2020. METHODS: We used health information system data for January 2019 to December 2020 from the Mexican Institute of Social Security (IMSS), which provides health services for more than half of Mexico's population-65 million people. Our analysis includes nine indicators of service use and three outcome indicators for reproductive, maternal and child health and non-communicable disease services. We used an interrupted time series design and linear generalised estimating equation models to estimate the change in service use and outcomes from April to December 2020. Estimates were expressed using average marginal effects on the risk ratio scale. RESULTS: The study found that across nine health services, an estimated 8.74 million patient visits were lost in Mexico. This included a decline of over two thirds for breast and cervical cancer screenings (79% and 68%, respectively), over half for sick child visits and female contraceptive services, approximately one-third for childhood vaccinations, diabetes, hypertension and antenatal care consultations, and a decline of 10% for deliveries performed at IMSS. In terms of patient outcomes, the proportion of patients with diabetes and hypertension with controlled conditions declined by 22% and 17%, respectively. Caesarean section rate did not change. CONCLUSION: Significant disruptions in health services show that the pandemic has strained the resilience of the Mexican health system and calls for urgent efforts to resume essential services and plan for catching up on missed preventive care even as the COVID-19 crisis continues in Mexico.

Predictors of job satisfaction and intention to stay in the job among health-care providers in Uganda and Zambia.

BACKGROUND: A shortage of competent health-care providers is a major contributor to poor quality health care in sub-Saharan Africa. To increase the retention of skilled health-care providers, we need to understand which factors make them feel satisfied with their work and want to stay in their job. This study investigates the relative contribution of provider, facility and contextual factors to job satisfaction and intention to stay on the job among health-care providers who performed obstetric care in Uganda and Zambia. METHODS: This study was a secondary analysis of data from a maternal and newborn health program implementation evaluation in Uganda and Zambia. Using a Likert scale, providers rated their job satisfaction and intention to stay in their job. Predictors included gender, cadre, satisfaction with various facility resources and country. We used the Shapley and Owen decomposition of R2 method to estimate the variance explained by individual factors and groups of factors, adjusting for covariates at the facility and provider levels. RESULTS: Of the 1134 providers included in the study, 68.3% were female, 32.4% were nurses and 77.1% worked in the public sector. Slightly more than half (52.3%) of providers were strongly satisfied with their job and 42.8% strongly agreed that they would continue to work at their facility for some time. A group of variables related to facility management explained most of the variance in both job satisfaction (37.6%) and intention to stay (43.1%). Among these, the most important individual variables were satisfaction with pay (20.57%) for job satisfaction and opinions being respected in the workplace (17.52%) for intention to stay. Doctors reported lower intention to stay than nurses. Provider demographics and facility level and ownership (public/private) were not associated with either outcome. There were also differences in job satisfaction and intention to stay between Ugandan and Zambian health-care providers. CONCLUSION: Our study suggests that managers play a crucial role in retaining a sufficient number of satisfied health-care providers providing obstetric care in two sub-Saharan African countries, Uganda and Zambia. Prioritizing and investing in health management systems and health managers are essential foundations for high-quality health systems.

Temporal trends in coverage, quality and equity of maternal and child health services in Rwanda, 2000-2015.

INTRODUCTION: Achieving the maternal and child health (MCH)-related Sustainable Development Goals (SDG) will require equitable and effective (quality-adjusted) coverage of recommended health interventions in low- and middle-income countries. We assessed effective coverage and equity of MCH services in Rwanda in the Millennium Development Goal (MDG) era to help guide policy decisions to improve equitable health gains in the SDG era and beyond. METHODS: Using four rounds of Rwanda demographic and health surveys conducted from 2000 to 2015, we identified coverage and quality indicators for five MCH services: antenatal care (ANC), delivery care, and care for child diarrhoea, suspected pneumonia and fever. We calculated crude coverage and quality in each survey and used these to estimate effective coverage. The effective coverage should be regarded as an upper bound because there were few available quality measures. We also described equity in effective coverage of these five MCH services over time across the wealth index, area of residence and maternal education using equiplots. RESULTS: A total of 48 910 women aged 15-49 years and 33 429 children under 5 years were included across the four survey rounds. In 2015, average effective coverage was 33.2% (range 19.9%-44.2%) across all five MCH services, 30.1% (range 19.9%-40.2%) for maternal health services (average of ANC and delivery) and 35.3% (range 27.3%-44.2%) for sick child care (diarrhoea, pneumonia and fever). This is in contrast to crude coverage which averaged 56.5% (range 43.6%-90.7%) across all five MCH services, 67.3% (range 43.9%-90.7%) for maternal health services and 49.2% (range 43.6%-53.9%) for sick child care. Between 2010 and 2015 effective coverage increased by 154.2% (range 127.3%-170.0%) for maternal health services and by 27.4% (range 4.2%-79.6%) for sick child care. These increases were associated with widening socioeconomic inequalities in effective coverage for maternal health services, and narrowing inequalities in effective coverage for sick child care. CONCLUSION: While effective coverage of common MCH services generally improved in the MDG era, it still lagged substantially behind crude coverage for the same services due to low-quality care. Overall, effective coverage of MCH services remained suboptimal and inequitable. Policies should focus on improving effective coverage of these services and reducing inequities.

Hospital-provision of essential primary care in 56 countries: determinants and quality.

OBJECTIVE: To estimate the use of hospitals for four essential primary care services offered in health centres in low- and middle-income countries and to explore differences in quality between hospitals and health centres. METHODS: We extracted data from all demographic and health surveys conducted since 2010 on the type of facilities used for obtaining contraceptives, routine antenatal care and care for minor childhood diarrhoea and cough or fever. Using mixed-effects logistic regression models we assessed associations between hospital use and individual and country-level covariates. We assessed competence of care based on the receipt of essential clinical actions during visits. We also analysed three indicators of user experience from countries with available service provision assessment survey data. FINDINGS: On average across 56 countries, public hospitals were used as the sole source of care by 16.9% of 126 012 women who obtained contraceptives, 23.1% of 418 236 women who received routine antenatal care, 19.9% of 47 677 children with diarrhoea and 18.5% of 82 082 children with fever or cough. Hospital use was more common in richer countries with higher expenditures on health per capita and among urban residents and wealthier, better-educated women. Antenatal care quality was higher in hospitals in 44 countries. In a subset of eight countries, people using hospitals tended to spend more, report more problems and be somewhat less satisfied with the care received. CONCLUSION: As countries work towards achieving ambitious health goals, they will need to assess care quality and user preferences to deliver effective primary care services that people want to use.

Effect of vaccination on children's learning achievements: findings from the India Human Development Survey.

BACKGROUND: Beyond the prevention of illness and death, vaccination may provide additional benefits such as improved educational outcomes. However, there is currently little evidence on this question. Our objective was to estimate the effect of childhood vaccination on learning achievements among primary school children in India. METHODS: We used cohort data from the India Human Development Survey. Vaccination status and confounders were measured among children who were at least 12 months old at baseline in 2004-2005. In 2011-2012, the same children completed basic reading, writing and math tests. We estimated the effect of full vaccination during childhood on learning achievements using inverse probability of treatment-weighted logistic regression models and results reported on the risk difference scale. The propensity score included 33 potential community-, household-, mother- and child-level confounders as well as state fixed effects. RESULTS: Among the 4877 children included in our analysis, 54% were fully vaccinated at baseline, and 54% could read by the age of 8-11 years. The estimated effect of full vaccination on learning achievements ranged from 4 to 6 percentage points, representing relative increases ranging from 6% to 12%. Bias analysis suggested that our observed effects could be explained by unmeasured confounding, but only in the case of strong associations with the treatment and outcome. CONCLUSION: These results support the hypothesis that vaccination has lasting effects on children's learning achievements. Further work is needed to confirm findings and elucidate the potential mechanisms linking vaccines to educational outcomes.

Determinants of healthcare providers' confidence in their clinical skills to deliver quality obstetric and newborn care in Uganda and Zambia.

BACKGROUND: Poor quality obstetric and newborn care persists in sub-Saharan Africa and weak provider competence is an important contributor. To be competent, providers need to be both knowledgeable and confident in their ability to perform necessary clinical actions. Confidence or self-efficacy has not been extensively studied but may be related to individuals' knowledge, ability to practice their skills, and other modifiable factors. In this study, we investigated how knowledge and scope of practice are associated with provider confidence in delivering obstetric and newborn health services in Uganda and Zambia. METHODS: This study was a secondary analysis of data from an obstetric and newborn care program implementation evaluation. Provider knowledge, scope of practice (completion of a series of obstetric tasks in the past 3 months) and confidence in delivering obstetric and newborn care were measured post intervention in intervention and comparison districts in Uganda and Zambia. We used multiple linear regression models to investigate the extent to which exposure to a wider range of clinical tasks associated with confidence, adjusting for facility and provider characteristics. RESULTS: Of the 574 providers included in the study, 69% were female, 24% were nurses, and 6% were doctors. The mean confidence score was 71%. Providers' mean knowledge score was 56% and they reported performing 57% of basic obstetric tasks in the past 3 months. In the adjusted model, providers who completed more than 69% of the obstetric tasks reported a 13-percentage point (95% CI 0.08, 0.17) higher confidence than providers who performed less than 50% of the tasks. Female providers and nurses were considerably less confident than males and doctors. Provider knowledge was moderately associated with provider confidence. CONCLUSIONS: Our study showed that scope of practice (the range of clinical tasks routinely performed by providers) is an important determinant of confidence. Ensuring that providers are exposed to a variety of services is crucial to support improvement in provider confidence and competence. Policies to improve provider confidence and pre-service training should also address differences by gender and by cadres.

User experience and patient satisfaction with tuberculosis care in low- and middle-income countries: A systematic review.

BACKGROUND: Patient-centered care is at the forefront of the End TB strategy, yet little is known about user (patient's) experience and patient satisfaction with TB services. Our study aims to systematically review quantitative studies evaluating user experience and TB patient satisfaction within the health care system. METHODS: Five medical databases were systematically searched between January 1st, 2009 and December 31st, 2018. English studies assessing user experience and patient satisfaction within the healthcare system from a TB patient's perspective in low and middle-income countries, were included. RESULTS: Thirty-five studies from 16 low and middle-income countries evaluated three major themes; facilities and patient centeredness (n = 23), patient-provider relationship (n = 22) and overall satisfaction (n = 19). Overall study quality was low as they used varying tools to measure user experience and patient satisfaction. CONCLUSION: Our study shows large variability in measurement of user experiences and patient satisfaction. Studies reported that patients were mostly satisfied with TB care services, and those that were dissatisfied were substantially more likely to be lost to follow-up. The high satisfaction rates could have been due to lack of education on good quality patient care or fear of losing access to health care. A standardized patient centered tool could be designed to help assess user experience and patient satisfaction to allow comparisons among health systems and countries.

Variation in competent and respectful delivery care in Kenya and Malawi: a retrospective analysis of national facility surveys.

OBJECTIVE: Although substantial progress has been made in increasing access to care during childbirth, reductions in maternal and neonatal mortality have been slower. Poor-quality care may be to blame. In this study, we measure the quality of labour and delivery services in Kenya and Malawi using data from observations of deliveries and explore factors associated with levels of competent and respectful care. METHODS: We used data from nationally representative health facility assessment surveys. A total of 1100 deliveries in 392 facilities across Kenya and Malawi were observed and quality was assessed using two indices: the quality of the process of intrapartum and immediate postpartum care (QoPIIPC) index and a previously validated index of respectful maternity care. Data from standardised observations of care were analysed using descriptive statistics and multivariable random-intercept regression models to examine factors associated with variation in quality of care. We also quantified the variance in quality explained by each domain of covariates (patient-, provider- and facility-level and subnational divisions). RESULTS: Only 61-66% of basic elements of competent and respectful care were performed. In adjusted models, better-staffed facilities, private hospitals and morning deliveries were associated with higher levels of competent and respectful care. In Malawi, younger, primipara and HIV-positive women received higher-quality care. Quality also differed substantially across regions in Kenya, with a 25 percentage-point gap between Nairobi and the Coast region. Quality was also higher in higher-volume facilities and those with caesarean section capacity. Most of the explained variance in quality was due to regions in Kenya and to facility, and patient-level characteristics in Malawi. CONCLUSIONS: Our findings suggest considerable scope for improvement in quality. Increasing staffing and shifting births to higher-volume facilities - along with promotion of respectful care in these facilities - should be considered in sub-Saharan Africa to improve outcomes for mothers and newborns.

OBJECTIF: Bien que des progrès substantiels aient été accomplis dans l'amélioration de l'accès aux soins pendant l'accouchement, les réductions de la mortalité maternelle et néonatale ont été plus lentes. Des soins de mauvaise qualité peuvent être à blâmer. Dans cette étude, nous mesurons la qualité de la main-d'œuvre et des services d'accouchement au Kenya et au Malawi en utilisant les données des observations des accouchements et explorons les facteurs associés aux niveaux de la compétence et du respect dans les soins. MÉTHODES: Nous avons utilisé les données d'enquêtes d'évaluation des établissements de santé représentatives au niveau national. 1100 accouchements dans 392 établissements au Kenya et au Malawi ont été observés et la qualité a été évaluée à l'aide de deux indices: l'indice de qualité du processus de soins intra-partum et postpartum immédiat (QoPIIPC) et un indice précédemment validé de soins maternels respectueux. Les données des observations normalisées des soins ont été analysées à l'aide de statistiques descriptives et de modèles de régression à interceptions aléatoires multivariables pour examiner les facteurs associés à la variation de la qualité des soins. Nous avons également quantifié la variance de la qualité expliquée par chaque domaine de covariables (divisions au niveau des patients, des prestataires et des établissements, et infranationales). RÉSULTATS: Seuls 61% à 66% des éléments de base de soins compétents et respectueux ont été réalisés. Dans les modèles ajustés, des établissements mieux dotés en personnel, des hôpitaux privés et des accouchements le matin étaient associés à des niveaux plus élevés de soins compétents et respectueux. Au Malawi, les femmes plus jeunes, primipares et VIH positives ont reçu des soins de meilleure qualité. La qualité différait également considérablement d'une région à l'autre au Kenya, avec un écart de 25 points de pourcentage entre Nairobi et la région côtière. La qualité était également plus élevée dans les établissements avec un volume plus élevé et ceux ayant une capacité de césarienne. La majeure partie des raisons de la variance dans la qualité était liée aux régions du Kenya et à l'établissement et aux caractéristiques des patients au Malawi. CONCLUSIONS: Nos résultats suggèrent une marge considérable pour l'amélioration de la qualité. L'augmentation du personnel et le déplacement des naissances vers des établissements de plus grand volume - ainsi que la promotion de soins respectueux dans ces établissements - devraient être envisagés en Afrique subsaharienne pour améliorer les résultats pour les mères et les nouveau-nés.