Assessing the validity of maternal report on breastfeeding counselling in Kosovo's primary health facilities.

BACKGROUND: Improving the quality of breastfeeding counselling delivered by primary care providers can improve breastfeeding outcomes and ultimately reduce mortality and morbidity of children and mothers. Accurate data on coverage and quality of primary care breastfeeding counselling is essential for monitoring progress; however, global and national indicators are limited. To help address this gap, this study validated indicators of receipt and quality of breastfeeding counselling during routine consultations for infant care at seven primary health facilities across Kosovo. METHODS: Mothers' reports of breastfeeding counselling received during routine consultations for their infants (0-12 months of age) were collected by exit interview in 2019 and 2021 (n = 609). Responses were compared against direct observation of their consultation using a structured checklist (reference standard) by a trained third-party observer at the primary care facility. We assessed 13 indicators; ten were related to the receipt and content of breastfeeding counselling, and three were specific to the provider's interpersonal skills. We calculated sensitivity, specificity, and area under the receiver operating curve (AUC) to determine individual-level reporting accuracy. RESULTS: Ten indicators had an agreement rate above 70% and seven indicators had high overall individual-level validity (AUC ≥ 0.7). High prevalence indicators recorded high sensitivity and low specificity, and the inverse for low prevalence indicators. More subjective indicators were less reliable, e.g., mothers over-reported the prevalence of all three indicators related to providers' interpersonal skills. CONCLUSIONS: This study offers evidence on breastfeeding counselling quality by validating maternal reports of whether a provider discussed breastfeeding, the clinical content of that counselling, and how it was delivered. It is also situated in a primary care setting within a fragile state of which there is limited evidence. We observed that mothers reported accurately when asked directly to recall breastfeeding counselling services received. However, there is a need to further validate subjective questions about interpersonal skills and other measures for the 'experience of care' quality dimension.

Factors shaping network emergence: A cross-country comparison of quality of care networks in Bangladesh, Ethiopia, Malawi, and Uganda.

The Quality-of-Care Network (QCN) was conceptualized by the World Health Organization (WHO) and other global partners to facilitate learning on and improve quality of care for maternal and newborn health within and across low and middle-income countries. However, there was significant variance in the speed and extent to which QCN formed in the involved countries. This paper investigates the factors that shaped QCN's differential emergence in Bangladesh, Ethiopia, Malawi, and Uganda. Drawing on network scholarship, we conducted a replicated case study of the four country cases and triangulated several sources of data, including a document review, observations of national-level and district level meetings, and key informant interviews in each country and at the global level. Thematic coding was performed in NVivo 12. We find that QCN emerged most quickly and robustly in Bangladesh, followed by Ethiopia, then Uganda, and slowest and with least institutionalization in Malawi. Factors connected to the policy environment and network features explained variance in network emergence. With respect to the policy environment, pre-existing resources and initiatives dedicated to maternal and newborn health and quality improvement, strong data and health system capacity, and national commitment to advancing on synergistic goals were crucial drivers to QCN's emergence. With respect to the features of the network itself, the embedding of QCN leadership in powerful agencies with pre-existing coordination structures and trusting relationships with key stakeholders, inclusive network membership, and effective individual national and local leadership were also crucial in explaining QCN's speed and quality of emergence across countries. Studying QCN emergence provides critical insights as to why well-intentioned top-down global health networks may not materialize in some country contexts and have relatively quick uptake in others, and has implications for a network's perceived legitimacy and ultimate effectiveness in producing stated objectives.

Effective coverage of antenatal care services in Ethiopia: a population-based cross-sectional study.

BACKGROUND: Antenatal care (ANC) is a principal component of safe motherhood and reproductive health strategies across the continuum of care. Although the coverage of antenatal care visits has increased in Ethiopia, there needs to be more evidence of effective coverage of antenatal care. The 'effective coverage' concept can pinpoint where action is required to improve high-quality coverage in Ethiopia. Effective coverage indicates a health system's performance by incorporating need, utilization, and quality into a single measurement. The concept includes the number of contacts, facility readiness, interventions received, and components of services received. This study aimed to measure effective antenatal care coverage in Ethiopia. METHODS: A two-stage cluster sampling method was used and included 2714 women aged 15-49 years and 462 health facilities from six Ethiopian regions from October 2019 to January 2020. The effective coverage cascade was analyzed among the targeted women by computing the proportion who received four or more antenatal care visits where the necessary inputs were available, received iron-folate supplementation and two doses of tetanus vaccination according to process quality components of antenatal care services. RESULTS: Of all women, 40% (95%CI; 38, 43) had four or more visits, ranging from 3% in Afar to 74% in Addis Ababa. The overall mean health facility readiness score of the facilities serving these women was 70%, the vaccination and iron-folate supplementation coverage was 26%, and the ANC process quality was 64%. As reported by women, the least score was given to the quality component of discussing birth preparedness and complication readiness with providers. In the effective coverage cascade, the input-adjusted, intervention-adjusted, and quality-adjusted antenatal coverage estimates were 28%, 18%, and 12%, respectively. CONCLUSION: The overall effective ANC coverage was low, primarily due to a considerable drop in the proportion of women who completed four or more ANC visits. Improving quality of services is crucial to increase ANC up take and completion of the recommended visits along with interventions increasing women's awareness.

Data-driven decision-making for district health management: a cluster-randomised study in 24 districts of Ethiopia.

BACKGROUND: Use of local data for health system planning and decision-making in maternal, newborn and child health services is limited in low-income and middle-income countries, despite decentralisation and advances in data gathering. An improved culture of data-sharing and collaborative planning is needed. The Data-Informed Platform for Health is a system-strengthening strategy which promotes structured decision-making by district health officials using local data. Here, we describe implementation including process evaluation at district level in Ethiopia, and evaluation through a cluster-randomised trial. METHODS: We supported district health teams in 4-month cycles of data-driven decision-making by: (a) defining problems using a health system framework; (b) reviewing data; (c) considering possible solutions; (d) value-based prioritising; and (e) a consultative process to develop, commit to and follow up on action plans. 12 districts were randomly selected from 24 in the North Shewa zone of Ethiopia between October 2020 and June 2022. The remaining districts formed the trial's comparison arm. Outcomes included health information system performance and governance of data-driven decision-making. Analysis was conducted using difference-in-differences. RESULTS: 58 4-month cycles were implemented, four or five in each district. Each focused on a health service delivery challenge at district level. Administrators' practice of, and competence in, data-driven decision-making showed a net increase of 77% (95% CI: 40%, 114%) in the regularity of monthly reviews of service performance, and 48% (95% CI: 9%, 87%) in data-based feedback to health facilities. Statistically significant improvement was also found in administrators' use of information to appraise services. Qualitative findings also suggested that district health staff reported enhanced data use and collaborative decision-making. CONCLUSIONS: This study generated robust evidence that 20 months' implementation of the Data-Informed Platform for Health strengthened health management through better data use and appraisal practices, systemised problem analysis to follow up on action points and improved stakeholder engagement. TRIAL REGISTRATION NUMBER: NCT05310682.

Understanding rural women's preferences for telephone call engagement with primary health care providers in Nigeria: a discrete choice experiment.

BACKGROUND: The COVID-19 pandemic has accelerated the use of mobile phones to provide primary health care services and maintain continuity of care. This study aims to understand rural women's preferences for telephone call engagement with primary health care providers in Nigeria. METHODS: A discrete choice experiment was conducted alongside an action research project that empowered primary health care workers to develop and implement a telephone call intervention to assess and enhance experiences with facility childbirth care. Between January and March 2022, 30 providers from 10 primary health care facilities implemented the choice experiment among rural women who had institutional childbirth to elicit service user preferences for telephone call engagement. The women were asked to express their preferred scenario for telephone call engagement with their primary health care providers. Generalised linear mixed models were used to estimate women's preferences. RESULTS: Data for 460 women were available for the discrete choice experiment. The study showed that rural women have preferences for telephone call engagement with primary health care providers. Specifically, women preferred engaging with female to male callers (ß=1.665 (95% CI 1.41, 1.93), SE=0.13, p<0.001), preferred call duration under 15 min (ß=1.287 (95% CI 0.61, 1.96), SE=0.34, p<0.001) and preferred being notified before the telephone engagement (warm calling) (ß=1.828 (95% CI 1.10, 2.56), SE=0.37, p<0.001). Phone credit incentive was also a statistically significant predictor of women's preferences for engagement. However, neither the availability of scheduling options, the period of the day or the day of the week predicts women's preferences. CONCLUSIONS: The study highlights the importance of understanding rural women's preferences for telephone call engagement with healthcare providers in low-income and middle-income countries. These findings can inform the development of mobile phone-based interventions and improve acceptability and broader adoption.

"We don't trust all data coming from all facilities": factors influencing the quality of care network data quality in Ethiopia.

BACKGROUND: Good quality data are a key to quality health care. In 2017, WHO has launched the Quality of Care Network (QCN) to reduce maternal, newborn and stillbirth mortality via learning and sharing networks. Guided by the principle of equity and dignity, the network members agreed to implement the programme in 2017-2021. OBJECTIVE: This paper seeks to explore how QCN has contributed to improving data quality and to identify factors influencing quality of data in Ethiopia. METHODS: We conducted a qualitative study in selected QCN facilities in Ethiopia using key informant interview and observation methods. We interviewed 40 people at national, sub-national and facility levels. Non-participant observations were carried out in four purposively selected health facilities; we accessed monthly reports from 41 QCN learning facilities. A codebook was prepared following a deductive and inductive analytical approach, coded using Nvivo 12 and thematically analysed. RESULTS: There was a general perception that QCN had improved health data documentation and use in the learning facilities, achieved through coaching, learning and building from pre-existing initiatives. QCN also enhanced the data elements available by introducing a broader set of quality indicators. However, the perception of poor data quality persisted. Factors negatively affecting data quality included a lack of integration of QCN data within routine health system activities, the perception that QCN was a pilot, plus a lack of inclusive engagement at different levels. Both individual and system capabilities needed to be strengthened. CONCLUSION: There is evidence of QCN's contribution to improving data awareness. But a lack of inclusive engagement of actors, alignment and limited skill for data collection and analysis continued to affect data quality and use. In the absence of new resources, integration of new data activities within existing routine health information systems emerged as the most important potential action for positive change.

Individual interactions in a multi-country implementation-focused quality of care network for maternal, newborn and child health: A social network analysis.

The Network for Improving Quality of Care for Maternal, Newborn and Child Health (QCN) was established to build a cross-country platform for joint-learning around quality improvement implementation approaches to reduce mortality. This paper describes and explores the structure of the QCN in four countries and at global level. Using Social Network Analysis (SNA), this cross-sectional study maps the QCN networks at global level and in four countries (Bangladesh, Ethiopia, Malawi and Uganda) and assesses the interactions among actors involved. A pre-tested closed-ended structured questionnaire was completed by 303 key actors in early 2022 following purposeful and snowballing sampling. Data were entered into an online survey tool, and exported into Microsoft Excel for data management and analysis. This study received ethical approval as part of a broader evaluation. The SNA identified 566 actors across the four countries and at global level. Bangladesh, Malawi and Uganda had multiple-hub networks signifying multiple clusters of actors reflecting facility or district networks, whereas the network in Ethiopia and at global level had more centralized networks. There were some common features across the country networks, such as low overall density of the network, engagement of actors at all levels of the system, membership of related committees identified as the primary role of actors, and interactions spanning all types (learning, action and information sharing). The most connected actors were facility level actors in all countries except Ethiopia, which had mostly national level actors. The results reveal the uniqueness and complexity of each network assessed in the evaluation. They also affirm the broader qualitative evaluation assessing the nature of these networks, including composition and leadership. Gaps in communication between members of the network and limited interactions of actors between countries and with global level actors signal opportunities to strengthen QCN.

Opportunities to sustain a multi-country quality of care network: Lessons on the actions of four countries Bangladesh, Ethiopia, Malawi, and Uganda.

The Quality of Care Network (QCN) is a global initiative that was established in 2017 under the leadership of WHO in 11 low-and- middle income countries to improve maternal, newborn, and child health. The vision was that the Quality of Care Network would be embedded within member countries and continued beyond the initial implementation period: that the Network would be sustained. This paper investigated the experience of actions taken to sustain QCN in four Network countries (Bangladesh, Ethiopia, Malawi, and Uganda) and reports on lessons learned. Multiple iterative rounds of data collection were conducted through qualitative interviews with global and national stakeholders, and non-participatory observation of health facilities and meetings. A total of 241 interviews, 42 facility and four meeting observations were carried out. We conducted a thematic analysis of all data using a framework approach that defined six critical actions that can be taken to promote sustainability. The analysis revealed that these critical actions were present with varying degrees in each of the four countries. Although vulnerabilities were observed, there was good evidence to support that actions were taken to institutionalize the innovation within the health system, to motivate micro-level actors, plan opportunities for reflection and adaptation from the outset, and to support strong government ownership. Two actions were largely absent and weakened confidence in future sustainability: managing financial uncertainties and fostering community ownership. Evidence from four countries suggested that the QCN model would not be sustained in its original format, largely because of financial vulnerability and insufficient time to embed the innovation at the sub-national level. But especially the efforts made to institutionalize the innovation in existing systems meant that some characteristics of QCN may be carried forward within broader government quality improvement initiatives.

Individual, organizational and system circumstances, and the functioning of a multi-country implementation-focused network for maternal, newborn and child health: Bangladesh, Ethiopia, Malawi, and Uganda.

Better policies, investments, and programs are needed to improve the integration and quality of maternal, newborn, and child health services. Previously, partnerships and collaborations that involved multiple countries with a unified aim have been observed to yield positive results. Since 2017, the WHO and partners have hosted the Quality of Care Network [QCN], a multi-country implementation network focused on improving maternal, neonatal, and child health care. In this paper, we examine the functionality of QCN in different contexts. We focus on implementation circumstances and contexts in four network countries: Bangladesh, Ethiopia, Malawi, and Uganda. In each country, the study was conducted over several consecutive rounds between 2019-2022, employing 227 key informant interviews with major stakeholders and members of the network countries, and 42 facility observations. The collected data were coded using Nvivo-12 software and categorized thematically. The study showed that individual, organizational and system-level circumstances all played an important role in shaping implementation success in network countries, but that these levels were inter-linked. Systems that enabled leadership, motivated and trained staff, and created a positive culture of data use were critical for policy-making including addressing financing issues-to the day-to-day practice improvement at the front line. Some characteristics of QCN actively supported this, for example, shared learning forums for continuous learning, a focus on data and tracking progress, and emphasising the importance of coordinated efforts towards a common goal. However, inadequate system financing and capacity also hampered network functioning, especially in the face of external shocks.

Women's perceptions of telephone interviews about their experiences with childbirth care in Nigeria: A qualitative study.

Our objective is to investigate women's perceptions of phone interviews about their experiences with facility childbirth care. The study was conducted between October 2020 and January 2021, in Gombe State, Nigeria. Participants were women aged 15-49 years, who delivered in ten study Primary Health Care centres, provided phone numbers, and consented to a follow-up telephone interview about their childbirth experience. The phone interviews took place 14 months after the delivery and consisted of a quantitative survey about women's experiences of facility childbirth followed by a set of structured qualitative questions about their experiences with the phone survey. Three months later 20 women were selected, based on their demographic characteristics, for a further in-depth qualitative phone interview to explore the answers to the structured qualitative questions in more depth. The qualitative interviews were analysed using a thematic approach. We found that most of the women appreciated being called to discuss their childbirth experiences as it made them feel privileged and valued, they were motivated to participate as they viewed the topic as relevant and thought that their interview could lead to improvements in care. They found the interview procedures easy and perceived that the call offered privacy. Poor network connectivity and not owning the phone they were using presented challenges to some women. Women felt more able to re-arrange interview times on the phone compared to a face-to-face interview, they valued the increased autonomy as they were often busy with household chores and could rearrange to a more convenient time. Views about interviewer gender diverged, but most participants preferred a female interviewer. The preferred interview length was a maximum of 30 minutes, though some women said duration was irrelevant if the subject of discussion was important. In conclusion, women had positive views about phone interviews on experiences with facility childbirth care.

Bibliometric analysis of authorship patterns in publications from a research group at the London School of Hygiene & Tropical Medicine, 2016-2020.

BACKGROUND: Authors from low and middle-income country (LMIC) institutions are under-represented in publications of research based in LMICs. This case study of publications from authors within the Medical Research Council International Statistics and Epidemiology Group (MRC-ISEG), a global health research group affiliated to the London School of Hygiene & Tropical Medicine in the UK, aims to describe patterns in authorship and factors associated with under-representation. METHODS: Papers were included if they were published between January 2016 and December 2020 inclusive, included an author from the MRC-ISEG and described work conducted in a LMIC. Authors' affiliations were classified using World Bank country income classifications into LMIC affiliations only, high-income country (HIC) affiliations only and mixed LMIC/HIC affiliations. Multinomial logistic regression analysis was used to assess associations of author affiliation category with authorship position, and whether patterns varied by journal impact factor quartile and multiple versus single-country studies. RESULTS: A total of 882 papers, including 10 570 authors describing research conducted in 61 LMICs, were included. Compared with authors of HIC-only affiliation, those with LMIC-only affiliation were less likely to be in first authorship position (relative risk ratio (RRR)=0.51, 95% CI 0.44 to 0.60) and mixed HIC/LMIC affiliation authors were more likely (RRR=2.80, 95% CI 2.35 to 3.34). Compared with authors of HIC-only affiliation, those with LMIC-only affiliation were less likely to be in last authorship position (RRR=0.20, 95% CI 0.16 to 0.24) and those with mixed HIC/LMIC affiliations were more likely (RRR=1.95, 95% CI 1.65 to 2.30). The proportion of senior authors with LMIC-only affiliation was lowest for the highest impact journals, and in multicountry versus single-country studies. CONCLUSION: Alongside increasing research capacity within LMICs, HIC institutions should ensure that LMIC-affiliated researchers are properly represented in global research. Academics working in global health should be judged on their involvement in representative collaborative research rather than individual achievements in authorship position.

How valid are women's reports of the antenatal health services they receive from Community Health Workers in Gombe State north-eastern Nigeria?

BACKGROUND: Community health workers (CHWs) in low- and middle-income countries are key to increasing coverage of maternal and newborn interventions through home visits to counsel families about healthy behaviours. Household surveys enable tracking the progress of CHW programmes but recent evidence questions the accuracy of maternal reports. We measured the validity of women's responses about the content of care they received during CHW home visits and examined whether the accuracy of women's responses was affected by CHW counselling skills. METHODS: We conducted a criterion validity study in 2019, in Gombe State-Nigeria, and collected data from 362 pregnant women. During accompanied CHW home visits the content of CHW care and the presence or absence of 18 positive counselling skills were observed and documented by a researcher. In a follow-up interview three months later, the same women were asked about the care received during the CHW home visit. Women's reports were compared with observation data and the sensitivity, specificity, and area under receiver curve (AUC) calculated. We performed a covariate validity analysis that adjusted for a counselling skill score to assess the variation in accuracy of women's reports with CHW counselling skills. RESULTS: Ten indicators were included in the validity analysis. Women consistently overestimated the content of care CHWs provided and no indicator met the condition for individual-level accuracy set at AUC ≥ 0.6. The CHW counselling skill score ranged from 9-18 points from a possible 18, with a mean of 14.3; checking on client history or concerns were the most frequently missed item. There was evidence that unmarried women and the relatively most poor women received less skilled counselling than other women (mean counselling scores of 13.2 and 13.7 respectively). There was no consistent evidence of an association between higher counselling skill scores and better accuracy of women's reports. CONCLUSIONS: The validity of women's responses about CHW care content was poor and consistently overestimated coverage. We discuss several challenges in applying criterion validity study methods to examine measures of community-based care and make only cautious interpretation of the findings that may be relevant to other researchers interested in developing similar studies.

Influence of context on quality improvement priorities: a qualitative study of three facility types in Lagos State, Nigeria.

BACKGROUND: Quality improvement (QI) collaboratives are increasingly popular. However, there is a need for an in-depth understanding of the influence of context on its implementation. We explored the influence of context on the change concepts considered by public primary (primary health centres), public secondary (public hospitals) and private (private facilities) collaboratives established to improve maternal and newborn health outcomes in Lagos State, Nigeria. METHODS: Between February 2019 and January 2020, we conducted a qualitative study using meeting reports, key informant interviews and participant observation. Data were analysed using the high-quality health system framework for assessing health system and user experience that distinguished three quality domains: quality impacts, processes of care and health system foundations. RESULTS: Nineteen change concepts and 158 change ideas were observed across 28 facility QI teams. Change concepts and ideas prioritised were influenced by government and non-governmental leaders but ultimately shaped by facility QI capacity, time allocated for QI activities and availability of local data. Of the three quality domains, process of care, including patient satisfaction, received the most attention across facility types. There was considerable variation in the change concepts considered across domains. For example, more public hospitals focused on complication management because of a relatively high prevalence of and capacity to manage maternal complications; primary health centres focused more on complication referrals, while private facilities prioritised revenue generation. Problems with availability of resources were particularly highlighted in primary health centres which had relatively less financial commitment from stakeholders. CONCLUSION: Our findings provide insights into QI collaboratives' mechanism of change in which external stakeholders, including government, drove QI priorities for action but the ultimate decisions depended on local realities of facilities. Our findings underscore the need for strong QI leadership and sufficient resources to enable facility QI teams to prioritise change concepts for greater health impact.

To call or not to call: exploring the validity of telephone interviews to derive maternal self-reports of experiences with facility childbirth care in northern Nigeria.

BACKGROUND: To institutionalise respectful maternity care, frequent data on the experience of childbirth care is needed by health facility staff and managers. Telephone interviews have been proposed as a low-cost alternative to derive timely and actionable maternal self-reports of experience of care. However, evidence on the validity of telephone interviews for this purpose is limited. METHODS: Eight indicators of positive maternity care experience and 18 indicators of negative maternity care experience were investigated. We compared the responses from exit interviews with women about their childbirth care experience (reference standard) to follow-up telephone interviews with the same women 14 months after childbirth. We calculated individual-level validity metrics including, agreement, sensitivity, specificity, area under the receiver operating characteristic curve (AUC). We compared the characteristics of women included in the telephone follow-up interviews to those from the exit interviews. RESULTS: Demographic characteristics were similar between the original exit interview group (n=388) and those subsequently reached for telephone interview (n=294). Seven of the eight positive maternity care experience indicators had reported prevalence higher than 50% at both exit and telephone interviews. For these indicators, agreement between the exit and the telephone interviews ranged between 50% and 92%; seven positive indicators met the criteria for validation analysis, but all had an AUC below 0.6. Reported prevalence for 15 of the 18 negative maternity care experience indicators was lower than 5% at exit and telephone interviews. For these 15 indicators, agreement between exit and telephone interview was high at over 80%. Just three negative indicators met the criteria for validation analysis, and all had an AUC below 0.6. CONCLUSIONS: The telephone interviews conducted 14 months after childbirth did not yield results that were consistent with exit interviews conducted at the time of facility discharge. Women's reports of experience of childbirth care may be influenced by the location of reporting or changes in the recall of experiences of care over time.

A rapid systematic review and evidence synthesis of effective coverage measures and cascades for childbirth, newborn and child health in low- and middle-income countries.

BACKGROUND: Effective coverage measures aim to estimate the proportion of a population in need of a service that received a positive health outcome. In 2020, the Effective Coverage Think Tank Group recommended using a 'coverage cascade' for maternal, newborn, child and adolescent health and nutrition (MNCAHN), which organises components of effective coverage in a stepwise fashion, with each step accounting for different aspects of quality of care (QoC), applied at the population level. The cascade outlines six steps that increase the likelihood that the population in need experience the intended health benefit: 1) the population in need (target population) who contact a health service; 2) that has the inputs available to deliver the service; 3) who receive the health service; 4) according to quality standards; 5) and adhere to prescribed medication(s) or health workers instructions; and 6) experience the expected health outcome. We examined how effective coverage of life-saving interventions from childbirth to children aged nine has been defined and assessed which steps of the cascade are captured by existing measures. METHODS: We undertook a rapid systematic review. Seven scientific literature databases were searched covering the period from May 1, 2017 to July, 8 2021. Reference lists from reviews published in 2018 and 2019 were examined to identify studies published prior to May 2017. Eligible studies reported population-level contact coverage measures adjusted for at least one dimension of QoC. RESULTS: Based on these two search approaches this review includes literature published from 2010 to 2021. From 16 662 records reviewed, 33 studies were included, reporting 64 effective coverage measures. The most frequently examined measures were for childbirth and immediate newborn care (n = 24). No studies examined measures among children aged five to nine years. Definitions of effective coverage varied across studies. Key sources of variability included (i) whether a single effective coverage measure was reported for a package of interventions or separate measures were calculated for each intervention; (ii) the number and type of coverage cascade steps applied to adjust for QoC; and (iii) the individual items included in the effective coverage definition and the methods used to generate a composite quality measure. CONCLUSION: In the MNCAHN literature there is substantial heterogeneity in both definitions and construction of effective coverage, limiting the comparability of measures over time and place. Current measurement approaches are not closely aligned with the proposed cascade. For widespread adoption, there is a need for greater standardisation of indicator definitions and transparency in reporting, so governments can use these measures to improve investments in MNACHN and implement life-saving health policies and programs.

Improving maternal and newborn health services in Northeast Nigeria through a government-led partnership of stakeholders: a quasi-experimental study.

OBJECTIVES: This study aimed to quantify change in the coverage, quality and equity of essential maternal and newborn healthcare interventions in Gombe state, Northeast Nigeria, following a four year, government-led, maternal and newborn health intervention. DESIGN: Quasi-experimental plausibility study. Repeat cross-sectional household and linked health facility surveys were implemented in intervention and comparison areas. SETTING: Gombe state, Northeast Nigeria. PARTICIPANTS: Each household survey included a sample of 1000 women aged 13-49 years with a live birth in the previous 12 months. Health facility surveys comprised a readiness assessment and birth attendant interview. INTERVENTIONS: Between 2016-2019 a complex package of evidence-based interventions was implemented to increase access, use and quality of maternal and newborn healthcare, spanning the six WHO health system building blocks. OUTCOME MEASURES: Eighteen indicators of maternal and newborn healthcare. RESULTS: Between 2016 and 2019, the coverage of all indicators improved in intervention areas, with the exception of postnatal and postpartum contacts, which remained below 15%. Greater improvements were observed in intervention than comparison areas for eight indicators, including coverage of at least one antenatal visit (71% (95% CI 62 to 68) to 88% (95% CI 82 to 93)), at least four antenatal visits (46% (95% CI 39 to 53) to 69% (95% CI 60 to 75)), facility birth (48% (95% CI 37 to 59) to 64% (95% CI 54 to 73)), administration of uterotonics (44% (95% CI 34 to 54) to 59% (95% CI 50 to 67)), delayed newborn bathing (44% (95% CI 36 to 52) to 62% (95% CI 52 to 71)) and clean cord care (42% (95% CI 34 to 49) to 73% (95% CI 66 to 79)). Wide-spread inequities persisted however; only at least one antenatal visit saw pro-poor improvement. CONCLUSIONS: This intervention achieved improvements in life-saving behaviours for mothers and newborns, demonstrating that multipartner action, coordinated through government leadership, can shift the needle in the right direction, even in resource-constrained settings.

Operationalising effective coverage measurement of facility based childbirth in Gombe State; a comparison of data sources.

Estimating effective coverage of childbirth care requires linking population based data sources to health facility data. For effective coverage to gain widespread adoption there is a need to focus on the feasibility of constructing these measures using data typically available to decision makers in low resource settings. We estimated effective coverage of childbirth care in Gombe State, northeast Nigeria, using two different combinations of facility data sources and examined their strengths and limitations for decision makers. Effective coverage captures information on four steps: access, facility inputs, receipt of interventions and process quality. We linked data from the 2018 Nigerian Demographic and Health Survey (NDHS) to two sources of health facility data: (1) comprehensive health facility survey data generated by a research project; and (2) District Health Information Software 2 (DHIS2). For each combination of data sources, we examined which steps were feasible to calculate, the size of the drop in coverage between steps and the resulting estimate of effective coverage. Analysis included 822 women with a recent live birth, 30% of whom attended a facility for childbirth. Effective coverage was low: 2% based on the project data and less than 1% using the DHIS2. Linking project data with NDHS, it was feasible to measure all four steps; using DHIS2 it was possible to estimate three steps: no data was available to measure process quality. The provision of high quality care is suboptimal in this high mortality setting where access and facility readiness to provide care, crucial foundations to the provision of high quality of care, have not yet been met. This study demonstrates that partial effective coverage measures can be constructed from routine data combined with nationally representative surveys. Advocacy to include process of care indicators in facility summary reports could optimise this data source for decision making.

From Theory to Implementation: Adaptations to a Quality Improvement Initiative According to Implementation Context.

As countries continue to invest in quality improvement (QI) initiatives in health facilities, it is important to acknowledge the role of context in implementation. We conducted a qualitative study between February 2019 and January 2020 to explore how a QI initiative was adapted to enable implementation in three facility types: primary health centres, public hospitals and private facilities in Lagos State, Nigeria.Despite a common theory of change, implementation of the initiative needed to be adapted to accommodate the local needs, priorities and organisational culture of each facility type. Across facility types, inadequate human and capital resources constrained implementation and necessitated an extension of the initiative's duration. In public facilities, the local governance structure was adapted to facilitate coordination, but similar adaptations to governance were not possible for private facilities. Our findings highlight the importance of anticipating and planning for the local adaptation of QI initiatives according to implementation environment.

Methodological considerations for linking household and healthcare provider data for estimating effective coverage: a systematic review.

OBJECTIVE: To assess existing knowledge related to methodological considerations for linking population-based surveys and health facility data to generate effective coverage estimates. Effective coverage estimates the proportion of individuals in need of an intervention who receive it with sufficient quality to achieve health benefit. DESIGN: Systematic review of available literature. DATA SOURCES: Medline, Carolina Population Health Center and Demographic and Health Survey publications and handsearch of related or referenced works of all articles included in full text review. The search included publications from 1 January 2000 to 29 March 2021. ELIGIBILITY CRITERIA: Publications explicitly evaluating (1) the suitability of data, (2) the implications of the design of existing data sources and (3) the impact of choice of method for combining datasets to obtain linked coverage estimates. RESULTS: Of 3805 papers reviewed, 70 publications addressed relevant issues. Limited data suggest household surveys can be used to identify sources of care, but their validity in estimating intervention need was variable. Methods for collecting provider data and constructing quality indices were diverse and presented limitations. There was little empirical data supporting an association between structural, process and outcome quality. Few studies addressed the influence of the design of common data sources on linking analyses, including imprecise household geographical information system data, provider sampling design and estimate stability. The most consistent evidence suggested under certain conditions, combining data based on geographical proximity or administrative catchment (ecological linking) produced similar estimates to linking based on the specific provider utilised (exact match linking). CONCLUSIONS: Linking household and healthcare provider data can leverage existing data sources to generate more informative estimates of intervention coverage and care. However, existing evidence on methods for linking data for effective coverage estimation are variable and numerous methodological questions remain. There is need for additional research to develop evidence-based, standardised best practices for these analyses.