Cost-effectiveness of a radio intervention to stimulate early childhood development: protocol for an economic evaluation of the SUNRISE trial in Burkina Faso.

INTRODUCTION: Approximately 250 million children under 5 years of age are at risk of poor development in low-income and middle-income countries. However, existing early childhood development (ECD) interventions can be expensive, labour intensive and challenging to deliver at scale. Mass media may offer an alternative approach to ECD intervention. This protocol describes the planned economic evaluation of a cluster-randomised controlled trial of a radio campaign promoting responsive caregiving and opportunities for early learning during the first 3 years of life in rural Burkina Faso (SUNRISE trial). METHODS AND ANALYSIS: The economic evaluation of the SUNRISE trial will be conducted as a within-trial analysis from the provider's perspective. Incremental costs and health outcomes of the radio campaign will be compared with standard broadcasting (ie, 'do nothing' comparator). All costs associated with creating and broadcasting the radio campaign during intervention start-up and implementation will be captured. The cost per child under 3 years old reached by the intervention will be calculated. Incremental cost-effectiveness ratios will be calculated for the trial's primary outcome (ie, incremental cost per SD of cognitive gain). A cost-consequence analysis will also be presented, whereby all relevant costs and outcomes are tabulated. Finally, an analysis will be conducted to assess the equity impact of the intervention. ETHICS AND DISSEMINATION: The SUNRISE trial has ethical approval from the ethics committees of the Ministry of Health, Burkina Faso, University College London and the London School of Hygiene and Tropical Medicine. The results of the economic evaluation will be disseminated in a peer-reviewed journal and presented at a relevant international conference. TRIAL REGISTRATION NUMBER: The SUNRISE trial was registered with ClinicalTrials.gov on 19 April 2019 (identifier: NCT05335395).

Understanding rural women's preferences for telephone call engagement with primary health care providers in Nigeria: a discrete choice experiment.

BACKGROUND: The COVID-19 pandemic has accelerated the use of mobile phones to provide primary health care services and maintain continuity of care. This study aims to understand rural women's preferences for telephone call engagement with primary health care providers in Nigeria. METHODS: A discrete choice experiment was conducted alongside an action research project that empowered primary health care workers to develop and implement a telephone call intervention to assess and enhance experiences with facility childbirth care. Between January and March 2022, 30 providers from 10 primary health care facilities implemented the choice experiment among rural women who had institutional childbirth to elicit service user preferences for telephone call engagement. The women were asked to express their preferred scenario for telephone call engagement with their primary health care providers. Generalised linear mixed models were used to estimate women's preferences. RESULTS: Data for 460 women were available for the discrete choice experiment. The study showed that rural women have preferences for telephone call engagement with primary health care providers. Specifically, women preferred engaging with female to male callers (ß=1.665 (95% CI 1.41, 1.93), SE=0.13, p<0.001), preferred call duration under 15 min (ß=1.287 (95% CI 0.61, 1.96), SE=0.34, p<0.001) and preferred being notified before the telephone engagement (warm calling) (ß=1.828 (95% CI 1.10, 2.56), SE=0.37, p<0.001). Phone credit incentive was also a statistically significant predictor of women's preferences for engagement. However, neither the availability of scheduling options, the period of the day or the day of the week predicts women's preferences. CONCLUSIONS: The study highlights the importance of understanding rural women's preferences for telephone call engagement with healthcare providers in low-income and middle-income countries. These findings can inform the development of mobile phone-based interventions and improve acceptability and broader adoption.

Parental experiences of the impacts of Covid-19 on the care of young children; qualitative interview findings from the Nairobi Early Childcare in Slums (NECS) project.

INTRODUCTION: The Covid-19 pandemic, and societal attempts to control it, have touched almost every aspect of people's lives around the world, albeit in unequal ways. In particular, there is considerable concern about the way that stringent 'lockdowns', as implemented in Kenya and many other countries, affected young children, especially those living in informal settlements. However, to date, there has been little research attempting to unpack and understand how the pandemic has impacted on the care of young children. METHODS: In-depth telephone interviews were conducted with 21 parents/carers of children aged under five years living in three Nairobi slums between May and September 2021 exploring the ways in which Covid-19, and policies to control the pandemic, impacted on their household and the care of their child/children. RESULTS: The impacts of Covid-19 control measures on the care of children have been widely felt, deep and multiple. The impact of economic hardship has been significant, reportedly undermining food security and access to services including healthcare and childcare. Respondents reported an associated increase in domestic and community violence. Many people relied on help from others; this was most commonly reported to be in the form of variable levels of flexibility from landlords and help from other community members. No direct harms from Covid-19 disease were reported by respondents. CONCLUSION: The impacts of Covid-19 control measures on the care of young children in informal settlements have been indirect but dramatic. Given the breadth and depth of these reported impacts, and the particular vulnerability of young children, deeper consideration ought to inform decisions about approaches to implementation of stringent disease control measures in future. In addition, these findings imply a need for both short- and long-term policy responses to ameliorate the impacts described.

Maternal time investment in caregiving activities to promote early childhood development: evidence from rural India.

Introduction: Intervention strategies that seek to improve early childhood development outcomes are often targeted at the primary caregivers of children, usually mothers. The interventions require mothers to assimilate new information and then act upon it by allocating sufficient physical resources and time to adopt and perform development promoting behaviours. However, women face many competing demands on their resources and time, returning to familiar habits and behaviours. In this study, we explore mothers' allocation of time for caregiving activities for children under the age of 2, nested within a cluster randomised controlled trial of a nutrition and care for development intervention in rural Haryana, India. Methods: We collected quantitative maternal time use data at two time points in rural Haryana, India, using a bespoke survey instrument. Data were collected from 704 mothers when their child was 12 months old, and 603 mothers when their child was 18 months old. We tested for significant differences in time spent by mothers on different activities when children are 12 months of age vs. 18 months of age between arms as well as over time, using linear regression. As these data were collected within a randomised controlled trial, we adjusted for clusters using random effects when testing for significant differences between the two time points. Results: At both time points, no statistically significant difference in maternal time use was found between arms. On average, mothers spent most of their waking time on household chores (over 6 h and 30 min) at both time points. When children were aged 12 months, approximately three and a half hours were spent on childcare activities for children under the age of 2 years. When children were 18 months old, mothers spent more time on income generating activities (30 min) than when the children were 12 years old, and on leisure (approximately 4 h and 30 min). When children were 18 months old, less time was spent on feeding/breastfeeding children (30 min less) and playing with children (15 min). However, mothers spent more time talking or reading to children at 18 months than at 12 months. Conclusion: We find that within a relatively short period of time in early childhood, maternal (or caregiver) time use can change, with time allocation being diverted away from childcare activities to others. This suggests that changing maternal time allocation in resource poor households may be quite challenging, and not allow the uptake of new and/or optimal behaviours.

Can home visits for early child development be implemented with sufficient coverage and quality at scale? Evidence from the SPRING program in India and Pakistan.

Introduction: There is limited evidence from low and middle-income settings on the effectiveness of early child development interventions at scale. To bridge this knowledge-gap we implemented the SPRING home visiting program where we tested integrating home visits into an existing government program (Pakistan) and employing a new cadre of intervention workers (India). We report the findings of the process evaluation which aimed to understand implementation. Methods and materials: We collected qualitative data on acceptability and barriers and facilitators for change through 24 in-depth interviews with mothers; eight focus group discussions with mothers, 12 with grandmothers, and 12 with fathers; and 12 focus group discussions and five in-depth interviews with the community-based agents and their supervisors. Results: Implementation was sub-optimal in both settings. In Pakistan issues were low field-supervision coverage and poor visit quality related to issues scheduling supervision, a lack of skill development, high workloads and competing priorities. In India, issues were low visit coverage - in part due to employing new workers and an empowerment approach to visit scheduling. Coaching caregivers to improve their skills was sub-optimal in both sites, and is likely to have contributed to caregiver perceptions that the intervention content was not new and was focused on play activities rather than interaction and responsivity - which was a focus of the coaching. In both sites caregiver time pressures was a key reason for low uptake among families who received visits. Discussion: Programs need feasible strategies to maximize quality, coverage and supervision including identifying and managing problems through monitoring and feedback loops. Where existing community-based agents are overstretched and system strengthening is unlikely, alternative implementation strategies should be considered such as group delivery. Core intervention ingredients such as coaching should be prioritized and supported during training and implementation. Given that time and resource constraints were a key barrier for families a greater focus on communication, responsivity and interaction during daily activities could have improved feasibility.

Effect of the SPRING home visits intervention on early child development and growth in rural India and Pakistan: parallel cluster randomised controlled trials.

Introduction: Almost 250 million children fail to achieve their full growth or developmental potential, trapping them in a cycle of continuing disadvantage. Strong evidence exists that parent-focussed face to face interventions can improve developmental outcomes; the challenge is delivering these on a wide scale. SPRING (Sustainable Programme Incorporating Nutrition and Games) aimed to address this by developing a feasible affordable programme of monthly home visits by community-based workers (CWs) and testing two different delivery models at scale in a programmatic setting. In Pakistan, SPRING was embedded into existing monthly home visits of Lady Health Workers (LHWs). In India, it was delivered by a civil society/non-governmental organisation (CSO/NGO) that trained a new cadre of CWs. Methods: The SPRING interventions were evaluated through parallel cluster randomised trials. In Pakistan, clusters were 20 Union Councils (UCs), and in India, the catchment areas of 24 health sub-centres. Trial participants were mother-baby dyads of live born babies recruited through surveillance systems of 2 monthly home visits. Primary outcomes were BSID-III composite scores for psychomotor, cognitive and language development plus height for age z-score (HAZ), assessed at 18 months of age. Analyses were by intention to treat. Results: 1,443 children in India were assessed at age 18 months and 1,016 in Pakistan. There was no impact in either setting on ECD outcomes or growth. The percentage of children in the SPRING intervention group who were receiving diets at 12 months of age that met the WHO minimum acceptable criteria was 35% higher in India (95% CI: 4-75%, p = 0.023) and 45% higher in Pakistan (95% CI: 15-83%, p = 0.002) compared to children in the control groups. Discussion: The lack of impact is explained by shortcomings in implementation factors. Important lessons were learnt. Integrating additional tasks into the already overloaded workload of CWs is unlikely to be successful without additional resources and re-organisation of their goals to include the new tasks. The NGO model is the most likely for scale-up as few countries have established infrastructures like the LHW programme. It will require careful attention to the establishment of strong administrative and management systems to support its implementation.

Improving community health worker treatment for malaria, diarrhoea, and pneumonia in Uganda through inSCALE community and mHealth innovations: A cluster randomised controlled trial.

The inSCALE cluster randomised controlled trial in Uganda evaluated two interventions, mHealth and Village Health Clubs (VHCs) which aimed to improve Community Health Worker (CHW) treatment for malaria, diarrhoea, and pneumonia within the national Integrated Community Case Management (iCCM) programme. The interventions were compared with standard care in a control arm. In a cluster randomised trial, 39 sub-counties in Midwest Uganda, covering 3167 CHWs, were randomly allocated to mHealth; VHC or usual care (control) arms. Household surveys captured parent-reported child illness, care seeking and treatment practices. Intention-to-treat analysis estimated the proportion of appropriately treated children with malaria, diarrhoea, and pneumonia according to WHO informed national guidelines. The trial was registered at ClinicalTrials.gov (NCT01972321). Between April-June 2014, 7679 households were surveyed; 2806 children were found with malaria, diarrhoea, or pneumonia symptoms in the last one month. Appropriate treatment was 11% higher in the mHealth compared to the control arm (risk ratio [RR] 1.11, 95% CI 1.02, 1.21; p = 0.018). The largest effect was on appropriate treatment for diarrhoea (RR 1.39; 95% CI 0.90, 2.15; p = 0.134). The VHC intervention increased appropriate treatment by 9% (RR 1.09; 95% CI 1.01, 1.18; p = 0.059), again with largest effect on treatment of diarrhoea (RR 1.56, 95% CI 1.04, 2.34, p = 0.030). CHWs provided the highest levels of appropriate treatment compared to other providers. However, improvements in appropriate treatment were observed at health facilities and pharmacies, with CHW appropriate treatment the same across the arms. The rate of CHW attrition in both intervention arms was less than half that of the control arm; adjusted risk difference mHealth arm -4.42% (95% CI -8.54, -0.29, p = 0.037) and VHC arm -4.75% (95% CI -8.74, -0.76, p = 0.021). Appropriate treatment by CHWs was encouragingly high across arms. The inSCALE mHealth and VHC interventions have the potential to reduce CHW attrition and improve the care quality for sick children, but not through improved CHW management as we had hypothesised. Trial Registration:ClinicalTrials.gov (NCT01972321).

Improving outcomes for children with malaria, diarrhoea and pneumonia in Mozambique: A cluster randomised controlled trial of the inSCALE technology innovation.

BACKGROUND: The majority of post-neonatal deaths in children under 5 are due to malaria, diarrhoea and pneumonia (MDP). The WHO recommends integrated community case management (iCCM) of these conditions using community-based health workers (CHW). However iCCM programmes have suffered from poor implementation and mixed outcomes. We designed and evaluated a technology-based (mHealth) intervention package 'inSCALE' (Innovations At Scale For Community Access and Lasting Effects) to support iCCM programmes and increase appropriate treatment coverage for children with MDP. METHODS: This superiority cluster randomised controlled trial allocated all 12 districts in Inhambane Province in Mozambique to receive iCCM only (control) or iCCM plus the inSCALE technology intervention. Population cross-sectional surveys were conducted at baseline and after 18 months of intervention implementation in approximately 500 eligible households in randomly selected communities in all districts including at least one child less than 60 months of age where the main caregiver was available to assess the impact of the intervention on the primary outcome, the coverage of appropriate treatment for malaria, diarrhoea and pneumonia in children 2-59months of age. Secondary outcomes included the proportion of sick children who were taken to the CHW for treatment, validated tool-based CHW motivation and performance scores, prevalence of cases of illness, and a range of secondary household and health worker level outcomes. All statistical models accounted for the clustered study design and variables used to constrain the randomisation. A meta-analysis of the estimated pooled impact of the technology intervention was conducted including results from a sister trial (inSCALE-Uganda). FINDINGS: The study included 2740 eligible children in control arm districts and 2863 children in intervention districts. After 18 months of intervention implementation 68% (69/101) CHWs still had a working inSCALE smartphone and app and 45% (44/101) had uploaded at least one report to their supervising health facility in the last 4 weeks. Coverage of the appropriate treatment of cases of MDP increased by 26% in the intervention arm (adjusted RR 1.26 95% CI 1.12-1.42, p<0.001). The rate of care seeking to the iCCM-trained community health worker increased in the intervention arm (14.4% vs 15.9% in control and intervention arms respectively) but fell short of the significance threshold (adjusted RR 1.63, 95% CI 0.93-2.85, p = 0.085). The prevalence of cases of MDP was 53.5% (1467) and 43.7% (1251) in the control and intervention arms respectively (risk ratio 0.82, 95% CI 0.78-0.87, p<0.001). CHW motivation and knowledge scores did not differ between intervention arms. Across two country trials, the estimated pooled effect of the inSCALE intervention on coverage of appropriate treatment for MDP was RR 1.15 (95% CI 1.08-1.24, p <0.001). INTERPRETATION: The inSCALE intervention led to an improvement in appropriate treatment of common childhood illnesses when delivered at scale in Mozambique. The programme will be rolled out by the ministry of health to the entire national CHW and primary care network in 2022-2023. This study highlights the potential value of a technology intervention aimed at strengthening iCCM systems to address the largest causes of childhood morbidity and mortality in sub-Saharan Africa.

'The objective was about not blaming one another': a qualitative study to explore how collaboration is experienced within quality improvement collaboratives in Ethiopia.

BACKGROUND: Quality improvement collaboratives are a common approach to improving quality of care. They rely on collaboration across and within health facilities to enable and accelerate quality improvement. Originating in high-income settings, little is known about how collaboration transfers to low-income settings, despite the widespread use of these collaboratives. METHOD: We explored collaboration within quality improvement collaboratives in Ethiopia through 42 in-depth interviews with staff of two hospitals and four health centers and three with quality improvement mentors. Data were analysed thematically using a deductive and inductive approach. RESULTS: There was collaboration at learning sessions though experience sharing, co-learning and peer pressure. Respondents were used to a blaming environment, which they contrasted to the open and non-blaming environment at the learning sessions. Respondents formed new relationships that led to across facility practical support. Within facilities, those in the quality improvement team continued to collaborate through the plan-do-study-act cycles, although this required high engagement and support from mentors. Few staff were able to attend learning sessions and within facility transfer of quality improvement knowledge was rare. This affected broader participation and led to some resentment and resistance. Improved teamwork skills and behaviors occurred at individual rather than facility or systems level, with implications for sustainability. Challenges to collaboration included unequal participation, lack of knowledge transfer, high workloads, staff turnover and a culture of dependency. CONCLUSION: We conclude that collaboration can occur and is valued within a traditionally hierarchical system, but may require explicit support at learning sessions and by mentors. More emphasis is needed on ensuring quality improvement knowledge transfer, buy-in and system level change. This could include a modified collaborative design to provide facility-level support for spread.

Parental experiences of childcare in an informal urban settlement: qualitative interview findings from the Nairobi Early Childcare in Slums (NECS) project.

OBJECTIVES: To gain an in-depth understanding of parent/carers' perspectives on, and decision-making about, early childhood care in general, and paid childcare specifically, in informal settlements in Nairobi. DESIGN: In-depth telephone interviews, conducted using a topic guide, were analysed through a combination of deductive and inductive thematic analysis and regular reflexivity meetings. We explored parents' childcare needs and experiences over time, and their perspectives on the provision of paid childcare in the slums. SETTING: Three informal settlements or slums in Nairobi: Kibera; Kawangware; and Mukuru-Viwandani. PARTICIPANTS: A purposively selected sample of 21 parental and non-parental carers of children aged under 5 years who were currently living in three Nairobi slums, including men and women, and users and non-users of paid childcare. RESULTS: Childcare is complex, with a plurality of approaches being used. Common strategies include family member provided care (often but not exclusively by mothers, at home or at a place of work), paid childcare and informal or ad hoc arrangements with neighbours. Childcare decision-making in these settings is constrained by economics and the broader context of living in the slum. Paid childcare is frequently used, but is widely understood to be lacking in quality, especially for the poorest. Quality of childcare is understood to comprise a combination of structural factors, such as the physical space, play and learning resources and processes such as interactions between the care provider and children or parents. CONCLUSIONS: These findings suggest a need, and opportunity, to improve early childhood care in slums. Understanding parental perspectives on both the deficiencies and valued features of childcare is likely to be vital to informing efforts to improve childcare in these settings.

Women's perceptions of telephone interviews about their experiences with childbirth care in Nigeria: A qualitative study.

Our objective is to investigate women's perceptions of phone interviews about their experiences with facility childbirth care. The study was conducted between October 2020 and January 2021, in Gombe State, Nigeria. Participants were women aged 15-49 years, who delivered in ten study Primary Health Care centres, provided phone numbers, and consented to a follow-up telephone interview about their childbirth experience. The phone interviews took place 14 months after the delivery and consisted of a quantitative survey about women's experiences of facility childbirth followed by a set of structured qualitative questions about their experiences with the phone survey. Three months later 20 women were selected, based on their demographic characteristics, for a further in-depth qualitative phone interview to explore the answers to the structured qualitative questions in more depth. The qualitative interviews were analysed using a thematic approach. We found that most of the women appreciated being called to discuss their childbirth experiences as it made them feel privileged and valued, they were motivated to participate as they viewed the topic as relevant and thought that their interview could lead to improvements in care. They found the interview procedures easy and perceived that the call offered privacy. Poor network connectivity and not owning the phone they were using presented challenges to some women. Women felt more able to re-arrange interview times on the phone compared to a face-to-face interview, they valued the increased autonomy as they were often busy with household chores and could rearrange to a more convenient time. Views about interviewer gender diverged, but most participants preferred a female interviewer. The preferred interview length was a maximum of 30 minutes, though some women said duration was irrelevant if the subject of discussion was important. In conclusion, women had positive views about phone interviews on experiences with facility childbirth care.

How valid are women's reports of the antenatal health services they receive from Community Health Workers in Gombe State north-eastern Nigeria?

BACKGROUND: Community health workers (CHWs) in low- and middle-income countries are key to increasing coverage of maternal and newborn interventions through home visits to counsel families about healthy behaviours. Household surveys enable tracking the progress of CHW programmes but recent evidence questions the accuracy of maternal reports. We measured the validity of women's responses about the content of care they received during CHW home visits and examined whether the accuracy of women's responses was affected by CHW counselling skills. METHODS: We conducted a criterion validity study in 2019, in Gombe State-Nigeria, and collected data from 362 pregnant women. During accompanied CHW home visits the content of CHW care and the presence or absence of 18 positive counselling skills were observed and documented by a researcher. In a follow-up interview three months later, the same women were asked about the care received during the CHW home visit. Women's reports were compared with observation data and the sensitivity, specificity, and area under receiver curve (AUC) calculated. We performed a covariate validity analysis that adjusted for a counselling skill score to assess the variation in accuracy of women's reports with CHW counselling skills. RESULTS: Ten indicators were included in the validity analysis. Women consistently overestimated the content of care CHWs provided and no indicator met the condition for individual-level accuracy set at AUC ≥ 0.6. The CHW counselling skill score ranged from 9-18 points from a possible 18, with a mean of 14.3; checking on client history or concerns were the most frequently missed item. There was evidence that unmarried women and the relatively most poor women received less skilled counselling than other women (mean counselling scores of 13.2 and 13.7 respectively). There was no consistent evidence of an association between higher counselling skill scores and better accuracy of women's reports. CONCLUSIONS: The validity of women's responses about CHW care content was poor and consistently overestimated coverage. We discuss several challenges in applying criterion validity study methods to examine measures of community-based care and make only cautious interpretation of the findings that may be relevant to other researchers interested in developing similar studies.

Self-reported vomiting during pregnancy in North-east Nigeria: perceptions, prevalence, severity and impacts.

BACKGROUND: Vomiting is a common ailment during pregnancy, often linked to negative impacts on women's quality of life. Very little is known about the issue in low income settings, particularly Sub-Saharan Africa, with studies from high income settings predominantly informing the evidence base. This study aimed to explore how women perceive vomiting during pregnancy and to measure its prevalence, severity and impacts in North-east Nigeria. METHODS: Qualitative in-depth interviews, focus group discussions, family interviews and a cross-sectional household survey were carried out between December 2015 and November 2016 with women who had given birth within the past two years. Purposive sampling and thematic analysis were used in the qualitative studies. A three-staged cluster sampling with 640 women and descriptive analyses were used in the survey. RESULTS: Women in the qualitative studies reported that vomiting was a normal part of pregnancy, unless a woman vomits after eating, has poor appetite, is not well-nourished, cannot perform chores, is overwhelmed by it or has to go to hospital. In the survey, 35.4% (95% CI 26.5-45.5) of women reported any vomiting during their last pregnancies and of these only 21.1% said it had stopped entirely within the first trimester. Over half of women who reported vomiting did so at least three times per day most days and 34.7% were vomiting five or more times per day during the most severe period. Care-seeking was reported by 61.5%. Both the qualitative and quantitative data found that vomiting impacted women in multiple ways including nutritionally, physiologically, mentally, financially and martially; 50.8% of women with any vomiting in the survey perceived the overall severity of the condition negatively. CONCLUSION: Vomiting during pregnancy is dually seen as normal and problematic depending on its characteristics and impacts. The burden appears to be high with many women seeking care for the condition.

Are verbatim transcripts necessary in applied qualitative research: experiences from two community-based intervention trials in Ghana.

Conducting qualitative research within public health trials requires balancing timely data collection with the need to maintain data quality. Verbatim transcription of interviews is the conventional way of recording qualitative data, but is time consuming and can severely delay the availability of research findings. Expanding field notes into fair notes is a quicker alternative method, but is not usually recommended as interviewers select and interpret what they record. We used the fair note methodology in Ghana, and found that where research questions are relatively simple, and interviewers undergo sufficient training and supervision, fair notes can decrease data collection and analysis time, while still providing detailed and relevant information to the study team. Interviewers liked the method and felt it made them more reflective and analytical and improved their interview technique. The exception was focus group discussions, where the fair note approach failed to capture the interaction and richness of discussions, capturing group consensus rather than the discussions leading to this consensus.

'The false reporter will get a praise and the one who reported truth will be discouraged': a qualitative study on intentional data falsification by frontline maternal and newborn healthcare workers in two regions in Ethiopia.

INTRODUCTION: Health Management Information Systems (HMIS) are vital to ensure accountability and for making decisions including for tracking the Sustainable Development Goals. The Ethiopia Health Sector Transformation Plan II includes preventing data falsification as a major strategic initiative and our study aimed to explore the reasons why healthcare providers intentionally falsify maternal and newborn health (MNH) data in two regions of Ethiopia. METHODS: We conducted a qualitative study in two hospitals, four health centres and their associated health posts in Oromia and Amhara regions. We conducted 45 in-depth interviews with health facility managers, quality improvement (QI) focal persons, health information technicians, MNH care providers, Health Extension Workers and QI mentors. Data were collected in local languages and transcribed in English. During analysis we repeatedly read the transcripts, coded them inductively using NVivo V.12, and categorised the codes into themes. RESULTS: Participants were hesitant to report personal data falsification but many reported that falsification is common and that they had experienced it in other facilities or had been told about it by other health workers. Falsification was mostly inflating the number of services provided (such as deliveries). Decreasing the number of deaths or reclassifying neonatal death into stillbirths was also reported. An overarching theme was that the health system focuses on, and rewards, the number of services provided over any other metric. This focus led to both system and individual level incentives for falsification and disincentives for accurate reporting. CONCLUSION: Our finding suggests that to reduce facility level data falsification policy makers might consider disentangling reward and punishments from the performance reports based on the routine HMIS data. Further studies examining the high-level drivers of falsification at regional, national and global levels and effective interventions to address the drivers of data falsification are needed.

Influence of context on quality improvement priorities: a qualitative study of three facility types in Lagos State, Nigeria.

BACKGROUND: Quality improvement (QI) collaboratives are increasingly popular. However, there is a need for an in-depth understanding of the influence of context on its implementation. We explored the influence of context on the change concepts considered by public primary (primary health centres), public secondary (public hospitals) and private (private facilities) collaboratives established to improve maternal and newborn health outcomes in Lagos State, Nigeria. METHODS: Between February 2019 and January 2020, we conducted a qualitative study using meeting reports, key informant interviews and participant observation. Data were analysed using the high-quality health system framework for assessing health system and user experience that distinguished three quality domains: quality impacts, processes of care and health system foundations. RESULTS: Nineteen change concepts and 158 change ideas were observed across 28 facility QI teams. Change concepts and ideas prioritised were influenced by government and non-governmental leaders but ultimately shaped by facility QI capacity, time allocated for QI activities and availability of local data. Of the three quality domains, process of care, including patient satisfaction, received the most attention across facility types. There was considerable variation in the change concepts considered across domains. For example, more public hospitals focused on complication management because of a relatively high prevalence of and capacity to manage maternal complications; primary health centres focused more on complication referrals, while private facilities prioritised revenue generation. Problems with availability of resources were particularly highlighted in primary health centres which had relatively less financial commitment from stakeholders. CONCLUSION: Our findings provide insights into QI collaboratives' mechanism of change in which external stakeholders, including government, drove QI priorities for action but the ultimate decisions depended on local realities of facilities. Our findings underscore the need for strong QI leadership and sufficient resources to enable facility QI teams to prioritise change concepts for greater health impact.

To call or not to call: exploring the validity of telephone interviews to derive maternal self-reports of experiences with facility childbirth care in northern Nigeria.

BACKGROUND: To institutionalise respectful maternity care, frequent data on the experience of childbirth care is needed by health facility staff and managers. Telephone interviews have been proposed as a low-cost alternative to derive timely and actionable maternal self-reports of experience of care. However, evidence on the validity of telephone interviews for this purpose is limited. METHODS: Eight indicators of positive maternity care experience and 18 indicators of negative maternity care experience were investigated. We compared the responses from exit interviews with women about their childbirth care experience (reference standard) to follow-up telephone interviews with the same women 14 months after childbirth. We calculated individual-level validity metrics including, agreement, sensitivity, specificity, area under the receiver operating characteristic curve (AUC). We compared the characteristics of women included in the telephone follow-up interviews to those from the exit interviews. RESULTS: Demographic characteristics were similar between the original exit interview group (n=388) and those subsequently reached for telephone interview (n=294). Seven of the eight positive maternity care experience indicators had reported prevalence higher than 50% at both exit and telephone interviews. For these indicators, agreement between the exit and the telephone interviews ranged between 50% and 92%; seven positive indicators met the criteria for validation analysis, but all had an AUC below 0.6. Reported prevalence for 15 of the 18 negative maternity care experience indicators was lower than 5% at exit and telephone interviews. For these 15 indicators, agreement between exit and telephone interview was high at over 80%. Just three negative indicators met the criteria for validation analysis, and all had an AUC below 0.6. CONCLUSIONS: The telephone interviews conducted 14 months after childbirth did not yield results that were consistent with exit interviews conducted at the time of facility discharge. Women's reports of experience of childbirth care may be influenced by the location of reporting or changes in the recall of experiences of care over time.

Implementing effective community-based surveillance in research studies of maternal, newborn and infant outcomes in low resource settings.

BACKGROUND: Globally adopted health and development milestones have not only encouraged improvements in the health and wellbeing of women and infants worldwide, but also a better understanding of the epidemiology of key outcomes and the development of effective interventions in these vulnerable groups. Monitoring of maternal and child health outcomes for milestone tracking requires the collection of good quality data over the long term, which can be particularly challenging in poorly-resourced settings. Despite the wealth of general advice on conducting field trials, there is a lack of specific guidance on designing and implementing studies on mothers and infants. Additional considerations are required when establishing surveillance systems to capture real-time information at scale on pregnancies, pregnancy outcomes, and maternal and infant health outcomes. MAIN BODY: Based on two decades of collaborative research experience between the Kintampo Health Research Centre in Ghana and the London School of Hygiene and Tropical Medicine, we propose a checklist of key items to consider when designing and implementing systems for pregnancy surveillance and the identification and classification of maternal and infant outcomes in research studies. These are summarised under four key headings: understanding your population; planning data collection cycles; enhancing routine surveillance with additional data collection methods; and designing data collection and management systems that are adaptable in real-time. CONCLUSION: High-quality population-based research studies in low resource communities are essential to ensure continued improvement in health metrics and a reduction in inequalities in maternal and infant outcomes. We hope that the lessons learnt described in this paper will help researchers when planning and implementing their studies.

From Theory to Implementation: Adaptations to a Quality Improvement Initiative According to Implementation Context.

As countries continue to invest in quality improvement (QI) initiatives in health facilities, it is important to acknowledge the role of context in implementation. We conducted a qualitative study between February 2019 and January 2020 to explore how a QI initiative was adapted to enable implementation in three facility types: primary health centres, public hospitals and private facilities in Lagos State, Nigeria.Despite a common theory of change, implementation of the initiative needed to be adapted to accommodate the local needs, priorities and organisational culture of each facility type. Across facility types, inadequate human and capital resources constrained implementation and necessitated an extension of the initiative's duration. In public facilities, the local governance structure was adapted to facilitate coordination, but similar adaptations to governance were not possible for private facilities. Our findings highlight the importance of anticipating and planning for the local adaptation of QI initiatives according to implementation environment.

Maximizing community participation and engagement: lessons learned over 2 decades of field trials in rural Ghana.

BACKGROUND: Successful implementation of community-based research is dominantly influenced by participation and engagement from the local community without which community members will not want to participate in research and important knowledge and potential health benefits will be missed. Therefore, maximising community participation and engagement is key for the effective conduct of community-based research. In this paper, we present lessons learnt over two decades of conducting research in 7 rural districts in the Brong Ahafo region of Ghana with an estimated population of around 600,000. The trials which were mainly in the area of Maternal, Neonatal and Child Health were conducted by the Kintampo Health Research Centre (KHRC) in collaboration with the London School of Hygiene and Tropical Medicine (LSHTM). METHODS: The four core strategies which were used were formative research methods, the formation of the Information, Education and Communication (IEC) team to serve as the main link between the research team and the community, recruitment of field workers from the communities within which they lived, and close collaboration with national and regional stakeholders. RESULTS: These measures allowed trust to be built between the community members and the research team and ensured that potential misconceptions which came up in the communities were promptly dealt with through the IEC team. The decision to place field workers in the communities from which they came and their knowledge of the local language created trust between the research team and the community. The close working relationship between the District health authorities and the Kintampo Health Research Centre supported the acceptance of the research in the communities as the District Health Authorities were respected and trusted. CONCLUSION: The successes achieved during the past 2 decades of collaboration between LSHTM and KHRC in conducting community-based field trials were based on involving the community in research projects. Community participation and engagement helped not only to identify the pertinent issues, but also enabled the communities and research team to contribute towards efforts to address challenges.