How to evaluate a multi-country implementation-focused network: Reflections from the Quality of Care Network (QCN) evaluation.

Learning about how to evaluate implementation-focused networks is important as they become more commonly used. This research evaluated the emergence, legitimacy and effectiveness of a multi-country Quality of Care Network (QCN) aiming to improve maternal, newborn and child health (MNCH) outcomes. We examined the QCN global level, national and local level interfaces in four case study countries. This paper presents the evaluation team's reflections on this 3.5 year multi-country, multi-disciplinary project. Specifically, we examine our approach, methodological innovations, lessons learned and recommendations for conducting similar research. We used a reflective methodological approach to draw lessons on our practice while evaluating the QCN. A 'reflections' tool was developed to guide the process, which happened within a period of 2-4 weeks across the different countries. All country research teams held focused 'reflection' meetings to discuss questions in the tool before sharing responses with this paper's lead author. Similarly, the different lead authors of all eight QCN papers convened their writing teams to reflect on the process and share key highlights. These data were thematically analysed and are presented across key themes around the implementation experience including what went well, facilitators and critical methodological adaptations, what can be done better and recommendations for undertaking similar work. Success drivers included the team's global nature, spread across seven countries with members affiliated to nine institutions. It was multi-level in expertise and seniority and highly multidisciplinary including experts in medicine, policy and health systems, implementation research, behavioural sciences and MNCH. Country Advisory Boards provided technical oversight and support. Despite complexities, the team effectively implemented the QCN evaluation. Strong leadership, partnership, communication and coordination were key; as were balancing standardization with in-country adaptation, co-production, flattening hierarchies among study team members and the iterative nature of data collection. Methodological adaptations included leveraging technology which became essential during COVID-19, clear division of roles and responsibilities, and embedding capacity building as both an evaluation process and outcome, and optimizing technology use for team cohesion and quality outputs.

Feasibility and usability of a very low-cost bubble continuous positive airway pressure device including oxygen blenders in a Ugandan level two newborn unit.

BACKGROUND: Preterm birth and resulting respiratory failure is a leading cause of newborn death- the majority of which occur in resource-constrained settings and could be prevented with bubble continuous positive airway pressure (bCPAP). Commercialized devices are expensive, however, and sites commonly use improvised devices utilizing 100% oxygen which can cause blindness. To address this, PATH and a multidisciplinary team developed a very low-cost bCPAP device including fixed-ratio oxygen blenders. OBJECTIVE: We assessed feasibility of use of the device on neonatal patients as well as the usability and acceptability of the device by healthcare workers. This study did not evaluate device effectiveness. METHODS: The study took place in a Ugandan level two unit. Neonates with respiratory failure were treated with the bCPAP device. Prospective data were collected through observation as well as likert-style scales and interviews with healthcare workers. Data were analyzed using frequencies, means and standard deviation and interviews via a descriptive coding method. Retrospectively registered via ClinicalTrials.gov number NCT05462509. RESULTS: Fourteen neonates were treated with the bCPAP device in October-December 2021. Patients were born onsite (57%), with median weight of 1.3 kg (IQR 1-1.8). Median treatment length was 2.5 days (IQR 2-6). bCPAP was stopped due to: improvement (83%) and death (17%). All patients experienced episodes of saturations >95%. Median time for device set up: 15 minutes (IQR 12-18) and changing the blender: 15 seconds (IQR 12-27). After initial device use, 9 out of 9 nurses report the set-up as well as blender use was "easy" and their overall satisfaction with the device was 8.5/10 (IQR 6.5-9.5). Interview themes included the appreciation for the ability to administer less than 100% oxygen, desire to continue use of the device, and a desire for additional blenders. CONCLUSIONS: In facilities otherwise using 100% oxygen, use of the bCPAP device including oxygen blenders is feasible and acceptable to healthcare workers. TRIAL REGISTRATION: ClinicalTrials.gov, Identifier NCT05462509.

Individual interactions in a multi-country implementation-focused quality of care network for maternal, newborn and child health: A social network analysis.

The Network for Improving Quality of Care for Maternal, Newborn and Child Health (QCN) was established to build a cross-country platform for joint-learning around quality improvement implementation approaches to reduce mortality. This paper describes and explores the structure of the QCN in four countries and at global level. Using Social Network Analysis (SNA), this cross-sectional study maps the QCN networks at global level and in four countries (Bangladesh, Ethiopia, Malawi and Uganda) and assesses the interactions among actors involved. A pre-tested closed-ended structured questionnaire was completed by 303 key actors in early 2022 following purposeful and snowballing sampling. Data were entered into an online survey tool, and exported into Microsoft Excel for data management and analysis. This study received ethical approval as part of a broader evaluation. The SNA identified 566 actors across the four countries and at global level. Bangladesh, Malawi and Uganda had multiple-hub networks signifying multiple clusters of actors reflecting facility or district networks, whereas the network in Ethiopia and at global level had more centralized networks. There were some common features across the country networks, such as low overall density of the network, engagement of actors at all levels of the system, membership of related committees identified as the primary role of actors, and interactions spanning all types (learning, action and information sharing). The most connected actors were facility level actors in all countries except Ethiopia, which had mostly national level actors. The results reveal the uniqueness and complexity of each network assessed in the evaluation. They also affirm the broader qualitative evaluation assessing the nature of these networks, including composition and leadership. Gaps in communication between members of the network and limited interactions of actors between countries and with global level actors signal opportunities to strengthen QCN.

Framing Contraceptive Use Motivations Among Adolescents and Young Adults Living in Informal Settlements in Kira Municipality, Wakiso District, Uganda.

Introduction: The use of contraceptives among adolescents and young adults is one of the most cost-effective strategies to address many sexual and reproductive health (SRH) challenges, including unintended pregnancies, early marriages, and sexually transmitted infections. Despite a high burden of SRH challenges, uptake and unmet needs of modern contraceptives remain low in Uganda, especially among adolescents and young adults in informal settlement settings. This study aimed to explore the motivations of adolescents and young people to use modern contraceptives (or not). Methods: We analysed qualitative data from eight focus group discussions with 88 adolescents and young people aged 18-24 years residing in informal settlements of urban communities in Kira Municipality of Wakiso district, Uganda. Results: Motivations for use (or not) of modern contraceptives were framed by two interrelated constructs, sources of information on contraception and the unacceptable use of contraceptives among adolescents widespread in the community. These two, in turn, formed the scope of knowledge upon which adolescents and young people based their decision on whether or not to access and use modern contraceptives. Conclusion: To be more effective, sexual and reproductive health programs and interventions that aim to motivate the use of modern contraceptives among adolescents and young people in informal settings should be more comprehensive and focused on alleviating individual, health systems, social, religious factors that reinforce negative health-seeking behaviours towards contraceptive use. In addition, there is a need to support adolescents and young people with socio-economic empowering strategies that equip them with sufficient resources to choose contraceptives of their choice.