Measuring implementation outcomes in the context of scaling up possible serious bacterial infection guidelines: Implications for measurement and programs.

BACKGROUND: Reducing the burden of neonatal sepsis requires timely identification and initiation of suitable antibiotic treatment in primary health care (PHC) settings. Countries are encouraged to adopt simplified antibiotic regimens at the PHC level for treating sick young infants (SYI) with signs of possible serious bacterial infection (PSBI). As countries implement PSBI guidelines, more lessons on effective implementation strategies and outcome measurements are needed. We document pragmatic approaches used to design, measure and report implementation strategies and outcomes while adopting PSBI guidelines in Kenya. METHODS: We designed implementation research using longitudinal mixed methods embedded in a continuous regular systematic learning and adoption of evidence in the PHC context. We synthesized formative data to co-create with stakeholders, implementation strategies to incorporate PSBI guidelines into routine service delivery for SYIs. This was followed by quarterly monitoring for learning and feedback on the effect of implementation strategies, documented lessons learned and tracked implementation outcomes. We collected endline data to measure the overall effect on service level outcomes. RESULTS: Our findings show that characterizing implementation strategies and linking them with implementation outcomes, helps illustrate the pathway between the implementation process and outcomes. Although we have demonstrated that it is feasible to implement PSBI in PHC, effective investment in continuous capacity strengthening of providers through blended approaches, efficient use of available human resources, and improving the efficiency of service areas for managing SYIs optimizes timely identification and management of SYI. Sustained provision of commodities for management of SYI facilitates increased uptake of services. Strengthening facility-community linkages supports adherence to scheduled visits. Enhancing the caregiver's preparedness during postnatal contacts in the community or facility will facilitate the effective completion of treatment. CONCLUSION: Careful design, and definition of terms related to the measurement of implementation outcomes and strategies enable ease of interpretation of findings. Using the taxonomy of implementation outcomes help frame the measurement process and provides empirical evidence in a structured way to demonstrate causal relationships between implementation strategies and outcomes. Using this approach, we have illustrated that the implementation of simplified antibiotic regimens for treating SYIs with PSBI in PHC settings is feasible in Kenya.

Institutionalizing the Management of Sick Young Infants: Kenya's Experience in Revising National Guidelines on Integrated Management of Newborn and Childhood Illnesses.

INTRODUCTION: In 2015, the World Health Organization (WHO) developed guidelines for the management of sick young infants (SYIs) with possible serious bacterial infection (PSBI) where referral is not feasible. The Ponya Mtoto project was designed as an implementation research project to demonstrate how to adopt the WHO PSBI guidelines in the Kenyan context. PONYA MTOTO PROJECT DESCRIPTION: Between October 2017 and June 2021, Ponya Mtoto was implemented in 4 Kenyan counties with higher infant and newborn mortality rates than the national mean. A total of 48 health facilities stratified by level of services were selected as study sites. IMPLEMENTATION APPROACH: The following activities were done to institutionalize the management of SYIs with PSBI where referral is not feasible in Kenya's health system: (1) participating in a cocreation workshop and development of a theory of change; (2) revising the national integrated management of newborn and childhood illnesses guidelines to incorporate the management of PSBI where referral is not feasible; (3) improving availability of essential commodities; (4) strengthening provider confidence in the management of SYIs; (5) strengthening awareness about PSBI services for SYIs at the community level; and (6) harmonizing the national integrated management of newborn and childhood illnesses guidelines to address discrepancies in the content on the management of PSBI. In addition, the project focused on strengthening quality of care for SYIs and using implementation research to track progress in achieving project targets and outcomes. CONCLUSION: Using an implementation research approach to introduce new WHO guidelines on PSBI where referral is not feasible into Kenya's health care service was critical to fostering engagement of a diverse range of stakeholders, monitoring provider skills and confidence-building, strengthening provision of key commodities for managing SYIs with PSBI, and sustaining community-facility linkages.

Devolved health system capacity in the provision of care for sick newborns and young infants in four counties serving vulnerable populations in Kenya.

Possible severe bacterial infections (PSBI) is one of the three leading causes of newborn and young infant mortality globally that can be prevented by timely diagnosis and treatment using suitable antibiotics. High impact interventions such as use of out-patient injectable gentamicin and dispersible Amoxicillin with community-based follow up have been shown to reduce mortality in clinical trials. The objective of this study was to assess the health systems' preparedness and organizational gaps that may impact execution in providing care for newborns and sick young infants. This formative research study was embedded within a three-year implementation research project in 4 Counties in Kenya. The indicators were based on facility audits for existing capacity to care for newborns and young infants as well as County organizational capacity assessment. The organizational capacity assessment domains were derived from the World Health Organization's Health Systems Building blocks for health service delivery. The scores were computed by adding average scores in each domain and calculated against the total possible scores to generate a percentage outcome. Statistical analyses were descriptive with adjustment for clustering of data. Overall, the Counties have inadequate organizational capacity for management of sick young infants with Organizational Capacity Index scores of between 61-64%. Among the domains, the highest score was in Health Management Information System and service delivery. The lowest scores were in monitoring and evaluation (M&E). Counties scored relatively low scores in human resources for health and health products and commodities with one scoring poorly for both areas while the rest scored average performance. The four counties revealed varying levels of organizational capacity deficit to effectively manage sick young infants. The key underlying issues for the below par performance include poor coordination, low funding, inadequate supportive supervision, and M&E to enable data utilisation for quality improvement. It was evident that newborn and young infant health services suffer from inadequate infrastructure, equipment, staffing, and coordination. As Kenya, continuously rolls out the guidelines on management of sick young infants, there is need to focus attention to these challenges to enhance sustainable adoption and reduction of young infant morbidity and mortality.

Systems Analysis and Improvement Approach to optimize the pediatric and adolescent HIV Cascade (SAIA-PEDS): a pilot study.

INTRODUCTION: Children and adolescents lag behind adults in achieving UNAIDS 95-95-95 targets for HIV testing, treatment, and viral suppression. The Systems Analysis and Improvement Approach (SAIA) is a multi-component implementation strategy previously shown to improve the HIV care cascade for pregnant women and infants. SAIA merits adaptation and testing to reduce gaps in the pediatric and adolescent HIV cascade. METHODS: We adapted the SAIA strategy components to be applicable to the pediatric and adolescent HIV care cascade (SAIA-PEDS) in Nairobi and western Kenya. We tested whether this SAIA-PEDS strategy improved HIV testing, linkage to care, antiretroviral treatment (ART), viral load (VL) testing, and viral load suppression for children and adolescents ages 0-24 years at 5 facilities. We conducted a pre-post analysis with 6 months pre- and 6 months post-implementation strategy (coupled with an interrupted time series sensitivity analysis) using abstracted routine program data to determine changes attributable to SAIA-PEDS. RESULTS: Baseline levels of HIV testing and care cascade indicators were heterogeneous between facilities. Per facility, the monthly average number of children/adolescents attending outpatient and inpatient services eligible for HIV testing was 842; on average, 253 received HIV testing services, 6 tested positive, 6 were linked to care, and 5 initiated ART. Among those on treatment at the facility, an average of 15 had a VL sample taken and 13 had suppressed VL results returned. Following the SAIA-PEDS training and mentorship, there was no substantial or significant change in the ratio of HIV testing (RR: 0.803 [95% CI: 0.420, 1.532]) and linkage to care (RR: 0.831 [95% CI: 0.546, 1.266]). The ratio of ART initiation increased substantially and trended towards significance (RR: 1.412 [95% CI: 0.999, 1.996]). There were significant and substantial improvements in the ratio of VL tests ordered (RR: 1.939 [95% CI: 1.230, 3.055]) but no substantial or significant change in the ratio of VL results suppressed (RR: 0.851 [95% CI: 0.554, 1.306]). CONCLUSIONS: The piloted SAIA-PEDS implementation strategy was associated with increases in health system performance for indicators later in the HIV care cascade, but not for HIV testing and treatment indicators. This strategy merits further rigorous testing for effectiveness and sustainment.

Providing "a beam of light to see the gaps": determinants of implementation of the Systems Analysis and Improvement Approach applied to the pediatric and adolescent HIV cascade in Kenya.

BACKGROUND: Children and adolescents living with HIV have poorer rates of HIV testing, treatment, and virologic suppression than adults. Strategies that use a systems approach to optimize these multiple, linked steps simultaneously are critical to close these gaps. METHODS: The Systems Analysis and Improvement Approach (SAIA) was adapted and piloted for the pediatric and adolescent HIV care and treatment cascade (SAIA-PEDS) at 6 facilities in Kenya. SAIA-PEDS includes three tools: continuous quality improvement (CQI), flow mapping, and pediatric cascade analysis (PedCAT). A predominately qualitative evaluation utilizing focus group discussions (N = 6) and in-depth interviews (N = 19) was conducted with healthcare workers after implementation to identify determinants of implementation. Data collection and analysis were grounded in the Consolidated Framework for Implementation Research (CFIR). RESULTS: Overall, the adapted SAIA-PEDS strategy was acceptable, and the three tools complemented one another and provided a relative advantage over existing processes. The flow mapping and CQI tools were compatible with existing workflows and resonated with team priorities and goals while providing a structure for group problem solving that transcended a single department's focus. The PedCAT was overly complex, making it difficult to use. Leadership and hierarchy were complex determinants. All teams reported supportive leadership, with some describing in detail how their leadership was engaged and enthusiastic about the SAIA-PEDS process, by providing recognition, time, and resources. Hierarchy was similarly complex: in some facilities, leadership stifled rapid innovation by insisting on approving each change, while at other facilities, leadership had strong and supportive oversight of processes, checking on the progress frequently and empowering teams to test innovative ideas. CONCLUSION: CQI and flow mapping were core components of SAIA-PEDS, with high acceptability and consistent use, but the PedCAT was too complex. Leadership and hierarchy had a nuanced role in implementation. Future SAIA-PEDS testing should address PedCAT complexity and further explore the modifiability of leadership engagement to maximize implementation.

Family and provider perceptions of quality of care in the management of sick young infants in primary healthcare settings in four counties of Kenya.

BACKGROUND: Understanding the perceptions of quality of care given to sick young infants in primary healthcare settings is key for developing strategies for effective uptake and utilisation of possible severe bacterial infection guidelines. The purpose of this study is to assess families and providers' perceptions of care given to sick young infants at primary healthcare facilities in four diverse counties in Kenya. METHODS: A cross-sectional qualitative design involving 37 in-depth interviews and 39 focus group discussions with very young (15-18 years), young (19-24 years) and older (25-45 years) caregivers of young infants aged 0-59 days; and key informant interviews with community-based and facility-based front-line health providers (14) in primary healthcare facilities. Qualitative data were captured using audio tapes and field notes, transcribed, translated and exported into QSR NVivo V.12 for analysis. A thematic framework approach was adopted to classify and analyse data. RESULTS: Perceived care given to sick young infants was described around six domains of the WHO framework for the quality of maternal and newborn healthcare: evidence-based practices for routine and emergency care; functional referral systems; effective communication; respect and preservation of dignity; availability of competent, motivated human resources; and availability of physical resources. Views of caregivers and providers regarding sick young infant care in primary healthcare settings were similar across the four sites. Main hindrance to sick young infant care includes stockout of essential drugs, limited infrastructure, lack of functional referral system, inadequate providers which led to delays in receiving treatment, inadequate provider skills and poor provider attitudes. Despite these challenges, motivation and teamwork of health providers were key tenets in care provision. CONCLUSION: The findings underscore the need to prioritise improving quality of sick young infant services at primary healthcare settings by building capacity of providers through training, ensuring continuous supply of essential medicines and equipment and improving infrastructure including referral.

Men's and women's knowledge of danger signs relevant to postnatal and neonatal care-seeking: A cross sectional study from Bungoma County, Kenya.

BACKGROUND: Neonatal and maternal mortality rates remain high in Kenya. Knowledge of neonatal danger signs may reduce delay in deciding to seek care. Evidence is emerging on the influential role of male partners in improving maternal and newborn health. This study analysed the factors that determine men's and women's knowledge and practices in postnatal and neonatal care-seeking, in order to inform design of future interventions. METHODS: A quantitative, cross-sectional study was undertaken in Bungoma County, Kenya. Women who had recently given birth (n = 348) and men whose wives had recently given birth (n = 82) completed questionnaires on knowledge and care-seeking practices relating to the postnatal period. Univariate and multivariate logistic regression analyses were performed to investigate associations with key maternal and newborn health outcomes. RESULTS: 51.2% of women and 50.0% of men knew at least one neonatal danger sign, however women knew more individual danger signs than men. In the univariate model, women's knowledge of a least one neonatal danger sign was associated with attending antenatal care ≥4 times (OR 4.46, 95%CI 2.73-7.29, p<0.001), facility birth (OR 3.26, 95%CI 1.89-5.72, p<0.001), and having a male partner accompany them to antenatal care (OR 3.34, 95%CI 1.35-8.27, p = 0.009). Higher monthly household income (≥10,000KSh, approximately US$100) was associated with facility delivery (AOR 11.99, 95%CI 1.59-90.40, p = 0.009). CONCLUSION: Knowledge of neonatal danger signs was low, however there was an association between knowledge of danger signs and increased healthcare service use, including male partner involvement in antenatal care. Future interventions should consider the extra costs of facility delivery and the barriers to men participating in antenatal and postnatal care.

Exploring perspectives on antimicrobial stewardship: a qualitative study of health managers in Kenya.

BACKGROUND: Antimicrobial resistance is a significant public health concern with the establishment of antimicrobial stewardship in hospitals being increasingly obligatory. Perspectives and insights of health managers on antimicrobial stewardship (AMS), complementary health services and building blocks are imperative towards implementation of robust AMS programs. This study aimed to understand perspectives of hospital managers on AMS and identify areas of management engagement while addressing potential blockades to change. METHODS: A cross-sectional, qualitative, multicenter study was conducted in three hospitals in Kenya. Key-informant interviews on perspectives on AMS were administered to hospital managers. Qualitative data was captured using audio tapes and field notes, transcribed and managed using NVivo 12 software. An iterative process was used to develop the thematic framework and updated in two rounds of iteration analysis. Analysis charts for each emergent theme were developed and categorized across all participants. RESULTS: Perspectives on AMS are described in five thematic categories; Importance of antimicrobial stewardship and the role of medicines and therapeutics committee, availability of antimicrobial formulary and usage surveillance systems, laboratory competency and recommendations for infection prevention and management, educational resources and communications channels available, building blocks and low-lying fruits for Antimicrobial Stewardship Committees. The role of stewardship collaboration in diagnosis and antimicrobial prescription was alluded to with managers indicating a growing rise in occurrence of antimicrobial resistance. There lacked contextualized, hospital specific antimicrobial formulary and adequate laboratory competency. Staff training and communication channels were available in varying capacity across the three hospitals. Building blocks identified include medicines and therapeutics committee, education, and training platforms (Continuous Medical Education and Continuous Professional Development activities) and hospital leadership commitment. CONCLUSIONS: The practice of antimicrobial stewardship is not implemented and well developed as demonstrated by lack of core AMS complementary health services. However, the health managers are aware of the fundamental importance of antimicrobial stewardship programs and the vast benefits of implementation and institutionalization of AMS to hospitals and their clients. The findings underpin the importance of understanding and incorporating perspectives of health managers on existing contextual mechanisms that can be leveraged on to establish robust AMS programs in the fight against antimicrobial resistance.

Combating antibiotic resistance using guidelines and enhanced stewardship in Kenya: a protocol for an implementation science approach.

INTRODUCTION: Antimicrobial resistance (AMR) is a growing problem globally especially in Sub-Saharan Africa including Kenya. Without any intervention, lower/middle-income countries (LMICs) will be most affected due to already higher AMR levels compared with higher income countries and due to the far higher burden of diseases in the LMICs. Studies have consistently shown that inappropriate use of antimicrobials is the major driver of AMR. To address this challenge, hospitals are now implementing antibiotic stewardship programmes (ASPs), which have been shown to achieve reduced antibiotic usage, to decrease the prevalence of resistance and lead to significant economic benefits. However, the implementation of the guideline is highly dependent on the settings in which they are rolled out. This study, employing an implementation science approach, aims to address the knowledge gap in this area and provide critical data as well as practical experiences when using antibiotic guidelines and stewardship programmes in the public health sector. This will provide evidence of ASP performance and potentially contribute to the county, national and regional policies on antibiotics use. METHODS AND ANALYSIS: The study will be conducted in three geographically diverse regions, each represented by two hospitals. A baseline study on antibiotic usage, resistance and de-escalation, duration of hospital stay, rates of readmission and costs will be carried out in the preimplementation phase. The intervention, that is, the use of antibiotic guidelines and ASPs will be instituted for 18 months using a stepwise implementation strategy that will facilitate learning and continuous improvement of stewardship activities and updating of guidelines to reflect the evolving antibiotic needs. ETHICS AND DISSEMINATION: Approvals to carry out the study have been obtained from the National Commission for Science, Technology and Innovation and the Mount Kenya University Ethics Review Committee. The approvals from the two institutions were used to obtain permission to conduct the study at each of the participating hospitals. Study findings will be presented to policy stakeholders and published in peer-reviewed scientific journals. It is anticipated that the findings will inform the appropriate antibiotic use guidelines within our local context.