Usability and Acceptability of Electronic Immunization Registry Data Entry Workflows From the Health Care Worker Perspective in Siaya, Kenya (Part 3): Pre-Post Study.

BACKGROUND: Digital health tools such as electronic immunization registries (EIRs) have the potential to improve patient care and alleviate the challenges that arise from the use of paper-based clinic records for reporting. To address some of these challenges, the Kenya Ministry of Health and the International Training and Education Center for Health Kenya implemented an EIR system in 161 immunizing clinics in Siaya County between 2018 and 2019. The successful implementation of digital health tools depends on many factors, one of which is alignment between the technology and the context in which it is used. One important aspect of that implementation context is the perceptions of the health care workers (HCWs) using the EIR. OBJECTIVE: This study aimed to evaluate HCWs' perceptions of the usability and acceptability of multiple clinic workflows using the new EIR. METHODS: We performed a mixed methods pre-post study using semistructured interviews with HCWs at 6 facilities in Siaya County, Kenya. We interviewed HCWs at each facility 4 times: at baseline and once after the implementation of 3 different workflow modifications (n=24 interviews). The baseline state was dual data entry with paper records and the EIR. We then implemented 3 workflow modifications for 1 full day each: fully paperless data entry, preparation of an appointment diary before patient visits for the day, and a combination of the 2 workflows. We compared ratings and themes across interviews after each of the 4 workflows to understand the changes in the usability and acceptability of the EIR. RESULTS: HCWs considered the EIR clinic workflows to be usable and acceptable. Of the modified workflows, HCWs perceived the fully paperless workflow most favorably. In all workflows, HCWs' perceived benefits included ease of clinical decision-making using the EIR, reduced mental burden of data entry when using the EIR, and ease of identification of errors. Perceived barriers to the workflow included contextual challenges such as staffing shortages and lack of network connectivity, EIR platform challenges such as errors in saving records and missing fields, and workflow challenges such as the dual data entry burden of using paper and digital tools simultaneously. CONCLUSIONS: Fully paperless EIR implementation shows great promise from a workflow acceptability standpoint, contingent upon the presence of supporting contextual clinic factors and the resolution of system performance and design challenges. Rather than trying to identify a singular best workflow, future efforts should provide adequate flexibility for HCWs to implement the new system in their unique clinic context. Future EIR implementation stands to benefit from continued monitoring of EIR adoption acceptability during implementation, both for Siaya's program and for other efforts around the globe, as digital health interventions become more widely used.

Integration of a Digital Health Intervention Into Immunization Clinic Workflows in Kenya: Qualitative, Realist Evaluation of Technology Usability.

BACKGROUND: In an effort to increase vaccination coverage in low-resource settings, digital tools have been introduced to better track immunization records, improve data management practices, and provide improved access to vaccination coverage data for decision-making. Despite the potential of these electronic systems to improve the provision of health services, few digital health interventions have been institutionalized at scale in low- and middle-income countries. OBJECTIVE: In this paper, we aimed to describe how health care workers in Kenya had integrated an electronic immunization registry into their immunization clinic workflows and to use these findings to inform the development of a refined program theory on the registry's usability. METHODS: Informed by realist methodology, we developed a program theory to explain usability of the electronic immunization registry. We designed a qualitative study based on our theory to describe the barriers and facilitators influencing data entry and use. Qualitative data were collected through semistructured interviews with users and workflow observations of immunization clinic sessions. Our findings were summarized by context-mechanism-outcome relationships formed after analyzing our key themes across interviews and workflow observations. Using these relationships, we were able to identify common rules for future implementers. RESULTS: Across the 12 facilities included in our study, 19 health care workers were interviewed, and 58 workflow sessions were observed. The common rules developed from our qualitative findings are as follows: rule 1-ensure that the users complete training to build familiarity with the system, understand the value of the system and data, and know where to find support; rule 2-confirm that the system captures all data needed for users to provide routine health care services and is easy to navigate; rule 3-identify work-arounds for poor network, system performance, and too few staff or resources; and rule 4-make users aware of expected changes to their workflow, and how these changes might differ over time and by facility size or number of patients. Upon study completion, we revised the program theory to reflect the importance of the goals and workflows of electronic immunization registries aligning with reality. CONCLUSIONS: We created a deeper understanding of the underlying mechanisms for usability of the registry. We found that the electronic immunization registry had high acceptability among users; however, there were numerous barriers to using the system, even under ideal conditions, causing a misalignment between the system and the reality of the users' workflows and their environment. Human-centered design and human-factors methods can assist during pilot stages to better align systems with users' needs and again after scale-up to ensure that interventions are suitable for all user settings.

Time Utilization Among Immunization Clinics Using an Electronic Immunization Registry (Part 2): Time and Motion Study of Modified User Workflows.

BACKGROUND: Digital health interventions have the potential to improve the provision of health care services through digitized data collection and management. Low- and middle-income countries are beginning to introduce electronic immunization registries (EIRs) into their routine immunization services to better capture and store childhood vaccination information. Especially in Africa, where 25% of children remain unimmunized or underimmunized, technologies that can help identify children due for a vaccination are particularly important for improving vaccination coverage. However, an improved understanding of the effectiveness of these systems is needed to develop and deploy sustainable EIRs in low- and middle-income countries. OBJECTIVE: We conducted an interventional pretest-posttest design study that sought to improve time efficiency through workflow modifications in Kenyan immunization clinics. Our aim was to describe how activity times differed after introducing workflow modifications that could potentially reduce the time needed to perform routine data entry activities. Our intent was to demonstrate changes in efficiency when moving from the existing dual-data entry workflow to a future paperless workflow by health facility size and experience length of health care workers (HCWs). METHODS: We tested how 3 workflow modifications would affect time utilization among HCWs using the EIR at the point of care compared with baseline immunization clinic workflows. Our outcome of interest was the time taken to complete individual activities and a patient's total time in the clinic where we compared the time spent during the baseline workflow with that during the modified workflow. We used a standardized tool to observe and document the immunization clinic workflow. To estimate differences in time utilization, we used bivariate analyses and fit multivariate linear mixed-effects models. RESULTS: Our study found that for HCWs using an EIR, the introduction of modified workflows decreased the amount of time needed to provide services to children seen in the immunization clinic. With a baseline mean time of 10 minutes spent per child, this decreased by about 3 minutes when the preparation modification was introduced and almost 5 minutes for the paperless and combined modifications. Results pertaining to the EIR's performance and ability to connect to the internet were particularly insightful about potential causes of delays. CONCLUSIONS: We were able to conduct a concise clinical simulation exercise by introducing modified workflows and estimating their impact on time utilization in immunization clinics using an EIR. We found that the paperless workflow provided the largest time savings when delivering services, although this was threatened by poor EIR performance and internet connectivity. This study demonstrated that not only should digital health interventions be built and adapted for particular use cases but existing user workflows also need to adapt to new technology.

Infection Prevention and Control Initiatives to Prevent Healthcare-Associated Transmission of SARS-CoV-2, East Africa.

The coronavirus disease pandemic has highlighted the need to establish and maintain strong infection prevention and control (IPC) practices, not only to prevent healthcare-associated transmission of SARS-CoV-2 to healthcare workers and patients but also to prevent disruptions of essential healthcare services. In East Africa, where basic IPC capacity in healthcare facilities is limited, the US Centers for Disease Control and Prevention (CDC) supported rapid IPC capacity building in healthcare facilities in 4 target countries: Tanzania, Ethiopia, Kenya, and Uganda. CDC supported IPC capacity-building initiatives at the healthcare facility and national levels according to each country's specific needs, priorities, available resources, and existing IPC capacity and systems. In addition, CDC established a multicountry learning network to strengthen hospital level IPC, with an emphasis on peer-to-peer learning. We present an overview of the key strategies used to strengthen IPC in these countries and lessons learned from implementation.

Adopting World Health Organization Multimodal Infection Prevention and Control Strategies to Respond to COVID-19, Kenya.

The World Health Organization advocates a multimodal approach to improving infection prevention and control (IPC) measures, which Kenya adopted in response to the COVID-19 pandemic. The Kenya Ministry of Health formed a national IPC committee for policy and technical leadership, coordination, communication, and training. During March-November 2020, a total of 69,892 of 121,500 (57.5%) healthcare workers were trained on IPC. Facility readiness assessments were conducted in 777 health facilities using a standard tool assessing 16 domains. A mean score was calculated for each domain across all facilities. Only 3 domains met the minimum threshold of 80%. The Ministry of Health maintained a national list of all laboratory-confirmed SARS-CoV-2 infections. By December 2020, a total of 3,039 healthcare workers were confirmed to be SARS-CoV-2-positive, an infection rate (56/100,000 workers) 12 times higher than in the general population. Facility assessments and healthcare workers' infection data provided information to guide IPC improvements.

Improving hand hygiene practices in two regional hospitals in Kenya using a continuous quality improvement (CQI) approach.

BACKGROUND: Hand hygiene (HH) is central in prevention of health care-associated infections. In low resource settings, models to improve HH compliance are needed. We implemented a continuous quality improvement (CQI) program targeting HH in two hospitals in Kenya. OBJECTIVE: To determine the impact of the HH CQI program and identify factors associated with HH compliance between 2018 and 2019. METHODS: A CQI project targeting the improvement of hand hygiene was implemented, including training and mentorship. Data were collected monthly between April 2018 and December 2019 in Thika and Kitale Hospitals. Healthcare workers trained on Infection Prevention and Control (IPC) observed and recorded HH opportunities and subsequent compliance among staff, including nurses, clinicians, and auxiliary staff, using the World Health Organization's "My Five Moments for Hand Hygiene" tool. Covariates were explored using mixed-effects logistic regression with random department-level intercepts. RESULTS: Hand hygiene compliance improved from 27% at baseline to 44% after 21 months. Indication/moment for HH was significantly associated with compliance. Adjusting for site, professional category and department, compliance was higher after a moment of body fluid exposure (aOR 1.43, 95% CI 1.17-1.74, p value < 0.001) and lower before an aseptic procedure (aOR 0.12, 95% CI 0.08-0.17, p value < 0.001) compared to after patient contact. Wearing of gloves often replaced proper HH in surgical departments, which although not significant, had lower compliance compared to departments for internal medicine (aOR 0.93, 95% CI 0.85-1.02). Adjusted HH compliance from all quarters improved from baseline, but comparing each quarter to the previous quarter, the improvement fluctuated over time. CONCLUSION: Training and mentorship on the importance of HH for all moments is needed to improve overall HH compliance. CQI with regular monitoring and feedback of HH performance can be an effective approach in improving HH compliance in public hospitals in Kenya.

Use of technology for public health surveillance reporting: opportunities, challenges and lessons learnt from Kenya.

BACKGROUND: Effective public health surveillance systems are crucial for early detection and response to outbreaks. In 2016, Kenya transitioned its surveillance system from a standalone web-based surveillance system to the more sustainable and integrated District Health Information System 2 (DHIS2). As part of Global Health Security Agenda (GHSA) initiatives in Kenya, training on use of the new system was conducted among surveillance officers. We evaluated the surveillance indicators during the transition period in order to assess the impact of this training on surveillance metrics and identify challenges affecting reporting rates. METHODS: From February to May 2017, we analysed surveillance data for 13 intervention and 13 comparison counties. An intervention county was defined as one that had received refresher training on DHIS2 while a comparison county was one that had not received training. We evaluated the impact of the training by analysing completeness and timeliness of reporting 15 weeks before and 12 weeks after the training. A chi-square test of independence was used to compare the reporting rates between the two groups. A structured questionnaire was administered to the training participants to assess the challenges affecting surveillance reporting. RESULTS: The average completeness of reporting for the intervention counties increased from 45 to 62%, i.e. by 17 percentage points (95% CI 16.14-17.86) compared to an increase from 49 to 52% for the comparison group, i.e. by 3 percentage points (95% CI 2.23-3.77). The timeliness of reporting increased from 30 to 51%, i.e. by 21 percentage points (95% CI 20.16-21.84) for the intervention group, compared to an increase from 31 to 38% for the comparison group, i.e.by 7 percentage points (95% CI 6.27-7.73). Major challenges for the low reporting rates included lack of budget support from government, lack of airtime for reporting, health workers strike, health facilities not sending surveillance data, use of wrong denominator to calculate reporting rates and surveillance officers having other competing tasks. CONCLUSIONS: Training plays an important role in improving public health surveillance reporting. However, to improve surveillance reporting rates to the desired national targets, other challenges affecting reporting must be identified and addressed accordingly.