Development and validation of a prediction tool to support engagement in HIV care among young people ages 10-24 years in Kenya.

INTRODUCTION: Loss to follow-up (LTFU) among adolescents and young adults living with HIV (AYALWH) is a barrier to optimal health and HIV services. We developed and validated a clinical prediction tool to identify AYALWH at risk of LTFU. METHODS: We used electronic medical records (EMR) of AYALWH ages 10 to 24 in HIV care at 6 facilities in Kenya and surveys from a subset of participants. Early LTFU was defined as >30 days late for a scheduled visit in the last 6 months, which accounts for clients with multi-month refills. We developed a tool combining surveys with EMR ('survey-plus-EMR tool'), and an 'EMR-alone' tool to predict high, medium, and low risk of LTFU. The survey-plus-EMR tool included candidate sociodemographics, partnership status, mental health, peer support, any unmet clinic needs, WHO stage, and time in care variables for tool development, while the EMR-alone included clinical and time in care variables only. Tools were developed in a 50% random sample of the data and internally validated using 10-fold cross-validation of the full sample. Tool performance was evaluated using Hazard Ratios (HR), 95% Confidence Intervals (CI), and area under the curve (AUC) ≥ 0.7 for good performance and ≥0.60 for modest performance. RESULTS: Data from 865 AYALWH were included in the survey-plus-EMR tool and early LTFU was (19.2%, 166/865). The survey-plus-EMR tool ranged from 0 to 4, including PHQ-9 ≥5, lack of peer support group attendance, and any unmet clinical need. High (3 or 4) and medium (2) prediction scores were associated with greater risk of LTFU (high, 29.0%, HR 2.16, 95%CI: 1.25-3.73; medium, 21.4%, HR 1.52, 95%CI: 0.93-2.49, global p-value = 0.02) in the validation dataset. The 10-fold cross validation AUC was 0.66 (95%CI: 0.63-0.72). Data from 2,696 AYALWH were included in the EMR-alone tool and early LTFU was 28.6% (770/2,696). In the validation dataset, high (score = 2, LTFU = 38.5%, HR 2.40, 95%CI: 1.17-4.96) and medium scores (1, 29.6%, HR 1.65, 95%CI: 1.00-2.72) predicted significantly higher LTFU than low-risk scores (0, 22.0%, global p-value = 0.03). Ten-fold cross-validation AUC was 0.61 (95%CI: 0.59-0.64). CONCLUSIONS: Clinical prediction of LTFU was modest using the surveys-plus-EMR tool and the EMR-alone tool, suggesting limited use in routine care. However, findings may inform future prediction tools and intervention targets to reduce LTFU among AYALWH.

Data-informed stepped care to improve youth engagement in HIV care in Kenya: a protocol for a cluster randomised trial of a health service intervention.

INTRODUCTION: Adolescents and youth living with HIV (AYLHIV) have lower retention in care, adherence to treatment, and viral suppression compared with adults. Stepped care is a process by which clients are assigned to increasingly intensive services or 'steps' according to level of need. Differentiated care, in which stable clients access less frequent services, can be combined with stepped care to align needs and preferences of youth to promote optimal engagement in care. METHODS AND ANALYSIS: This hybrid type I effectiveness implementation cluster randomised trial aims to evaluate a data-informed stepped care (DiSC) intervention for AYLHIV. AYLHIV ages 10-24 receiving care at 24 HIV treatment facilities in Kisumu, Homabay and Migori counties in Kenya will be enrolled. Twelve facilities will be randomised to the DiSC intervention, and 12 will provide standard care. A clinical assignment tool developed by the study team will be used at intervention sites to assign AYLHIV to one of four steps based on risk for loss to follow-up: differentiated care, standard care, counselling services or intensive support services. The primary clinical outcome is retention in care, specifically missed visits (failure to return within 30 days for any visit) and 12-month loss to follow-up. Implementation outcomes are based on the Reach, Effectiveness, Adoption, Implementation and Maintenance framework. Proportions of missed visits will be compared using mixed effect models clustered by facility and participant. ETHICS AND DISSEMINATION: This study has been approved by the University of Washington Institutional Review Board (STUDY00011096), Maseno University Ethical Review Committee (MUERC/00917/20) and the Kenya National Commission for Science, Technology and Innovation (444824). AYLHIV provide written informed consent when legally permitted, or assent with caregiver permission for minors. Study staff will work with a Community Advisory Board, including youth members, to disseminate results via discussions, presentations, journal publications and local or international conferences. TRIAL REGISTRATION NUMBER: NCT05007717.

Contrasting Comprehension of HIV Research by Adolescents, Young Adults, and Caregivers in Western Kenya: A Cross-sectional Analysis.

ABSTRACT: Adolescent participation in research is critical to inform interventions that improve outcomes for this group. Adolescents and young adults living with HIV often present to care without caregivers, yet caregiver permission is typically required for those younger than 18 years. We evaluated whether understanding of key consent information differed between adolescents ( n = 1,393) and caregiver adults ( n = 169). Compared with caregivers, adolescents aged 10-14 years showed significantly lower understanding, whereas understanding for older adults living with HIV did not differ significantly from caregivers. Risks were the least understood consent information for all age groups. Our findings suggest that for low-risk research, waiving caregiver permission requirements will not compromise the ethical need to ensure understanding of research before enrollment and may allow adolescents greater access to potential research benefits.

The Psychosocial Effects of the COVID-19 Pandemic on Youth Living with HIV in Western Kenya.

The objective of this study was to assess psychosocial effects of COVID-19 among adolescents living with HIV (ALHIV) in Kenya and to assess the feasibility of conducting behavioral surveys by phone. We adapted our protocol to administer telephone rather than in-person follow-up surveys and included questions about COVID-19. The majority of participants (99%) reported having heard of COVID-19; 23% reported no longer being able to go outside, 17% reported that they could no longer go to their regular clinic for medical care, and 3% reported that they could no longer get medication refills. PHQ-9 screening identified 9% (n = 45) with mild depression symptoms, and 1% (n = 3) with moderate-to-severe depression symptoms. Young adults 20-24 years old had more mild to severe depressive symptoms than the younger age groups (p < 0.001). Offering remote peer-support or mental health care, continuing to offer differentiated care services, and considering financial support will support the health and well-being of ALHIV.

Provider knowledge and perceptions following an integrated simulation training on emergency obstetric and neonatal care and respectful maternity care: A mixed-methods study in Ghana.

INTRODUCTION: Little is known about the effect of integrating respectful maternity care into clinical training programs. We sought to examine the effectiveness of an integrated simulation training on emergency obstetric and neonatal care and respectful maternity care on providers' knowledge and self-efficacy, and to asess providers' perceptions of the integrated training. METHODS: The project was piloted in East Mamprusi district in Northern Ghana. Forty-three maternity providers were trained, with six participants trained as Simulation Facilitators. Data are from self-administered evaluation forms (with structured and open-ended questions) from all 43 providers and in-depth interviews with 17 providers. We conducted descriptive quantitative analysis and framework qualitative analysis. RESULTS: Provider knowledge increased from an average of 61.6% at pre-test to 74.5% at post-test. Self-efficacy also increased from an average of 5.8/10 at pretest to 9.2/10 at post-test. Process evaluation data showed that providers valued the training. Over 95% of participants agreed that the training was useful to them and that they will use the tools learned in the training in their practice. Overall, providers had positive perceptions of the training. They noted improvements in their knowledge and confidence to manage obstetric and neonatal emergencies, as well as in patient-provider communication and teamwork. Many listed respectful maternity care elements as what was most impactful to them from the training. CONCLUSIONS: Simulation and team-training on emergency obstetric and neonatal care, combined with respectful maternity care content, can enable health care providers to improve both their clinical and interpersonal knowledge and skills in a training setting that reflects their complex and stressful work environments. Our findings suggest this type of training is feasible, acceptable, and effective in limited-resource settings. Uptake of such trainings could drive efforts towards providing high quality safe, responsive, and respectful obstetric and neonatal care.

Simulation and team training embedded nurse mentoring programme and improvement in intrapartum and newborn care in a low-resource setting in Bihar, India.

BACKGROUND: Improvement of the quality of maternal and child health care remains a focus in India. Working with the Government of Bihar, CARE-India facilitated a comprehensive set of quality of care improvement initiatives. PRONTO's simulation and team-training was incorporated into the large-scale Apatkaleen Matritva evam Navjat Tatparta (AMANAT)nurse-mentoring program of the Government of Bihar supported by CARE-India to improve maternal and child health outcomes. Along-with the AMANAT program, the PRONTO components provided training on nontechnical and technical competencies for managing a variety of obstetric and neonatal conditions, as a team. This study assessed the effectiveness of nurse-mentoring including simulations on intrapartum and newborn care practices in 320 basic emergency obstetric and neonatal care (BEmONC) facilities. METHODS: Deliveries were observed to obtain specific information on evidence-based practice (EBP) indicators before and after the intervention. Intrapartum and newborn care composite scores - were calculated using those EBP indicators. A web-based routine monitoring system provided total training days, weeks and days/week of training and counts of simulation and teamwork-communication activities. Multilevel linear regression was used to examine the exposure-outcome associations. RESULTS: The final analysis included 668 normal spontaneous vaginal deliveries (NSVDs) from 289 public health facilities in Bihar. Facility-level intrapartum and newborn scores improved by 37 and 26-percentage points, respectively, from baseline to endline. Compared to the bottom one-third facilities that performed fewest NSVD simulations, the top one-third had 6 (95% confidence interval (CI) = 1-12) percentage points higher intrapartum score. Similar comparison using maternal complication simulations yielded 7 (95% CI = 1-12) percentage point higher scores. The highest newborn scores were observed in the middle one-third of facilities relative to the bottom one-third that did the fewest NSVD simulations (5, 95% CI: 1-10). CONCLUSIONS: Findings suggest significant overall improvement in intrapartum and newborn care practices after the AMANAT nurse-mentoring program in public sector BEmONC facilities. Simulation and team-training likely contributed towards the overall improvement, especially for intrapartum care. STUDY REGISTRATION: ClinicalTrials.gov number NCT02726230.

Logistical, cultural, and structural barriers to immediate neonatal care and neonatal resuscitation in Bihar, India.

BACKGROUND: In India, the neonatal mortality rate is nearly double the Sustainable Development Goal target with more than half of neonatal deaths occurring in only four states, one of which is Bihar. Evaluations of immediate neonatal care and neonatal resuscitation skills in Bihar have demonstrated a need for significant improvement. However, barriers to evidence based practices in clinical care remain incompletely characterized. METHODS: To better understand such barriers, semi-structured interviews were conducted with 18 nurses who participated as mentors in the AMANAT maternal and child health quality improvement project, implemented by CARE India and the Government of Bihar. Nurse-mentors worked in primary health centers throughout Bihar facilitating PRONTO International emergency obstetric and neonatal simulations for nurse-mentees in addition to providing direct supervision of clinical care. Interviews focused on mentors' perceptions of barriers to evidence based practices in immediate neonatal care and neonatal resuscitation faced by mentees employed at Bihar's rural primary health centers. Data was analyzed using the thematic content approach. RESULTS: Mentors identified numerous interacting logistical, cultural, and structural barriers to care. Logistical barriers included poor facility layout, supply issues, human resource shortages, and problems with the local referral system. Cultural barriers included norms such as male infant preference, traditional clinical practices, hierarchy in the labor room, and interpersonal relations amongst staff as well as with patients' relatives. Poverty was described as an overarching structural barrier. CONCLUSION: Interacting logistical, cultural and structural barriers affect all aspects of immediate neonatal care and resuscitation in Bihar. These barriers must be addressed in any intervention focused on improving providers' clinical skills. Strategic local partnerships are vital to addressing such barriers and to contextualizing skills-based trainings developed in Western contexts to achieve the desired impact of reducing neonatal mortality.

Barriers and facilitators to the provision of optimal obstetric and neonatal emergency care and to the implementation of simulation-enhanced mentorship in primary care facilities in Bihar, India: a qualitative study.

BACKGROUND: Globally, an estimated 275,000 maternal deaths, 2.7 million neonatal deaths, and 2.6 million third trimester stillbirths occurred in 2015. Major improvements could be achieved by providing effective care in low- and middle-income countries, where the majority of these deaths occur. Mentoring programs have become a popular modality to improve knowledge and skills among providers in low-resource settings. Thus, a detailed understanding of interrelated factors affecting care provision and mentorship is necessary both to improve the quality of care and to maximize the impact of mentoring programs. METHODS: In partnership with the Government of Bihar, CARE India and PRONTO International implemented simulation-enhanced mentoring in 320 primary health clinics (PHC) across the state of Bihar, India from 2015 to 2017, within the context of the AMANAT mobile nurse mentoring program. Between June and August 2016, we conducted semi-structured interviews with 20 AMANAT nurse mentors to explore barriers and facilitators to optimal care provision and to implementation of simulation-enhanced mentorship in PHCs in Bihar. Data were analyzed using the thematic content approach. RESULTS: Mentors identified numerous factors affecting care provision and mentorship, many of which were interdependent. Such barriers included human resource shortages, nurse-nurse hierarchy, distance between labor and training rooms, cultural norms, and low skill level and resistance to change among mentees. In contrast, physical resource shortages, doctor-nurse hierarchy, corruption, and violence against providers posed barriers to care provision alone. Facilitators included improved skills and confidence among providers, inclusion of doctors in training, increased training frequency, establishment of strong mentor-mentee relationships, administrative support, and nursing supervision and feedback. CONCLUSIONS: This study has identified many interrelated factors affecting care provision and mentorship in Bihar. The mentoring program was not designed to address several barriers, including resource shortages, facility infrastructure, corruption, and cultural norms. These require government support, community awareness, and other systemic changes. Programs may be adapted to address some barriers beyond knowledge and skill deficiencies, notably hierarchy, violence against providers, and certain cultural taboos. An in-depth understanding of barriers and facilitators is essential to enable the design of targeted interventions to improve maternal and neonatal survival in Bihar and related contexts.

Tracking and debriefing birth data at scale: A mobile phone application to improve obstetric and neonatal care in Bihar, India.

AIM: This analysis assessed changes over time in skill and knowledge related to the use of evidence-based practices associated with quality of maternal and neonatal care during a nurse midwife mentoring intervention at primary health clinics (PHCs) in Bihar, India. DESIGN: Nurse midwife mentors (NMMs) entered live birth observation data into a mobile App from 320 PHCs. METHODS: The NMMs completed prompted questions in the App after every live birth witnessed. The App consisted of questions around three main themes, "What went well?", "What needed improvement?" and "What can be done differently next time?". RESULTS: Observational data from 5,799 births was recorded by 120 NMMs in 320 PHCs. Knowledge and skill during normal spontaneous vaginal deliveries and complicated deliveries with either a postpartum haemorrhage or non-vigorous infant all showed statistically significant improvement (p < .001) over time using a Chi-squared test for trend with a mean increase of 41% across all indicators.

Video Monitoring a Simulation-Based Quality Improvement Program in Bihar, India.

BACKGROUND: Simulation-based training has become an accepted clinical training andragogy in high-resource settings with its use increasing in low-resource settings. Video recordings of simulated scenarios are commonly used by facilitators. Beyond using the videos during debrief sessions, researchers can also analyze the simulation videos to quantify technical and nontechnical skills during simulated scenarios over time. Little is known about the feasibility and use of large-scale systems to video record and analyze simulation and debriefing data for monitoring and evaluation in low-resource settings. METHODS: This manuscript describes the process of designing and implementing a large-scale video monitoring system. Mentees and Mentors were consented and all simulations and debriefs conducted at 320 Primary Health Centers (PHCs) were video recorded. The system design, number of video recordings, and inter-rater reliability of the coded videos were assessed. RESULTS: The final dataset included a total of 11,278 videos. Overall, a total of 2,124 simulation videos were coded and 183 (12%) were blindly double-coded. For the double-coded sample, the average inter-rater reliability (IRR) scores were 80% for nontechnical skills, and 94% for clinical technical skills. Among 4,450 long debrief videos received, 216 were selected for coding and all were double-coded. Data quality of simulation videos was found to be very good in terms of recorded instances of "unable to see" and "unable to hear" in Phases 1 and 2. CONCLUSION: This study demonstrates that video monitoring systems can be effectively implemented at scale in resource limited settings. Further, video monitoring systems can play several vital roles within program implementation, including monitoring and evaluation, provision of actionable feedback to program implementers, and assurance of program fidelity.