RESUMEN
Models for digital triage of sick children at emergency departments of hospitals in resource poor settings have been developed. However, prior to their adoption, external validation should be performed to ensure their generalizability. We externally validated a previously published nine-predictor paediatric triage model (Smart Triage) developed in Uganda using data from two hospitals in Kenya. Both discrimination and calibration were assessed, and recalibration was performed by optimizing the intercept for classifying patients into emergency, priority, or non-urgent categories based on low-risk and high-risk thresholds. A total of 2539 patients were eligible at Hospital 1 and 2464 at Hospital 2, and 5003 for both hospitals combined; admission rates were 8.9%, 4.5%, and 6.8%, respectively. The model showed good discrimination, with area under the receiver-operator curve (AUC) of 0.826, 0.784 and 0.821, respectively. The pre-calibrated model at a low-risk threshold of 8% achieved a sensitivity of 93% (95% confidence interval, (CI):89%-96%), 81% (CI:74%-88%), and 89% (CI:85%-92%), respectively, and at a high-risk threshold of 40%, the model achieved a specificity of 86% (CI:84%-87%), 96% (CI:95%-97%), and 91% (CI:90%-92%), respectively. Recalibration improved the graphical fit, but new risk thresholds were required to optimize sensitivity and specificity.The Smart Triage model showed good discrimination on external validation but required recalibration to improve the graphical fit of the calibration plot. There was no change in the order of prioritization of patients following recalibration in the respective triage categories. Recalibration required new site-specific risk thresholds that may not be needed if prioritization based on rank is all that is required. The Smart Triage model shows promise for wider application for use in triage for sick children in different settings.
RESUMEN
BACKGROUND: Effective triage at hospitals can improve outcomes for children globally by helping identify and prioritize care for those most at-risk of death. Paper-based pediatric triage guidelines have been developed to support frontline health workers in low-resource settings, but these guidelines can be challenging to implement. Smart Triage is a digital triaging platform for quality improvement (QI) that aims to address this challenge. Smart Triage represents a major cultural and behavioural shift in terms of managing patients at health facilities in low-and middle-income countries. The purpose of this study is to understand user perspectives on the usability, feasibility, and acceptability of Smart Triage to inform ongoing and future implementation. METHODS: This was a descriptive qualitative study comprising of face-to-face interviews with health workers (n = 15) at a regional referral hospital in Eastern Uganda, conducted as a sub-study of a larger clinical trial to evaluate Smart Triage (NCT04304235). Thematic analysis was used to assess the usability, feasibility, and acceptability of the platform, focusing on its use in stratifying and prioritizing patients according to their risk and informing QI initiatives implemented by health workers. RESULTS: With appropriate training and experience, health workers found most features of Smart Triage usable and feasible to implement, and reported the platform was acceptable due to its positive impact on reducing the time to treatment for emergency pediatric cases and its use in informing QI initiatives within the pediatric ward. Several factors that reduced the feasibility and acceptability were identified, including high staff turnover, a lack of medical supplies at the hospital, and challenges with staff attitudes. CONCLUSION: Health workers can use the Smart Triage digital triaging platform to identify and prioritize care for severely ill children and improve quality of care at health facilities in low-resource settings. Future innovation is needed to address identified feasibility and acceptability challenges; however, this platform could potentially address some of the challenges to implementing current paper-based systems.