External validation of a paediatric Smart triage model for use in resource limited facilities.

Models for digital triage of sick children at emergency departments of hospitals in resource poor settings have been developed. However, prior to their adoption, external validation should be performed to ensure their generalizability. We externally validated a previously published nine-predictor paediatric triage model (Smart Triage) developed in Uganda using data from two hospitals in Kenya. Both discrimination and calibration were assessed, and recalibration was performed by optimizing the intercept for classifying patients into emergency, priority, or non-urgent categories based on low-risk and high-risk thresholds. A total of 2539 patients were eligible at Hospital 1 and 2464 at Hospital 2, and 5003 for both hospitals combined; admission rates were 8.9%, 4.5%, and 6.8%, respectively. The model showed good discrimination, with area under the receiver-operator curve (AUC) of 0.826, 0.784 and 0.821, respectively. The pre-calibrated model at a low-risk threshold of 8% achieved a sensitivity of 93% (95% confidence interval, (CI):89%-96%), 81% (CI:74%-88%), and 89% (CI:85%-92%), respectively, and at a high-risk threshold of 40%, the model achieved a specificity of 86% (CI:84%-87%), 96% (CI:95%-97%), and 91% (CI:90%-92%), respectively. Recalibration improved the graphical fit, but new risk thresholds were required to optimize sensitivity and specificity.The Smart Triage model showed good discrimination on external validation but required recalibration to improve the graphical fit of the calibration plot. There was no change in the order of prioritization of patients following recalibration in the respective triage categories. Recalibration required new site-specific risk thresholds that may not be needed if prioritization based on rank is all that is required. The Smart Triage model shows promise for wider application for use in triage for sick children in different settings.

Repeatability of Pulse Oximetry Measurements in Children During Triage in 2 Ugandan Hospitals.

BACKGROUND: In low- and middle-income countries, health workers use pulse oximeters for intermittent spot measurements of oxygen saturation (SpO2). However, the accuracy and reliability of pulse oximeters for spot measurements have not been determined. We evaluated the repeatability of spot measurements and the ideal observation time to guide recommendations during spot check measurements. METHODS: Two 1-minute measurements were taken for the 3,903 subjects enrolled in the study conducted April 2020-January 2022 in Uganda, collecting 1 Hz SpO2 and signal quality index (SQI) data. The repeatability between the 2 measurements was assessed using an intraclass correlation coefficient (ICC), calculated using a median of all seconds of non-zero SpO2 values for each recording (any quality, Q1) and again with a quality filter only using seconds with SQI 90% or higher (good quality, Q2). The ICC was also recalculated for both conditions of Q1 and Q2 using the initial 5 seconds, then the initial 10 seconds, and continuing with 5-second increments up to the full 60 seconds. Lastly, the whole minute ICC was calculated with good quality (Q2), including only records where both measurements had a mean SQI of more than 70% (Q3). RESULTS: The repeatability ICC with condition Q1 was 0.591 (95% confidence interval [CI]=0.570, 0.611). Using only the first 5 seconds of each measurement reduced the repeatability to 0.200 (95% CI=0.169, 0.230). Filtering with Q2, the whole-minute ICC was 0.855 (95% CI=0.847, 0.864). The ICC did not improve beyond the first 35 seconds. For Q3, the repeatability rose to 0.908 (95% CI=0.901, 0.914). CONCLUSIONS: Training guidelines must emphasize the importance of signal quality and duration of measurement, targeting a minimum of 35 seconds of adequate-quality, stable data. In addition, the design of new devices should incorporate user prompts and force quality checks to encourage more accurate pulse oximetry measurements.

Smart triage: Development of a rapid pediatric triage algorithm for use in low-and-middle income countries.

Introduction: Early and accurate recognition of children at risk of progressing to critical illness could contribute to improved patient outcomes and resource allocation. In resource limited settings digital triage tools can support decision making and improve healthcare delivery. We developed a model for rapid identification of critically ill children at triage. Methods: This was a prospective cohort study of acutely ill children presenting at Jinja Regional Referral Hospital in Eastern Uganda. Variables collected in the emergency department informed the development of a logistic model based on hospital admission using bootstrap stepwise regression. Low and high-risk thresholds for 90% minimum sensitivity and specificity, respectively generated three risk level categories. Performance was assessed using receiver operating characteristic curve analysis on a held-out test set generated by an 80:20 split with 10-fold cross validation. A risk stratification table informed clinical interpretation. Results: The model derivation cohort included 1,612 participants, with an admission rate of approximately 23%. The majority of admitted patients were under five years old and presenting with sepsis, malaria, or pneumonia. A 9-predictor triage model was derived: logit (p) = -32.888 + (0.252, square root of age) + (0.016, heart rate) + (0.819, temperature) + (-0.022, mid-upper arm circumference) + (0.048 transformed oxygen saturation) + (1.793, parent concern) + (1.012, difficulty breathing) + (1.814, oedema) + (1.506, pallor). The model afforded good discrimination, calibration, and risk stratification at the selected thresholds of 8% and 40%. Conclusion: In a low income, pediatric population, we developed a nine variable triage model with high sensitivity and specificity to predict who should be admitted. The triage model can be integrated into any digital platform and used with minimal training to guide rapid identification of critically ill children at first contact. External validation and clinical implementation are in progress.

A proposed de-identification framework for a cohort of children presenting at a health facility in Uganda.

Data sharing has enormous potential to accelerate and improve the accuracy of research, strengthen collaborations, and restore trust in the clinical research enterprise. Nevertheless, there remains reluctancy to openly share raw data sets, in part due to concerns regarding research participant confidentiality and privacy. Statistical data de-identification is an approach that can be used to preserve privacy and facilitate open data sharing. We have proposed a standardized framework for the de-identification of data generated from cohort studies in children in a low-and-middle income country. We applied a standardized de-identification framework to a data sets comprised of 241 health related variables collected from a cohort of 1750 children with acute infections from Jinja Regional Referral Hospital in Eastern Uganda. Variables were labeled as direct and quasi-identifiers based on conditions of replicability, distinguishability, and knowability with consensus from two independent evaluators. Direct identifiers were removed from the data sets, while a statistical risk-based de-identification approach using the k-anonymity model was applied to quasi-identifiers. Qualitative assessment of the level of privacy invasion associated with data set disclosure was used to determine an acceptable re-identification risk threshold, and corresponding k-anonymity requirement. A de-identification model using generalization, followed by suppression was applied using a logical stepwise approach to achieve k-anonymity. The utility of the de-identified data was demonstrated using a typical clinical regression example. The de-identified data sets was published on the Pediatric Sepsis Data CoLaboratory Dataverse which provides moderated data access. Researchers are faced with many challenges when providing access to clinical data. We provide a standardized de-identification framework that can be adapted and refined based on specific context and risks. This process will be combined with moderated access to foster coordination and collaboration in the clinical research community.

Common data elements for predictors of pediatric sepsis: A framework to standardize data collection.

BACKGROUND: Standardized collection of predictors of pediatric sepsis has enormous potential to increase data compatibility across research studies. The Pediatric Sepsis Predictor Standardization Working Group collaborated to define common data elements for pediatric sepsis predictors at the point of triage to serve as a standardized framework for data collection in resource-limited settings. METHODS: A preliminary list of pediatric sepsis predictor variables was compiled through a systematic literature review and examination of global guideline documents. A 5-round modified Delphi that involved independent voting and active group discussions was conducted to select, standardize, and prioritize predictors. Considerations included the perceived predictive value of the candidate predictor at the point of triage, intra- and inter-rater measurement reliability, and the amount of time and material resources required to reliably collect the predictor in resource-limited settings. RESULTS: We generated 116 common data elements for implementation in future studies. Each common data element includes a standardized prompt, suggested response values, and prioritization as tier 1 (essential), tier 2 (important), or tier 3 (exploratory). Branching logic was added to the predictors list to facilitate the design of efficient data collection methods, such as low-cost electronic case report forms on a mobile application. The set of common data elements are freely available on the Pediatric Sepsis CoLab Dataverse and a web-based feedback survey is available through the Pediatric Sepsis CoLab. Updated iterations will continuously be released based on feedback from the pediatric sepsis research community and emergence of new information. CONCLUSION: Routine use of the common data elements in future studies can allow data sharing between studies and contribute to development of powerful risk prediction algorithms. These algorithms may then be used to support clinical decision making at triage in resource-limited settings. Continued collaboration, engagement, and feedback from the pediatric sepsis research community will be important to ensure the common data elements remain applicable across a broad range of geographical and sociocultural settings.

Smart triage: triage and management of sepsis in children using the point-of-care Pediatric Rapid Sepsis Trigger (PRST) tool.

BACKGROUND: Sepsis is the leading cause of death and disability in children. Every hour of delay in treatment is associated with an escalating risk of morbidity and mortality. The burden of sepsis is greatest in low- and middle-income countries where timely treatment may not occur due to delays in diagnosis and prioritization of critically ill children. To circumvent these challenges, we propose the development and clinical evaluation of a digital triage tool that will identify high risk children and reduce time to treatment. We will also implement and clinically validate a Radio-Frequency Identification system to automate tracking of patients. The mobile platform (mobile device and dashboard) and automated patient tracking system will create a low cost, highly scalable solution for critically ill children, including those with sepsis. METHODS: This is pre-post intervention study consisting of three phases. Phase I will be a baseline period where data is collected on key predictors and outcomes before implementation of the digital triage tool. In Phase I, there will be no changes to healthcare delivery processes in place at the study hospitals. Phase II will involve model derivation, technology development, and usability testing. Phase III will be the intervention period where data is collected on key predictors and outcomes after implementation of the digital triage tool. The primary outcome, time to treatment initiation, will be compared to assess effectiveness of the digital health intervention. DISCUSSION: Smart technology has the potential to overcome the barrier of limited clinical expertise in the identification of the child at risk. This mobile health platform, with sensors and data-driven applications, will provide real-time individualized risk prediction to rapidly triage patients and facilitate timely access to life-saving treatments for children in low- and middle-income countries, where specialists are not regularly available and deaths from sepsis are common. TRIAL REGISTRATION: Clinical Trials.gov Identifier: NCT04304235, Registered 11 March 2020.

Derivation and internal validation of a data-driven prediction model to guide frontline health workers in triaging children under-five in Nairobi, Kenya.

Background: Many hospitalized children in developing countries die from infectious diseases. Early recognition of those who are critically ill coupled with timely treatment can prevent many deaths. A data-driven, electronic triage system to assist frontline health workers in categorizing illness severity is lacking. This study aimed to develop a data-driven parsimonious triage algorithm for children under five years of age. Methods: This was a prospective observational study of children under-five years of age presenting to the outpatient department of Mbagathi Hospital in Nairobi, Kenya between January and June 2018. A study nurse examined participants and recorded history and clinical signs and symptoms using a mobile device with an attached low-cost pulse oximeter sensor. The need for hospital admission was determined independently by the facility clinician and used as the primary outcome in a logistic predictive model. We focused on the selection of variables that could be quickly and easily assessed by low skilled health workers. Results: The admission rate (for more than 24 hours) was 12% (N=138/1,132). We identified an eight-predictor logistic regression model including continuous variables of weight, mid-upper arm circumference, temperature, pulse rate, and transformed oxygen saturation, combined with dichotomous signs of difficulty breathing, lethargy, and inability to drink or breastfeed. This model predicts overnight hospital admission with an area under the receiver operating characteristic curve of 0.88 (95% CI 0.82 to 0.94). Low- and high-risk thresholds of 5% and 25%, respectively were selected to categorize participants into three triage groups for implementation.  Conclusion: A logistic regression model comprised of eight easily understood variables may be useful for triage of children under the age of five based on the probability of need for admission. This model could be used by frontline workers with limited skills in assessing children. External validation is needed before adoption in clinical practice.