Evaluation of the Validity and Reliability of ANKUTRIAGE, a New Decision Support System in Pediatric Emergency Triage.

BACKGROUND: The intensity of emergency services is an increasing health problem all over the world, necessitating an effective triage system. The aim of this study was to evaluate the validity and reliability of the "ANKUTRIAGE" in children. METHODS: This prospective, longitudinal study was carried out at a pediatric emergency department. ANKUTRIAGE, a 5-level computer-aided triage decision support system, was developed. Patients younger than 18 years who do not need emergency intervention, who had complete vital sign measurements, who gave consent for the study, and who were admitted to the emergency service during working hours with trained personnel were included. For validity, agreement between the urgency levels determined by ANKUTRIAGE and the reference triage systems: Pediatric Canadian Triage and Acuity Scale and Emergency Severity Index, was evaluated. In addition, the association of urgency levels with clinical outcomes was studied. To assess reliability, patients were evaluated by 2 blinded healthcare professionals using ANKUTRIAGE and a quadratic weighted κ was estimated. RESULTS: A total of 1232 children with a median age of 4.00 years were included. ANKUTRIAGE acuity levels significantly correlated with the number of resources used, the number of patients undergoing life-saving procedures, pediatric intensive care unit, and overall hospitalization rates, respectively ( P < 0.001, P < 0.001, P < 0.001, P < 0.001). The agreement of ANKUTRIAGE with Pediatric Canadian Triage and Acuity Scale was found to be 0.94 (95% confidence interval [CI], 0.93-0.94), with an Emergency Severity Index of 0.75 (95% CI, 0.70-0.80). The interrater agreement between 2 evaluators who used ANKUTRIAGE reflected as excellent consistency 0.92 (95% CI, 0.89-0.95; κ > 0.8). CONCLUSIONS: ANKUTRIAGE demonstrated high agreement with clinical outcomes and with proven triage systems and reflected high reliability between users. ANKUTRIAGE will enable a more standardized and practical triage, especially in crowded pediatric emergency departments and in situations where triage is performed by health professionals with different experience and professions.

Reliability and Validity of a New Computer-Based Triage Decision Support Tool: ANKUTRIAGE.

OBJECTIVE: Triage is a tool used to determine patients' severity of illness or injury within minutes of arrival. This study aims to assess the reliability and validity of a new computer-based triage decision support tool, ANKUTRIAGE, prospectively. METHODS: ANKUTRIAGE, a 5-level triage tool was established considering 2 major factors, patient's vital signs and characteristics of the admission complaint. Adult patients admitted to the ED between July and October, 2019 were consecutively and independently double triaged by 2 assessors using ANKUTRIAGE system. To measure inter-rater reliability, quadratic-weighted kappa coefficients (Kw) were calculated. For the validity, associations among urgency levels, resource use, and clinical outcomes were evaluated. RESULTS: The inter-rater reliability between users of ANKUTRIAGE was excellent with an agreement coefficient (Kw) greater than 0.8 in all compared groups. In the validity phase, hospitalization rate, intensive care unit admission and mortality rate decreased from level 1 to 5. Likewise, according to the urgency levels, resource use decreased significantly as the triage level decreased (P < 0.05). CONCLUSIONS: ANKUTRIAGE proved to be a valid and reliable tool in the emergency department. The results showed that displaying the key discriminator for each complaint to assist decision leads to a high inter-rater agreement with good correlation between urgency levels and clinical outcomes, as well as between urgency levels and resource consumptions.