Inter-Rater Reliability and Agreement Among Mass-Casualty Incident Algorithms Using a Pediatric Trauma Dataset: A Pilot Study.

INTRODUCTION: Many triage algorithms exist for use in mass-casualty incidents (MCIs) involving pediatric patients. Most of these algorithms have not been validated for reliability across users. STUDY OBJECTIVE: Investigators sought to compare inter-rater reliability (IRR) and agreement among five MCI algorithms used in the pediatric population. METHODS: A dataset of 253 pediatric (<14 years of age) trauma activations from a Level I trauma center was used to obtain prehospital information and demographics. Three raters were trained on five MCI triage algorithms: Simple Triage and Rapid Treatment (START) and JumpSTART, as appropriate for age (combined as J-START); Sort Assess Life-Saving Intervention Treatment (SALT); Pediatric Triage Tape (PTT); CareFlight (CF); and Sacco Triage Method (STM). Patient outcomes were collected but not available to raters. Each rater triaged the full set of patients into Green, Yellow, Red, or Black categories with each of the five MCI algorithms. The IRR was reported as weighted kappa scores with 95% confidence intervals (CI). Descriptive statistics were used to describe inter-rater and inter-MCI algorithm agreement. RESULTS: Of the 253 patients, 247 had complete triage assignments among the five algorithms and were included in the study. The IRR was excellent for a majority of the algorithms; however, J-START and CF had the highest reliability with a kappa 0.94 or higher (0.9-1.0, 95% CI for overall weighted kappa). The greatest variability was in SALT among Green and Yellow patients. Overall, J-START and CF had the highest inter-rater and inter-MCI algorithm agreements. CONCLUSION: The IRR was excellent for a majority of the algorithms. The SALT algorithm, which contains subjective components, had the lowest IRR when applied to this dataset of pediatric trauma patients. Both J-START and CF demonstrated the best overall reliability and agreement.

Comparison of Outcome Tools Used to Test Mass-Casualty Algorithms in the Pediatric Population.

INTRODUCTION: Mass-casualty incident (MCI) algorithms are used to sort large numbers of patients rapidly into four basic categories based on severity. To date, there is no consensus on the best method to test the accuracy of an MCI algorithm in the pediatric population, nor on the agreement between different tools designed for this purpose. STUDY OBJECTIVE: This study is to compare agreement between the Criteria Outcomes Tool (COT) to previously published outcomes tools in assessing the triage category applied to a simulated set of pediatric MCI patients. METHODS: An MCI triage category (black, red, yellow, and green) was applied to patients from a pre-collected retrospective cohort of pediatric patients under 14 years of age brought in as a trauma activation to a Level I trauma center from July 2010 through November 2013 using each of the following outcome measures: COT, modified Baxt score, modified Baxt combined with mortality and/or length-of-stay (LOS), ambulatory status, mortality alone, and Injury Severity Score (ISS). Descriptive statistics were applied to determine agreement between tools. RESULTS: A total of 247 patients were included, ranging from 25 days to 13 years of age. The outcome of mortality had 100% agreement with the COT black. The "modified Baxt positive and alive" outcome had the highest agreement with COT red (65%). All yellow outcomes had 47%-53% agreement with COT yellow. "Modified Baxt negative and <24 hours LOS" had the highest agreement with the COT green at 89%. CONCLUSIONS: Assessment of algorithms for triaging pediatric MCI patients is complicated by the lack of a gold standard outcome tool and variability between existing measures.

Tabletop Application of SALT Triage to 10, 100, and 1000 Pediatric Victims.

INTRODUCTION: The Sort, Access, Life-saving interventions, Treatment and/or Triage (SALT) mass-casualty incident (MCI) algorithm is unique in that it includes two subjective questions during the triage process: "Is the victim likely to survive given the resources?" and "Is the injury minor?" HYPOTHESIS/PROBLEM: Given this subjectivity, it was hypothesized that as casualties increase, the inter-rater reliability (IRR) of the tool would decline, due to an increase in the number of patients triaged as Minor and Expectant. METHODS: A pre-collected dataset of pediatric trauma patients age <14 years from a single Level 1 trauma center was used to generate "patients." Three trained raters triaged each patient using SALT as if they were in each of the following scenarios: 10, 100, and 1,000 victim MCIs. Cohen's kappa test was used to evaluate IRR between the raters in each of the scenarios. RESULTS: A total of 247 patients were available for triage. The kappas were consistently "poor" to "fair:" 0.37 to 0.59 in the 10-victim scenario; 0.13 to 0.36 in the 100-victim scenario; and 0.05 to 0.36 in the 1,000-victim scenario. There was an increasing percentage of subjects triaged Minor as the number of estimated victims increased: 27.8% increase from 10- to 100-victim scenario and 7.0% increase from 100- to 1,000-victim scenario. Expectant triage categorization of patients remained stable as victim numbers increased. CONCLUSION: Overall, SALT demonstrated poor IRR in this study of increasing casualty counts while triaging pediatric patients. Increased casualty counts in the scenarios did lead to increased Minor but not Expectant categorizations.

Continuous requirement for the Clr4 complex but not RNAi for centromeric heterochromatin assembly in fission yeast harboring a disrupted RITS complex.

Formation of centromeric heterochromatin in fission yeast requires the combined action of chromatin modifying enzymes and small RNAs derived from centromeric transcripts. Positive feedback mechanisms that link the RNAi pathway and the Clr4/Suv39h1 histone H3K9 methyltransferase complex (Clr-C) result in requirements for H3K9 methylation for full siRNA production and for siRNA production to achieve full histone methylation. Nonetheless, it has been proposed that the Argonaute protein, Ago1, is the key initial trigger for heterochromatin assembly via its association with Dicer-independent "priRNAs." The RITS complex physically links Ago1 and the H3-K9me binding protein Chp1. Here we exploit an assay for heterochromatin assembly in which loss of silencing by deletion of RNAi or Clr-C components can be reversed by re-introduction of the deleted gene. We showed previously that a mutant version of the RITS complex (Tas3(WG)) that biochemically separates Ago1 from Chp1 and Tas3 proteins permits maintenance of heterochromatin, but prevents its formation when Clr4 is removed and re-introduced. Here we show that the block occurs with mutants in Clr-C, but not mutants in the RNAi pathway. Thus, Clr-C components, but not RNAi factors, play a more critical role in assembly when the integrity of RITS is disrupted. Consistent with previous reports, cells lacking Clr-C components completely lack H3K9me2 on centromeric DNA repeats, whereas RNAi pathway mutants accumulate low levels of H3K9me2. Further supporting the existence of RNAi-independent mechanisms for establishment of centromeric heterochromatin, overexpression of clr4(+) in clr4Δago1Δ cells results in some de novo H3K9me2 accumulation at centromeres. These findings and our observation that ago1Δ and dcr1Δ mutants display indistinguishable low levels of H3K9me2 (in contrast to a previous report) challenge the model that priRNAs trigger heterochromatin formation. Instead, our results indicate that RNAi cooperates with RNAi-independent factors in the assembly of heterochromatin.