Reproducibility and predictive value of three grading systems for intraoperative adverse events in a cohort of abdominal surgery.

INTRODUCTION: Intraoperative adverse events (iAEs) are increasingly recognized for their impact on patient outcomes. The Kaafarani classification and Surgical Apgar Score (SAS) were developed to assess the intraoperative course; however, both have their drawbacks. ClassIntra was validated for iAEs of any origin. This study compares the Kaafarani and SAS to ClassIntra considering predictive value and interrater reliability in a cohort of abdominal surgery to support implementation of a classification in clinical practice. METHODS: The authors made use of the LAParotomy or LAParoscopy and ADhesiolysis (LAPAD) study database of elective abdominal surgery. Detailed descriptions on iAEs were collected in real-time by a researcher. For the current research aim, all iAEs were graded according ClassIntra, Kaafarani, and SAS (score ≤4). The predictive value was assessed using univariable and multivariable linear regression and the area under the receiver operating curve (AUROC). Two teams graded ClassIntra and Kaafarani to assess the interrater reliability using Cohen's Kappa. RESULTS: A total of 755 surgeries were included, in which 335 (44%) iAEs were graded according to ClassIntra, 228 (30%) to Kaafarani, and 130 (20%) to SAS. All classifications were significantly correlated to postoperative complications, with an AUROC of 0.67 (95% CI: 0.62-0.72), 0.64 (0.59-0.70), and 0.71 (0.56-0.76), respectively. For the secondary endpoint, the interrater reliability of ClassIntra with κ 0.87 (95% CI: 0.84-0.90) and Kaafarani 0.90 (95% CI: 0.87-0.93) was both strong. CONCLUSION: ClassIntra, Kaafarani, and SAS can be used for reporting of iAEs in abdominal surgery with good predictive value for postoperative complications, with strong reliability. ClassIntra, compared with Kaafarani and SAS, included the most iAEs and has the most comprehensive definition suitable for uniform reporting of iAEs in clinical practice and research.

Inter-Rater Agreement of the Classification of Intraoperative Adverse Events (ClassIntra) in Abdominal Surgery.

OBJECTIVE AND SUMMARY OF BACKGROUND DATA: Adverse events in surgical patients can occur preoperatively, intraoperatively, and postoperatively. Universally accepted classification systems are not yet available for intraoperative adverse events (iAEs). ClassIntra has recently been developed and validated as a tool for grading iAEs that occur between skin incision and skin closure irrespective of the origin, that is, surgery, anesthesia, or organizational. The aim of this study is to assess the inter-rater agreement of ClassIntra and assess its predictive value for postoperative complications in elective abdominal surgery. METHODS: This study is a secondary use of data from the LAParotomy or LAParoscopy and ADhesiolysis (LAPAD) study, with detailed data on incidence and management of intra-operative and post-operative complications. Data were collected in a cohort of elective abdominal surgeries. Two teams graded all recorded events in the LAPAD study according to ClassIntra. Cohen Kappa coefficient was calculated to determine inter-rater agreement. Uni- and multivariable linear regression was used to assess the predictive value of the ClassIntra grades for postoperative complications. RESULTS: IAEs were rated in 333 of 755 (44%) surgeries by team 1, and in 324 of 755 (43%) surgeries by team 2. Cohen kappa coefficient for ClassIntra grades was 0.87 [95% confidence interval (CI) 0.84-0.90]. Discrepancies in grading were most frequent for intraoperative bleeding and adhesions' associated injuries. At least 1 postoperative complication was observed in 278 (37%) patients. The risk of a postoperative complications increased with every increase in severity grade of ClassIntra. Intraoperative hypotension [mean difference (MD) 23.41, 95% CI 12.93-33.90] and other organ injuries (MD 18.90, 95% CI -4.22 - 42.02) were the strongest predictors for postoperative complications. CONCLUSIONS: ClassIntra has an almost perfect inter-rater agreement for the classification of iAEs. An increasing grade of ClassIntra was associated with a higher incidence of postoperative complications. Discrepancies in grading related to common complications in abdominal procedures mostly consisted of intraoperative bleeding and adhesion-related injuries. Grading of interoperative events in abdominal surgery might further improve by consensus regarding the definitions of a number of frequent events.