Does training improve diagnostic accuracy and inter-rater agreement in applying the Berlin radiographic definition of acute respiratory distress syndrome? A multicenter prospective study.

BACKGROUND: Poor inter-rater reliability in chest radiograph interpretation has been reported in the context of acute respiratory distress syndrome (ARDS), although not for the Berlin definition of ARDS. We sought to examine the effect of training material on the accuracy and consistency of intensivists' chest radiograph interpretations for ARDS diagnosis. METHODS: We conducted a rater agreement study in which 286 intensivists (residents 41.3%, junior attending physicians 35.3%, and senior attending physician 23.4%) independently reviewed the same 12 chest radiographs developed by the ARDS Definition Task Force ("the panel") before and after training. Radiographic diagnoses by the panel were classified into the consistent (n = 4), equivocal (n = 4), and inconsistent (n = 4) categories and were used as a reference. The 1.5-hour training course attended by all 286 intensivists included introduction of the diagnostic rationale, and a subsequent in-depth discussion to reach consensus for all 12 radiographs. RESULTS: Overall diagnostic accuracy, which was defined as the percentage of chest radiographs that were interpreted correctly, improved but remained poor after training (42.0 ± 14.8% before training vs. 55.3 ± 23.4% after training, p < 0.001). Diagnostic sensitivity and specificity improved after training for all diagnostic categories (p < 0.001), with the exception of specificity for the equivocal category (p = 0.883). Diagnostic accuracy was higher for the consistent category than for the inconsistent and equivocal categories (p < 0.001). Comparisons of pre-training and post-training results revealed that inter-rater agreement was poor and did not improve after training, as assessed by overall agreement (0.450 ± 0.406 vs. 0.461 ± 0.575, p = 0.792), Fleiss's kappa (0.133 ± 0.575 vs. 0.178 ± 0.710, p = 0.405), and intraclass correlation coefficient (ICC; 0.219 vs. 0.276, p = 0.470). CONCLUSIONS: The radiographic diagnostic accuracy and inter-rater agreement were poor when the Berlin radiographic definition was used, and were not significantly improved by the training set of chest radiographs developed by the ARDS Definition Task Force. TRIAL REGISTRATION: The study was registered at ClinicalTrials.gov (registration number NCT01704066 ) on 6 October 2012.

Value of Kidney Disease Improving Global Outcomes Urine Output Criteria in Critically Ill Patients: A Secondary Analysis of a Multicenter Prospective Cohort Study.

BACKGROUND: Urine output (UO) is an essential criterion of the Kidney Disease Improving Global Outcomes (KDIGO) definition and classification system for acute kidney injury (AKI), of which the diagnostic value has not been extensively studied. We aimed to determine whether AKI based on KDIGO UO criteria (KDIGOUO) could improve the diagnostic and prognostic accuracy, compared with KDIGO serum creatinine criteria (KDIGOSCr). METHODS: We conducted a secondary analysis of the database of a previous study conducted by China Critical Care Clinical Trial Group (CCCCTG), which was a 2-month prospective cohort study (July 1, 2009 to August 31, 2009) involving 3063 patients in 22 tertiary Intensive Care Units in Mainland of China. AKI was diagnosed and classified separately based on KDIGOUOand KDIGOSCr. Hospital mortality of patients with more severe AKI classification based on KDIGOUOwas compared with other patients by univariate and multivariate regression analyses. RESULTS: The prevalence of AKI increased from 52.4% based on KDIGOSCrto 55.4% based on KDIGOSCrcombined with KDIGOUO. KDIGOUOalso resulted in an upgrade of AKI classification in 7.3% of patients, representing those with more severe AKI classification based on KDIGOUO. Compared with non-AKI patients or those with maximum AKI classification by KDIGOSCr, those with maximum AKI classification by KDIGOUOhad a significantly higher hospital mortality of 58.4% (odds ratio [OR]: 7.580, 95% confidence interval [CI]: 4.141-13.873, P< 0.001). In a multivariate logistic regression analysis, AKI based on KDIGOUO (OR: 2.891, 95% CI: 1.964-4.254, P< 0.001), but not based on KDIGOSCr (OR: 1.322, 95% CI: 0.902-1.939, P = 0.152), was an independent risk factor for hospital mortality. CONCLUSION: UO was a criterion with additional value beyond creatinine criterion for AKI diagnosis and classification, which can help identify a group of patients with high risk of death.

Prevalence, risk factors, clinical course, and outcome of acute kidney injury in Chinese intensive care units: a prospective cohort study.

BACKGROUND: Acute kidney injury (AKI) has been recognized as a major healthcare problem affecting millions of patients worldwide. However, epidemiologic data concerning AKI in China are still lacking. The objectives of this study were to characterize AKI defined by RIFLE criteria, assess the association with hospital mortality, and evaluate the impact of AKI in the context of other risk factors. METHODS: This prospective multicenter observational study enrolled 3,063 consecutive patients from 1 July 2009 to 31 August 2009 in 22 ICUs across mainland China. We excluded patients who were admitted for less than 24 hours (n = 1623), younger than 18 years (n = 127), receiving chronic hemodialysis (n = 29), receiving renal transplantation (n = 1) and unknown reasons (n = 28). There were 1255 patients in the final analysis. AKI was diagnosed and classified according to RIFLE criteria. RESULTS: There were 396 patients (31.6%) who had AKI, with RIFLE maximum class R, I, and F in 126 (10.0%), 91 (7.3%), and 179 (14.3%) patients, respectively. Renal function deteriorated in 206 patients (16.4%). In comparison with non AKI patients, patients in the risk class on ICU admission were more likely to progress to the injury class (odds ratio (OR) 3.564, 95% confidence interval (CI) 1.706 - 7.443, P = 0.001], while patients in the risk class (OR 5.215, 95% CI 2.798-9.719, P < 0.001) and injury class (OR 13.316, 95% CI 7.507-23.622, P < 0.001) had a significantly higher probability of deteriorating into failure class. The adjusted hazard ratios for 90-day mortality were 1.884 for the risk group, 3.401 for the injury group, and 5.306 for the failure group. CONCLUSIONS: The prevalence of AKI was high among critically ill patients in Chinese ICUs. In comparison with non-AKI patients, patients with RIFLE class R or class I on ICU admission were more susceptibility to progression to class I or class F. The RIFLE criteria were robust and correlated well with clinical deterioration and mortality.