Inter- and Intra-Observer Variability and the Effect of Experience in Cine-MRI for Adhesion Detection.

Cine-MRI for adhesion detection is a promising novel modality that can help the large group of patients developing pain after abdominal surgery. Few studies into its diagnostic accuracy are available, and none address observer variability. This retrospective study explores the inter- and intra-observer variability, diagnostic accuracy, and the effect of experience. A total of 15 observers with a variety of experience reviewed 61 sagittal cine-MRI slices, placing box annotations with a confidence score at locations suspect for adhesions. Five observers reviewed the slices again one year later. Inter- and intra-observer variability are quantified using Fleiss' (inter) and Cohen's (intra) κ and percentage agreement. Diagnostic accuracy is quantified with receiver operating characteristic (ROC) analysis based on a consensus standard. Inter-observer Fleiss' κ values range from 0.04 to 0.34, showing poor to fair agreement. High general and cine-MRI experience led to significantly (p < 0.001) better agreement among observers. The intra-observer results show Cohen's κ values between 0.37 and 0.53 for all observers, except one with a low κ of -0.11. Group AUC scores lie between 0.66 and 0.72, with individual observers reaching 0.78. This study confirms that cine-MRI can diagnose adhesions, with respect to a radiologist consensus panel and shows that experience improves reading cine-MRI. Observers without specific experience adapt to this modality quickly after a short online tutorial. Observer agreement is fair at best and area under the receiver operating characteristic curve (AUC) scores leave room for improvement. Consistently interpreting this novel modality needs further research, for instance, by developing reporting guidelines or artificial intelligence-based methods.

A novel diagnostic aid for intra-abdominal adhesion detection in cine-MRI: pilot study and initial diagnostic impressions.

OBJECTIVE: A non-invasive diagnostic technique for abdominal adhesions is not currently available. Capture of abdominal motion due to respiration in cine-MRI has shown promise, but is difficult to interpret. This article explores the value of a complimentary diagnostic aid to facilitate the non-invasive detection of abdominal adhesions using cine-MRI. METHOD: An image processing technique was developed to quantify the amount of sliding that occurs between the organs of the abdomen and the abdominal wall in sagittal cine-MRI slices. The technique produces a "sheargram" which depicts the amount of sliding which has occurred over 1-3 respiratory cycles. A retrospective cohort of 52 patients, scanned for suspected adhesions, made 281 cine-MRI sagittal slices available for processing. The resulting sheargrams were reported by two operators and compared with expert clinical judgment of the cine-MRI scans. RESULTS: The sheargram matched clinical judgment in 84% of all sagittal slices and 93-96% of positive adhesions were identified on the sheargram. The sheargram displayed a slight skew towards sensitivity over specificity, with a high positive adhesion detection rate but at the expense of false positives. CONCLUSION: Good correlation between sheargram and absence/presence of inferred adhesions indicates quantification of sliding motion has potential to aid adhesion detection in cine-MRI. ADVANCES IN KNOWLEDGE: This is the first attempt to clinically evaluate a novel image processing technique quantifying the sliding motion of the abdominal contents against the abdominal wall. The results of this pilot study reveal its potential as a diagnostic aid for detection of abdominal adhesions.