Evaluating automated longitudinal tumor measurements for glioblastoma response assessment.

Automated tumor segmentation tools for glioblastoma show promising performance. To apply these tools for automated response assessment, longitudinal segmentation, and tumor measurement, consistency is critical. This study aimed to determine whether BraTumIA and HD-GLIO are suited for this task. We evaluated two segmentation tools with respect to automated response assessment on the single-center retrospective LUMIERE dataset with 80 patients and a total of 502 post-operative time points. Volumetry and automated bi-dimensional measurements were compared with expert measurements following the Response Assessment in Neuro-Oncology (RANO) guidelines. The longitudinal trend agreement between the expert and methods was evaluated, and the RANO progression thresholds were tested against the expert-derived time-to-progression (TTP). The TTP and overall survival (OS) correlation was used to check the progression thresholds. We evaluated the automated detection and influence of non-measurable lesions. The tumor volume trend agreement calculated between segmentation volumes and the expert bi-dimensional measurements was high (HD-GLIO: 81.1%, BraTumIA: 79.7%). BraTumIA achieved the closest match to the expert TTP using the recommended RANO progression threshold. HD-GLIO-derived tumor volumes reached the highest correlation between TTP and OS (0.55). Both tools failed at an accurate lesion count across time. Manual false-positive removal and restricting to a maximum number of measurable lesions had no beneficial effect. Expert supervision and manual corrections are still necessary when applying the tested automated segmentation tools for automated response assessment. The longitudinal consistency of current segmentation tools needs further improvement. Validation of volumetric and bi-dimensional progression thresholds with multi-center studies is required to move toward volumetry-based response assessment.

Clinical Evaluation of a Quantitative Imaging Biomarker Supporting Radiological Assessment of Hippocampal Sclerosis.

OBJECTIVE: To evaluate the influence of quantitative reports (QReports) on the radiological assessment of hippocampal sclerosis (HS) from MRI of patients with epilepsy in a setting mimicking clinical reality. METHODS: The study included 40 patients with epilepsy, among them 20 with structural abnormalities in the mesial temporal lobe (13 with HS). Six raters blinded to the diagnosis assessed the 3T MRI in two rounds, first using MRI only and later with both MRI and the QReport. Results were evaluated using inter-rater agreement (Fleiss' kappa [Formula: see text]) and comparison with a consensus of two radiological experts derived from clinical and imaging data, including 7T MRI. RESULTS: For the primary outcome, diagnosis of HS, the mean accuracy of the raters improved from 77.5% with MRI only to 86.3% with the additional QReport (effect size [Formula: see text]). Inter-rater agreement increased from [Formula: see text] to [Formula: see text]. Five of the six raters reached higher accuracies, and all reported higher confidence when using the QReports. CONCLUSION: In this pre-use clinical evaluation study, we demonstrated clinical feasibility and usefulness as well as the potential impact of a previously suggested imaging biomarker for radiological assessment of HS.

A Quantitative Imaging Biomarker Supporting Radiological Assessment of Hippocampal Sclerosis Derived From Deep Learning-Based Segmentation of T1w-MRI.

PURPOSE: Hippocampal volumetry is an important biomarker to quantify atrophy in patients with mesial temporal lobe epilepsy. We investigate the sensitivity of automated segmentation methods to support radiological assessments of hippocampal sclerosis (HS). Results from FreeSurfer and FSL-FIRST are contrasted to a deep learning (DL)-based segmentation method. MATERIALS AND METHODS: We used T1-weighted MRI scans from 105 patients with epilepsy and 354 healthy controls. FreeSurfer, FSL, and a DL-based method were applied for brain anatomy segmentation. We calculated effect sizes (Cohen's d) between left/right HS and healthy controls based on the asymmetry of hippocampal volumes. Additionally, we derived 14 shape features from the segmentations and determined the most discriminating feature to identify patients with hippocampal sclerosis by a support vector machine (SVM). RESULTS: Deep learning-based segmentation of the hippocampus was the most sensitive to detecting HS. The effect sizes of the volume asymmetries were larger with the DL-based segmentations (HS left d= -4.2, right = 4.2) than with FreeSurfer (left= -3.1, right = 3.7) and FSL (left= -2.3, right = 2.5). For the classification based on the shape features, the surface-to-volume ratio was identified as the most important feature. Its absolute asymmetry yielded a higher area under the curve (AUC) for the deep learning-based segmentation (AUC = 0.87) than for FreeSurfer (0.85) and FSL (0.78) to dichotomize HS from other epilepsy cases. The robustness estimated from repeated scans was statistically significantly higher with DL than all other methods. CONCLUSION: Our findings suggest that deep learning-based segmentation methods yield a higher sensitivity to quantify hippocampal sclerosis than atlas-based methods and derived shape features are more robust. We propose an increased asymmetry in the surface-to-volume ratio of the hippocampus as an easy-to-interpret quantitative imaging biomarker for HS.

Standardized Assessment of Automatic Segmentation of White Matter Hyperintensities and Results of the WMH Segmentation Challenge.

Quantification of cerebral white matter hyperintensities (WMH) of presumed vascular origin is of key importance in many neurological research studies. Currently, measurements are often still obtained from manual segmentations on brain MR images, which is a laborious procedure. The automatic WMH segmentation methods exist, but a standardized comparison of the performance of such methods is lacking. We organized a scientific challenge, in which developers could evaluate their methods on a standardized multi-center/-scanner image dataset, giving an objective comparison: the WMH Segmentation Challenge. Sixty T1 + FLAIR images from three MR scanners were released with the manual WMH segmentations for training. A test set of 110 images from five MR scanners was used for evaluation. The segmentation methods had to be containerized and submitted to the challenge organizers. Five evaluation metrics were used to rank the methods: 1) Dice similarity coefficient; 2) modified Hausdorff distance (95th percentile); 3) absolute log-transformed volume difference; 4) sensitivity for detecting individual lesions; and 5) F1-score for individual lesions. In addition, the methods were ranked on their inter-scanner robustness; 20 participants submitted their methods for evaluation. This paper provides a detailed analysis of the results. In brief, there is a cluster of four methods that rank significantly better than the other methods, with one clear winner. The inter-scanner robustness ranking shows that not all the methods generalize to unseen scanners. The challenge remains open for future submissions and provides a public platform for method evaluation.

Neural Network-derived Perfusion Maps for the Assessment of Lesions in Patients with Acute Ischemic Stroke.

PURPOSE: To perform a proof-of-concept study to investigate the clinical utility of perfusion maps derived from convolutional neural networks (CNNs) for the workup of patients with acute ischemic stroke presenting with a large vessel occlusion. MATERIALS AND METHODS: Data on endovascularly treated patients with acute ischemic stroke (n = 151; median age, 68 years [interquartile range, 59-75 years]; 82 of 151 [54.3%] women) were retrospectively extracted from a single-center institutional prospective registry (between January 2011 and December 2015). Dynamic susceptibility perfusion imaging data were processed by applying a commercially available reference method and in parallel by a recently proposed CNN method to automatically infer time to maximum of the tissue residue function (Tmax) perfusion maps. The outputs were compared by using quantitative markers of tissue at risk derived from manual segmentations of perfusion lesions from two expert raters. RESULTS: Strong correlations of lesion volumes (Tmax > 4 seconds, > 6 seconds, and > 8 seconds; R = 0.865-0.914; P < .001) and good spatial overlap of respective lesion segmentations (Dice coefficients, 0.70-0.85) between the CNN method and reference output were observed. Eligibility for late-window reperfusion treatment was feasible with use of the CNN method, with complete interrater agreement for the CNN method (Cohen κ = 1; P < .001), although slight discrepancies compared with the reference-based output were observed (Cohen κ = 0.609-0.64; P < .001). The CNN method tended to underestimate smaller lesion volumes, leading to a disagreement between the CNN and reference method in five of 45 patients (9%). CONCLUSION: Compared with standard deconvolution-based processing of raw perfusion data, automatic CNN-derived Tmax perfusion maps can be applied to patients who have acute ischemic large vessel occlusion stroke, with similar clinical utility.© RSNA, 2019Supplemental material is available for this article.