Improving Data-Efficiency and Robustness of Medical Imaging Segmentation Using Inpainting-Based Self-Supervised Learning.

We systematically evaluate the training methodology and efficacy of two inpainting-based pretext tasks of context prediction and context restoration for medical image segmentation using self-supervised learning (SSL). Multiple versions of self-supervised U-Net models were trained to segment MRI and CT datasets, each using a different combination of design choices and pretext tasks to determine the effect of these design choices on segmentation performance. The optimal design choices were used to train SSL models that were then compared with baseline supervised models for computing clinically-relevant metrics in label-limited scenarios. We observed that SSL pretraining with context restoration using 32 × 32 patches and Poission-disc sampling, transferring only the pretrained encoder weights, and fine-tuning immediately with an initial learning rate of 1 × 10-3 provided the most benefit over supervised learning for MRI and CT tissue segmentation accuracy (p < 0.001). For both datasets and most label-limited scenarios, scaling the size of unlabeled pretraining data resulted in improved segmentation performance. SSL models pretrained with this amount of data outperformed baseline supervised models in the computation of clinically-relevant metrics, especially when the performance of supervised learning was low. Our results demonstrate that SSL pretraining using inpainting-based pretext tasks can help increase the robustness of models in label-limited scenarios and reduce worst-case errors that occur with supervised learning.

Validation of a robust method for quantification of three-dimensional growth of the thoracic aorta using deformable image registration.

PURPOSE: Accurate assessment of thoracic aortic aneurysm (TAA) growth is important for appropriate clinical management. Maximal aortic diameter is the primary metric that is used to assess growth, but it suffers from substantial measurement variability. A recently proposed technique, termed vascular deformation mapping (VDM), is able to quantify three-dimensional aortic growth using clinical computed tomography angiography (CTA) data using an approach based on deformable image registration (DIR). However, the accuracy and robustness of VDM remains undefined given the lack of ground truth from clinical CTA data, and, furthermore, the performance of VDM relative to standard manual diameter measurements is unknown. METHODS: To evaluate the performance of the VDM pipeline for quantifying aortic growth, we developed a novel and systematic evaluation process to generate 76 unique synthetic CTA growth phantoms (based on 10 unique cases) with variable degrees and locations of aortic wall deformation. Aortic deformation was quantified using two metrics: area ratio (AR), defined as the ratio of surface area in triangular mesh elements and the magnitude of deformation in the normal direction (DiN) relative to the aortic surface. Using these phantoms, we further investigated the effects on VDM's measurement accuracy resulting from factors that influence the quality of clinical CTA data such as respiratory translations, slice thickness, and image noise. Lastly, we compare the measurement error of VDM TAA growth assessments against two expert raters performing standard diameter measurements of synthetic phantom images. RESULTS: Across our population of 76 synthetic growth phantoms, the median absolute error was 0.063 (IQR: 0.073-0.054) for AR and 0.181 mm (interquartile range [IQR]: 0.214-0.143 mm) for DiN. Median relative error was 1.4% for AR and 3.3 % $3.3\%$ for DiN at the highest tested noise level (contrast-to-noise ratio [CNR] = 2.66). Error in VDM output increased with slice thickness, with the highest median relative error of 1.5% for AR and 4.1% for DiN at a slice thickness of 2.0 mm. Respiratory motion of the aorta resulted in maximal absolute error of 3% AR and 0.6 mm in DiN, but bulk translations in aortic position had a very small effect on measured AR and DiN values (relative errors < 1 % $< 1\%$ ). VDM-derived measurements of magnitude and location of maximal diameter change demonstrated significantly high accuracy and lower variability compared to two expert manual raters ( p < 0.03 $p<0.03$ across all comparisons). CONCLUSIONS: VDM yields an accurate, three-dimensional assessment of aortic growth in TAA patients and is robust to factors such as image noise, respiration-induced translations, and differences in patient position. Further, VDM significantly outperformed two expert manual raters in assessing the magnitude and location of aortic growth despite optimized experimental measurement conditions. These results support validation of the VDM technique for accurate quantification of aortic growth in patients and highlight several important advantages over diameter measurements.

Vascular Deformation Mapping for CT Surveillance of Thoracic Aortic Aneurysm Growth.

Background Aortic diameter measurements in patients with a thoracic aortic aneurysm (TAA) show wide variation. There is no technique to quantify aortic growth in a three-dimensional (3D) manner. Purpose To validate a CT-based technique for quantification of 3D growth based on deformable registration in patients with TAA. Materials and Methods Patients with ascending and descending TAA with two or more CT angiography studies between 2006 and 2020 were retrospectively identified. The 3D aortic growth was quantified using vascular deformation mapping (VDM), a technique that uses deformable registration to warp a mesh constructed from baseline aortic anatomy. Growth assessments between VDM and clinical CT diameter measurements were compared. Aortic growth was quantified as the ratio of change in surface area at each mesh element (area ratio). Manual segmentations were performed by independent raters to assess interrater reproducibility. Registration error was assessed using manually placed landmarks. Agreement between VDM and clinical diameter measurements was assessed using Pearson correlation and Cohen κ coefficients. Results A total of 38 patients (68 surveillance intervals) were evaluated (mean age, 69 years ± 9 [standard deviation]; 21 women), with TAA involving the ascending aorta (n = 26), descending aorta (n = 10), or both (n = 2). VDM was technically successful in 35 of 38 (92%) patients and 58 of 68 intervals (85%). Median registration error was 0.77 mm (interquartile range, 0.54-1.10 mm). Interrater agreement was high for aortic segmentation (Dice similarity coefficient = 0.97 ± 0.02) and VDM-derived area ratio (bias = 0.0, limits of agreement: -0.03 to 0.03). There was strong agreement (r = 0.85, P < .001) between peak area ratio values and diameter change. VDM detected growth in 14 of 58 (24%) intervals. VDM revealed growth outside the maximally dilated segment in six of 14 (36%) growth intervals, none of which were detected with diameter measurements. Conclusion Vascular deformation mapping provided reliable and comprehensive quantitative assessment of three-dimensional aortic growth and growth patterns in patients with thoracic aortic aneurysms undergoing CT surveillance. Published under a CC BY 4.0 license Online supplemental material is available for this article. See also the editorial by Wieben in this issue.