Automated anomaly-aware 3D segmentation of bones and cartilages in knee MR images from the Osteoarthritis Initiative.

In medical image analysis, automated segmentation of multi-component anatomical entities, with the possible presence of variable anomalies or pathologies, is a challenging task. In this work, we develop a multi-step approach using U-Net-based models to initially detect anomalies (bone marrow lesions, bone cysts) in the distal femur, proximal tibia and patella from 3D magnetic resonance (MR) images in individuals with varying grades of knee osteoarthritis. Subsequently, the extracted data are used for downstream tasks involving semantic segmentation of individual bone and cartilage volumes as well as bone anomalies. For anomaly detection, U-Net-based models were developed to reconstruct bone volume profiles of the femur and tibia in images via inpainting so anomalous bone regions could be replaced with close to normal appearances. The reconstruction error was used to detect bone anomalies. An anomaly-aware segmentation network, which was compared to anomaly-naïve segmentation networks, was used to provide a final automated segmentation of the individual femoral, tibial and patellar bone and cartilage volumes from the knee MR images which contain a spectrum of bone anomalies. The anomaly-aware segmentation approach provided up to 58% reduction in Hausdorff distances for bone segmentations compared to the results from anomaly-naïve segmentation networks. In addition, the anomaly-aware networks were able to detect bone anomalies in the MR images with greater sensitivity and specificity (area under the receiver operating characteristic curve [AUC] up to 0.896) compared to anomaly-naïve segmentation networks (AUC up to 0.874).

Automated volumetric and statistical shape assessment of cam-type morphology of the femoral head-neck region from clinical 3D magnetic resonance images.

Background: Femoroacetabular impingement (FAI) cam morphology is routinely assessed using manual measurements of two-dimensional (2D) alpha angles which are prone to high rater variability and do not provide direct three-dimensional (3D) data on these osseous formations. We present CamMorph, a fully automated 3D pipeline for segmentation, statistical shape assessment and measurement of cam volume, surface area and height from clinical magnetic resonance (MR) images of the hip in FAI patients. Methods: The novel CamMorph pipeline involves two components: (I) accurate proximal femur segmentation generated by combining the 3D U-net to identify both global (region) and local (edge) features in clinical MR images and focused shape modelling to generate a 3D anatomical model for creating patient-specific proximal femur models; (II) patient-specific anatomical information from 3D focused shape modelling to simulate 'healthy' femoral bone models with cam-affected region constraints applied to the anterosuperior femoral head-neck region to quantify cam morphology in FAI patients. The CamMorph pipeline, which generates patient-specific data within 5 min, was used to analyse multi-site clinical MR images of the hip to measure and assess cam morphology in male (n=56) and female (n=41) FAI patients. Results: There was excellent agreement between manual and CamMorph segmentations of the proximal femur as demonstrated by the mean Dice similarity index (DSI; 0.964±0.006), 95% Hausdorff distance (HD; 2.123±0.876 mm) and average surface distance (ASD; 0.539±0.189 mm) values. Compared to female FAI patients, male patients had a significantly larger median cam volume (969.22 vs. 272.97 mm3, U=240.0, P<0.001), mean surface area [657.36 vs. 306.93 mm2, t(95)=8.79, P<0.001], median maximum-height (3.66 vs. 2.15 mm, U=407.0, P<0.001) and median average-height (1.70 vs. 0.86 mm, U=380.0, P<0.001). Conclusions: The fully automated 3D CamMorph pipeline developed in the present study successfully segmented and measured cam morphology from clinical MR images of the hip in male and female patients with differing FAI severity and pathoanatomical characteristics.

CAN3D: Fast 3D medical image segmentation via compact context aggregation.

Direct automatic segmentation of objects in 3D medical imaging, such as magnetic resonance (MR) imaging, is challenging as it often involves accurately identifying multiple individual structures with complex geometries within a large volume under investigation. Most deep learning approaches address these challenges by enhancing their learning capability through a substantial increase in trainable parameters within their models. An increased model complexity will incur high computational costs and large memory requirements unsuitable for real-time implementation on standard clinical workstations, as clinical imaging systems typically have low-end computer hardware with limited memory and CPU resources only. This paper presents a compact convolutional neural network (CAN3D) designed specifically for clinical workstations and allows the segmentation of large 3D Magnetic Resonance (MR) images in real-time. The proposed CAN3D has a shallow memory footprint to reduce the number of model parameters and computer memory required for state-of-the-art performance and maintain data integrity by directly processing large full-size 3D image input volumes with no patches required. The proposed architecture significantly reduces computational costs, especially for inference using the CPU. We also develop a novel loss function with extra shape constraints to improve segmentation accuracy for imbalanced classes in 3D MR images. Compared to state-of-the-art approaches (U-Net3D, improved U-Net3D and V-Net), CAN3D reduced the number of parameters up to two orders of magnitude and achieved much faster inference, up to 5 times when predicting with a standard commercial CPU (instead of GPU). For the open-access OAI-ZIB knee MR dataset, in comparison with manual segmentation, CAN3D achieved Dice coefficient values of (mean = 0.87 ± 0.02 and 0.85 ± 0.04) with mean surface distance errors (mean = 0.36 ± 0.32 mm and 0.29 ± 0.10 mm) for imbalanced classes such as (femoral and tibial) cartilage volumes respectively when training volume-wise under only 12G video memory. Similarly, CAN3D demonstrated high accuracy and efficiency on a pelvis 3D MR imaging dataset for prostate cancer consisting of 211 examinations with expert manual semantic labels (bladder, body, bone, rectum, prostate) now released publicly for scientific use as part of this work.

Automated 3D Analysis of Clinical Magnetic Resonance Images Demonstrates Significant Reductions in Cam Morphology Following Arthroscopic Intervention in Contrast to Physiotherapy.

Purpose: To obtain automated measurements of cam volume, surface area, and height from baseline (preintervention) and 12-month magnetic resonance (MR) images acquired from male and female patients allocated to physiotherapy (PT) or arthroscopic surgery (AS) management for femoroacetabular impingement (FAI) in the Australian FASHIoN trial. Methods: An automated segmentation pipeline (CamMorph) was used to obtain cam morphology data from three-dimensional (3D) MR hip examinations in FAI patients classified with mild, moderate, or major cam volumes. Pairwise comparisons between baseline and 12-month cam volume, surface area, and height data were performed within the PT and AS patient groups using paired t-tests or Wilcoxon signed-rank tests. Results: A total of 43 patients were included with 15 PT patients (9 males, 6 females) and 28 AS patients (18 males, 10 females) for premanagement and postmanagement cam morphology assessments. Within the PT male and female patient groups, there were no significant differences between baseline and 12-month mean cam volume (male: 1269 vs 1288 mm3, t[16] = -0.39; female: 545 vs 550 mm,3 t[10] = -0.78), surface area (male: 1525 vs 1491 mm2, t[16] = 0.92; female: 885 vs 925 mm,2 t[10] = -0.78), maximum height (male: 4.36 vs 4.32 mm, t[16] = 0.34; female: 3.05 vs 2.96 mm, t[10] = 1.05) and average height (male: 2.18 vs 2.18 mm, t[16] = 0.22; female: 1.4 vs 1.43 mm, t[10] = -0.38). In contrast, within the AS male and female patient groups, there were significant differences between baseline and 12-month cam volume (male: 1343 vs 718 mm3, W = 0.0; female: 499 vs 240 mm3, t[18] = 2.89), surface area (male: 1520 vs 1031 mm2, t(34) = 6.48; female: 782 vs 483 mm2, t(18) = 3.02), maximum-height (male: 4.3 vs 3.42 mm, W = 13.5; female: 2.85 vs 2.24 mm, t(18) = 3.04) and average height (male: 2.17 vs 1.52 mm, W = 3.0; female: 1.4 vs 0.94 mm, W = 3.0). In AS patients, 3D bone models provided good visualization of cam bone mass removal postostectomy. Conclusions: Automated measurement of cam morphology from baseline (preintervention) and 12-month MR images demonstrated that the cam volume, surface area, maximum-height, and average height were significantly smaller in AS patients following ostectomy, whereas there were no significant differences in these cam measures in PT patients from the Australian FASHIoN study. Level of Evidence: Level II, cohort study.

Automated T2-mapping of the Menisci From Magnetic Resonance Images in Patients with Acute Knee Injury.

RATIONALE AND OBJECTIVES: This study aimed to evaluate the accuracy of an automated method for segmentation and T2 mapping of the medial meniscus (MM) and lateral meniscus (LM) in clinical magnetic resonance images from patients with acute knee injury. MATERIALS AND METHODS: Eighty patients scheduled for surgery of an anterior cruciate ligament or meniscal injury underwent magnetic resonance imaging of the knee (multiplanar two-dimensional [2D] turbo spin echo [TSE] or three-dimensional [3D]-TSE examinations, T2 mapping). Each meniscus was automatically segmented from the 2D-TSE (composite volume) or 3D-TSE images, auto-partitioned into anterior, mid, and posterior regions, and co-registered onto the T2 maps. The Dice similarity index (spatial overlap) was calculated between automated and manual segmentations of 2D-TSE (15 patients), 3D-TSE (16 patients), and corresponding T2 maps (31 patients). Pearson and intraclass correlation coefficients (ICC) were calculated between automated and manual T2 values. T2 values were compared (Wilcoxon rank sum tests) between torn and non-torn menisci for the subset of patients with both manual and automated segmentations to compare statistical outcomes of both methods. RESULTS: The Dice similarity index values for the 2D-TSE, 3D-TSE, and T2 map volumes, respectively, were 76.4%, 84.3%, and 75.2% for the MM and 76.4%, 85.1%, and 76.1% for the LM. There were strong correlations between automated and manual T2 values (rMM = 0.95, ICCMM = 0.94; rLM = 0.97, ICCLM = 0.97). For both the manual and the automated methods, T2 values were significantly higher in torn than in non-torn MM for the full meniscus and its subregions (P < .05). Non-torn LM had higher T2 values than non-torn MM (P < .05). CONCLUSIONS: The present automated method offers a promising alternative to manual T2 mapping analyses of the menisci and a considerable advance for integration into clinical workflows.

Electromechanical design and construction of a rotating radio-frequency coil system for applications in magnetic resonance.

While recent studies have shown that rotating a single radio-frequency (RF) coil during the acquisition of magnetic resonance (MR) images provides a number of hardware advantages (i.e., requires only one RF channel, avoids coil-coil coupling and facilitates large-scale multinuclear imaging), they did not describe in detail how to build a rotating RF coil system. This paper presents detailed engineering information on the electromechanical design and construction of a MR-compatible RRFC system for human head imaging at 2 T. A custom-made (bladeless) pneumatic Tesla turbine was used to rotate the RF coil at a constant velocity, while an infrared optical encoder measured the selected frequency of rotation. Once the rotating structure was mechanically balanced and the compressed air supply suitably regulated, the maximum frequency of rotation measured ~14.5 Hz with a 2.4% frequency variation over time. MR images of a water phantom and human head were obtained using the rotating RF head coil system.