An iterative multi-path fully convolutional neural network for automatic cardiac segmentation in cine MR images.

ABSTRACT

PURPOSE: Segmentation of the left ventricle (LV), right ventricle (RV) cavities and the myocardium (MYO) from cine cardiac magnetic resonance (MR) images is an important step for diagnosis and monitoring cardiac diseases. Spatial context information may be highly beneficial for segmentation performance improvement. To this end, this paper proposes an iterative multi-path fully convolutional network (IMFCN) to effectively leverage spatial context for automatic cardiac segmentation in cine MR images. METHODS: To effectively leverage spatial context information, the proposed IMFCN explicitly models the interslice spatial correlations using a multi-path late fusion strategy. First, the contextual inputs including both the adjacent slices and the already predicted mask of the above adjacent slice are processed by independent feature-extraction paths. Then, an atrous spatial pyramid pooling (ASPP) module is employed at the feature fusion process to combine the extracted high-level contextual features in a more effective way. Finally, deep supervision (DS) and batch-wise class re-weighting mechanism are utilized to enhance the training of the proposed network. RESULTS: The proposed IMFCN was evaluated and analyzed on the MICCAI 2017 automatic cardiac diagnosis challenge (ACDC) dataset. On the held-out training dataset reserved for testing, our method effectively improved its counterparts that without spatial context and that with spatial context but using an early fusion strategy. On the 50 subjects test dataset, our method achieved Dice similarity coefficient of 0.935, 0.920, and 0.905, and Hausdorff distance of 7.66, 12.10, and 8.80 mm for LV, RV, and MYO, respectively, which are comparable or even better than the state-of-the-art methods of ACDC Challenge. In addition, to explore the applicability to other datasets, the proposed IMFCN was retrained on the Sunnybrook dataset for LV segmentation and also produced comparable performance to the state-of-the-art methods. CONCLUSIONS: We have presented an automatic end-to-end fully convolutional architecture for accurate cardiac segmentation. The proposed method provides an effective way to leverage spatial context in a two-dimensional manner and results in precise and consistent segmentation results.