PSFHS challenge report: Pubic symphysis and fetal head segmentation from intrapartum ultrasound images.

Segmentation of the fetal and maternal structures, particularly intrapartum ultrasound imaging as advocated by the International Society of Ultrasound in Obstetrics and Gynecology (ISUOG) for monitoring labor progression, is a crucial first step for quantitative diagnosis and clinical decision-making. This requires specialized analysis by obstetrics professionals, in a task that i) is highly time- and cost-consuming and ii) often yields inconsistent results. The utility of automatic segmentation algorithms for biometry has been proven, though existing results remain suboptimal. To push forward advancements in this area, the Grand Challenge on Pubic Symphysis-Fetal Head Segmentation (PSFHS) was held alongside the 26th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI 2023). This challenge aimed to enhance the development of automatic segmentation algorithms at an international scale, providing the largest dataset to date with 5,101 intrapartum ultrasound images collected from two ultrasound machines across three hospitals from two institutions. The scientific community's enthusiastic participation led to the selection of the top 8 out of 179 entries from 193 registrants in the initial phase to proceed to the competition's second stage. These algorithms have elevated the state-of-the-art in automatic PSFHS from intrapartum ultrasound images. A thorough analysis of the results pinpointed ongoing challenges in the field and outlined recommendations for future work. The top solutions and the complete dataset remain publicly available, fostering further advancements in automatic segmentation and biometry for intrapartum ultrasound imaging.

Fetal Head and Pubic Symphysis Segmentation in Intrapartum Ultrasound Image Using a Dual-Path Boundary-Guided Residual Network.

Accurate segmentation of the fetal head and pubic symphysis in intrapartum ultrasound images and measurement of fetal angle of progression (AoP) are critical to both outcome prediction and complication prevention in delivery. However, due to poor quality of perinatal ultrasound imaging with blurred target boundaries and the relatively small target of the public symphysis, fully automated and accurate segmentation remains challenging. In this paper, we propse a dual-path boundary-guided residual network (DBRN), which is a novel approach to tackle these challenges. The model contains a multi-scale weighted module (MWM) to gather global context information, and enhance the feature response within the target region by weighting the feature map. The model also incorporates an enhanced boundary module (EBM) to obtain more precise boundary information. Furthermore, the model introduces a boundary-guided dual-attention residual module (BDRM) for residual learning. BDRM leverages boundary information as prior knowledge and employs spatial attention to simultaneously focus on background and foreground information, in order to capture concealed details and improve segmentation accuracy. Extensive comparative experiments have been conducted on three datasets. The proposed method achieves average Dice score of 0.908 ±0.05 and average Hausdorff distance of 3.396 ±0.66 mm. Compared with state-of-the-art competitors, the proposed DBRN achieves better results. In addition, the average difference between the automatic measurement of AoPs based on this model and the manual measurement results is 6.157 °, which has good consistency and has broad application prospects in clinical practice.

Radiomics analysis enhances the diagnostic performance of CMR stress perfusion: a proof-of-concept study using the Dan-NICAD dataset.

Objectives: To assess the feasibility of extracting radiomics signal intensity based features from the myocardium using cardiovascular magnetic resonance (CMR) imaging stress perfusion sequences. Furthermore, to compare the diagnostic performance of radiomics models against standard-of-care qualitative visual assessment of stress perfusion images, with the ground truth stenosis label being defined by invasive Fractional Flow Reserve (FFR) and quantitative coronary angiography. Methods: We used the Dan-NICAD 1 dataset, a multi-centre study with coronary computed tomography angiography, 1,5 T CMR stress perfusion, and invasive FFR available for a subset of 148 patients with suspected coronary artery disease. Image segmentation was performed by two independent readers. We used the Pyradiomics platform to extract radiomics first-order (n = 14) and texture (n = 75) features from the LV myocardium (basal, mid, apical) in rest and stress perfusion images. Results: Overall, 92 patients (mean age 62 years, 56 men) were included in the study, 39 with positive FFR. We double-cross validated the model and, in each inner fold, we trained and validated a per territory model. The conventional analysis results reported sensitivity of 41% and specificity of 84%. Our final radiomics model demonstrated an improvement on these results with an average sensitivity of 53% and specificity of 86%. Conclusion: In this proof-of-concept study from the Dan-NICAD dataset, we demonstrate the feasibility of radiomics analysis applied to CMR perfusion images with a suggestion of superior diagnostic performance of radiomics models over conventional visual analysis of perfusion images in picking up perfusion defects defined by invasive coronary angiography.

Deep Learning Segmentation of the Right Ventricle in Cardiac MRI: The M&Ms Challenge.

In recent years, several deep learning models have been proposed to accurately quantify and diagnose cardiac pathologies. These automated tools heavily rely on the accurate segmentation of cardiac structures in MRI images. However, segmentation of the right ventricle is challenging due to its highly complex shape and ill-defined borders. Hence, there is a need for new methods to handle such structure's geometrical and textural complexities, notably in the presence of pathologies such as Dilated Right Ventricle, Tricuspid Regurgitation, Arrhythmogenesis, Tetralogy of Fallot, and Inter-atrial Communication. The last MICCAI challenge on right ventricle segmentation was held in 2012 and included only 48 cases from a single clinical center. As part of the 12th Workshop on Statistical Atlases and Computational Models of the Heart (STACOM 2021), the M&Ms-2 challenge was organized to promote the interest of the research community around right ventricle segmentation in multi-disease, multi-view, and multi-center cardiac MRI. Three hundred sixty CMR cases, including short-axis and long-axis 4-chamber views, were collected from three Spanish hospitals using nine different scanners from three different vendors, and included a diverse set of right and left ventricle pathologies. The solutions provided by the participants show that nnU-Net achieved the best results overall. However, multi-view approaches were able to capture additional information, highlighting the need to integrate multiple cardiac diseases, views, scanners, and acquisition protocols to produce reliable automatic cardiac segmentation algorithms.

Image-Based Biological Heart Age Estimation Reveals Differential Aging Patterns Across Cardiac Chambers.

BACKGROUND: Biological heart age estimation can provide insights into cardiac aging. However, existing studies do not consider differential aging across cardiac regions. PURPOSE: To estimate biological age of the left ventricle (LV), right ventricle (RV), myocardium, left atrium, and right atrium using magnetic resonance imaging radiomics phenotypes and to investigate determinants of aging by cardiac region. STUDY TYPE: Cross-sectional. POPULATION: A total of 18,117 healthy UK Biobank participants including 8338 men (mean age = 64.2 ± 7.5) and 9779 women (mean age = 63.0 ± 7.4). FIELD STRENGTH/SEQUENCE: A 1.5 T/balanced steady-state free precession. ASSESSMENT: An automated algorithm was used to segment the five cardiac regions, from which radiomic features were extracted. Bayesian ridge regression was used to estimate biological age of each cardiac region with radiomics features as predictors and chronological age as the output. The "age gap" was the difference between biological and chronological age. Linear regression was used to calculate associations of age gap from each cardiac region with socioeconomic, lifestyle, body composition, blood pressure and arterial stiffness, blood biomarkers, mental well-being, multiorgan health, and sex hormone exposures (n = 49). STATISTICAL TEST: Multiple testing correction with false discovery method (threshold = 5%). RESULTS: The largest model error was with RV and the smallest with LV age (mean absolute error in men: 5.26 vs. 4.96 years). There were 172 statistically significant age gap associations. Greater visceral adiposity was the strongest correlate of larger age gaps, for example, myocardial age gap in women (Beta = 0.85, P = 1.69 × 10-26 ). Poor mental health associated with large age gaps, for example, "disinterested" episodes and myocardial age gap in men (Beta = 0.25, P = 0.001), as did a history of dental problems (eg LV in men Beta = 0.19, P = 0.02). Higher bone mineral density was the strongest associate of smaller age gaps, for example, myocardial age gap in men (Beta = -1.52, P = 7.44 × 10-6 ). DATA CONCLUSION: This work demonstrates image-based heart age estimation as a novel method for understanding cardiac aging. EVIDENCE LEVEL: 1. TECHNICAL EFFICACY: Stage 1.

Generalisability of fetal ultrasound deep learning models to low-resource imaging settings in five African countries.

Most artificial intelligence (AI) research and innovations have concentrated in high-income countries, where imaging data, IT infrastructures and clinical expertise are plentiful. However, slower progress has been made in limited-resource environments where medical imaging is needed. For example, in Sub-Saharan Africa, the rate of perinatal mortality is very high due to limited access to antenatal screening. In these countries, AI models could be implemented to help clinicians acquire fetal ultrasound planes for the diagnosis of fetal abnormalities. So far, deep learning models have been proposed to identify standard fetal planes, but there is no evidence of their ability to generalise in centres with low resources, i.e. with limited access to high-end ultrasound equipment and ultrasound data. This work investigates for the first time different strategies to reduce the domain-shift effect arising from a fetal plane classification model trained on one clinical centre with high-resource settings and transferred to a new centre with low-resource settings. To that end, a classifier trained with 1792 patients from Spain is first evaluated on a new centre in Denmark in optimal conditions with 1008 patients and is later optimised to reach the same performance in five African centres (Egypt, Algeria, Uganda, Ghana and Malawi) with 25 patients each. The results show that a transfer learning approach for domain adaptation can be a solution to integrate small-size African samples with existing large-scale databases in developed countries. In particular, the model can be re-aligned and optimised to boost the performance on African populations by increasing the recall to [Formula: see text] and at the same time maintaining a high precision across centres. This framework shows promise for building new AI models generalisable across clinical centres with limited data acquired in challenging and heterogeneous conditions and calls for further research to develop new solutions for the usability of AI in countries with fewer resources and, consequently, in higher need of clinical support.

Prediction of incident cardiovascular events using machine learning and CMR radiomics.

OBJECTIVES: Evaluation of the feasibility of using cardiovascular magnetic resonance (CMR) radiomics in the prediction of incident atrial fibrillation (AF), heart failure (HF), myocardial infarction (MI), and stroke using machine learning techniques. METHODS: We identified participants from the UK Biobank who experienced incident AF, HF, MI, or stroke during the continuous longitudinal follow-up. The CMR indices and the vascular risk factors (VRFs) as well as the CMR images were obtained for each participant. Three-segmented regions of interest (ROIs) were computed: right ventricle cavity, left ventricle (LV) cavity, and LV myocardium in end-systole and end-diastole phases. Radiomics features were extracted from the 3D volumes of the ROIs. Seven integrative models were built for each incident cardiovascular disease (CVD) as an outcome. Each model was built with VRF, CMR indices, and radiomics features and a combination of them. Support vector machine was used for classification. To assess the model performance, the accuracy, sensitivity, specificity, and AUC were reported. RESULTS: AF prediction model using the VRF+CMR+Rad model (accuracy: 0.71, AUC 0.76) obtained the best result. However, the AUC was similar to the VRF+Rad model. HF showed the most significant improvement with the inclusion of CMR metrics (VRF+CMR+Rad: 0.79, AUC 0.84). Moreover, adding only the radiomics features to the VRF reached an almost similarly good performance (VRF+Rad: accuracy 0.77, AUC 0.83). Prediction models looking into incident MI and stroke reached slightly smaller improvement. CONCLUSIONS: Radiomics features may provide incremental predictive value over VRF and CMR indices in the prediction of incident CVDs. KEY POINTS: • Prediction of incident atrial fibrillation, heart failure, stroke, and myocardial infarction using machine learning techniques. • CMR radiomics, vascular risk factors, and standard CMR indices will be considered in the machine learning models. • The experiments show that radiomics features can provide incremental predictive value over VRF and CMR indices in the prediction of incident cardiovascular diseases.

Atrial fibrillation prediction by combining ECG markers and CMR radiomics.

Atrial fibrillation (AF) is the most common cardiac arrhythmia. It is associated with a higher risk of important adverse health outcomes such as stroke and death. AF is linked to distinct electro-anatomic alterations. The main tool for AF diagnosis is the Electrocardiogram (ECG). However, an ECG recorded at a single time point may not detect individuals with paroxysmal AF. In this study, we developed machine learning models for discrimination of prevalent AF using a combination of image-derived radiomics phenotypes and ECG features. Thus, we characterize the phenotypes of prevalent AF in terms of ECG and imaging alterations. Moreover, we explore sex-differential remodelling by building sex-specific models. Our integrative model including radiomics and ECG together resulted in a better performance than ECG alone, particularly in women. ECG had a lower performance in women than men (AUC: 0.77 vs 0.88, p < 0.05) but adding radiomics features, the accuracy of the model was able to improve significantly. The sensitivity also increased considerably in women by adding the radiomics (0.68 vs 0.79, p < 0.05) having a higher detection of AF events. Our findings provide novel insights into AF-related electro-anatomic remodelling and its variations by sex. The integrative radiomics-ECG model also presents a potential novel approach for earlier detection of AF.

Cardiac aging synthesis from cross-sectional data with conditional generative adversarial networks.

Age has important implications for health, and understanding how age manifests in the human body is the first step for a potential intervention. This becomes especially important for cardiac health, since age is the main risk factor for development of cardiovascular disease. Data-driven modeling of age progression has been conducted successfully in diverse applications such as face or brain aging. While longitudinal data is the preferred option for training deep learning models, collecting such a dataset is usually very costly, especially in medical imaging. In this work, a conditional generative adversarial network is proposed to synthesize older and younger versions of a heart scan by using only cross-sectional data. We train our model with more than 14,000 different scans from the UK Biobank. The induced modifications focused mainly on the interventricular septum and the aorta, which is consistent with the existing literature in cardiac aging. We evaluate the results by measuring image quality, the mean absolute error for predicted age using a pre-trained regressor, and demonstrate the application of synthetic data for counter-balancing biased datasets. The results suggest that the proposed approach is able to model realistic changes in the heart using only cross-sectional data and that these data can be used to correct age bias in a dataset.

Domain generalization in deep learning for contrast-enhanced imaging.

BACKGROUND: The domain generalization problem has been widely investigated in deep learning for non-contrast imaging over the last years, but it received limited attention for contrast-enhanced imaging. However, there are marked differences in contrast imaging protocols across clinical centers, in particular in the time between contrast injection and image acquisition, while access to multi-center contrast-enhanced image data is limited compared to available datasets for non-contrast imaging. This calls for new tools for generalizing single-domain, single-center deep learning models across new unseen domains and clinical centers in contrast-enhanced imaging. METHODS: In this paper, we present an exhaustive evaluation of deep learning techniques to achieve generalizability to unseen clinical centers for contrast-enhanced image segmentation. To this end, several techniques are investigated, optimized and systematically evaluated, including data augmentation, domain mixing, transfer learning and domain adaptation. To demonstrate the potential of domain generalization for contrast-enhanced imaging, the methods are evaluated for ventricular segmentation in contrast-enhanced cardiac magnetic resonance imaging (MRI). RESULTS: The results are obtained based on a multi-center cardiac contrast-enhanced MRI dataset acquired in four hospitals located in three countries (France, Spain and China). They show that the combination of data augmentation and transfer learning can lead to single-center models that generalize well to new clinical centers not included during training. CONCLUSIONS: Single-domain neural networks enriched with suitable generalization procedures can reach and even surpass the performance of multi-center, multi-vendor models in contrast-enhanced imaging, hence eliminating the need for comprehensive multi-center datasets to train generalizable models.

Cardiac segmentation on late gadolinium enhancement MRI: A benchmark study from multi-sequence cardiac MR segmentation challenge.

Accurate computing, analysis and modeling of the ventricles and myocardium from medical images are important, especially in the diagnosis and treatment management for patients suffering from myocardial infarction (MI). Late gadolinium enhancement (LGE) cardiac magnetic resonance (CMR) provides an important protocol to visualize MI. However, compared with the other sequences LGE CMR images with gold standard labels are particularly limited. This paper presents the selective results from the Multi-Sequence Cardiac MR (MS-CMR) Segmentation challenge, in conjunction with MICCAI 2019. The challenge offered a data set of paired MS-CMR images, including auxiliary CMR sequences as well as LGE CMR, from 45 patients who underwent cardiomyopathy. It was aimed to develop new algorithms, as well as benchmark existing ones for LGE CMR segmentation focusing on myocardial wall of the left ventricle and blood cavity of the two ventricles. In addition, the paired MS-CMR images could enable algorithms to combine the complementary information from the other sequences for the ventricle segmentation of LGE CMR. Nine representative works were selected for evaluation and comparisons, among which three methods are unsupervised domain adaptation (UDA) methods and the other six are supervised. The results showed that the average performance of the nine methods was comparable to the inter-observer variations. Particularly, the top-ranking algorithms from both the supervised and UDA methods could generate reliable and robust segmentation results. The success of these methods was mainly attributed to the inclusion of the auxiliary sequences from the MS-CMR images, which provide important label information for the training of deep neural networks. The challenge continues as an ongoing resource, and the gold standard segmentation as well as the MS-CMR images of both the training and test data are available upon registration via its homepage (www.sdspeople.fudan.edu.cn/zhuangxiahai/0/mscmrseg/).

Minimising multi-centre radiomics variability through image normalisation: a pilot study.

Radiomics is an emerging technique for the quantification of imaging data that has recently shown great promise for deeper phenotyping of cardiovascular disease. Thus far, the technique has been mostly applied in single-centre studies. However, one of the main difficulties in multi-centre imaging studies is the inherent variability of image characteristics due to centre differences. In this paper, a comprehensive analysis of radiomics variability under several image- and feature-based normalisation techniques was conducted using a multi-centre cardiovascular magnetic resonance dataset. 218 subjects divided into healthy (n = 112) and hypertrophic cardiomyopathy (n = 106, HCM) groups from five different centres were considered. First and second order texture radiomic features were extracted from three regions of interest, namely the left and right ventricular cavities and the left ventricular myocardium. Two methods were used to assess features' variability. First, feature distributions were compared across centres to obtain a distribution similarity index. Second, two classification tasks were proposed to assess: (1) the amount of centre-related information encoded in normalised features (centre identification) and (2) the generalisation ability for a classification model when trained on these features (healthy versus HCM classification). The results showed that the feature-based harmonisation technique ComBat is able to remove the variability introduced by centre information from radiomic features, at the expense of slightly degrading classification performance. Piecewise linear histogram matching normalisation gave features with greater generalisation ability for classification ( balanced accuracy in between 0.78 ± 0.08 and 0.79 ± 0.09). Models trained with features from images without normalisation showed the worst performance overall ( balanced accuracy in between 0.45 ± 0.28 and 0.60 ± 0.22). In conclusion, centre-related information removal did not imply good generalisation ability for classification.

Mathematical Abilities in School-Aged Children: A Structural Magnetic Resonance Imaging Analysis With Radiomics.

Structural magnetic resonance imaging (sMRI) studies have shown that children that differ in some mathematical abilities show differences in gray matter volume mainly in parietal and frontal regions that are involved in number processing, attentional control, and memory. In the present study, a structural neuroimaging analysis based on radiomics and machine learning models is presented with the aim of identifying the brain areas that better predict children's performance in a variety of mathematical tests. A sample of 77 school-aged children from third to sixth grade were administered four mathematical tests: Math fluency, Calculation, Applied problems and Quantitative concepts as well as a structural brain imaging scan. By extracting radiomics related to the shape, intensity, and texture of specific brain areas, we observed that areas from the frontal, parietal, temporal, and occipital lobes, basal ganglia, and limbic system, were differentially related to children's performance in the mathematical tests. sMRI-based analyses in the context of mathematical performance have been mainly focused on volumetric measures. However, the results for radiomics-based analysis showed that for these areas, texture features were the most important for the regression models, while volume accounted for less than 15% of the shape importance. These findings highlight the potential of radiomics for more in-depth analysis of medical images for the identification of brain areas related to mathematical abilities.

Radiomics-Based Classification of Left Ventricular Non-compaction, Hypertrophic Cardiomyopathy, and Dilated Cardiomyopathy in Cardiovascular Magnetic Resonance.

Left Ventricular (LV) Non-compaction (LVNC), Hypertrophic Cardiomyopathy (HCM), and Dilated Cardiomyopathy (DCM) share morphological and functional traits that increase the diagnosis complexity. Additional clinical information, besides imaging data such as cardiovascular magnetic resonance (CMR), is usually required to reach a definitive diagnosis, including electrocardiography (ECG), family history, and genetics. Alternatively, indices of hypertrabeculation have been introduced, but they require tedious and time-consuming delineations of the trabeculae on the CMR images. In this paper, we propose a radiomics approach to automatically encode differences in the underlying shape, gray-scale and textural information in the myocardium and its trabeculae, which may enhance the capacity to differentiate between these overlapping conditions. A total of 118 subjects, including 35 patients with LVNC, 25 with HCM, 37 with DCM, as well as 21 healthy volunteers (NOR), underwent CMR imaging. A comprehensive radiomics characterization was applied to LV short-axis images to quantify shape, first-order, co-occurrence matrix, run-length matrix, and local binary patterns. Conventional CMR indices (LV volumes, mass, wall thickness, LV ejection fraction-LVEF-), as well as hypertrabeculation indices by Petersen and Jacquier, were also analyzed. State-of-the-art Machine Learning (ML) models (one-vs.-rest Support Vector Machine-SVM-, Logistic Regression-LR-, and Random Forest Classifier-RF-) were used for one-vs.-rest classification tasks. The use of radiomics models for the automated diagnosis of LVNC, HCM, and DCM resulted in excellent one-vs.-rest ROC-AUC values of 0.95 while generating these results without the need for the delineation of the trabeculae. First-order and texture features resulted to be among the most discriminative features in the obtained radiomics signatures, indicating their added value for quantifying relevant tissue patterns in cardiomyopathy differential diagnosis.

Multi-Centre, Multi-Vendor and Multi-Disease Cardiac Segmentation: The M&Ms Challenge.

The emergence of deep learning has considerably advanced the state-of-the-art in cardiac magnetic resonance (CMR) segmentation. Many techniques have been proposed over the last few years, bringing the accuracy of automated segmentation close to human performance. However, these models have been all too often trained and validated using cardiac imaging samples from single clinical centres or homogeneous imaging protocols. This has prevented the development and validation of models that are generalizable across different clinical centres, imaging conditions or scanner vendors. To promote further research and scientific benchmarking in the field of generalizable deep learning for cardiac segmentation, this paper presents the results of the Multi-Centre, Multi-Vendor and Multi-Disease Cardiac Segmentation (M&Ms) Challenge, which was recently organized as part of the MICCAI 2020 Conference. A total of 14 teams submitted different solutions to the problem, combining various baseline models, data augmentation strategies, and domain adaptation techniques. The obtained results indicate the importance of intensity-driven data augmentation, as well as the need for further research to improve generalizability towards unseen scanner vendors or new imaging protocols. Furthermore, we present a new resource of 375 heterogeneous CMR datasets acquired by using four different scanner vendors in six hospitals and three different countries (Spain, Canada and Germany), which we provide as open-access for the community to enable future research in the field.

Cardiac magnetic resonance radiomics: basic principles and clinical perspectives.

Radiomics is a novel image analysis technique, whereby voxel-level information is extracted from digital images and used to derive multiple numerical quantifiers of shape and tissue character. Cardiac magnetic resonance (CMR) is the reference imaging modality for assessment of cardiac structure and function. Conventional analysis of CMR scans is mostly reliant on qualitative image analysis and basic geometric quantifiers. Small proof-of-concept studies have demonstrated the feasibility and superior diagnostic accuracy of CMR radiomics analysis over conventional reporting. CMR radiomics has the potential to transform our approach to defining image phenotypes and, through this, improve diagnostic accuracy, treatment selection, and prognostication. The purpose of this article is to provide an overview of radiomics concepts for clinicians, with particular consideration of application to CMR. We will also review existing literature on CMR radiomics, discuss challenges, and consider directions for future work.

Image-Based Cardiac Diagnosis With Machine Learning: A Review.

Cardiac imaging plays an important role in the diagnosis of cardiovascular disease (CVD). Until now, its role has been limited to visual and quantitative assessment of cardiac structure and function. However, with the advent of big data and machine learning, new opportunities are emerging to build artificial intelligence tools that will directly assist the clinician in the diagnosis of CVDs. This paper presents a thorough review of recent works in this field and provide the reader with a detailed presentation of the machine learning methods that can be further exploited to enable more automated, precise and early diagnosis of most CVDs.