Deep Learning for Automatic Calcium Scoring in CT: Validation Using Multiple Cardiac CT and Chest CT Protocols.

Background Although several deep learning (DL) calcium scoring methods have achieved excellent performance for specific CT protocols, their performance in a range of CT examination types is unknown. Purpose To evaluate the performance of a DL method for automatic calcium scoring across a wide range of CT examination types and to investigate whether the method can adapt to different types of CT examinations when representative images are added to the existing training data set. Materials and Methods The study included 7240 participants who underwent various types of nonenhanced CT examinations that included the heart: coronary artery calcium (CAC) scoring CT, diagnostic CT of the chest, PET attenuation correction CT, radiation therapy treatment planning CT, CAC screening CT, and low-dose CT of the chest. CAC and thoracic aorta calcification (TAC) were quantified using a convolutional neural network trained with (a) 1181 low-dose chest CT examinations (baseline), (b) a small set of examinations of the respective type supplemented to the baseline (data specific), and (c) a combination of examinations of all available types (combined). Supplemental training sets contained 199-568 CT images depending on the calcium burden of each population. The DL algorithm performance was evaluated with intraclass correlation coefficients (ICCs) between DL and manual (Agatston) CAC and (volume) TAC scoring and with linearly weighted κ values for cardiovascular risk categories (Agatston score; cardiovascular disease risk categories: 0, 1-10, 11-100, 101-400, >400). Results At baseline, the DL algorithm yielded ICCs of 0.79-0.97 for CAC and 0.66-0.98 for TAC across the range of different types of CT examinations. ICCs improved to 0.84-0.99 (CAC) and 0.92-0.99 (TAC) for CT protocol-specific training and to 0.85-0.99 (CAC) and 0.96-0.99 (TAC) for combined training. For assignment of cardiovascular disease risk category, the κ value for all test CT scans was 0.90 (95% confidence interval [CI]: 0.89, 0.91) for the baseline training. It increased to 0.92 (95% CI: 0.91, 0.93) for both data-specific and combined training. Conclusion A deep learning calcium scoring algorithm for quantification of coronary and thoracic calcium was robust, despite substantial differences in CT protocol and variations in subject population. Augmenting the algorithm training with CT protocol-specific images further improved algorithm performance. © RSNA, 2020 See also the editorial by Vannier in this issue.

Graph neural networks for automatic extraction and labeling of the coronary artery tree in CT angiography.

Purpose: Automatic comprehensive reporting of coronary artery disease (CAD) requires anatomical localization of the coronary artery pathologies. To address this, we propose a fully automatic method for extraction and anatomical labeling of the coronary artery tree using deep learning. Approach: We include coronary CT angiography (CCTA) scans of 104 patients from two hospitals. Reference annotations of coronary artery tree centerlines and labels of coronary artery segments were assigned to 10 segment classes following the American Heart Association guidelines. Our automatic method first extracts the coronary artery tree from CCTA, automatically placing a large number of seed points and simultaneous tracking of vessel-like structures from these points. Thereafter, the extracted tree is refined to retain coronary arteries only, which are subsequently labeled with a multi-resolution ensemble of graph convolutional neural networks that combine geometrical and image intensity information from adjacent segments. Results: The method is evaluated on its ability to extract the coronary tree and to label its segments, by comparing the automatically derived and the reference labels. A separate assessment of tree extraction yielded an F1 score of 0.85. Evaluation of our combined method leads to an average F1 score of 0.74. Conclusions: The results demonstrate that our method enables fully automatic extraction and anatomical labeling of coronary artery trees from CCTA scans. Therefore, it has the potential to facilitate detailed automatic reporting of CAD.

Competing risk analysis of cardiovascular disease risk in breast cancer patients receiving a radiation boost.

BACKGROUND: Thoracic radiotherapy may damage the myocardium and arteries, increasing cardiovascular disease (CVD) risk. Women with a high local breast cancer (BC) recurrence risk may receive an additional radiation boost to the tumor bed. OBJECTIVE: We aimed to evaluate the CVD risk and specifically ischemic heart disease (IHD) in BC patients treated with a radiation boost, and investigated whether this was modified by age. METHODS: We identified 5260 BC patients receiving radiotherapy between 2005 and 2016 without a history of CVD. Boost data were derived from hospital records and the national cancer registry. Follow-up data on CVD events were obtained from Statistics Netherlands until December 31, 2018. The relation between CVD and boost was evaluated with competing risk survival analysis. RESULTS: 1917 (36.4%) received a boost. Mean follow-up was 80.3 months (SD37.1) and the mean age 57.8 years (SD10.7). Interaction between boost and age was observed for IHD: a boost was significantly associated with IHD incidence in patients younger than 40 years but not in patients over 40 years. The subdistribution hazard ratio (sHR) was calculated for ages from 25 to 75 years, showing a sHR range from 5.1 (95%CI 1.2-22.6) for 25-year old patients to sHR 0.5 (95%CI 0.2-1.02) for 75-year old patients. CONCLUSION: In patients younger than 40, a radiation boost is significantly associated with an increased risk of CVD. In absolute terms, the increased risk was low. In older patients, there was no association between boost and CVD risk, which is likely a reflection of appropriate patient selection.

Learning coronary artery calcium scoring in coronary CTA from non-contrast CT using unsupervised domain adaptation.

Deep learning methods have demonstrated the ability to perform accurate coronary artery calcium (CAC) scoring. However, these methods require large and representative training data hampering applicability to diverse CT scans showing the heart and the coronary arteries. Training methods that accurately score CAC in cross-domain settings remains challenging. To address this, we present an unsupervised domain adaptation method that learns to perform CAC scoring in coronary CT angiography (CCTA) from non-contrast CT (NCCT). To address the domain shift between NCCT (source) domain and CCTA (target) domain, feature distributions are aligned between two domains using adversarial learning. A CAC scoring convolutional neural network is divided into a feature generator that maps input images to features in the latent space and a classifier that estimates predictions from the extracted features. For adversarial learning, a discriminator is used to distinguish the features between source and target domains. Hence, the feature generator aims to extract features with aligned distributions to fool the discriminator. The network is trained with adversarial loss as the objective function and a classification loss on the source domain as a constraint for adversarial learning. In the experiments, three data sets were used. The network is trained with 1,687 labeled chest NCCT scans from the National Lung Screening Trial. Furthermore, 200 labeled cardiac NCCT scans and 200 unlabeled CCTA scans were used to train the generator and the discriminator for unsupervised domain adaptation. Finally, a data set containing 313 manually labeled CCTA scans was used for testing. Directly applying the CAC scoring network trained on NCCT to CCTA led to a sensitivity of 0.41 and an average false positive volume 140 mm3/scan. The proposed method improved the sensitivity to 0.80 and reduced average false positive volume of 20 mm3/scan. The results indicate that the unsupervised domain adaptation approach enables automatic CAC scoring in contrast enhanced CT while learning from a large and diverse set of CT scans without contrast. This may allow for better utilization of existing annotated data sets and extend the applicability of automatic CAC scoring to contrast-enhanced CT scans without the need for additional manual annotations. The code is publicly available at https://github.com/qurAI-amsterdam/CACscoringUsingDomainAdaptation.

Generative models for reproducible coronary calcium scoring.

Purpose: Coronary artery calcium (CAC) score, i.e., the amount of CAC quantified in CT, is a strong and independent predictor of coronary heart disease (CHD) events. However, CAC scoring suffers from limited interscan reproducibility, which is mainly due to the clinical definition requiring application of a fixed intensity level threshold for segmentation of calcifications. This limitation is especially pronounced in non-electrocardiogram-synchronized computed tomography (CT) where lesions are more impacted by cardiac motion and partial volume effects. Therefore, we propose a CAC quantification method that does not require a threshold for segmentation of CAC. Approach: Our method utilizes a generative adversarial network (GAN) where a CT with CAC is decomposed into an image without CAC and an image showing only CAC. The method, using a cycle-consistent GAN, was trained using 626 low-dose chest CTs and 514 radiotherapy treatment planning (RTP) CTs. Interscan reproducibility was compared to clinical calcium scoring in RTP CTs of 1662 patients, each having two scans. Results: A lower relative interscan difference in CAC mass was achieved by the proposed method: 47% compared to 89% manual clinical calcium scoring. The intraclass correlation coefficient of Agatston scores was 0.96 for the proposed method compared to 0.91 for automatic clinical calcium scoring. Conclusions: The increased interscan reproducibility achieved by our method may lead to increased reliability of CHD risk categorization and improved accuracy of CHD event prediction.

AI-Based Quantification of Planned Radiation Therapy Dose to Cardiac Structures and Coronary Arteries in Patients With Breast Cancer.

PURPOSE: The purpose of this work is to develop and evaluate an automatic deep learning method for segmentation of cardiac chambers and large arteries, and localization of the 3 main coronary arteries in radiation therapy planning on computed tomography (CT). In addition, a second purpose is to determine the planned radiation therapy dose to cardiac structures for breast cancer therapy. METHODS AND MATERIALS: Eighteen contrast-enhanced cardiac scans acquired with a dual-layer-detector CT scanner were included for method development. Manual reference annotations of cardiac chambers, large arteries, and coronary artery locations were made in the contrast scans and transferred to virtual noncontrast images, mimicking noncontrast-enhanced CT. In addition, 31 noncontrast-enhanced radiation therapy treatment planning CTs with corresponding dose-distribution maps of breast cancer cases were included for evaluation. For reference, cardiac chambers and large vessels were manually annotated in two 2-dimensional (2D) slices per scan (26 scans, totaling 52 slices) and in 3-dimensional (3D) scan volumes in 5 scans. Coronary artery locations were annotated on 3D imaging. The method uses an ensemble of convolutional neural networks with 2 output branches that perform 2 distinct tasks: (1) segmentation of the cardiac chambers and large arteries and (2) localization of coronary arteries. Training was performed using reference annotations and virtual noncontrast cardiac scans. Automatic segmentation of the cardiac chambers and large vessels and the coronary artery locations was evaluated in radiation therapy planning CT with Dice score (DSC) and average symmetrical surface distance (ASSD). The correlation between dosimetric parameters derived from the automatic and reference segmentations was evaluated with R2. RESULTS: For cardiac chambers and large arteries, median DSC was 0.76 to 0.88, and the median ASSD was 0.17 to 0.27 cm in 2D slice evaluation. 3D evaluation found a DSC of 0.87 to 0.93 and an ASSD of 0.07 to 0.10 cm. Median DSC of the coronary artery locations ranged from 0.80 to 0.91. R2 values of dosimetric parameters were 0.77 to 1.00 for the cardiac chambers and large vessels, and 0.76 to 0.95 for the coronary arteries. CONCLUSIONS: The developed and evaluated method can automatically obtain accurate estimates of planned radiation dose and dosimetric parameters for the cardiac chambers, large arteries, and coronary arteries.

Deep learning-based detection of functionally significant stenosis in coronary CT angiography.

Patients with intermediate anatomical degree of coronary artery stenosis require determination of its functional significance. Currently, the reference standard for determining the functional significance of a stenosis is invasive measurement of the fractional flow reserve (FFR), which is associated with high cost and patient burden. To address these drawbacks, FFR can be predicted non-invasively from a coronary CT angiography (CCTA) scan. Hence, we propose a deep learning method for predicting the invasively measured FFR of an artery using a CCTA scan. The study includes CCTA scans of 569 patients from three hospitals. As reference for the functional significance of stenosis, FFR was measured in 514 arteries in 369 patients, and in the remaining 200 patients, obstructive coronary artery disease was ruled out by Coronary Artery Disease-Reporting and Data System (CAD-RADS) category 0 or 1. For prediction, the coronary tree is first extracted and used to reconstruct an MPR for the artery at hand. Thereafter, the coronary artery is characterized by its lumen, its attenuation and the area of the coronary artery calcium in each artery cross-section extracted from the MPR using a CNN. Additionally, characteristics indicating the presence of bifurcations and information indicating whether the artery is a main branch or a side-branch of a main artery are derived from the coronary artery tree. All characteristics are fed to a second network that predicts the FFR value and classifies the presence of functionally significant stenosis. The final result is obtained by merging the two predictions. Performance of our method is evaluated on held out test sets from multiple centers and vendors. The method achieves an area under the receiver operating characteristics curve (AUC) of 0.78, outperforming other works that do not require manual correction of the segmentation of the artery. This demonstrates that our method may reduce the number of patients that unnecessarily undergo invasive measurements.

AI-Based Radiation Dose Quantification for Estimation of Heart Disease Risk in Breast Cancer Survivors After Radiation Therapy.

PURPOSE: To investigate whether the dose planned for cardiac structures is associated with the risk of heart disease (HD) in patients with breast cancer treated with radiation therapy, and whether this association is modified by the presence of coronary artery calcification (CAC). METHODS AND MATERIALS: Radiation therapy planning computed tomographic (CT) scans and corresponding dose distribution maps of 5561 patients were collected, 5300 patients remained after the exclusion of ineligible patients and duplicates; 1899 patients received their CT scan before 2011, allowing long follow-up. CAC was detected automatically. Using an artificial intelligence-based method, the cardiac structures (heart, cardiac chambers, large arteries, 3 main coronary arteries) were segmented. The planned radiation dose to each structure separately and to the whole heart were determined. Patients were assigned to a low-, medium-, or high-dose group based on the dose to the respective heart structure. Information on HD hospitalization and mortality was obtained for each patient. The association of planned radiation dose to cardiac structures with risk of HD was investigated in patients with and without CAC using Cox proportional hazard analysis in the long follow-up population. Tests for interaction were performed. RESULTS: After a median follow-up of 96.0 months (interquartile range, 84.2-110.4 months) in the long follow-up group, 135 patients were hospitalized for HD or died of HD. If the dose to a structure increased 1 Gy, the relative HD risk increased by 3% to 11%. The absolute increase in HD risk was substantially higher in patients with CAC (event-ratelow-dose = 14-15 vs event-ratehigh-dose = 15-34 per 1000 person-years) than in patients without CAC (event-ratelow-dose = 6-8 vs event-ratehigh-dose = 5-17 per 1000 person-years). No interaction between CAC and radiation dose was found. CONCLUSIONS: Radiation exposure of cardiac structures is associated with increased risk of HD. Automatic segmentation of cardiac structures enables spatially localized dose estimation, which can aid in the prevention of radiation therapy-induced cardiac damage. This could be especially valuable in patients with breast cancer and CAC.

Identification of Risk of Cardiovascular Disease by Automatic Quantification of Coronary Artery Calcifications on Radiotherapy Planning CT Scans in Patients With Breast Cancer.

IMPORTANCE: Cardiovascular disease (CVD) is common in patients treated for breast cancer, especially in patients treated with systemic treatment and radiotherapy and in those with preexisting CVD risk factors. Coronary artery calcium (CAC), a strong independent CVD risk factor, can be automatically quantified on radiotherapy planning computed tomography (CT) scans and may help identify patients at increased CVD risk. OBJECTIVE: To evaluate the association of CAC with CVD and coronary artery disease (CAD) in patients with breast cancer. DESIGN, SETTING, AND PARTICIPANTS: In this multicenter cohort study of 15 915 patients with breast cancer receiving radiotherapy between 2005 and 2016 who were followed until December 31, 2018, age, calendar year, and treatment-adjusted Cox proportional hazard models were used to evaluate the association of CAC with CVD and CAD. EXPOSURES: Overall CAC scores were automatically extracted from planning CT scans using a deep learning algorithm. Patients were classified into Agatston risk categories (0, 1-10, 11-100, 101-399, >400 units). MAIN OUTCOMES AND MEASURES: Occurrence of fatal and nonfatal CVD and CAD were obtained from national registries. RESULTS: Of the 15 915 participants included in this study, the mean (SD) age at CT scan was 59.0 (11.2; range, 22-95) years, and 15 879 (99.8%) were women. Seventy percent (n = 11 179) had no CAC. Coronary artery calcium scores of 1 to 10, 11 to 100, 101 to 400, and greater than 400 were present in 10.0% (n = 1584), 11.5% (n = 1825), 5.2% (n = 830), and 3.1% (n = 497) respectively. After a median follow-up of 51.2 months, CVD risks increased from 5.2% in patients with no CAC to 28.2% in patients with CAC scores higher than 400. After adjustment, CVD risk increased with higher CAC score (hazard ratio [HR]CAC = 1-10 = 1.1; 95% CI, 0.9-1.4; HRCAC = 11-100 = 1.8; 95% CI, 1.5-2.1; HRCAC = 101-400 = 2.1; 95% CI, 1.7-2.6; and HRCAC>400 = 3.4; 95% CI, 2.8-4.2). Coronary artery calcium was particularly strongly associated with CAD (HRCAC>400 = 7.8; 95% CI, 5.5-11.2). The association between CAC and CVD was strongest in patients treated with anthracyclines (HRCAC>400 = 5.8; 95% CI, 3.0-11.4) and patients who received a radiation boost (HRCAC>400 = 6.1; 95% CI, 3.8-9.7). CONCLUSIONS AND RELEVANCE: This cohort study found that coronary artery calcium on breast cancer radiotherapy planning CT scan results was associated with CVD, especially CAD. Automated CAC scoring on radiotherapy planning CT scans may be used as a fast and low-cost tool to identify patients with breast cancer at increased risk of CVD, allowing implementing CVD risk-mitigating strategies with the aim to reduce the risk of CVD burden after breast cancer. TRIAL REGISTRATION: ClinicalTrials.gov Identifier: NCT03206333.

Machine Learning for Assessment of Coronary Artery Disease in Cardiac CT: A Survey.

Cardiac computed tomography (CT) allows rapid visualization of the heart and coronary arteries with high spatial resolution. However, analysis of cardiac CT scans for manifestation of coronary artery disease is time-consuming and challenging. Machine learning (ML) approaches have the potential to address these challenges with high accuracy and consistent performance. In this mini review, we present a survey of the literature on ML-based analysis of coronary artery disease in cardiac CT. We summarize ML methods for detection and characterization of atherosclerotic plaque as well as anatomically and functionally significant coronary artery stenosis.

Bragatston study protocol: a multicentre cohort study on automated quantification of cardiovascular calcifications on radiotherapy planning CT scans for cardiovascular risk prediction in patients with breast cancer.

INTRODUCTION: Cardiovascular disease (CVD) is an important cause of death in breast cancer survivors. Some breast cancer treatments including anthracyclines, trastuzumab and radiotherapy can increase the risk of CVD, especially for patients with pre-existing CVD risk factors. Early identification of patients at increased CVD risk may allow switching to less cardiotoxic treatments, active surveillance or treatment of CVD risk factors. One of the strongest independent CVD risk factors is the presence and extent of coronary artery calcifications (CAC). In clinical practice, CAC are generally quantified on ECG-triggered cardiac CT scans. Patients with breast cancer treated with radiotherapy routinely undergo radiotherapy planning CT scans of the chest, and those scans could provide the opportunity to routinely assess CAC before a potentially cardiotoxic treatment. The Bragatston study aims to investigate the association between calcifications in the coronary arteries, aorta and heart valves (hereinafter called 'cardiovascular calcifications') measured automatically on planning CT scans of patients with breast cancer and CVD risk. METHODS AND ANALYSIS: In a first step, we will optimise and validate a deep learning algorithm for automated quantification of cardiovascular calcifications on planning CT scans of patients with breast cancer. Then, in a multicentre cohort study (University Medical Center Utrecht, Utrecht, Erasmus MC Cancer Institute, Rotterdam and Radboudumc, Nijmegen, The Netherlands), the association between cardiovascular calcifications measured on planning CT scans of patients with breast cancer (n≈16 000) and incident (non-)fatal CVD events will be evaluated. To assess the added predictive value of these calcifications over traditional CVD risk factors and treatment characteristics, a case-cohort analysis will be performed among all cohort members diagnosed with a CVD event during follow-up (n≈200) and a random sample of the baseline cohort (n≈600). ETHICS AND DISSEMINATION: The Institutional Review Boards of the participating hospitals decided that the Medical Research Involving Human Subjects Act does not apply. Findings will be published in peer-reviewed journals and presented at conferences. TRIAL REGISTRATION NUMBER: NCT03206333.

Automatic quantification of calcifications in the coronary arteries and thoracic aorta on radiotherapy planning CT scans of Western and Asian breast cancer patients.

PURPOSE: This study automatically quantified calcifications in coronary arteries (CAC) and thoracic aorta (TAC) on breast planning computed tomography (CT) scans and assessed its reproducibility compared to manual scoring. MATERIAL AND METHODS: Dutch (n = 1199) and Singaporean (n = 1090) breast cancer patients with radiotherapy planning CT scan were included. CAC and TAC were automatically scored using deep learning algorithm. CVD risk categories were based on Agatson CAC: 0, 1-10, 11-100, 101-400 and >400. Reliability between automatic and manual scoring was assessed in 120 randomly selected CT scans from each population, with linearly weighted kappa for CAC categories and intraclass correlation coefficient for TAC. RESULTS: Median age was higher in Dutch patients than Singaporean patients: 57 versus 52 years. CAC and TAC increased with age and were more present in Dutch patients than Singaporean patients: 24.2% versus 17.3% and 73.0% versus 62.2%, respectively. Reliability of CAC categories and TAC was excellent in the Netherlands (0.85 (95% confidence interval (CI) = 0.77-0.93) and 0.98 (95% CI = 0.96-0.98) respectively) and Singapore (0.90 (95% CI = 0.84-0.96) and 0.99 (95% CI = 0.98-0.99) respectively). CONCLUSIONS: CAC and TAC prevalence was considerable and increased with age. Deep learning software is a reliable method to automatically measure CAC and TAC on radiotherapy breast CT scans.