Enhancing cardiovascular risk prediction through AI-enabled calcium-omics.

Whole-heart coronary calcium Agatston score is a well-established predictor of major adverse cardiovascular events (MACE), but it does not account for individual calcification features related to the pathophysiology of the disease (e.g., multiple-vessel disease, spread of the disease along the vessel, stable calcifications, numbers of lesions, and density). We used novel, hand-crafted calcification features (calcium-omics); Cox time-to-event modeling; elastic net; and up and down synthetic sampling methods for imbalanced data, to assess MACE risk. We used 2457 CT calcium score (CTCS) images enriched for MACE events from our large no-cost CLARIFY program (ClinicalTrials.gov Identifier: NCT04075162). Among calcium-omics features, numbers of calcifications, LAD mass, and diffusivity (a measure of spatial distribution) were especially important determinants of increased risk, with dense calcification (> 1000HU, stable calcifications) associated with reduced risk Our calcium-omics model with (training/testing, 80/20) gave C-index (80.5%/71.6%) and 2-year AUC (82.4%/74.8%). Although the C-index is notoriously impervious to model improvements, calcium-omics compared favorably to Agatston and gave a significant difference (P < 0.001). The calcium-omics model identified 73.5% of MACE cases in the high-risk group, a 13.2% improvement as compared to Agatston, suggesting that calcium-omics could be used to better identity candidates for intensive follow-up and therapies. The categorical net-reclassification index was NRI = 0.153. Our findings from this exploratory study suggest the utility of calcium-omics in improved risk prediction. These promising results will pave the way for more extensive, multi-institutional studies of calcium-omics.

AI prediction of cardiovascular events using opportunistic epicardial adipose tissue assessments from CT calcium score.

Background: Recent studies have used basic epicardial adipose tissue (EAT) assessments (e.g., volume and mean HU) to predict risk of atherosclerosis-related, major adverse cardiovascular events (MACE). Objectives: Create novel, hand-crafted EAT features, "fat-omics", to capture the pathophysiology of EAT and improve MACE prediction. Methods: We segmented EAT using a previously-validated deep learning method with optional manual correction. We extracted 148 radiomic features (morphological, spatial, and intensity) and used Cox elastic-net for feature reduction and prediction of MACE. Results: Traditional fat features gave marginal prediction (EAT-volume/EAT-mean-HU/BMI gave C-index 0.53/0.55/0.57, respectively). Significant improvement was obtained with 15 fat-omics features (C-index=0.69, test set). High-risk features included volume-of-voxels-having-elevated-HU-[-50, -30-HU] and HU-negative-skewness, both of which assess high HU, which as been implicated in fat inflammation. Other high-risk features include kurtosis-of-EAT-thickness, reflecting the heterogeneity of thicknesses, and EAT-volume-in-the-top-25%-of-the-heart, emphasizing adipose near the proximal coronary arteries. Kaplan-Meyer plots of Cox-identified, high- and low-risk patients were well separated with the median of the fat-omics risk, while high-risk group having HR 2.4 times that of the low-risk group (P<0.001). Conclusion: Preliminary findings indicate an opportunity to use more finely tuned, explainable assessments on EAT for improved cardiovascular risk prediction.

Deep learning segmentation of fibrous cap in intravascular optical coherence tomography images.

Thin-cap fibroatheroma (TCFA) is a prominent risk factor for plaque rupture. Intravascular optical coherence tomography (IVOCT) enables identification of fibrous cap (FC), measurement of FC thicknesses, and assessment of plaque vulnerability. We developed a fully-automated deep learning method for FC segmentation. This study included 32,531 images across 227 pullbacks from two registries (TRANSFORM-OCT and UHCMC). Images were semi-automatically labeled using our OCTOPUS with expert editing using established guidelines. We employed preprocessing including guidewire shadow detection, lumen segmentation, pixel-shifting, and Gaussian filtering on raw IVOCT (r,θ) images. Data were augmented in a natural way by changing θ in spiral acquisitions and by changing intensity and noise values. We used a modified SegResNet and comparison networks to segment FCs. We employed transfer learning from our existing much larger, fully-labeled calcification IVOCT dataset to reduce deep-learning training. Postprocessing with a morphological operation enhanced segmentation performance. Overall, our method consistently delivered better FC segmentation results (Dice: 0.837 ± 0.012) than other deep-learning methods. Transfer learning reduced training time by 84% and reduced the need for more training samples. Our method showed a high level of generalizability, evidenced by highly-consistent segmentations across five-fold cross-validation (sensitivity: 85.0 ± 0.3%, Dice: 0.846 ± 0.011) and the held-out test (sensitivity: 84.9%, Dice: 0.816) sets. In addition, we found excellent agreement of FC thickness with ground truth (2.95 ± 20.73 µm), giving clinically insignificant bias. There was excellent reproducibility in pre- and post-stenting pullbacks (average FC angle: 200.9 ± 128.0°/202.0 ± 121.1°). Our fully automated, deep-learning FC segmentation method demonstrated excellent performance, generalizability, and reproducibility on multi-center datasets. It will be useful for multiple research purposes and potentially for planning stent deployments that avoid placing a stent edge over an FC.

Prediction of stent under-expansion in calcified coronary arteries using machine learning on intravascular optical coherence tomography images.

It can be difficult/impossible to fully expand a coronary artery stent in a heavily calcified coronary artery lesion. Under-expanded stents are linked to later complications. Here we used machine/deep learning to analyze calcifications in pre-stent intravascular optical coherence tomography (IVOCT) images and predicted the success of vessel expansion. Pre- and post-stent IVOCT image data were obtained from 110 coronary lesions. Lumen and calcifications in pre-stent images were segmented using deep learning, and lesion features were extracted. We analyzed stent expansion along the lesion, enabling frame, segmental, and whole-lesion analyses. We trained regression models to predict the post-stent lumen area and then computed the stent expansion index (SEI). Best performance (root-mean-square-error = 0.04 ± 0.02 mm2, r = 0.94 ± 0.04, p < 0.0001) was achieved when we used features from both lumen and calcification to train a Gaussian regression model for segmental analysis of 31 frames in length. Stents with minimum SEI > 80% were classified as "well-expanded;" others were "under-expanded." Under-expansion classification results (e.g., AUC = 0.85 ± 0.02) were significantly improved over a previous, simple calculation, as well as other machine learning solutions. Promising results suggest that such methods can identify lesions at risk of under-expansion that would be candidates for intervention lesion preparation (e.g., atherectomy).

Enhancing cardiovascular risk prediction through AI-enabled calcium-omics.

Background: Coronary artery calcium (CAC) is a powerful predictor of major adverse cardiovascular events (MACE). Traditional Agatston score simply sums the calcium, albeit in a non-linear way, leaving room for improved calcification assessments that will more fully capture the extent of disease. Objective: To determine if AI methods using detailed calcification features (i.e., calcium-omics) can improve MACE prediction. Methods: We investigated additional features of calcification including assessment of mass, volume, density, spatial distribution, territory, etc. We used a Cox model with elastic-net regularization on 2457 CT calcium score (CTCS) enriched for MACE events obtained from a large no-cost CLARIFY program (ClinicalTrials.gov Identifier: NCT04075162). We employed sampling techniques to enhance model training. We also investigated Cox models with selected features to identify explainable high-risk characteristics. Results: Our proposed calcium-omics model with modified synthetic down sampling and up sampling gave C-index (80.5%/71.6%) and two-year AUC (82.4%/74.8%) for (80:20, training/testing), respectively (sampling was applied to the training set only). Results compared favorably to Agatston which gave C-index (71.3%/70.3%) and AUC (71.8%/68.8%), respectively. Among calcium-omics features, numbers of calcifications, LAD mass, and diffusivity (a measure of spatial distribution) were important determinants of increased risk, with dense calcification (>1000HU) associated with lower risk. The calcium-omics model reclassified 63% of MACE patients to the high risk group in a held-out test. The categorical net-reclassification index was NRI=0.153. Conclusions: AI analysis of coronary calcification can lead to improved results as compared to Agatston scoring. Our findings suggest the utility of calcium-omics in improved prediction of risk.

OCTOPUS - Optical coherence tomography plaque and stent analysis software.

Background and objective: Compared with other imaging modalities, intravascular optical coherence tomography (IVOCT) has significant advantages for guiding percutaneous coronary interventions, assessing their outcomes, and characterizing plaque components. To aid IVOCT research studies, we developed the Optical Coherence TOmography PlaqUe and Stent (OCTOPUS) analysis software, which provides highly automated, comprehensive analysis of coronary plaques and stents in IVOCT images. Methods: User specifications for OCTOPUS were obtained from detailed, iterative discussions with IVOCT analysts in the Cardiovascular Imaging Core Laboratory at University Hospitals Cleveland Medical Center, a leading laboratory for IVOCT image analysis. To automate image analysis results, the software includes several important algorithmic steps: pre-processing, deep learning plaque segmentation, machine learning identification of stent struts, and registration of pullbacks for sequential comparisons. Intuitive, interactive visualization and manual editing of segmentations were included in the software. Quantifications include stent deployment characteristics (e.g., stent area and stent strut malapposition), strut level analysis, calcium angle, and calcium thickness measurements. Interactive visualizations include (x,y) anatomical, en face, and longitudinal views with optional overlays (e.g., segmented calcifications). To compare images over time, linked visualizations were enabled to display up to four registered vessel segments at a time. Results: OCTOPUS has been deployed for nearly 1 year and is currently being used in multiple IVOCT studies. Underlying plaque segmentation algorithm yielded excellent pixel-wise results (86.2% sensitivity and 0.781 F1 score). Using OCTOPUS on 34 new pullbacks, we determined that following automated segmentation, only 13% and 23% of frames needed any manual touch up for detailed lumen and calcification labeling, respectively. Only up to 3.8% of plaque pixels were modified, leading to an average editing time of only 7.5 s/frame, an approximately 80% reduction compared to manual analysis. Regarding stent analysis, sensitivity and precision were both greater than 90%, and each strut was successfully classified as either covered or uncovered with high sensitivity (94%) and specificity (90%). We demonstrated use cases for sequential analysis. To analyze plaque progression, we loaded multiple pullbacks acquired at different points (e.g., pre-stent, 3-month follow-up, and 18-month follow-up) and evaluated frame-level development of in-stent neo-atherosclerosis. In ex vivo cadaver experiments, the OCTOPUS software enabled visualization and quantitative evaluation of irregular stent deployment in the presence of calcifications identified in pre-stent images. Conclusions: We introduced and evaluated the clinical application of a highly automated software package, OCTOPUS, for quantitative plaque and stent analysis in IVOCT images. The software is currently used as an offline tool for research purposes; however, the software's embedded algorithms may also be useful for real-time treatment planning.

Improved bias and reproducibility of coronary artery calcification features using deconvolution.

Purpose: Our long-range goal is to improve whole-heart CT calcium scores by extracting quantitative features from individual calcifications. Here, we perform deconvolution to improve bias/reproducibility of small calcification assessments, which can be degraded at the normal CT calcium score image resolution. Approach: We analyzed features of individual calcifications on repeated standard (2.5 mm) and thin (1.25 mm) slice scans from QRM-Cardio phantom, cadaver hearts, and CARDIA study participants. Preprocessing to improve the resolution involved of Lucy-Richardson deconvolution with a measured point spread function (PSF) or three-dimensional blind deconvolution in which the PSF was iteratively optimized on high detail structures such as calcifications in images. Results: Using QRM with inserts having known mg-calcium, we determined that both blind and conventional deconvolution improved mass measurements nearly equally well on standard images. Further, deconvolved thin images gave an excellent recovery of actual mass scores, suggesting that such processing could be our gold standard. For CARDIA images, blind deconvolution greatly improved results on standard slices. Bias across 33 calcifications (without, with deconvolution) was (23%, 9%), (18%, 1%), and ( - 19 % , - 1 % ) for Agatston, volume, and mass scores, respectively. Reproducibility was (0.13, 0.10), (0.12, 0.08), and (0.11, 0.06), respectively. Mass scores were more reproducible than Agatston scores or volume scores. For many other calcification features, blind deconvolution improved reproducibility in 21 out of 24 features. Cadaver images showed similar improvements in bias/reproducibility and slightly better results with a measured PSF. Conclusions: Deconvolution improves bias and reproducibility of multiple features extracted from individual calcifications in CT calcium score exams. Blind deconvolution is useful for improving feature assessments of coronary calcification in archived datasets.

Automatic microchannel detection using deep learning in intravascular optical coherence tomography images.

Microchannel formation is known to be a significant marker of plaque vulnerability, plaque rupture, and intraplaque hemorrhage, which are responsible for plaque progression. We developed a fully-automated method for detecting microchannels in intravascular optical coherence tomography (IVOCT) images using deep learning. A total of 3,075 IVOCT image frames across 41 patients having 62 microchannel segments were analyzed. Microchannel was manually annotated by expert cardiologists, according to previously established criteria. In order to improve segmentation performance, pre-processing including guidewire detection/removal, lumen segmentation, pixel-shifting, and noise filtering was applied to the raw (r,θ) IVOCT image. We used the DeepLab-v3 plus deep learning model with the Xception backbone network for identifying microchannel candidates. After microchannel candidate detection, each candidate was classified as either microchannel or no-microchannel using a convolutional neural network (CNN) classification model. Our method provided excellent segmentation of microchannel with a Dice coefficient of 0.811, sensitivity of 92.4%, and specificity of 99.9%. We found that pre-processing and data augmentation were very important to improve results. In addition, a CNN classification step was also helpful to rule out false positives. Furthermore, automated analysis missed only 3% of frames having microchannels and showed no false positives. Our method has great potential to enable highly automated, objective, repeatable, and comprehensive evaluations of vulnerable plaques and treatments. We believe that this method is promising for both research and clinical applications.

Automated analysis of fibrous cap in intravascular optical coherence tomography images of coronary arteries.

Thin-cap fibroatheroma (TCFA) and plaque rupture have been recognized as the most frequent risk factor for thrombosis and acute coronary syndrome. Intravascular optical coherence tomography (IVOCT) can identify TCFA and assess cap thickness, which provides an opportunity to assess plaque vulnerability. We developed an automated method that can detect lipidous plaque and assess fibrous cap thickness in IVOCT images. This study analyzed a total of 4360 IVOCT image frames of 77 lesions among 41 patients. Expert cardiologists manually labeled lipidous plaque based on established criteria. To improve segmentation performance, preprocessing included lumen segmentation, pixel-shifting, and noise filtering on the raw polar (r, θ) IVOCT images. We used the DeepLab-v3 plus deep learning model to classify lipidous plaque pixels. After lipid detection, we automatically detected the outer border of the fibrous cap using a special dynamic programming algorithm and assessed the cap thickness. Our method provided excellent discriminability of lipid plaque with a sensitivity of 85.8% and A-line Dice coefficient of 0.837. By comparing lipid angle measurements between two analysts following editing of our automated software, we found good agreement by Bland-Altman analysis (difference 6.7° ± 17°; mean ~ 196°). Our method accurately detected the fibrous cap from the detected lipid plaque. Automated analysis required a significant modification for only 5.5% frames. Furthermore, our method showed a good agreement of fibrous cap thickness between two analysts with Bland-Altman analysis (4.2 ± 14.6 µm; mean ~ 175 µm), indicating little bias between users and good reproducibility of the measurement. We developed a fully automated method for fibrous cap quantification in IVOCT images, resulting in good agreement with determinations by analysts. The method has great potential to enable highly automated, repeatable, and comprehensive evaluations of TCFAs.

Automated Segmentation of Microvessels in Intravascular OCT Images Using Deep Learning.

Microvessels in vascular plaque are associated with plaque progression and are found in plaque rupture and intra-plaque hemorrhage. To analyze this characteristic of vulnerability, we developed an automated deep learning method for detecting microvessels in intravascular optical coherence tomography (IVOCT) images. A total of 8403 IVOCT image frames from 85 lesions and 37 normal segments were analyzed. Manual annotation was performed using a dedicated software (OCTOPUS) previously developed by our group. Data augmentation in the polar (r,θ) domain was applied to raw IVOCT images to ensure that microvessels appear at all possible angles. Pre-processing methods included guidewire/shadow detection, lumen segmentation, pixel shifting, and noise reduction. DeepLab v3+ was used to segment microvessel candidates. A bounding box on each candidate was classified as either microvessel or non-microvessel using a shallow convolutional neural network. For better classification, we used data augmentation (i.e., angle rotation) on bounding boxes with a microvessel during network training. Data augmentation and pre-processing steps improved microvessel segmentation performance significantly, yielding a method with Dice of 0.71 ± 0.10 and pixel-wise sensitivity/specificity of 87.7 ± 6.6%/99.8 ± 0.1%. The network for classifying microvessels from candidates performed exceptionally well, with sensitivity of 99.5 ± 0.3%, specificity of 98.8 ± 1.0%, and accuracy of 99.1 ± 0.5%. The classification step eliminated the majority of residual false positives and the Dice coefficient increased from 0.71 to 0.73. In addition, our method produced 698 image frames with microvessels present, compared with 730 from manual analysis, representing a 4.4% difference. When compared with the manual method, the automated method improved microvessel continuity, implying improved segmentation performance. The method will be useful for research purposes as well as potential future treatment planning.

Deep learning segmentation and quantification method for assessing epicardial adipose tissue in CT calcium score scans.

Epicardial adipose tissue volume (EAT) has been linked to coronary artery disease and the risk of major adverse cardiac events. As manual quantification of EAT is time-consuming, requires specialized training, and is prone to human error, we developed a deep learning method (DeepFat) for the automatic assessment of EAT on non-contrast low-dose CT calcium score images. Our DeepFat intuitively segmented the tissue enclosed by the pericardial sac on axial slices, using two preprocessing steps. First, we applied a HU-attention-window with a window/level 350/40-HU to draw attention to the sac and reduce numerical errors. Second, we applied a novel look ahead slab-of-slices with bisection ("bisect") in which we split the heart into halves and sequenced the lower half from bottom-to-middle and the upper half from top-to-middle, thereby presenting an always increasing curvature of the sac to the network. EAT volume was obtained by thresholding voxels within the sac in the fat window (- 190/- 30-HU). Compared to manual segmentation, our algorithm gave excellent results with volume Dice = 88.52% ± 3.3, slice Dice = 87.70% ± 7.5, EAT error = 0.5% ± 8.1, and R = 98.52% (p < 0.001). HU-attention-window and bisect improved Dice volume scores by 0.49% and 3.2% absolute, respectively. Variability between analysts was comparable to variability with DeepFat. Results compared favorably to those of previous publications.

Neoatherosclerosis prediction using plaque markers in intravascular optical coherence tomography images.

Introduction: In-stent neoatherosclerosis has emerged as a crucial factor in post-stent complications including late in-stent restenosis and very late stent thrombosis. In this study, we investigated the ability of quantitative plaque characteristics from intravascular optical coherence tomography (IVOCT) images taken just prior to stent implantation to predict neoatherosclerosis after implantation. Methods: This was a sub-study of the TRiple Assessment of Neointima Stent FOrmation to Reabsorbable polyMer with Optical Coherence Tomography (TRANSFORM-OCT) trial. Images were obtained before and 18 months after stent implantation. Final analysis included images of 180 lesions from 90 patients; each patient had images of two lesions in different coronary arteries. A total of 17 IVOCT plaque features, including lesion length, lumen (e.g., area and diameter); calcium (e.g., angle and thickness); and fibrous cap (FC) features (e.g., thickness, surface area, and burden), were automatically extracted from the baseline IVOCT images before stenting using dedicated software developed by our group (OCTOPUS). The predictive value of baseline IVOCT plaque features for neoatherosclerosis development after stent implantation was assessed using univariate/multivariate logistic regression and receiver operating characteristic (ROC) analyses. Results: Follow-up IVOCT identified stents with (n = 19) and without (n = 161) neoatherosclerosis. Greater lesion length and maximum calcium angle and features related to FC were associated with a higher prevalence of neoatherosclerosis after stent implantation (p < 0.05). Hierarchical clustering identified six clusters with the best prediction p-values. In univariate logistic regression analysis, maximum calcium angle, minimum calcium thickness, maximum FC angle, maximum FC area, FC surface area, and FC burden were significant predictors of neoatherosclerosis. Lesion length and features related to the lumen were not significantly different between the two groups. In multivariate logistic regression analysis, only larger FC surface area was strongly associated with neoatherosclerosis (odds ratio 1.38, 95% confidence interval [CI] 1.05-1.80, p < 0.05). The area under the ROC curve was 0.901 (95% CI 0.859-0.946, p < 0.05) for FC surface area. Conclusion: Post-stent neoatherosclerosis can be predicted by quantitative IVOCT imaging of plaque characteristics prior to stent implantation. Our findings highlight the additional clinical benefits of utilizing IVOCT imaging in the catheterization laboratory to inform treatment decision-making and improve outcomes.

Automatic Deep Learning Segmentation and Quantification of Epicardial Adipose Tissue in Non-Contrast Cardiac CT scans.

An Automatic deep learning semantic segmentation (ADLS) using DeepLab-v3-plus technique is proposed for a full and accurate whole heart Epicardial adipose tissue (EAT) segmentation from non-contrast cardiac CT scan. The ADLS algorithm was trained on manual segmented scans of the enclosed region of the pericardium (sac), which represents the internal heart tissues where the EAT is located. A level of 40 Hounsfield unit (HU) and a window of 350 HU was applied to every axial slice for contrast enhancement. Each slice was associated with two additional consecutive slices, representing the three-channel single input image of the deep network. The detected output mask region, as a post-step, was thresholded between [-190, -30] HU to detect the EAT region. A median filter with kernel size 3mm was applied to remove the noise. Using 70 CT scans (50 training/20 testing), the ADLS showed excellent results compared to manual segmentation (ground truth). The total average Dice score was (89.31%±1.96) with a high correlation of (R=97.15%, p-value <0.001), while the average error of EAT volume was (0.79±9.21).Clinical Relevance- Epicardial adipose tissue (EAT) volume aids in predicting atherosclerosis development and is linked to major adverse cardiac events. However, accurate manual segmentation is considered tedious work and requires skilled expertise.

Multicolumn RBF Network.

This paper proposes the multicolumn RBF network (MCRN) as a method to improve the accuracy and speed of a traditional radial basis function network (RBFN). The RBFN, as a fully connected artificial neural network (ANN), suffers from costly kernel inner-product calculations due to the use of many instances as the centers of hidden units. This issue is not critical for small datasets, as adding more hidden units will not burden the computation time. However, for larger datasets, the RBFN requires many hidden units with several kernel computations to generalize the problem. The MCRN mechanism is constructed based on dividing a dataset into smaller subsets using the k-d tree algorithm. resultant subsets are considered as separate training datasets to train individual RBFNs. Those small RBFNs are stacked in parallel and bulged into the MCRN structure during testing. The MCRN is considered as a well-developed and easy-to-use parallel structure, because each individual ANN has been trained on its own subsets and is completely separate from the other ANNs. This parallelized structure reduces the testing time compared with that of a single but larger RBFN, which cannot be easily parallelized due to its fully connected structure. Small informative subsets provide the MCRN with a regional experience to specify the problem instead of generalizing it. The MCRN has been tested on many benchmark datasets and has shown better accuracy and great improvements in training and testing times compared with a single RBFN. The MCRN also shows good results compared with those of some machine learning techniques, such as the support vector machine and k-nearest neighbors.