Prediction of new-onset atrial fibrillation in patients with non-small cell lung cancer treated with curative-intent conventional radiotherapy.

BACKGROUND: Atrial fibrillation (AF) is an important side effect of thoracic Radiotherapy (RT), which may impair quality of life and survival. This study aimed to develop a prediction model for new-onset AF in patients with Non-Small Cell Lung Cancer (NSCLC) receiving RT alone or as a part of their multi-modal treatment. PATIENTS AND METHODS: Patients with stage I-IV NSCLC treated with curative-intent conventional photon RT were included. The baseline electrocardiogram (ECG) was compared with follow-up ECGs to identify the occurrence of new-onset AF. A wide range of potential clinical predictors and dose-volume measures on the whole heart and six automatically contoured cardiac substructures, including chambers and conduction nodes, were considered for statistical modeling. Internal validation with optimism-correction was performed. A nomogram was made. RESULTS: 374 patients (mean age 69 ±â€¯10 years, 57 % male) were included. At baseline, 9.1 % of patients had AF, and 42 (11.2 %) patients developed new-onset AF. The following parameters were predictive: older age (OR=1.04, 95 % CI: 1.013-1.068), being overweight or obese (OR=1.791, 95 % CI: 1.139-2.816), alcohol use (OR=4.052, 95 % CI: 2.445-6.715), history of cardiac procedures (OR=2.329, 95 % CI: 1.287-4.215), tumor located in the upper lobe (OR=2.571, 95 % CI: 1.518-4.355), higher forced expiratory volume in 1 s (OR=0.989, 95 % CI: 0.979-0.999), higher creatinine (OR=1.008, 95 % CI: 1.002-1.014), concurrent chemotherapy (OR=3.266, 95 % CI: 1.757 to 6.07) and left atrium Dmax (OR=1.022, 95 % CI: 1.012-1.032). The model showed good discrimination (area under the curve = 0.80, 95 % CI: 0.76-0.84), calibration and positive net benefits. CONCLUSION: This prediction model employs readily available predictors to identify patients at high risk of new-onset AF who could potentially benefit from active screening and timely management of post-RT AF.

Delta radiomics to track radiation response in lung tumors receiving stereotactic magnetic resonance-guided radiotherapy.

Background and purpose: Lung cancer is a leading cause of cancer-related mortality, and stereotactic body radiotherapy (SBRT) has become a standard treatment for early-stage lung cancer. However, the heterogeneous response to radiation at the tumor level poses challenges. Currently, standardized dosage regimens lack adaptation based on individual patient or tumor characteristics. Thus, we explore the potential of delta radiomics from on-treatment magnetic resonance (MR) imaging to track radiation dose response, inform personalized radiotherapy dosing, and predict outcomes. Materials and methods: A retrospective study of 47 MR-guided lung SBRT treatments for 39 patients was conducted. Radiomic features were extracted using Pyradiomics, and stability was evaluated temporally and spatially. Delta radiomics were correlated with radiation dose delivery and assessed for associations with tumor control and survival with Cox regressions. Results: Among 107 features, 49 demonstrated temporal stability, and 57 showed spatial stability. Fifteen stable and non-collinear features were analyzed. Median Skewness and surface to volume ratio decreased with radiation dose fraction delivery, while coarseness and 90th percentile values increased. Skewness had the largest relative median absolute changes (22 %-45 %) per fraction from baseline and was associated with locoregional failure (p = 0.012) by analysis of covariance. Skewness, Elongation, and Flatness were significantly associated with local recurrence-free survival, while tumor diameter and volume were not. Conclusions: Our study establishes the feasibility and stability of delta radiomics analysis for MR-guided lung SBRT. Findings suggest that MR delta radiomics can capture short-term radiographic manifestations of the intra-tumoral radiation effect.

End-to-end reproducible AI pipelines in radiology using the cloud.

Artificial intelligence (AI) algorithms hold the potential to revolutionize radiology. However, a significant portion of the published literature lacks transparency and reproducibility, which hampers sustained progress toward clinical translation. Although several reporting guidelines have been proposed, identifying practical means to address these issues remains challenging. Here, we show the potential of cloud-based infrastructure for implementing and sharing transparent and reproducible AI-based radiology pipelines. We demonstrate end-to-end reproducibility from retrieving cloud-hosted data, through data pre-processing, deep learning inference, and post-processing, to the analysis and reporting of the final results. We successfully implement two distinct use cases, starting from recent literature on AI-based biomarkers for cancer imaging. Using cloud-hosted data and computing, we confirm the findings of these studies and extend the validation to previously unseen data for one of the use cases. Furthermore, we provide the community with transparent and easy-to-extend examples of pipelines impactful for the broader oncology field. Our approach demonstrates the potential of cloud resources for implementing, sharing, and using reproducible and transparent AI pipelines, which can accelerate the translation into clinical solutions.

Multimodal Deep Learning Improves Recurrence Risk Prediction in Pediatric Low-Grade Gliomas.

BACKGROUND: Postoperative recurrence risk for pediatric low-grade gliomas (pLGGs) is challenging to predict by conventional clinical, radiographic, and genomic factors. We investigated if deep learning of MRI tumor features could improve postoperative pLGG risk stratification. METHODS: We used pre-trained deep learning (DL) tool designed for pLGG segmentation to extract pLGG imaging features from preoperative T2-weighted MRI from patients who underwent surgery (DL-MRI features). Patients were pooled from two institutions: Dana Farber/Boston Children's Hospital (DF/BCH) and the Children's Brain Tumor Network (CBTN). We trained three DL logistic hazard models to predict postoperative event-free survival (EFS) probabilities with 1) clinical features, 2) DL-MRI features, and 3) multimodal (clinical and DL-MRI features). We evaluated the models with a time-dependent Concordance Index (Ctd) and risk group stratification with Kaplan Meier plots and log-rank tests. We developed an automated pipeline integrating pLGG segmentation and EFS prediction with the best model. RESULTS: Of the 396 patients analyzed (median follow-up: 85 months, range: 1.5-329 months), 214 (54%) underwent gross total resection and 110 (28%) recurred. The multimodal model improved EFS prediction compared to the DL-MRI and clinical models (Ctd: 0.85 (95% CI: 0.81-0.93), 0.79 (95% CI: 0.70-0.88), and 0.72 (95% CI: 0.57-0.77), respectively). The multimodal model improved risk-group stratification (3-year EFS for predicted high-risk: 31% versus low-risk: 92%, p<0.0001). CONCLUSIONS: DL extracts imaging features that can inform postoperative recurrence prediction for pLGG. Multimodal DL improves postoperative risk stratification for pLGG and may guide postoperative decision-making. Larger, multicenter training data may be needed to improve model generalizability.

Longitudinal risk prediction for pediatric glioma with temporal deep learning.

Pediatric glioma recurrence can cause morbidity and mortality; however, recurrence pattern and severity are heterogeneous and challenging to predict with established clinical and genomic markers. Resultingly, almost all children undergo frequent, long-term, magnetic resonance (MR) brain surveillance regardless of individual recurrence risk. Deep learning analysis of longitudinal MR may be an effective approach for improving individualized recurrence prediction in gliomas and other cancers but has thus far been infeasible with current frameworks. Here, we propose a self-supervised, deep learning approach to longitudinal medical imaging analysis, temporal learning, that models the spatiotemporal information from a patient's current and prior brain MRs to predict future recurrence. We apply temporal learning to pediatric glioma surveillance imaging for 715 patients (3,994 scans) from four distinct clinical settings. We find that longitudinal imaging analysis with temporal learning improves recurrence prediction performance by up to 41% compared to traditional approaches, with improvements in performance in both low- and high-grade glioma. We find that recurrence prediction accuracy increases incrementally with the number of historical scans available per patient. Temporal deep learning may enable point-of-care decision-support for pediatric brain tumors and be adaptable more broadly to patients with other cancers and chronic diseases undergoing surveillance imaging.

Stepwise Transfer Learning for Expert-level Pediatric Brain Tumor MRI Segmentation in a Limited Data Scenario.

Purpose To develop, externally test, and evaluate clinical acceptability of a deep learning pediatric brain tumor segmentation model using stepwise transfer learning. Materials and Methods In this retrospective study, the authors leveraged two T2-weighted MRI datasets (May 2001 through December 2015) from a national brain tumor consortium (n = 184; median age, 7 years [range, 1-23 years]; 94 male patients) and a pediatric cancer center (n = 100; median age, 8 years [range, 1-19 years]; 47 male patients) to develop and evaluate deep learning neural networks for pediatric low-grade glioma segmentation using a stepwise transfer learning approach to maximize performance in a limited data scenario. The best model was externally tested on an independent test set and subjected to randomized blinded evaluation by three clinicians, wherein they assessed clinical acceptability of expert- and artificial intelligence (AI)-generated segmentations via 10-point Likert scales and Turing tests. Results The best AI model used in-domain stepwise transfer learning (median Dice score coefficient, 0.88 [IQR, 0.72-0.91] vs 0.812 [IQR, 0.56-0.89] for baseline model; P = .049). With external testing, the AI model yielded excellent accuracy using reference standards from three clinical experts (median Dice similarity coefficients: expert 1, 0.83 [IQR, 0.75-0.90]; expert 2, 0.81 [IQR, 0.70-0.89]; expert 3, 0.81 [IQR, 0.68-0.88]; mean accuracy, 0.82). For clinical benchmarking (n = 100 scans), experts rated AI-based segmentations higher on average compared with other experts (median Likert score, 9 [IQR, 7-9] vs 7 [IQR 7-9]) and rated more AI segmentations as clinically acceptable (80.2% vs 65.4%). Experts correctly predicted the origin of AI segmentations in an average of 26.0% of cases. Conclusion Stepwise transfer learning enabled expert-level automated pediatric brain tumor autosegmentation and volumetric measurement with a high level of clinical acceptability. Keywords: Stepwise Transfer Learning, Pediatric Brain Tumors, MRI Segmentation, Deep Learning Supplemental material is available for this article. © RSNA, 2024.

Body Composition in Advanced Non-Small Cell Lung Cancer Treated With Immunotherapy.

Importance: The association between body composition (BC) and cancer outcomes is complex and incompletely understood. Previous research in non-small-cell lung cancer (NSCLC) has been limited to small, single-institution studies and yielded promising, albeit heterogeneous, results. Objectives: To evaluate the association of BC with oncologic outcomes in patients receiving immunotherapy for advanced or metastatic NSCLC. Design, Setting, and Participants: This comprehensive multicohort analysis included clinical data from cohorts receiving treatment at the Dana-Farber Brigham Cancer Center (DFBCC) who received immunotherapy given alone or in combination with chemotherapy and prospectively collected data from the phase 1/2 Study 1108 and the chemotherapy arm of the phase 3 MYSTIC trial. Baseline and follow-up computed tomography (CT) scans were collected and analyzed using deep neural networks for automatic L3 slice selection and body compartment segmentation (skeletal muscle [SM], subcutaneous adipose tissue [SAT], and visceral adipose tissue). Outcomes were compared based on baseline BC measures or their change at the first follow-up scan. The data were analyzed between July 2022 and April 2023. Main Outcomes and Measures: Hazard ratios (HRs) for the association of BC measurements with overall survival (OS) and progression-free survival (PFS). Results: A total of 1791 patients (878 women [49%]) with NSCLC were analyzed, of whom 487 (27.2%) received chemoimmunotherapy at DFBCC (DFBCC-CIO), 825 (46.1%) received ICI monotherapy at DFBCC (DFBCC-IO), 222 (12.4%) were treated with durvalumab monotherapy on Study 1108, and 257 (14.3%) were treated with chemotherapy on MYSTIC; median (IQR) ages were 65 (58-74), 66 (57-71), 65 (26-87), and 63 (30-84) years, respectively. A loss in SM mass, as indicated by a change in the L3 SM area, was associated with worse oncologic outcome across patient groups (HR, 0.59 [95% CI, 0.43-0.81] and 0.61 [95% CI, 0.47-0.79] for OS and PFS, respectively, in DFBCC-CIO; HR, 0.74 [95% CI, 0.60-0.91] for OS in DFBCC-IO; HR, 0.46 [95% CI, 0.33-0.64] and 0.47 [95% CI, 0.34-0.64] for OS and PFS, respectively, in Study 1108; HR, 0.76 [95% CI, 0.61-0.96] for PFS in the MYSTIC trial). This association was most prominent among male patients, with a nonsignificant association among female patients in the MYSTIC trial and DFBCC-CIO cohorts on Kaplan-Meier analysis. An increase of more than 5% in SAT density, as quantified by the average CT attenuation in Hounsfield units of the SAT compartment, was associated with poorer OS in 3 patient cohorts (HR, 0.61 [95% CI, 0.43-0.86] for DFBCC-CIO; HR, 0.62 [95% CI, 0.49-0.79] for DFBCC-IO; and HR, 0.56 [95% CI, 0.40-0.77] for Study 1108). The change in SAT density was also associated with PFS for DFBCC-CIO (HR, 0.73; 95% CI, 0.54-0.97). This was primarily observed in female patients on Kaplan-Meier analysis. Conclusions and Relevance: The results of this multicohort study suggest that loss in SM mass during systemic therapy for NSCLC is a marker of poor outcomes, especially in male patients. SAT density changes are also associated with prognosis, particularly in female patients. Automated CT-derived BC measurements should be considered in determining NSCLC prognosis.

Noninvasive Molecular Subtyping of Pediatric Low-Grade Glioma with Self-Supervised Transfer Learning.

Purpose To develop and externally test a scan-to-prediction deep learning pipeline for noninvasive, MRI-based BRAF mutational status classification for pediatric low-grade glioma. Materials and Methods This retrospective study included two pediatric low-grade glioma datasets with linked genomic and diagnostic T2-weighted MRI data of patients: Dana-Farber/Boston Children's Hospital (development dataset, n = 214 [113 (52.8%) male; 104 (48.6%) BRAF wild type, 60 (28.0%) BRAF fusion, and 50 (23.4%) BRAF V600E]) and the Children's Brain Tumor Network (external testing, n = 112 [55 (49.1%) male; 35 (31.2%) BRAF wild type, 60 (53.6%) BRAF fusion, and 17 (15.2%) BRAF V600E]). A deep learning pipeline was developed to classify BRAF mutational status (BRAF wild type vs BRAF fusion vs BRAF V600E) via a two-stage process: (a) three-dimensional tumor segmentation and extraction of axial tumor images and (b) section-wise, deep learning-based classification of mutational status. Knowledge-transfer and self-supervised approaches were investigated to prevent model overfitting, with a primary end point of the area under the receiver operating characteristic curve (AUC). To enhance model interpretability, a novel metric, center of mass distance, was developed to quantify the model attention around the tumor. Results A combination of transfer learning from a pretrained medical imaging-specific network and self-supervised label cross-training (TransferX) coupled with consensus logic yielded the highest classification performance with an AUC of 0.82 (95% CI: 0.72, 0.91), 0.87 (95% CI: 0.61, 0.97), and 0.85 (95% CI: 0.66, 0.95) for BRAF wild type, BRAF fusion, and BRAF V600E, respectively, on internal testing. On external testing, the pipeline yielded an AUC of 0.72 (95% CI: 0.64, 0.86), 0.78 (95% CI: 0.61, 0.89), and 0.72 (95% CI: 0.64, 0.88) for BRAF wild type, BRAF fusion, and BRAF V600E, respectively. Conclusion Transfer learning and self-supervised cross-training improved classification performance and generalizability for noninvasive pediatric low-grade glioma mutational status prediction in a limited data scenario. Keywords: Pediatrics, MRI, CNS, Brain/Brain Stem, Oncology, Feature Detection, Diagnosis, Supervised Learning, Transfer Learning, Convolutional Neural Network (CNN) Supplemental material is available for this article. © RSNA, 2024.

Deep Learning to Estimate Cardiovascular Risk From Chest Radiographs : A Risk Prediction Study.

BACKGROUND: Guidelines for primary prevention of atherosclerotic cardiovascular disease (ASCVD) recommend a risk calculator (ASCVD risk score) to estimate 10-year risk for major adverse cardiovascular events (MACE). Because the necessary inputs are often missing, complementary approaches for opportunistic risk assessment are desirable. OBJECTIVE: To develop and test a deep-learning model (CXR CVD-Risk) that estimates 10-year risk for MACE from a routine chest radiograph (CXR) and compare its performance with that of the traditional ASCVD risk score for implications for statin eligibility. DESIGN: Risk prediction study. SETTING: Outpatients potentially eligible for primary cardiovascular prevention. PARTICIPANTS: The CXR CVD-Risk model was developed using data from a cancer screening trial. It was externally validated in 8869 outpatients with unknown ASCVD risk because of missing inputs to calculate the ASCVD risk score and in 2132 outpatients with known risk whose ASCVD risk score could be calculated. MEASUREMENTS: 10-year MACE predicted by CXR CVD-Risk versus the ASCVD risk score. RESULTS: Among 8869 outpatients with unknown ASCVD risk, those with a risk of 7.5% or higher as predicted by CXR CVD-Risk had higher 10-year risk for MACE after adjustment for risk factors (adjusted hazard ratio [HR], 1.73 [95% CI, 1.47 to 2.03]). In the additional 2132 outpatients with known ASCVD risk, CXR CVD-Risk predicted MACE beyond the traditional ASCVD risk score (adjusted HR, 1.88 [CI, 1.24 to 2.85]). LIMITATION: Retrospective study design using electronic medical records. CONCLUSION: On the basis of a single CXR, CXR CVD-Risk predicts 10-year MACE beyond the clinical standard and may help identify individuals at high risk whose ASCVD risk score cannot be calculated because of missing data. PRIMARY FUNDING SOURCE: None.

Foundation model for cancer imaging biomarkers.

Foundation models in deep learning are characterized by a single large-scale model trained on vast amounts of data serving as the foundation for various downstream tasks. Foundation models are generally trained using self-supervised learning and excel in reducing the demand for training samples in downstream applications. This is especially important in medicine, where large labelled datasets are often scarce. Here, we developed a foundation model for cancer imaging biomarker discovery by training a convolutional encoder through self-supervised learning using a comprehensive dataset of 11,467 radiographic lesions. The foundation model was evaluated in distinct and clinically relevant applications of cancer imaging-based biomarkers. We found that it facilitated better and more efficient learning of imaging biomarkers and yielded task-specific models that significantly outperformed conventional supervised and other state-of-the-art pretrained implementations on downstream tasks, especially when training dataset sizes were very limited. Furthermore, the foundation model was more stable to input variations and showed strong associations with underlying biology. Our results demonstrate the tremendous potential of foundation models in discovering new imaging biomarkers that may extend to other clinical use cases and can accelerate the widespread translation of imaging biomarkers into clinical settings.

Deep learning analysis of epicardial adipose tissue to predict cardiovascular risk in heavy smokers.

BACKGROUND: Heavy smokers are at increased risk for cardiovascular disease and may benefit from individualized risk quantification using routine lung cancer screening chest computed tomography. We investigated the prognostic value of deep learning-based automated epicardial adipose tissue quantification and compared it to established cardiovascular risk factors and coronary artery calcium. METHODS: We investigated the prognostic value of automated epicardial adipose tissue quantification in heavy smokers enrolled in the National Lung Screening Trial and followed for 12.3 (11.9-12.8) years. The epicardial adipose tissue was segmented and quantified on non-ECG-synchronized, non-contrast low-dose chest computed tomography scans using a validated deep-learning algorithm. Multivariable survival regression analyses were then utilized to determine the associations of epicardial adipose tissue volume and density with all-cause and cardiovascular mortality (myocardial infarction and stroke). RESULTS: Here we show in 24,090 adult heavy smokers (59% men; 61 ± 5 years) that epicardial adipose tissue volume and density are independently associated with all-cause (adjusted hazard ratios: 1.10 and 1.38; P < 0.001) and cardiovascular mortality (adjusted hazard ratios: 1.14 and 1.78; P < 0.001) beyond demographics, clinical risk factors, body habitus, level of education, and coronary artery calcium score. CONCLUSIONS: Our findings suggest that automated assessment of epicardial adipose tissue from low-dose lung cancer screening images offers prognostic value in heavy smokers, with potential implications for cardiovascular risk stratification in this high-risk population.

Heavy smokers are at increased risk of poor health outcomes, particularly outcomes related to cardiovascular disease. We explore how fat surrounding the heart, known as epicardial adipose tissue, may be an indicator of the health of heavy smokers. We use an artificial intelligence system to measure the heart fat on chest scans of heavy smokers taken during a lung cancer screening trial and following their health for 12 years. We find that higher amounts and denser epicardial adipose tissue are linked to an increased risk of death from any cause, specifically from heart-related issues, even when considering other health factors. This suggests that measuring epicardial adipose tissue during lung cancer screenings could be a valuable tool for identifying heavy smokers at greater risk of heart problems and death, possibly helping to guide their medical management and improve their cardiovascular health.

Robustness and reproducibility for AI learning in biomedical sciences: RENOIR.

Artificial intelligence (AI) techniques are increasingly applied across various domains, favoured by the growing acquisition and public availability of large, complex datasets. Despite this trend, AI publications often suffer from lack of reproducibility and poor generalisation of findings, undermining scientific value and contributing to global research waste. To address these issues and focusing on the learning aspect of the AI field, we present RENOIR (REpeated random sampliNg fOr machIne leaRning), a modular open-source platform for robust and reproducible machine learning (ML) analysis. RENOIR adopts standardised pipelines for model training and testing, introducing elements of novelty, such as the dependence of the performance of the algorithm on the sample size. Additionally, RENOIR offers automated generation of transparent and usable reports, aiming to enhance the quality and reproducibility of AI studies. To demonstrate the versatility of our tool, we applied it to benchmark datasets from health, computer science, and STEM (Science, Technology, Engineering, and Mathematics) domains. Furthermore, we showcase RENOIR's successful application in recently published studies, where it identified classifiers for SET2D and TP53 mutation status in cancer. Finally, we present a use case where RENOIR was employed to address a significant pharmacological challenge-predicting drug efficacy. RENOIR is freely available at https://github.com/alebarberis/renoir .

Enrichment of lung cancer computed tomography collections with AI-derived annotations.

Public imaging datasets are critical for the development and evaluation of automated tools in cancer imaging. Unfortunately, many do not include annotations or image-derived features, complicating downstream analysis. Artificial intelligence-based annotation tools have been shown to achieve acceptable performance and can be used to automatically annotate large datasets. As part of the effort to enrich public data available within NCI Imaging Data Commons (IDC), here we introduce AI-generated annotations for two collections containing computed tomography images of the chest, NSCLC-Radiomics, and a subset of the National Lung Screening Trial. Using publicly available AI algorithms, we derived volumetric annotations of thoracic organs-at-risk, their corresponding radiomics features, and slice-level annotations of anatomical landmarks and regions. The resulting annotations are publicly available within IDC, where the DICOM format is used to harmonize the data and achieve FAIR (Findable, Accessible, Interoperable, Reusable) data principles. The annotations are accompanied by cloud-enabled notebooks demonstrating their use. This study reinforces the need for large, publicly accessible curated datasets and demonstrates how AI can aid in cancer imaging.

Edge roughness quantifies impact of physician variation on training and performance of deep learning auto-segmentation models for the esophagus.

Manual segmentation of tumors and organs-at-risk (OAR) in 3D imaging for radiation-therapy planning is time-consuming and subject to variation between different observers. Artificial intelligence (AI) can assist with segmentation, but challenges exist in ensuring high-quality segmentation, especially for small, variable structures, such as the esophagus. We investigated the effect of variation in segmentation quality and style of physicians for training deep-learning models for esophagus segmentation and proposed a new metric, edge roughness, for evaluating/quantifying slice-to-slice inconsistency. This study includes a real-world cohort of 394 patients who each received radiation therapy (mainly for lung cancer). Segmentation of the esophagus was performed by 8 physicians as part of routine clinical care. We evaluated manual segmentation by comparing the length and edge roughness of segmentations among physicians to analyze inconsistencies. We trained eight multiple- and individual-physician segmentation models in total, based on U-Net architectures and residual backbones. We used the volumetric Dice coefficient to measure the performance for each model. We proposed a metric, edge roughness, to quantify the shift of segmentation among adjacent slices by calculating the curvature of edges of the 2D sagittal- and coronal-view projections. The auto-segmentation model trained on multiple physicians (MD1-7) achieved the highest mean Dice of 73.7 ± 14.8%. The individual-physician model (MD7) with the highest edge roughness (mean ± SD: 0.106 ± 0.016) demonstrated significantly lower volumetric Dice for test cases compared with other individual models (MD7: 58.5 ± 15.8%, MD6: 67.1 ± 16.8%, p < 0.001). A multiple-physician model trained after removing the MD7 data resulted in fewer outliers (e.g., Dice ≤ 40%: 4 cases for MD1-6, 7 cases for MD1-7, Ntotal = 394). While we initially detected this pattern in a single clinician, we validated the edge roughness metric across the entire dataset. The model trained with the lowest-quantile edge roughness (MDER-Q1, Ntrain = 62) achieved significantly higher Dice (Ntest = 270) than the model trained with the highest-quantile ones (MDER-Q4, Ntrain = 62) (MDER-Q1: 67.8 ± 14.8%, MDER-Q4: 62.8 ± 15.7%, p < 0.001). This study demonstrates that there is significant variation in style and quality in manual segmentations in clinical care, and that training AI auto-segmentation algorithms from real-world, clinical datasets may result in unexpectedly under-performing algorithms with the inclusion of outliers. Importantly, this study provides a novel evaluation metric, edge roughness, to quantify physician variation in segmentation which will allow developers to filter clinical training data to optimize model performance.

Automated temporalis muscle quantification and growth charts for children through adulthood.

Lean muscle mass (LMM) is an important aspect of human health. Temporalis muscle thickness is a promising LMM marker but has had limited utility due to its unknown normal growth trajectory and reference ranges and lack of standardized measurement. Here, we develop an automated deep learning pipeline to accurately measure temporalis muscle thickness (iTMT) from routine brain magnetic resonance imaging (MRI). We apply iTMT to 23,876 MRIs of healthy subjects, ages 4 through 35, and generate sex-specific iTMT normal growth charts with percentiles. We find that iTMT was associated with specific physiologic traits, including caloric intake, physical activity, sex hormone levels, and presence of malignancy. We validate iTMT across multiple demographic groups and in children with brain tumors and demonstrate feasibility for individualized longitudinal monitoring. The iTMT pipeline provides unprecedented insights into temporalis muscle growth during human development and enables the use of LMM tracking to inform clinical decision-making.

National Cancer Institute Imaging Data Commons: Toward Transparency, Reproducibility, and Scalability in Imaging Artificial Intelligence.

The remarkable advances of artificial intelligence (AI) technology are revolutionizing established approaches to the acquisition, interpretation, and analysis of biomedical imaging data. Development, validation, and continuous refinement of AI tools requires easy access to large high-quality annotated datasets, which are both representative and diverse. The National Cancer Institute (NCI) Imaging Data Commons (IDC) hosts large and diverse publicly available cancer image data collections. By harmonizing all data based on industry standards and colocalizing it with analysis and exploration resources, the IDC aims to facilitate the development, validation, and clinical translation of AI tools and address the well-documented challenges of establishing reproducible and transparent AI processing pipelines. Balanced use of established commercial products with open-source solutions, interconnected by standard interfaces, provides value and performance, while preserving sufficient agility to address the evolving needs of the research community. Emphasis on the development of tools, use cases to demonstrate the utility of uniform data representation, and cloud-based analysis aim to ease adoption and help define best practices. Integration with other data in the broader NCI Cancer Research Data Commons infrastructure opens opportunities for multiomics studies incorporating imaging data to further empower the research community to accelerate breakthroughs in cancer detection, diagnosis, and treatment. Published under a CC BY 4.0 license.

Image based prognosis in head and neck cancer using convolutional neural networks: a case study in reproducibility and optimization.

In the past decade, there has been a sharp increase in publications describing applications of convolutional neural networks (CNNs) in medical image analysis. However, recent reviews have warned of the lack of reproducibility of most such studies, which has impeded closer examination of the models and, in turn, their implementation in healthcare. On the other hand, the performance of these models is highly dependent on decisions on architecture and image pre-processing. In this work, we assess the reproducibility of three studies that use CNNs for head and neck cancer outcome prediction by attempting to reproduce the published results. In addition, we propose a new network structure and assess the impact of image pre-processing and model selection criteria on performance. We used two publicly available datasets: one with 298 patients for training and validation and another with 137 patients from a different institute for testing. All three studies failed to report elements required to reproduce their results thoroughly, mainly the image pre-processing steps and the random seed. Our model either outperforms or achieves similar performance to the existing models with considerably fewer parameters. We also observed that the pre-processing efforts significantly impact the model's performance and that some model selection criteria may lead to suboptimal models. Although there have been improvements in the reproducibility of deep learning models, our work suggests that wider implementation of reporting standards is required to avoid a reproducibility crisis.

Foundation Models for Quantitative Biomarker Discovery in Cancer Imaging.

Foundation models represent a recent paradigm shift in deep learning, where a single large-scale model trained on vast amounts of data can serve as the foundation for various downstream tasks. Foundation models are generally trained using self-supervised learning and excel in reducing the demand for training samples in downstream applications. This is especially important in medicine, where large labeled datasets are often scarce. Here, we developed a foundation model for imaging biomarker discovery by training a convolutional encoder through self-supervised learning using a comprehensive dataset of 11,467 radiographic lesions. The foundation model was evaluated in distinct and clinically relevant applications of imaging-based biomarkers. We found that they facilitated better and more efficient learning of imaging biomarkers and yielded task-specific models that significantly outperformed their conventional supervised counterparts on downstream tasks. The performance gain was most prominent when training dataset sizes were very limited. Furthermore, foundation models were more stable to input and inter-reader variations and showed stronger associations with underlying biology. Our results demonstrate the tremendous potential of foundation models in discovering novel imaging biomarkers that may extend to other clinical use cases and can accelerate the widespread translation of imaging biomarkers into clinical settings.

Spatial transformation of multi-omics data unlocks novel insights into cancer biology.

The application of next-generation sequencing (NGS) has transformed cancer research. As costs have decreased, NGS has increasingly been applied to generate multiple layers of molecular data from the same samples, covering genomics, transcriptomics, and methylomics. Integrating these types of multi-omics data in a combined analysis is now becoming a common issue with no obvious solution, often handled on an ad hoc basis, with multi-omics data arriving in a tabular format and analyzed using computationally intensive statistical methods. These methods particularly ignore the spatial orientation of the genome and often apply stringent p-value corrections that likely result in the loss of true positive associations. Here, we present GENIUS (GEnome traNsformatIon and spatial representation of mUltiomicS data), a framework for integrating multi-omics data using deep learning models developed for advanced image analysis. The GENIUS framework is able to transform multi-omics data into images with genes displayed as spatially connected pixels and successfully extract relevant information with respect to the desired output. We demonstrate the utility of GENIUS by applying the framework to multi-omics datasets from the Cancer Genome Atlas. Our results are focused on predicting the development of metastatic cancer from primary tumors, and demonstrate how through model inference, we are able to extract the genes which are driving the model prediction and are likely associated with metastatic disease progression. We anticipate our framework to be a starting point and strong proof of concept for multi-omics data transformation and analysis without the need for statistical correction.

Decoding biological age from face photographs using deep learning.

Because humans age at different rates, a person's physical appearance may yield insights into their biological age and physiological health more reliably than their chronological age. In medicine, however, appearance is incorporated into medical judgments in a subjective and non-standardized fashion. In this study, we developed and validated FaceAge, a deep learning system to estimate biological age from easily obtainable and low-cost face photographs. FaceAge was trained on data from 58,851 healthy individuals, and clinical utility was evaluated on data from 6,196 patients with cancer diagnoses from two institutions in the United States and The Netherlands. To assess the prognostic relevance of FaceAge estimation, we performed Kaplan Meier survival analysis. To test a relevant clinical application of FaceAge, we assessed the performance of FaceAge in end-of-life patients with metastatic cancer who received palliative treatment by incorporating FaceAge into clinical prediction models. We found that, on average, cancer patients look older than their chronological age, and looking older is correlated with worse overall survival. FaceAge demonstrated significant independent prognostic performance in a range of cancer types and stages. We found that FaceAge can improve physicians' survival predictions in incurable patients receiving palliative treatments, highlighting the clinical utility of the algorithm to support end-of-life decision-making. FaceAge was also significantly associated with molecular mechanisms of senescence through gene analysis, while age was not. These findings may extend to diseases beyond cancer, motivating using deep learning algorithms to translate a patient's visual appearance into objective, quantitative, and clinically useful measures.