Deep learning for lung cancer prognostication: A retrospective multi-cohort radiomics study.

BACKGROUND: Non-small-cell lung cancer (NSCLC) patients often demonstrate varying clinical courses and outcomes, even within the same tumor stage. This study explores deep learning applications in medical imaging allowing for the automated quantification of radiographic characteristics and potentially improving patient stratification. METHODS AND FINDINGS: We performed an integrative analysis on 7 independent datasets across 5 institutions totaling 1,194 NSCLC patients (age median = 68.3 years [range 32.5-93.3], survival median = 1.7 years [range 0.0-11.7]). Using external validation in computed tomography (CT) data, we identified prognostic signatures using a 3D convolutional neural network (CNN) for patients treated with radiotherapy (n = 771, age median = 68.0 years [range 32.5-93.3], survival median = 1.3 years [range 0.0-11.7]). We then employed a transfer learning approach to achieve the same for surgery patients (n = 391, age median = 69.1 years [range 37.2-88.0], survival median = 3.1 years [range 0.0-8.8]). We found that the CNN predictions were significantly associated with 2-year overall survival from the start of respective treatment for radiotherapy (area under the receiver operating characteristic curve [AUC] = 0.70 [95% CI 0.63-0.78], p < 0.001) and surgery (AUC = 0.71 [95% CI 0.60-0.82], p < 0.001) patients. The CNN was also able to significantly stratify patients into low and high mortality risk groups in both the radiotherapy (p < 0.001) and surgery (p = 0.03) datasets. Additionally, the CNN was found to significantly outperform random forest models built on clinical parameters-including age, sex, and tumor node metastasis stage-as well as demonstrate high robustness against test-retest (intraclass correlation coefficient = 0.91) and inter-reader (Spearman's rank-order correlation = 0.88) variations. To gain a better understanding of the characteristics captured by the CNN, we identified regions with the most contribution towards predictions and highlighted the importance of tumor-surrounding tissue in patient stratification. We also present preliminary findings on the biological basis of the captured phenotypes as being linked to cell cycle and transcriptional processes. Limitations include the retrospective nature of this study as well as the opaque black box nature of deep learning networks. CONCLUSIONS: Our results provide evidence that deep learning networks may be used for mortality risk stratification based on standard-of-care CT images from NSCLC patients. This evidence motivates future research into better deciphering the clinical and biological basis of deep learning networks as well as validation in prospective data.

AI powered quantification of nuclear morphology in cancers enables prediction of genome instability and prognosis.

While alterations in nucleus size, shape, and color are ubiquitous in cancer, comprehensive quantification of nuclear morphology across a whole-slide histologic image remains a challenge. Here, we describe the development of a pan-tissue, deep learning-based digital pathology pipeline for exhaustive nucleus detection, segmentation, and classification and the utility of this pipeline for nuclear morphologic biomarker discovery. Manually-collected nucleus annotations were used to train an object detection and segmentation model for identifying nuclei, which was deployed to segment nuclei in H&E-stained slides from the BRCA, LUAD, and PRAD TCGA cohorts. Interpretable features describing the shape, size, color, and texture of each nucleus were extracted from segmented nuclei and compared to measurements of genomic instability, gene expression, and prognosis. The nuclear segmentation and classification model trained herein performed comparably to previously reported models. Features extracted from the model revealed differences sufficient to distinguish between BRCA, LUAD, and PRAD. Furthermore, cancer cell nuclear area was associated with increased aneuploidy score and homologous recombination deficiency. In BRCA, increased fibroblast nuclear area was indicative of poor progression-free and overall survival and was associated with gene expression signatures related to extracellular matrix remodeling and anti-tumor immunity. Thus, we developed a powerful pan-tissue approach for nucleus segmentation and featurization, enabling the construction of predictive models and the identification of features linking nuclear morphology with clinically-relevant prognostic biomarkers across multiple cancer types.

Prognostic value of metabolic metrics extracted from baseline positron emission tomography images in non-small cell lung cancer.

BACKGROUND: Maximum, mean and peak SUV of primary tumor at baseline FDG-PET scans, have often been found predictive for overall survival in non-small cell lung cancer (NSCLC) patients. In this study we further investigated the prognostic power of advanced metabolic metrics derived from intensity volume histograms (IVH) extracted from PET imaging. METHODS: A cohort of 220 NSCLC patients (mean age, 66.6 years; 149 men, 71 women), stages I-IIIB, treated with radiotherapy with curative intent were included (NCT00522639). Each patient underwent standardized pre-treatment CT-PET imaging. Primary GTV was delineated by an experienced radiation oncologist on CT-PET images. Common PET descriptors such as maximum, mean and peak SUV, and metabolic tumor volume (MTV) were quantified. Advanced descriptors of metabolic activity were quantified by IVH. These comprised five groups of features: absolute and relative volume above relative intensity threshold (AVRI and RVRI), absolute and relative volume above absolute intensity threshold (AVAI and RVAI), and absolute intensity above relative volume threshold (AIRV). MTV was derived from the IVH curves for volumes with SUV above 2.5, 3 and 4, and of 40% and 50% maximum SUV. Univariable analysis using Cox Proportional Hazard Regression was performed for overall survival assessment. RESULTS: Relative volume above higher SUV (80%) was an independent predictor of OS (p = 0.05). None of the possible surrogates for MTV based on volumes above SUV of 3, 40% and 50% of maximum SUV showed significant associations with OS [p (AVAI3) = 0.10, p (AVAI4) = 0.22, p (AVRI40%) = 0.15, p (AVRI50%) = 0.17]. Maximum and peak SUV (r = 0.99) revealed no prognostic value for OS [p (maximum SUV) = 0.20, p (peak SUV) = 0.22]. CONCLUSIONS: New methods using more advanced imaging features extracted from PET were analyzed. Best prognostic value for OS of NSCLC patients was found for relative portions of the tumor above higher uptakes (80% SUV).

Stability of FDG-PET Radiomics features: an integrated analysis of test-retest and inter-observer variability.

PURPOSE: Besides basic measurements as maximum standardized uptake value (SUV)max or SUVmean derived from 18F-FDG positron emission tomography (PET) scans, more advanced quantitative imaging features (i.e. "Radiomics" features) are increasingly investigated for treatment monitoring, outcome prediction, or as potential biomarkers. With these prospected applications of Radiomics features, it is a requisite that they provide robust and reliable measurements. The aim of our study was therefore to perform an integrated stability analysis of a large number of PET-derived features in non-small cell lung carcinoma (NSCLC), based on both a test-retest and an inter-observer setup. METHODS: Eleven NSCLC patients were included in the test-retest cohort. Patients underwent repeated PET imaging within a one day interval, before any treatment was delivered. Lesions were delineated by applying a threshold of 50% of the maximum uptake value within the tumor. Twenty-three NSCLC patients were included in the inter-observer cohort. Patients underwent a diagnostic whole body PET-computed tomography (CT). Lesions were manually delineated based on fused PET-CT, using a standardized clinical delineation protocol. Delineation was performed independently by five observers, blinded to each other. Fifteen first order statistics, 39 descriptors of intensity volume histograms, eight geometric features and 44 textural features were extracted. For every feature, test-retest and inter-observer stability was assessed with the intra-class correlation coefficient (ICC) and the coefficient of variability, normalized to mean and range. Similarity between test-retest and inter-observer stability rankings of features was assessed with Spearman's rank correlation coefficient. RESULTS: Results showed that the majority of assessed features had both a high test-retest (71%) and inter-observer (91%) stability in terms of their ICC. Overall, features more stable in repeated PET imaging were also found to be more robust against inter-observer variability. CONCLUSION: Results suggest that further research of quantitative imaging features is warranted with respect to more advanced applications of PET imaging as being used for treatment monitoring, outcome prediction or imaging biomarkers.

Deep convolutional neural networks to predict cardiovascular risk from computed tomography.

Coronary artery calcium is an accurate predictor of cardiovascular events. While it is visible on all computed tomography (CT) scans of the chest, this information is not routinely quantified as it requires expertise, time, and specialized equipment. Here, we show a robust and time-efficient deep learning system to automatically quantify coronary calcium on routine cardiac-gated and non-gated CT. As we evaluate in 20,084 individuals from distinct asymptomatic (Framingham Heart Study, NLST) and stable and acute chest pain (PROMISE, ROMICAT-II) cohorts, the automated score is a strong predictor of cardiovascular events, independent of risk factors (multivariable-adjusted hazard ratios up to 4.3), shows high correlation with manual quantification, and robust test-retest reliability. Our results demonstrate the clinical value of a deep learning system for the automated prediction of cardiovascular events. Implementation into clinical practice would address the unmet need of automating proven imaging biomarkers to guide management and improve population health.

Radiomics of Coronary Artery Calcium in the Framingham Heart Study.

PURPOSE: To extract radiomic features from coronary artery calcium (CAC) on CT images and to determine whether this approach could improve the ability to identify individuals at risk for a composite endpoint of clinical events. MATERIALS AND METHODS: Participants from the Offspring and Third Generation cohorts of the community-based Framingham Heart Study underwent noncontrast cardiac CT (2002-2005) and were followed for more than a median of 9.1 years for composite major events. A total of 624 participants with CAC Agatston score (AS) of greater than 0 and good or excellent CT image quality were included for manual CAC segmentation and extraction of a predefined set of radiomic features reflecting intensity, shape, and texture. In a discovery cohort (n = 318), machine learning was used to select the 20 most informative and nonredundant CAC radiomic features, classify features predicting events, and define a radiomic-based score (RS). Performance of the RS was tested independently for the prediction of events in a validation cohort (n = 306). RESULTS: The RS had a median value of 0.08 (interquartile range, 0.007-0.71) and a weak and modest correlation with Framingham risk score (FRS) (r = 0.2) and AS (r = 0.39), respectively. The continuous RS unadjusted, adjusted for age and sex, FRS, AS, and FRS plus AS were significantly associated with events (hazard ratio [HR] = 2.2, P < .001; HR = 1.8, P = .002; HR = 2.0, P < .001; HR = 1.7, P = .02; and HR = 1.8, P = .01, respectively). In participants with AS of less than 300, RS association with events remained significant when unadjusted and adjusted for age and sex, FRS, AS, and FRS plus AS (HR = 2.4, 2.8, 2.8, 2.3, and 2.6; P < .001, respectively). In the same subgroup of participants, adding the RS to AS resulted in a significant improvement in the discriminatory ability for events as compared with the AS (area under the receiver operating curve: 0.80 vs 0.68, respectively; P = .03). CONCLUSION: A radiomic-based score, including the complex properties of CAC, may constitute an imaging biomarker to be further developed to identify individuals at risk for major adverse cardiovascular events in a community-based cohort. Supplemental material is available for this article. © RSNA, 2020.

Deep Learning Predicts Lung Cancer Treatment Response from Serial Medical Imaging.

PURPOSE: Tumors are continuously evolving biological systems, and medical imaging is uniquely positioned to monitor changes throughout treatment. Although qualitatively tracking lesions over space and time may be trivial, the development of clinically relevant, automated radiomics methods that incorporate serial imaging data is far more challenging. In this study, we evaluated deep learning networks for predicting clinical outcomes through analyzing time series CT images of patients with locally advanced non-small cell lung cancer (NSCLC).Experimental Design: Dataset A consists of 179 patients with stage III NSCLC treated with definitive chemoradiation, with pretreatment and posttreatment CT images at 1, 3, and 6 months follow-up (581 scans). Models were developed using transfer learning of convolutional neural networks (CNN) with recurrent neural networks (RNN), using single seed-point tumor localization. Pathologic response validation was performed on dataset B, comprising 89 patients with NSCLC treated with chemoradiation and surgery (178 scans). RESULTS: Deep learning models using time series scans were significantly predictive of survival and cancer-specific outcomes (progression, distant metastases, and local-regional recurrence). Model performance was enhanced with each additional follow-up scan into the CNN model (e.g., 2-year overall survival: AUC = 0.74, P < 0.05). The models stratified patients into low and high mortality risk groups, which were significantly associated with overall survival [HR = 6.16; 95% confidence interval (CI), 2.17-17.44; P < 0.001]. The model also significantly predicted pathologic response in dataset B (P = 0.016). CONCLUSIONS: We demonstrate that deep learning can integrate imaging scans at multiple timepoints to improve clinical outcome predictions. AI-based noninvasive radiomics biomarkers can have a significant impact in the clinic given their low cost and minimal requirements for human input.

Data Analysis Strategies in Medical Imaging.

Radiographic imaging continues to be one of the most effective and clinically useful tools within oncology. Sophistication of artificial intelligence has allowed for detailed quantification of radiographic characteristics of tissues using predefined engineered algorithms or deep learning methods. Precedents in radiology as well as a wealth of research studies hint at the clinical relevance of these characteristics. However, critical challenges are associated with the analysis of medical imaging data. Although some of these challenges are specific to the imaging field, many others like reproducibility and batch effects are generic and have already been addressed in other quantitative fields such as genomics. Here, we identify these pitfalls and provide recommendations for analysis strategies of medical imaging data, including data normalization, development of robust models, and rigorous statistical analyses. Adhering to these recommendations will not only improve analysis quality but also enhance precision medicine by allowing better integration of imaging data with other biomedical data sources. Clin Cancer Res; 24(15); 3492-9. ©2018 AACR.

Artificial intelligence in radiology.

Artificial intelligence (AI) algorithms, particularly deep learning, have demonstrated remarkable progress in image-recognition tasks. Methods ranging from convolutional neural networks to variational autoencoders have found myriad applications in the medical image analysis field, propelling it forward at a rapid pace. Historically, in radiology practice, trained physicians visually assessed medical images for the detection, characterization and monitoring of diseases. AI methods excel at automatically recognizing complex patterns in imaging data and providing quantitative, rather than qualitative, assessments of radiographic characteristics. In this Opinion article, we establish a general understanding of AI methods, particularly those pertaining to image-based tasks. We explore how these methods could impact multiple facets of radiology, with a general focus on applications in oncology, and demonstrate ways in which these methods are advancing the field. Finally, we discuss the challenges facing clinical implementation and provide our perspective on how the domain could be advanced.

Author Correction: Deep Learning for Fully-Automated Localization and Segmentation of Rectal Cancer on Multiparametric MR.

A correction to this article has been published and is linked from the HTML version of this paper. The error has been fixed in the paper.

Impact of experimental design on PET radiomics in predicting somatic mutation status.

PURPOSE: PET-based radiomic features have demonstrated great promises in predicting genetic data. However, various experimental parameters can influence the feature extraction pipeline, and hence, Here, we investigated how experimental settings affect the performance of radiomic features in predicting somatic mutation status in non-small cell lung cancer (NSCLC) patients. METHODS: 348 NSCLC patients with somatic mutation testing and diagnostic PET images were included in our analysis. Radiomic feature extractions were analyzed for varying voxel sizes, filters and bin widths. 66 radiomic features were evaluated. The performance of features in predicting mutations status was assessed using the area under the receiver-operating-characteristic curve (AUC). The influence of experimental parameters on feature predictability was quantified as the relative difference between the minimum and maximum AUC (δ). RESULTS: The large majority of features (n=56, 85%) were significantly predictive for EGFR mutation status (AUC≥0.61). 29 radiomic features significantly predicted EGFR mutations and were robust to experimental settings with δOverall<5%. The overall influence (δOverall) of the voxel size, filter and bin width for all features ranged from 5% to 15%, respectively. For all features, none of the experimental designs was predictive of KRAS+ from KRAS- (AUC≤0.56). CONCLUSION: The predictability of 29 radiomic features was robust to the choice of experimental settings; however, these settings need to be carefully chosen for all other features. The combined effect of the investigated processing methods could be substantial and must be considered. Optimized settings that will maximize the predictive performance of individual radiomic features should be investigated in the future.

Application of the 3D slicer chest imaging platform segmentation algorithm for large lung nodule delineation.

PURPOSE: Accurate segmentation of lung nodules is crucial in the development of imaging biomarkers for predicting malignancy of the nodules. Manual segmentation is time consuming and affected by inter-observer variability. We evaluated the robustness and accuracy of a publically available semiautomatic segmentation algorithm that is implemented in the 3D Slicer Chest Imaging Platform (CIP) and compared it with the performance of manual segmentation. METHODS: CT images of 354 manually segmented nodules were downloaded from the LIDC database. Four radiologists performed the manual segmentation and assessed various nodule characteristics. The semiautomatic CIP segmentation was initialized using the centroid of the manual segmentations, thereby generating four contours for each nodule. The robustness of both segmentation methods was assessed using the region of uncertainty (δ) and Dice similarity index (DSI). The robustness of the segmentation methods was compared using the Wilcoxon-signed rank test (pWilcoxon<0.05). The Dice similarity index (DSIAgree) between the manual and CIP segmentations was computed to estimate the accuracy of the semiautomatic contours. RESULTS: The median computational time of the CIP segmentation was 10 s. The median CIP and manually segmented volumes were 477 ml and 309 ml, respectively. CIP segmentations were significantly more robust than manual segmentations (median δCIP = 14ml, median dsiCIP = 99% vs. median δmanual = 222ml, median dsimanual = 82%) with pWilcoxon~10-16. The agreement between CIP and manual segmentations had a median DSIAgree of 60%. While 13% (47/354) of the nodules did not require any manual adjustment, minor to substantial manual adjustments were needed for 87% (305/354) of the nodules. CIP segmentations were observed to perform poorly (median DSIAgree≈50%) for non-/sub-solid nodules with subtle appearances and poorly defined boundaries. CONCLUSION: Semi-automatic CIP segmentation can potentially reduce the physician workload for 13% of nodules owing to its computational efficiency and superior stability compared to manual segmentation. Although manual adjustment is needed for many cases, CIP segmentation provides a preliminary contour for physicians as a starting point.

Associations Between Somatic Mutations and Metabolic Imaging Phenotypes in Non-Small Cell Lung Cancer.

PET-based radiomics have been used to noninvasively quantify the metabolic tumor phenotypes; however, little is known about the relationship between these phenotypes and underlying somatic mutations. This study assessed the association and predictive power of 18F-FDG PET-based radiomic features for somatic mutations in non-small cell lung cancer patients. Methods: Three hundred forty-eight non-small cell lung cancer patients underwent diagnostic 18F-FDG PET scans and were tested for genetic mutations. Thirteen percent (44/348) and 28% (96/348) of patients were found to harbor epidermal growth factor receptor (EGFR) or Kristen rat sarcoma viral (KRAS) mutations, respectively. We evaluated 21 imaging features: 19 independent radiomic features quantifying phenotypic traits and 2 conventional features (metabolic tumor volume and maximum SUV). The association between imaging features and mutation status (e.g., EGFR-positive [EGFR+] vs. EGFR-negative) was assessed using the Wilcoxon rank-sum test. The ability of each imaging feature to predict mutation status was evaluated by the area under the receiver operating curve (AUC) and its significance was compared with a random guess (AUC = 0.5) using the Noether test. All P values were corrected for multiple hypothesis testing by controlling the false-discovery rate (FDRWilcoxon, FDRNoether) with a significance threshold of 10%. Results: Eight radiomic features and both conventional features were significantly associated with EGFR mutation status (FDRWilcoxon = 0.01-0.10). One radiomic feature (normalized inverse difference moment) outperformed all other features in predicting EGFR mutation status (EGFR+ vs. EGFR-negative, AUC = 0.67, FDRNoether = 0.0032), as well as differentiating between KRAS-positive and EGFR+ (AUC = 0.65, FDRNoether = 0.05). None of the features was associated with or predictive of KRAS mutation status (KRAS-positive vs. KRAS-negative, AUC = 0.50-0.54). Conclusion: Our results indicate that EGFR mutations may drive different metabolic tumor phenotypes that are captured in PET images, whereas KRAS-mutated tumors do not. This proof-of-concept study sheds light on genotype-phenotype interactions, using radiomics to capture and describe the phenotype, and may have potential for developing noninvasive imaging biomarkers for somatic mutations.

Associations of Radiomic Data Extracted from Static and Respiratory-Gated CT Scans with Disease Recurrence in Lung Cancer Patients Treated with SBRT.

Radiomics aims to quantitatively capture the complex tumor phenotype contained in medical images to associate them with clinical outcomes. This study investigates the impact of different types of computed tomography (CT) images on the prognostic performance of radiomic features for disease recurrence in early stage non-small cell lung cancer (NSCLC) patients treated with stereotactic body radiation therapy (SBRT). 112 early stage NSCLC patients treated with SBRT that had static free breathing (FB) and average intensity projection (AIP) images were analyzed. Nineteen radiomic features were selected from each image type (FB or AIP) for analysis based on stability and variance. The selected FB and AIP radiomic feature sets had 6 common radiomic features between both image types and 13 unique features. The prognostic performances of the features for distant metastasis (DM) and locoregional recurrence (LRR) were evaluated using the concordance index (CI) and compared with two conventional features (tumor volume and maximum diameter). P-values were corrected for multiple testing using the false discovery rate procedure. None of the FB radiomic features were associated with DM, however, seven AIP radiomic features, that described tumor shape and heterogeneity, were (CI range: 0.638-0.676). Conventional features from FB images were not associated with DM, however, AIP conventional features were (CI range: 0.643-0.658). Radiomic and conventional multivariate models were compared between FB and AIP images using cross validation. The differences between the models were assessed using a permutation test. AIP radiomic multivariate models (median CI = 0.667) outperformed all other models (median CI range: 0.601-0.630) in predicting DM. None of the imaging features were prognostic of LRR. Therefore, image type impacts the performance of radiomic models in their association with disease recurrence. AIP images contained more information than FB images that were associated with disease recurrence in early stage NSCLC patients treated with SBRT, which suggests that AIP images may potentially be more optimal for the development of an imaging biomarker.

Associations between radiologist-defined semantic and automatically computed radiomic features in non-small cell lung cancer.

Tumor phenotypes captured in computed tomography (CT) images can be described qualitatively and quantitatively using radiologist-defined "semantic" and computer-derived "radiomic" features, respectively. While both types of features have shown to be promising predictors of prognosis, the association between these groups of features remains unclear. We investigated the associations between semantic and radiomic features in CT images of 258 non-small cell lung adenocarcinomas. The tumor imaging phenotypes were described using 9 qualitative semantic features that were scored by radiologists, and 57 quantitative radiomic features that were automatically calculated using mathematical algorithms. Of the 9 semantic features, 3 were rated on a binary scale (cavitation, air bronchogram, and calcification) and 6 were rated on a categorical scale (texture, border definition, contour, lobulation, spiculation, and concavity). 32-41 radiomic features were associated with the binary semantic features (AUC = 0.56-0.76). The relationship between all radiomic features and the categorical semantic features ranged from weak to moderate (|Spearmen's correlation| = 0.002-0.65). There are associations between semantic and radiomic features, however the associations were not strong despite being significant. Our results indicate that radiomic features may capture distinct tumor phenotypes that fail to be perceived by naked eye that semantic features do not describe and vice versa.

Deep Learning for Fully-Automated Localization and Segmentation of Rectal Cancer on Multiparametric MR.

Multiparametric Magnetic Resonance Imaging (MRI) can provide detailed information of the physical characteristics of rectum tumours. Several investigations suggest that volumetric analyses on anatomical and functional MRI contain clinically valuable information. However, manual delineation of tumours is a time consuming procedure, as it requires a high level of expertise. Here, we evaluate deep learning methods for automatic localization and segmentation of rectal cancers on multiparametric MR imaging. MRI scans (1.5T, T2-weighted, and DWI) of 140 patients with locally advanced rectal cancer were included in our analysis, equally divided between discovery and validation datasets. Two expert radiologists segmented each tumor. A convolutional neural network (CNN) was trained on the multiparametric MRIs of the discovery set to classify each voxel into tumour or non-tumour. On the independent validation dataset, the CNN showed high segmentation accuracy for reader1 (Dice Similarity Coefficient (DSC = 0.68) and reader2 (DSC = 0.70). The area under the curve (AUC) of the resulting probability maps was very high for both readers, AUC = 0.99 (SD = 0.05). Our results demonstrate that deep learning can perform accurate localization and segmentation of rectal cancer in MR imaging in the majority of patients. Deep learning technologies have the potential to improve the speed and accuracy of MRI-based rectum segmentations.

Defining the biological basis of radiomic phenotypes in lung cancer.

Medical imaging can visualize characteristics of human cancer noninvasively. Radiomics is an emerging field that translates these medical images into quantitative data to enable phenotypic profiling of tumors. While radiomics has been associated with several clinical endpoints, the complex relationships of radiomics, clinical factors, and tumor biology are largely unknown. To this end, we analyzed two independent cohorts of respectively 262 North American and 89 European patients with lung cancer, and consistently identified previously undescribed associations between radiomic imaging features, molecular pathways, and clinical factors. In particular, we found a relationship between imaging features, immune response, inflammation, and survival, which was further validated by immunohistochemical staining. Moreover, a number of imaging features showed predictive value for specific pathways; for example, intra-tumor heterogeneity features predicted activity of RNA polymerase transcription (AUC = 0.62, p=0.03) and intensity dispersion was predictive of the autodegration pathway of a ubiquitin ligase (AUC = 0.69, p<10-4). Finally, we observed that prognostic biomarkers performed highest when combining radiomic, genetic, and clinical information (CI = 0.73, p<10-9) indicating complementary value of these data. In conclusion, we demonstrate that radiomic approaches permit noninvasive assessment of both molecular and clinical characteristics of tumors, and therefore have the potential to advance clinical decision-making by systematically analyzing standard-of-care medical images.

Somatic Mutations Drive Distinct Imaging Phenotypes in Lung Cancer.

Tumors are characterized by somatic mutations that drive biological processes ultimately reflected in tumor phenotype. With regard to radiographic phenotypes, generally unconnected through present understanding to the presence of specific mutations, artificial intelligence methods can automatically quantify phenotypic characters by using predefined, engineered algorithms or automatic deep-learning methods, a process also known as radiomics. Here we demonstrate how imaging phenotypes can be connected to somatic mutations through an integrated analysis of independent datasets of 763 lung adenocarcinoma patients with somatic mutation testing and engineered CT image analytics. We developed radiomic signatures capable of distinguishing between tumor genotypes in a discovery cohort (n = 353) and verified them in an independent validation cohort (n = 352). All radiomic signatures significantly outperformed conventional radiographic predictors (tumor volume and maximum diameter). We found a radiomic signature related to radiographic heterogeneity that successfully discriminated between EGFR+ and EGFR- cases (AUC = 0.69). Combining this signature with a clinical model of EGFR status (AUC = 0.70) significantly improved prediction accuracy (AUC = 0.75). The highest performing signature was capable of distinguishing between EGFR+ and KRAS+ tumors (AUC = 0.80) and, when combined with a clinical model (AUC = 0.81), substantially improved its performance (AUC = 0.86). A KRAS+/KRAS- radiomic signature also showed significant albeit lower performance (AUC = 0.63) and did not improve the accuracy of a clinical predictor of KRAS status. Our results argue that somatic mutations drive distinct radiographic phenotypes that can be predicted by radiomics. This work has implications for the use of imaging-based biomarkers in the clinic, as applied noninvasively, repeatedly, and at low cost. Cancer Res; 77(14); 3922-30. ©2017 AACR.

Computational Radiomics System to Decode the Radiographic Phenotype.

Radiomics aims to quantify phenotypic characteristics on medical imaging through the use of automated algorithms. Radiomic artificial intelligence (AI) technology, either based on engineered hard-coded algorithms or deep learning methods, can be used to develop noninvasive imaging-based biomarkers. However, lack of standardized algorithm definitions and image processing severely hampers reproducibility and comparability of results. To address this issue, we developed PyRadiomics, a flexible open-source platform capable of extracting a large panel of engineered features from medical images. PyRadiomics is implemented in Python and can be used standalone or using 3D Slicer. Here, we discuss the workflow and architecture of PyRadiomics and demonstrate its application in characterizing lung lesions. Source code, documentation, and examples are publicly available at www.radiomics.io With this platform, we aim to establish a reference standard for radiomic analyses, provide a tested and maintained resource, and to grow the community of radiomic developers addressing critical needs in cancer research. Cancer Res; 77(21); e104-7. ©2017 AACR.

Radiographic prediction of meningioma grade by semantic and radiomic features.

OBJECTIVES: The clinical management of meningioma is guided by tumor grade and biological behavior. Currently, the assessment of tumor grade follows surgical resection and histopathologic review. Reliable techniques for pre-operative determination of tumor grade may enhance clinical decision-making. METHODS: A total of 175 meningioma patients (103 low-grade and 72 high-grade) with pre-operative contrast-enhanced T1-MRI were included. Fifteen radiomic (quantitative) and 10 semantic (qualitative) features were applied to quantify the imaging phenotype. Area under the curve (AUC) and odd ratios (OR) were computed with multiple-hypothesis correction. Random-forest classifiers were developed and validated on an independent dataset (n = 44). RESULTS: Twelve radiographic features (eight radiomic and four semantic) were significantly associated with meningioma grade. High-grade tumors exhibited necrosis/hemorrhage (ORsem = 6.6, AUCrad = 0.62-0.68), intratumoral heterogeneity (ORsem = 7.9, AUCrad = 0.65), non-spherical shape (AUCrad = 0.61), and larger volumes (AUCrad = 0.69) compared to low-grade tumors. Radiomic and sematic classifiers could significantly predict meningioma grade (AUCsem = 0.76 and AUCrad = 0.78). Furthermore, combining them increased the classification power (AUCradio = 0.86). Clinical variables alone did not effectively predict tumor grade (AUCclin = 0.65) or show complementary value with imaging data (AUCcomb = 0.84). CONCLUSIONS: We found a strong association between imaging features of meningioma and histopathologic grade, with ready application to clinical management. Combining qualitative and quantitative radiographic features significantly improved classification power.