Feature selection methodology for longitudinal cone-beam CT radiomics.

BACKGROUND: Cone-beam CT (CBCT) scans are typically acquired daily for positioning verification of non-small cell lung cancer (NSCLC) patients. Quantitative information, derived using radiomics, can potentially contribute to (early) treatment adaptation. The aims of this study were to (1) describe and investigate a methodology for feature selection of a longitudinal radiomics approach (2) investigate which time-point during treatment is potentially useful for early treatment response assessment. MATERIAL AND METHODS: For 90 NSCLC patients CBCT scans of the first two fractions of treatment (considered as 'test-retest' scans) were analyzed, as well as weekly CBCT images. One hundred and sixteen radiomic features were extracted from the GTV of all scans and subsequently absolute and relative differences were calculated between weekly CBCT images and the CBCT of the first fraction. Test-retest scans were used to determine the smallest detectable change (C = 1.96 * SD) allowing for feature selection by choosing a minimum number of patients for which a feature should change more than 'C' to be considered as relevant. Analysis of which features change at which moment during treatment was used to investigate which time-point is potentially relevant to extract longitudinal radiomics information for early treatment response assessment. RESULTS: A total of six absolute delta features changed for at least ten patients at week 2 of treatment and increased to 61 at week 3, 79 at week 4 and 85 at week 5. There was 93% overlap between features selected at week 3 and the other weeks. CONCLUSIONS: This study describes a feature selection methodology for longitudinal radiomics that is able to select reproducible delta radiomics features that are informative due to their change during treatment, which can potentially be used for treatment decisions concerning adaptive radiotherapy. Nonetheless, the prognostic value of the selected delta radiomic features should be investigated in future studies.

Influence of gray level discretization on radiomic feature stability for different CT scanners, tube currents and slice thicknesses: a comprehensive phantom study.

BACKGROUND: Radiomic analyses of CT images provide prognostic information that can potentially be used for personalized treatment. However, heterogeneity of acquisition- and reconstruction protocols influences robustness of radiomic analyses. The aim of this study was to investigate the influence of different CT-scanners, slice thicknesses, exposures and gray-level discretization on radiomic feature values and their stability. MATERIAL AND METHODS: A texture phantom with ten different inserts was scanned on nine different CT-scanners with varying tube currents. Scans were reconstructed with 1.5 mm or 3 mm slice thickness. Image pre-processing comprised gray-level discretization in ten different bin widths ranging from 5 to 50 HU and different resampling methods (i.e., linear, cubic and nearest neighbor interpolation to 1 × 1 × 3 mm3 voxels) were investigated. Subsequently, 114 textural radiomic features were extracted from a 2.1 cm3 sphere in the center of each insert. The influence of slice thickness, exposure and bin width on feature values was investigated. Feature stability was assessed by calculating the concordance correlation coefficient (CCC) in a test-retest setting and for different combinations of scanners, tube currents and slice thicknesses. RESULTS: Bin width influenced feature values, but this only had a marginal effect on the total number of stable features (CCC > 0.85) when comparing different scanners, slice thicknesses or exposures. Most radiomic features were affected by slice thickness, but this effect could be reduced by resampling the CT-images before feature extraction. Statistics feature 'energy' was the most dependent on slice thickness. No clear correlation between feature values and exposures was observed. CONCLUSIONS: CT-scanner, slice thickness and bin width affected radiomic feature values, whereas no effect of exposure was observed. Optimization of gray-level discretization to potentially improve prognostic value can be performed without compromising feature stability. Resampling images prior to feature extraction decreases the variability of radiomic features.

Longitudinal radiomics of cone-beam CT images from non-small cell lung cancer patients: Evaluation of the added prognostic value for overall survival and locoregional recurrence.

BACKGROUND AND PURPOSE: The prognostic value of radiomics for non-small cell lung cancer (NSCLC) patients has been investigated for images acquired prior to treatment, but no prognostic model has been developed that includes the change of radiomic features during treatment. Therefore, the aim of this study was to investigate the potential added prognostic value of a longitudinal radiomics approach using cone-beam computed tomography (CBCT) for NSCLC patients. MATERIALS AND METHODS: This retrospective study includes a training dataset of 141 stage I-IV NSCLC patients and three external validation datasets of 94, 61 and 41 patients, all treated with curative intended (chemo)radiotherapy. The change of radiomic features extracted from CBCT images was summarized as the slope of a linear regression. The CBCT slope-features and CT-extracted features were used as input for a Cox proportional hazards model. Moreover, prognostic performance of clinical parameters was investigated for overall survival and locoregional recurrence. Model performances were assessed using the Kaplan-Meier curves and c-index. RESULTS: The radiomics model contained only CT-derived features and reached a c-index of 0.63 for overall survival and could be validated on the first validation dataset. No model for locoregional recurrence could be developed that validated on the validation datasets. The clinical parameters model could not be validated for either overall survival or locoregional recurrence. CONCLUSION: In this study we could not confirm our hypothesis that longitudinal CBCT-extracted radiomic features contribute to improved prognostic information. Moreover, performance of baseline radiomic features or clinical parameters was poor, probably affected by heterogeneity within and between datasets.

Challenges and caveats of a multi-center retrospective radiomics study: an example of early treatment response assessment for NSCLC patients using FDG-PET/CT radiomics.

BACKGROUND: Prognostic models based on individual patient characteristics can improve treatment decisions and outcome in the future. In many (radiomic) studies, small size and heterogeneity of datasets is a challenge that often limits performance and potential clinical applicability of these models. The current study is example of a retrospective multi-centric study with challenges and caveats. To highlight common issues and emphasize potential pitfalls, we aimed for an extensive analysis of these multi-center pre-treatment datasets, with an additional 18F-fluorodeoxyglucose (FDG) positron emission tomography/computed tomography (PET/CT) scan acquired during treatment. METHODS: The dataset consisted of 138 stage II-IV non-small cell lung cancer (NSCLC) patients from four different cohorts acquired from three different institutes. The differences between the cohorts were compared in terms of clinical characteristics and using the so-called 'cohort differences model' approach. Moreover, the potential prognostic performances for overall survival of radiomic features extracted from CT or FDG-PET, or relative or absolute differences between the scans at the two time points, were assessed using the LASSO regression method. Furthermore, the performances of five different classifiers were evaluated for all image sets. RESULTS: The individual cohorts substantially differed in terms of patient characteristics. Moreover, the cohort differences model indicated statistically significant differences between the cohorts. Neither LASSO nor any of the tested classifiers resulted in a clinical relevant prognostic model that could be validated on the available datasets. CONCLUSION: The results imply that the study might have been influenced by a limited sample size, heterogeneous patient characteristics, and inconsistent imaging parameters. No prognostic performance of FDG-PET or CT based radiomics models can be reported. This study highlights the necessity of extensive evaluations of cohorts and of validation datasets, especially in retrospective multi-centric datasets.

Decision Support Systems in Oncology.

Precision medicine is the future of health care: please watch the animation at https://vimeo.com/241154708 . As a technology-intensive and -dependent medical discipline, oncology will be at the vanguard of this impending change. However, to bring about precision medicine, a fundamental conundrum must be solved: Human cognitive capacity, typically constrained to five variables for decision making in the context of the increasing number of available biomarkers and therapeutic options, is a limiting factor to the realization of precision medicine. Given this level of complexity and the restriction of human decision making, current methods are untenable. A solution to this challenge is multifactorial decision support systems (DSSs), continuously learning artificial intelligence platforms that integrate all available data-clinical, imaging, biologic, genetic, cost-to produce validated predictive models. DSSs compare the personalized probable outcomes-toxicity, tumor control, quality of life, cost effectiveness-of various care pathway decisions to ensure optimal efficacy and economy. DSSs can be integrated into the workflows both strategically (at the multidisciplinary tumor board level to support treatment choice, eg, surgery or radiotherapy) and tactically (at the specialist level to support treatment technique, eg, prostate spacer or not). In some countries, the reimbursement of certain treatments, such as proton therapy, is already conditional on the basis that a DSS is used. DSSs have many stakeholders-clinicians, medical directors, medical insurers, patient advocacy groups-and are a natural consequence of big data in health care. Here, we provide an overview of DSSs, their challenges, opportunities, and capacity to improve clinical decision making, with an emphasis on the utility in oncology.

18F-fluorodeoxyglucose positron-emission tomography (FDG-PET)-Radiomics of metastatic lymph nodes and primary tumor in non-small cell lung cancer (NSCLC) - A prospective externally validated study.

BACKGROUND: Lymph node stage prior to treatment is strongly related to disease progression and poor prognosis in non-small cell lung cancer (NSCLC). However, few studies have investigated metabolic imaging features derived from pre-radiotherapy 18F-fluorodeoxyglucose (FDG) positron-emission tomography (PET) of metastatic hilar/mediastinal lymph nodes (LNs). We hypothesized that these would provide complementary prognostic information to FDG-PET descriptors to only the primary tumor (tumor). METHODS: Two independent cohorts of 262 and 50 node-positive NSCLC patients were used for model development and validation. Image features (i.e. Radiomics) including shape and size, first order statistics, texture, and intensity-volume histograms (IVH) (http://www.radiomics.io/) were evaluated by univariable Cox regression on the development cohort. Prognostic modeling was conducted with a 10-fold cross-validated least absolute shrinkage and selection operator (LASSO), automatically selecting amongst FDG-PET-Radiomics descriptors from (1) tumor, (2) LNs or (3) both structures. Performance was assessed with the concordance-index. Development data are publicly available at www.cancerdata.org and Dryad (doi:10.5061/dryad.752153b). RESULTS: Common SUV descriptors (maximum, peak, and mean) were significantly related to overall survival when extracted from LNs, as were LN volume and tumor load (summed tumor and LNs' volumes), though this was not true for either SUV metrics or tumor's volume. Feature selection exclusively from imaging information based on FDG-PET-Radiomics, exhibited performances of (1) 0.53 -external 0.54, when derived from the tumor, (2) 0.62 -external 0.56 from LNs, and (3) 0.62 -external 0.59 from both structures, including at least one feature from each sub-category, except IVH. CONCLUSION: Combining imaging information based on FDG-PET-Radiomics features from tumors and LNs is desirable to achieve a higher prognostic discriminative power for NSCLC.

Tracking tumor biology with radiomics: A systematic review utilizing a radiomics quality score.

INTRODUCTION: In this review we describe recent developments in the field of radiomics along with current relevant literature linking it to tumor biology. We furthermore explore the methodologic quality of these studies with our in-house radiomics quality scoring (RQS) tool. Finally, we offer our vision on necessary future steps for the development of stable radiomic features and their links to tumor biology. METHODS: Two authors (S.S. and H.W.) independently performed a thorough systematic literature search and outcome extraction to identify relevant studies published in MEDLINE/PubMed (National Center for Biotechnology Information, NCBI), EMBASE (Ovid) and Web of Science (WoS). Two authors (S.S, H.W) separately and two authors (J.v.T and E.d.J) concordantly scored the articles for their methodology and analyses according to the previously published radiomics quality score (RQS). RESULTS: In summary, a total of 655 records were identified till 25-09-2017 based on the previously specified search terms, from which n = 236 in MEDLINE/PubMed, n = 215 in EMBASE and n = 204 from Web of Science. After determining full article availability and reading the available articles, a total of n = 41 studies were included in the systematic review. The RQS scoring resulted in some discrepancies between the reviewers, e.g. reviewer H.W scored 4 studies ≥50%, reviewer S.S scored 3 studies ≥50% while reviewers J.v.T and E.d.J scored 1 study ≥50%. Up to nine studies were given a quality score of 0%. The majority of studies were scored below 50%. DISCUSSION: In this study, we performed a systematic literature search linking radiomics to tumor biology. All but two studies (n = 39) revealed that radiomic features derived from ultrasound, CT, PET and/or MR are significantly associated with one or several specific tumor biologic substrates, from somatic mutation status to tumor histopathologic grading and metabolism. Considerable inter-observer differences were found with regard to RQS scoring, while important questions were raised concerning the interpretability of the outcome of such scores.

Survival prediction of non-small cell lung cancer patients using radiomics analyses of cone-beam CT images.

BACKGROUND AND PURPOSE: In this study we investigated the interchangeability of planning CT and cone-beam CT (CBCT) extracted radiomic features. Furthermore, a previously described CT based prognostic radiomic signature for non-small cell lung cancer (NSCLC) patients using CBCT based features was validated. MATERIAL AND METHODS: One training dataset of 132 and two validation datasets of 62 and 94stage I-IV NSCLC patients were included. Interchangeability was assessed by performing a linear regression on CT and CBCT extracted features. A two-step correction was applied prior to model validation of a previously published radiomic signature. Results 13.3% (149 out of 1119) of the radiomic features, including all features of the previously published radiomic signature, showed an R2 above 0.85 between intermodal imaging techniques. For the radiomic signature, Kaplan-Meier curves were significantly different between groups with high and low prognostic value for both modalities. Harrell's concordance index was 0.69 for CT and 0.66 for CBCT models for dataset 1. Conclusions The results show that a subset of radiomic features extracted from CT and CBCT images are interchangeable using simple linear regression. Moreover, a previously developed radiomics signature has prognostic value for overall survival in three CBCT cohorts, showing the potential of CBCT radiomics to be used as prognostic imaging biomarker.

4DCT imaging to assess radiomics feature stability: An investigation for thoracic cancers.

BACKGROUND AND PURPOSE: Quantitative tissue characteristics derived from medical images, also called radiomics, contain valuable prognostic information in several tumour-sites. The large number of features available increases the risk of overfitting. Typically test-retest CT-scans are used to reduce dimensionality and select robust features. However, these scans are not always available. We propose to use different phases of respiratory-correlated 4D CT-scans (4DCT) as alternative. MATERIALS AND METHODS: In test-retest CT-scans of 26 non-small cell lung cancer (NSCLC) patients and 4DCT-scans (8 breathing phases) of 20 NSCLC and 20 oesophageal cancer patients, 1045 radiomics features of the primary tumours were calculated. A concordance correlation coefficient (CCC) >0.85 was used to identify robust features. Correlation with prognostic value was tested using univariate cox regression in 120 oesophageal cancer patients. RESULTS: Features based on unfiltered images demonstrated greater robustness than wavelet-filtered features. In total 63/74 (85%) unfiltered features and 268/299 (90%) wavelet features stable in the 4D-lung dataset were also stable in the test-retest dataset. In oesophageal cancer 397/1045 (38%) features were robust, of which 108 features were significantly associated with overall-survival. CONCLUSION: 4DCT-scans can be used as alternative to eliminate unstable radiomics features as first step in a feature selection procedure. Feature robustness is tumour-site specific and independent of prognostic value.

Test-Retest Data for Radiomics Feature Stability Analysis: Generalizable or Study-Specific?

Radiomics is an objective method for extracting quantitative information from medical images. However, in radiomics, standardization, overfitting, and generalization are major challenges to be overcome. Test-retest experiments can be used to select robust radiomic features that have minimal variation. Currently, it is unknown whether they should be identified for each disease (disease specific) or are only imaging device-specific (computed tomography [CT]-specific). Here, we performed a test-retest analysis on CT scans of 40 patients with rectal cancer in a clinical setting. Correlation between radiomic features was assessed using the concordance correlation coefficient (CCC). In total, only 9/542 features have a CCC > 0.85. Furthermore, results were compared with the test-retest results on CT scans of 27 patients with lung cancer with a 15-minute interval. Results show that 446/542 features have a higher CCC for the test-retest analysis of the data set of patients with lung cancer than for patients with rectal cancer. The importance of controlling factors such as scanners, imaging protocol, reconstruction methods, and time points in a radiomics analysis is shown. Moreover, the results imply that test-retest analyses should be performed before each radiomics study. More research is required to independently evaluate the effect of each factor.