Identification of robust and reproducible CT-texture metrics using a customized 3D-printed texture phantom.

OBJECTIVE: The objective of this study was to evaluate the robustness and reproducibility of computed tomography-based texture analysis (CTTA) metrics extracted from CT images of a customized texture phantom built for assessing the association of texture metrics to three-dimensional (3D) printed progressively increasing textural heterogeneity. MATERIALS AND METHODS: A custom-built 3D-printed texture phantom comprising of six texture patterns was used to evaluate the robustness and reproducibility of a radiomics panel under a variety of routine abdominal imaging protocols. The phantom was scanned on four CT scanners (Philips, Canon, GE, and Siemens) to assess reproducibility. The robustness assessment was conducted by imaging the texture phantom across different CT imaging parameters such as slice thickness, field of view (FOV), tube voltage, and tube current for each scanner. The texture panel comprised of 387 features belonging to 15 subgroups of texture extraction methods (e.g., Gray-level Co-occurrence Matrix: GLCM). Twelve unique image settings were tested on all the four scanners (e.g., FOV125). Interclass correlation two-way mixed with absolute agreement (ICC3) was used to assess the robustness and reproducibility of radiomic features. Linear regression was used to test the association between change in radiomic features and increased texture heterogeneity. Results were summarized in heat maps. RESULTS: A total of 5612 (23.2%) of 24 090 features showed excellent robustness and reproducibility (ICC ≥ 0.9). Intensity, GLCM 3D, and gray-level run length matrix (GLRLM) 3D features showed best performance. Among imaging variables, changes in slice thickness affected all metrics more intensely compared to other imaging variables in reducing the ICC3. From the analysis of linear trend effect of the CTTA metrics, the top three metrics with high linear correlations across all scanners and scanning settings were from the GLRLM 2D/3D and discrete cosine transform (DCT) texture family. CONCLUSION: The choice of scanner and imaging protocols affect texture metrics. Furthermore, not all CTTA metrics have a linear association with linearly varying texture patterns.

Reliability of CT-based texture features: Phantom study.

OBJECTIVE: To determine the intra-, inter- and test-retest variability of CT-based texture analysis (CTTA) metrics. MATERIALS AND METHODS: In this study, we conducted a series of CT imaging experiments using a texture phantom to evaluate the performance of a CTTA panel on routine abdominal imaging protocols. The phantom comprises of three different regions with various textures found in tumors. The phantom was scanned on two CT scanners viz. the Philips Brilliance 64 CT and Toshiba Aquilion Prime 160 CT scanners. The intra-scanner variability of the CTTA metrics was evaluated across imaging parameters such as slice thickness, field of view, post-reconstruction filtering, tube voltage, and tube current. For each scanner and scanning parameter combination, we evaluated the performance of eight different types of texture quantification techniques on a predetermined region of interest (ROI) within the phantom image using 235 different texture metrics. We conducted the repeatability (test-retest) and robustness (intra-scanner) test on both the scanners and the reproducibility test was conducted by comparing the inter-scanner differences in the repeatability and robustness to identify reliable CTTA metrics. Reliable metrics are those metrics that are repeatable, reproducible and robust. RESULTS: As expected, the robustness, repeatability and reproducibility of CTTA metrics are variably sensitive to various scanner and scanning parameters. Entropy of Fast Fourier Transform-based texture metrics was overall most reliable across the two scanners and scanning conditions. Post-processing techniques that reduce image noise while preserving the underlying edges associated with true anatomy or pathology bring about significant differences in radiomic reliability compared to when they were not used. CONCLUSION: Following large-scale validation, identification of reliable CTTA metrics can aid in conducting large-scale multicenter CTTA analysis using sample sets acquired using different imaging protocols, scanners etc.