Image-based scatter correction for cone-beam CT using flip swin transformer U-shape network.

BACKGROUND: Cone beam computed tomography (CBCT) plays an increasingly important role in image-guided radiation therapy. However, the image quality of CBCT is severely degraded by excessive scatter contamination, especially in the abdominal region, hindering its further applications in radiation therapy. PURPOSE: To restore low-quality CBCT images contaminated by scatter signals, a scatter correction algorithm combining the advantages of convolutional neural networks (CNN) and Swin Transformer is proposed. METHODS: In this paper a scatter correction model for CBCT image, the Flip Swin Transformer U-shape network (FSTUNet) model, is proposed. In this model, the advantages of CNN in texture detail and Swin Transformer in global correlation are used to accurately extract shallow and deep features, respectively. Instead of using the original Swin Transformer tandem structure, we build the Flip Swin Transformer Block to achieve a more powerful inter-window association extraction. The validity and clinical relevance of the method is demonstrated through extensive experiments on a Monte Carlo (MC) simulation dataset and frequency split dataset generated by a validated method, respectively. RESULT: Experimental results on the MC simulated dataset show that the root mean square error of images corrected by the method is reduced from over 100 HU to about 7 HU. Both the structural similarity index measure (SSIM) and the universal quality index (UQI) are close to 1. Experimental results on the frequency split dataset demonstrate that the method not only corrects shading artifacts but also exhibits a high degree of structural consistency. In addition, comparison experiments show that FSTUNet outperforms UNet, Deep Residual Convolutional Neural Network (DRCNN), DSENet, Pix2pixGAN, and 3DUnet methods in both qualitative and quantitative metrics. CONCLUSIONS: Accurately capturing the features at different levels is greatly beneficial for reconstructing high-quality scatter-free images. The proposed FSTUNet method is an effective solution to CBCT scatter correction and has the potential to improve the accuracy of CBCT image-guided radiation therapy.

A generalized image quality improvement strategy of cone-beam CT using multiple spectral CT labels in Pix2pix GAN.

Objective.The quantitative and routine imaging capabilities of cone-beam CT (CBCT) are hindered from clinical applications due to the severe shading artifacts of scatter contamination. The scatter correction methods proposed in the literature only consider the anatomy of the scanned objects while disregarding the impact of incident x-ray energy spectra. The multiple-spectral model is in urgent need for CBCT scatter estimation.Approach.In this work, we incorporate the multiple spectral diagnostic multidetector CT labels into the pixel-to-pixel (Pix2pix) GAN to estimate accurate scatter distributions from CBCT projections acquired at various imaging volume sizes and x-ray energy spectra. The Pix2pix GAN combines the residual network as the generator and the PatchGAN as the discriminator to construct the correspondence between the scatter-contaminated projection and scatter distribution. The network architectures and loss function of Pix2pix GAN are optimized to achieve the best performance on projection-to-scatter transition.Results.The CBCT data of a head phantom and abdominal patients are applied to test the performance of the proposed method. The error of the corrected CBCT image using the proposed method is reduced from over 200 HU to be around 20 HU in both phantom and patient studies. The mean structural similarity index of the CT image is improved from 0.2 to around 0.9 after scatter correction using the proposed method compared with the MC-simulation method, which indicates a high similarity of the anatomy in the images before and after the proposed correction. The proposed method achieves higher accuracy of scatter estimation than using the Pix2pix GAN with the U-net generator.Significance.The proposed scheme is an effective solution to the multiple spectral CBCT scatter correction. The scatter-correction software using the proposed model will be available at:https://github.com/YangkangJiang/Cone-beam-CT-scatter-correction-tool.

Dynamic ginsenoside-sheltered nanocatalysts for safe ferroptosis-apoptosis combined therapy.

Chemodynamic therapy (CDT)-activated apoptosis is a potential anticancer strategy. However, CDT encounters a bottleneck in clinical translation due to its serious side effects and low efficacy. Here, we first reveal that surface engineering of ginsenoside Rg3 dramatically alters the organ distribution and tumor enrichment of systematically administered nanocatalysts using the orthotopic pancreatic tumor model while avoiding toxicity and increasing efficacy in vivo to address the key and universal toxicity problems encountered in nanomedicine. Compared with nanocatalysts alone, Rg3-sheltered dynamic nanocatalysts form hydrophilic nanoclusters, prolonging their circulation lifespan in the blood, protecting the internal nanocatalysts from leakage while allowing their specific release at the tumor site. Moreover, the nanoclusters provide a drug-loading platform for Rg3 so that more Rg3 reaches the tumor site to achieve obvious synergistic effect with nanocatalysts. Rg3-sheltered dynamic nanocatalysts can simultaneously activate ferroptosis and apoptosis to significantly improve anticancer efficacy. Systematic administration of ginsenoside Rg3-sheltered nanocatalysts inhibited 86.6% of tumor growth without toxicity and prolonged the survival time of mice. This study provides a promising approach of nanomedicine with high biosafety and a new outlook for catalytic ferroptosis-apoptosis combined antitumor therapies. STATEMENT OF SIGNIFICANCE: Chemodynamic therapy (CDT) has limited clinical efficacy in cancer. In this study, we developed Rg3-sheltered dynamic nanocatalysts, which could simultaneously activate ferroptosis based on CDT-activated apoptosis, and ultimately form a combined therapy of ferroptosis-apoptosis to kill tumors. Studies have shown that the nanocatalysts after Rg3 surface engineering dramatically alters the pharmacokinetics and organ distribution of the nanocatalysts after being systematically administered, resulting in avoiding the toxicity of the nanocatalysts. Nanocatalysts also act as a drug-loading platform, guiding more Rg3 into the tumor site. This study emphasizes that nanocatalysts after Rg3 surface engineering improve the safety and effectiveness of ferroptosis-apoptosis combined therapy, providing an effective idea for clinical practices.

Deep neural network-based approach to improving radiomics analysis reproducibility in liver cancer: effect on image resampling.

Objectives.To test the effect of traditional up-sampling slice thickness (ST) methods on the reproducibility of CT radiomics features of liver tumors and investigate the improvement using a deep neural network (DNN) scheme.Methods.CT images with ≤ 1 mm ST in the public dataset were converted to low-resolution (3 mm, 5 mm) CT images. A DNN model was trained for the conversion from 3 mm ST and 5 mm ST to 1 mm ST and compared with conventional interpolation-based methods (cubic, linear, nearest) using structural similarity (SSIM) and peak-signal-to-noise-ratio (PSNR). Radiomics features were extracted from the tumor and tumor ring regions. The reproducibility of features from images converted using DNN and interpolation schemes were assessed using the concordance correlation coefficients (CCC) with the cutoff of 0.85. The paired t-test and Mann-Whitney U test were used to compare the evaluation metrics, where appropriate.Results.CT images of 108 patients were used for training (n = 63), validation (n = 11) and testing (n = 34). The DNN method showed significantly higher PSNR and SSIM values (p < 0.05) than interpolation-based methods. The DNN method also showed a significantly higher CCC value than interpolation-based methods. For features in the tumor region, compared with the cubic interpolation approach, the reproducible features increased from 393 (82%) to 422(88%) for the conversion of 3-1 mm, and from 305(64%) to 353(74%) for the conversion of 5-1 mm. For features in the tumor ring region, the improvement was from 395 (82%) to 431 (90%) and from 290 (60%) to 335 (70%), respectively.Conclusions.The DNN based ST up-sampling approach can improve the reproducibility of CT radiomics features in liver tumors, promoting the standardization of CT radiomics studies in liver cancer.

Multi-Material Decomposition for Single Energy CT Using Material Sparsity Constraint.

Multi-material decomposition (MMD) decomposes CT images into basis material images, and is a promising technique in clinical diagnostic CT to identify material compositions within the human body. MMD could be implemented on measurements obtained from spectral CT protocol, although spectral CT data acquisition is not readily available in most clinical environments. MMD methods using single energy CT (SECT), broadly applied in radiological departments of most hospitals, have been proposed in the literature while challenged by the inferior decomposition accuracy and the limited number of material bases due to the constrained material information in the SECT measurement. In this paper, we propose an image-domain SECT MMD method using material sparsity as an assistance under the condition that each voxel of the CT image contains at most two different elemental materials. L0 norm represents the material sparsity constraint (MSC) and is integrated into the decomposition objective function with a least-square data fidelity term, total variation term, and a sum-to-one constraint of material volume fractions. An accelerated primal-dual (APD) algorithm with line-search scheme is applied to solve the problem. The pixelwise direct inversion method with the two-material assumption (TMA) is applied to estimate the initials. We validate the proposed method on phantom and patient data. Compared with the TMA method, the proposed MSC method increases the volume fraction accuracy (VFA) from 92.0% to 98.5% in the phantom study. In the patient study, the calcification area can be clearly visualized in the virtual non-contrast image generated by the proposed method, and has a similar shape to that in the ground-truth contrast-free CT image. The high decomposition image quality from the proposed method substantially facilitates the SECT-based MMD clinical applications.

Image domain multi-material decomposition using single energy CT.

Multi-material decomposition (MMD) technique decomposes the CT images into basis material images and has been promising in clinical practice for material composition quantification within the human body. MMD could be implemented using the image data acquired from spectral CT or its special case, dual-energy CT (DECT) while the spectral CT data acquisition usually requires a hardware modification. In this paper, we propose an image domain MMD method using single energy CT (SECT). The proposed objective function applies a least square data fidelity term to enforce the minimization between the linear combination of decomposed material image and the measured SECT image, and an edge-preserving (EP) regularization term to meet the piecewise constant property of the material image. We apply the optimization transfer principle to form a pixel-wise separable quadratic surrogate (PWSQS) function in each iteration to decrease the objective function. The pixelwise direct inversion method assisted by the two-material assumption (TMA) is applied to obtain a good initial value. The proposed method is evaluated using a digital phantom, a Catphan phantom and the clinical data. A low-pass filtration method is implemented for a comparison purpose. In the phantom study, the proposed TMA method achieves high volume fraction accuracy (VFA) of 79.64% and the proposed EP method further increases the VFA by 15.56% and decreases the decomposition standard deviation (STD) by 81.51% compared with the TMA method. At the comparable noise level, the proposed EP method increases spatial resolution by an overall factor of 1.01 when the modulation transfer function magnitude is decreased to 50% compared with the low-pass filtration method. In clinical data study, the virtual non-contrast image generated by the proposed method achieves the root-mean-squared-relative error of 2.93% compared with the contrast-free ground-truth image.

Noise Suppression in Image-Domain Multi-Material Decomposition for Dual-Energy CT.

OBJECTIVE: Dual-energy CT (DECT) strengthens the material characterization and quantification due to its capability of material discrimination. The image-domain multi-material decomposition (MMD) via matrix inversion suffers from serious degradation of the signal-to-noise ratios (SNRs) of the decomposed images, and thus the clinical application of DECT is limited. In this paper, we propose a noise suppression algorithm based on the noise propagation for image-domain MMD. METHODS: The noise in the decomposed images only distributes in two perpendicular directions and is suppressed by estimating the center of mass of the same-material pixel group vertically along the principal axis where the noise disturbance is minimal. The proposed method is evaluated using the line-pair and contrast-rod slices of the Catphan©600 phantom and one patient data set. We compared the proposed method with the direct inversion and the block-matching and three-dimensional (BM3D) filtration methods. RESULTS: The results of Catphan©600 phantom and the patient show that the proposed method successfully suppresses the noise of the basis material images by one order of magnitude and preserves the spatial resolution of the decomposed images. Compared with the BM3D filtration method, the proposed method maintains the texture distribution of the decomposed images at the same SNR and the accuracy of the electron density measurement. CONCLUSION: The algorithm achieves effective noise suppression compared with the BM3D filtration while maintaining the spatial distribution of the decomposed material images. It is, thus, attractive for advanced clinical applications using DECT.

Extracting and Selecting Robust Radiomic Features from PET/MR Images in Nasopharyngeal Carcinoma.

OBJECTIVES: This work aims to study the variation, robustness, and feature redundancy of PET/MR radiomic features in the primary tumor of nasopharyngeal carcinoma (NPC). PROCEDURES: PET/MR scans of 21 NPC patients were used in this study. The primary tumor volumes were defined using PET, T2-weighted-MR (T2-MR), and diffusion-weighted MR (DW-MR) images. A random-dilation-erosion method was used to simulate 10 sets of tumor volumes for identifying features invariant with manual segmentation uncertainties. Feature robustness was evaluated against imaging modalities, pixel sizes, slice thickness, and grey-level bin sizes using intraclass correlation coefficient (ICC) and spearman correlation coefficient. Feature redundancy was analyzed using the hierarchical cluster analysis. RESULTS: Voxel size of 0.5 × 0.5 × 1.0 mm3 was found optimal for robust feature extraction from PET and MR. Normalized grey level of 64 and 128 was suggested for PET and MR, respectively. The features from wavelet-transformed images were less stable than those from the original images. The robustness analysis and volume correlation analysis identified 335 (62.04 %) PET features, 240 (44.44 %) T2-MR features, and 366 (67.78 %) DW-MR features. The cluster analysis grouped PET, T2-MR, and DW-MR features into 106, 83, and 133 representative features, respectively. CONCLUSIONS: The present study analyzed and identified robust features extracted from tumor volumes on PET/MR, which can provide guidance and promote standardization for PET/MR radiomic studies in NPC.

Scatter correction of cone-beam CT using a deep residual convolution neural network (DRCNN).

Scatter correction is an essential technique to improve the image quality of cone-beam CT (CBCT). Although different scatter correction methods have been proposed in the literature, a standard solution is still being studied due to the limitations including accuracy, computation efficiency and generalization. In this paper, we propose a novel scatter correction scheme for CBCT using a deep residual convolution neural network (DRCNN) to overcome the limitations. The proposed method combines the deep convolution neural network (CNN) and the residual learning framework (RLF) to train the mapping function from the uncorrected image to the corrected image. Two residual network modules (RNMs) are built based on the RLF to improve the accuracy of the mapping function by strengthening the propagation of the gradient. The dropout operations are applied as the regularizer of the network to avoid the overfitting problem. The RMSE of the corrected images reconstructed using the DRCNN is reduced from over 200 HU to be about 20 HU. The structural similarity (SSIM) is slightly increased from 0.95 to 0.99, indicating that the proposed scheme maintains the anatomical structure. The proposed DRCNN has a higher accuracy of scatter correction than the networks without the RLF or the dropout operations. The proposed network is effective, efficient and robust as a solution to the CBCT scatter correction.

Scatter correction for a clinical cone-beam CT system using an optimized stationary beam blocker in a single scan.

PURPOSE: Scatter contamination in the cone-beam CT (CBCT) leads to CT number inaccuracy, spatial nonuniformity, and loss of image contrast. In our previous work, we proposed a single scan scatter correction approach using a stationary partial beam blocker. Although the previous method works effectively on a tabletop CBCT system, it fails to achieve high image quality on a clinical CBCT system mainly due to the wobble of the LINAC gantry during scan acquisition. Due to the mechanical deformation of CBCT gantry, the wobbling effect is observed in the clinical CBCT scan, and more missing data present using the previous blocker with the uniformly distributed lead strips. METHODS: An optimal blocker distribution is proposed to minimize the missing data. In the objective function of the missing data, the motion of the beam blocker in each projection is estimated using the segmentation due to its high contrast in the blocked area. The scatter signals from the blocker are also estimated using an air scan with the inserted blocker. The final image is generated using the forward projection to compensate for the missing data. RESULTS: On the Catphan©504 phantom, our approach reduces the average CT number error from 86 Hounsfield unit (HU) to 9 HU and improves the image contrast by a factor of 1.45 in the high-contrast rods. On a head patient, the CT number error is reduced from 97 HU to 6 HU in the soft-tissue region and the image spatial nonuniformity is decreased from 27% to 5%. CONCLUSIONS: The results suggest that the proposed method is promising for clinical applications.

A multi-organ cancer study of the classification performance using 2D and 3D image features in radiomics analysis.

The purpose of this study was to investigate the predictive performance of 2D and 3D image features across multi-organ cancers using multi-modality images in radiomics studies. In this retrospective study, we included 619 patients with three different cancer types (intrahepatic cholangiocarcinoma (ICC), high-grade osteosarcoma (HOS), pancreatic neuroendocrine tumors (pNETs)) and four clinical end points (early recurrence (ER), lymph node metastasis (LNM), 5-year survival and histologic grade). The image features included fifty-eight 2D image features and fifty-eight 3D image features. The 3D image features were extracted based on the 3D tumor volumes. The 2D image features were extracted based on 2D tumor region, which was the layer with the maximum tumor diameter within the 3D tumor volume. The predictive performance of individual 2D and 3D image feature was measured using the area under the receiver operating characteristic curve (AUC) with univariate analysis. Radiomics signatures were further developed using multivariable analysis with 4-fold cross-validation method. Using univariate analysis, we found that more 3D image features showed the statistically predictive capabilities than 2D image features across all the included cancer types. By comparing the predictive performance of radiomics signatures developed by 2D and 3D image features, we observed better prediction performance in radiomics signatures based on 3D image features than those based on 2D image features for patients with ICC and HGO. Meanwhile, the signatures based on 2D and 3D image features performed closely in the pNETs dataset with the clinical end point of the histologic grade. The reason for this inconsistent result might be that the gross tumor volumes of pNETs were generally small. The tumor heterogeneity was mostly presented in the middle several layers within the tumor volume. Both 2D and 3D image features have certain predictive capacities. By contrast, the 3D image features show better or close predictive performance than 2D image features using both univariate analysis and multivariate analysis. In brief, 3D image features are recommended in radiomics studies.

Survival Prediction in High-grade Osteosarcoma Using Radiomics of Diagnostic Computed Tomography.

The poor 5-year survival rate in high-grade osteosarcoma (HOS) has not been increased significantly over the past 30 years. This work aimed to develop a radiomics nomogram for survival prediction at the time of diagnosis in HOS. In this retrospective study, an initial cohort of 102 HOS patients, diagnosed from January 2008 to March 2011, was used as the training cohort. Radiomics features were extracted from the pretreatment diagnostic computed tomography images. A radiomics signature was constructed with the lasso algorithm; then, a radiomics score was calculated to reflect survival probability by using the radiomics signature for each patient. A radiomics nomogram was developed by incorporating the radiomics score and clinical factors. A clinical model was constructed by using clinical factors only. The models were validated in an independent cohort comprising 48 patients diagnosed from April 2011 to April 2012. The performance of the nomogram was assessed with respect to its calibration, discrimination, and clinical usefulness. Kaplan-Meier survival analysis was performed. The radiomics nomogram showed better calibration and classification capacity than the clinical model with AUC 0.86 vs. 0.79 for the training cohort, and 0.84 vs. 0.73 for the validation cohort. Decision curve analysis demonstrated the clinical usefulness of the radiomics nomogram. A significant difference (p-value <.05; log-rank test) was observed between the survival curves of the nomogram-predicted survival and non-survival groups. The radiomics nomogram may assist clinicians in tailoring appropriate therapy.