Synthesis of virtual monoenergetic images from kilovoltage peak images using wavelet loss enhanced CycleGAN for improving radiomics features reproducibility.

Background: Dual-energy computed tomography (CT) can provide a range of image information beyond conventional CT through virtual monoenergetic images (VMIs). The purpose of this study was to investigate the impact of material decomposition in detector-based spectral CT on radiomics features and effectiveness of using deep learning-based image synthesis to improve the reproducibility of radiomics features. Methods: In this paper, spectral CT image data from 45 esophageal cancer patients were collected for investigation retrospectively. First, we computed the correlation coefficient of radiomics features between conventional kilovoltage peak (kVp) CT images and VMI. Then, a wavelet loss-enhanced CycleGAN (WLL-CycleGAN) with paired loss terms was developed to synthesize virtual monoenergetic CT images from the corresponding conventional single-energy CT (SECT) images for improving radiomics reproducibility. Finally, the radiomic features in 6 different categories, including gray-level co-occurrence matrix (GLCM), gray-level difference matrix (GLDM), gray-level run-length matrix (GLRLM), gray-level size-zone matrix (GLSZM), neighborhood gray-tone difference matrix (NGTDM), and wavelet, were extracted from the gross tumor volumes from conventional single energy CT, synthetic virtual monoenergetic CT images, and virtual monoenergetic CT images. Comparison between errors in the VMI and synthetic VMI (sVMI) suggested that the performance of our proposed deep learning method improved the radiomic feature accuracy. Results: Material decomposition of dual-layer dual-energy CT (DECT) can substantially influence the reproducibility of the radiomic features, and the degree of impact is feature dependent. The average reduction of radiomics errors for 15 patients in testing sets was 96.9% for first-order, 12.1% for GLCM, 12.9% for GLDM, 15.7% for GLRLM, 50.3% for GLSZM, 53.4% for NGTDM, and 6% for wavelet features. Conclusions: The work revealed that material decomposition has a significant effect on the radiomic feature values. The deep learning-based method reduced the influence of material decomposition in VMIs and might improve the robustness and reproducibility of radiomic features in esophageal cancer. Quantitative results demonstrated that our proposed wavelet loss-enhanced paired CycleGAN outperforms the original CycleGAN.

Online prediction for respiratory movement compensation: a patient-specific gating control for MRI-guided radiotherapy.

BACKGROUND: This study aims to validate the effectiveness of linear regression for motion prediction of internal organs or tumors on 2D cine-MR and to present an online gating signal prediction scheme that can improve the accuracy of MR-guided radiotherapy for liver and lung cancer. MATERIALS AND METHODS: We collected 2D cine-MR sequences of 21 liver cancer patients and 10 lung cancer patients to develop a binary gating signal prediction algorithm that forecasts the crossing-time of tumor motion traces relative to the target threshold. Both 0.4 s and 0.6 s prediction windows were tested using three linear predictors and three recurrent neural networks (RNNs), given the system delay of 0.5 s. Furthermore, an adaptive linear regression model was evaluated using only the first 30 s as the burn-in period, during which the model parameters were adapted during the online prediction process. The accuracy of the predicted traces was measured using amplitude metrics (MAE, RMSE, and R2), and in addition, we proposed three temporal metrics, namely crossing error, gating error, and gating accuracy, which are more relevant to the nature of the gating signals. RESULTS: In both 0.6 s and 0.4 s prediction cases, linear regression outperformed other methods, demonstrating significantly smaller amplitude errors compared to the RNNs (P < 0.05). The proposed algorithm with adaptive linear regression had the best performance with an average gating accuracy of 98.3% and 98.0%, a gating error of 44 ms and 45 ms, for liver cancer and lung cancer patients, respectively. CONCLUSION: A functional online gating control scheme was developed with an adaptive linear regression that is both more cost-efficient and accurate than sophisticated RNN based methods in all studied metrics.

Deep learning-based combination of [18F]-FDG PET and CT images for producing pulmonary perfusion image.

BACKGROUND: The main application of [18F] FDG-PET (18 FDG-PET) and CT images in oncology is tumor identification and quantification. Combining PET and CT images to mine pulmonary perfusion information for functional lung avoidance radiation therapy (FLART) is desirable but remains challenging. PURPOSE: To develop a deep-learning-based (DL) method to combine 18 FDG-PET and CT images for producing pulmonary perfusion images (PPI). METHODS: Pulmonary technetium-99 m-labeled macroaggregated albumin SPECT (PPISPECT ), 18 FDG-PET, and CT images obtained from 53 patients were enrolled. CT and PPISPECT images were rigidly registered, and registration displacement was subsequently used to align 18 FDG-PET and PPISPECT images. The left/right lung was separated and rigidly registered again to improve the registration accuracy. A DL model based on 3D Unet architecture was constructed to directly combine multi-modality 18 FDG-PET and CT images for producing PPI (PPIDLM ). 3D Unet architecture was used as the basic architecture, and the input was expanded from a single-channel to a dual-channel to combine multi-modality images. For comparative evaluation, 18 FDG-PET images were also used alone to generate PPIDLPET . Sixty-seven samples were randomly selected for training and cross-validation, and 36 were used for testing. The Spearman correlation coefficient (rs ) and multi-scale structural similarity index measure (MS-SSIM) between PPIDLM /PPIDLPET and PPISPECT were computed to assess the statistical and perceptual image similarities. The Dice similarity coefficient (DSC) was calculated to determine the similarity between high-/low- functional lung (HFL/LFL) volumes. RESULTS: The voxel-wise rs and MS-SSIM of PPIDLM /PPIDLPET were 0.78 ± 0.04/0.57 ± 0.03, 0.93 ± 0.01/0.89 ± 0.01 for cross-validation and 0.78 ± 0.11/0.55 ± 0.18, 0.93 ± 0.03/0.90 ± 0.04 for testing. PPIDLM /PPIDLPET achieved averaged DSC values of 0.78 ± 0.03/0.64 ± 0.02 for HFL and 0.83 ± 0.01/0.72 ± 0.03 for LFL in the training dataset and 0.77 ± 0.11/0.64 ± 0.12, 0.82 ± 0.05/0.72 ± 0.06 in the testing dataset. PPIDLM yielded a stronger correlation and higher MS-SSIM with PPISPECT than PPIDLPET (p < 0.001). CONCLUSIONS: The DL-based method integrates lung metabolic and anatomy information for producing PPI and significantly improved the accuracy over methods based on metabolic information alone. The generated PPIDLM can be applied for pulmonary perfusion volume segmentation, which is potentially beneficial for FLART treatment plan optimization.

BPAT-UNet: Boundary preserving assembled transformer UNet for ultrasound thyroid nodule segmentation.

BACKGROUND AND OBJECTIVE: Accurate and efficient segmentation of thyroid nodules on ultrasound images is critical for computer-aided nodule diagnosis and treatment. For ultrasound images, Convolutional neural networks (CNNs) and Transformers, which are widely used in natural images, cannot obtain satisfactory segmentation results, because they either cannot obtain precise boundaries or segment small objects. METHODS: To address these issues, we propose a novel Boundary-preserving assembly Transformer UNet (BPAT-UNet) for ultrasound thyroid nodule segmentation. In the proposed network, a Boundary point supervision module (BPSM), which adopts two novel self-attention pooling approaches, is designed to enhance boundary features and generate ideal boundary points through a novel method. Meanwhile, an Adaptive multi-scale feature fusion module (AMFFM) is constructed to fuse features and channel information at different scales. Finally, to fully integrate the characteristics of high-frequency local and low-frequency global, the Assembled transformer module (ATM) is placed at the bottleneck of the network. The correlation between deformable features and features-among computation is characterized by introducing them into the above two modules of AMFFM and ATM. As the design goal and eventually demonstrated, BPSM and ATM promote the proposed BPAT-UNet to further constrain boundaries, whereas AMFFM assists to detect small objects. RESULTS: Compared to other classical segmentation networks, the proposed BPAT-UNet displays superior segmentation performance in visualization results and evaluation metrics. Significant improvement of segmentation accuracy was shown on the public thyroid dataset of TN3k with Dice similarity coefficient (DSC) of 81.64% and 95th percentage of the asymmetric Hausdorff distance (HD95) of 14.06, whereas those on our private dataset were with DSC of 85.63% and HD95 of 14.53, respectively. CONCLUSIONS: This paper presents a method for thyroid ultrasound image segmentation, which achieves high accuracy and meets the clinical requirements. Code is available at https://github.com/ccjcv/BPAT-UNet.

Estimation of intravoxel incoherent motion (IVIM) parameters in vertebral bone marrow: a comparative study of five algorithms.

OBJECTIVES: To access the performances of different algorithms for quantification of Intravoxel incoherent motion (IVIM) parameters D, f, [Formula: see text] in Vertebral Bone Marrow (VBM). MATERIALS AND METHODS: Five algorithms were studied: four deterministic algorithms (the One-Step and three segmented methods: Two-Step, Three-Step, and Fixed-[Formula: see text] algorithm) based on the least-squares (LSQ) method and a Bayesian probabilistic algorithm. Numerical simulations and quantification of IVIM parameters D, f, [Formula: see text] in vivo in vertebral bone marrow, were done on six healthy volunteers. The One-way repeated-measures analysis of variance (ANOVA) followed by Bonferroni's multiple comparison test (p value = 0.05) was applied. RESULTS: In numerical simulations, the Bayesian algorithm provided the best estimation of D, f, [Formula: see text] compared to the deterministic algorithms. In vivo VBM-IVIM, the values of D and f estimated by the Bayesian algorithm were close to those of the One-Step method, in contrast to the three segmented methods. DISCUSSION: The comparison of the five algorithms indicates that the Bayesian algorithm provides the best estimation of VBM-IVIM parameters, in both numerical simulations and in vivo data.

Artificial intelligence assisted cytological detection for early esophageal squamous epithelial lesions by using low-grade squamous intraepithelial lesion as diagnostic threshold.

BACKGROUND: Manual cytological diagnosis for early esophageal squamous cell carcinoma (early ESCC) and high-grade intraepithelial neoplasia (HGIN) is unsatisfactory. Herein, we have introduced an artificial intelligence (AI)-assisted cytological diagnosis for such lesions. METHODS: Low-grade squamous intraepithelial lesion or worse was set as the diagnostic threshold for AI-assisted diagnosis. The performance of AI-assisted diagnosis was evaluated and compared to that of manual diagnosis. Feasibility in large-scale screening was also assessed. RESULTS: AI-assisted diagnosis for abnormal cells was superior to manual reading by presenting a higher efficiency for each slide (50.9 ± 0.8 s vs 236.8 ± 3.9 s, p = 1.52 × 10-76 ) and a better interobserver agreement (93.27% [95% CI, 92.76%-93.74%] vs 65.29% [95% CI, 64.35%-66.22%], p = 1.03 × 10-84 ). AI-assisted detection showed a higher diagnostic accuracy (96.89% [92.38%-98.57%] vs 72.54% [65.85%-78.35%], p = 1.42 × 10-14 ), sensitivity (99.35% [95.92%-99.97%] vs 68.39% [60.36%-75.48%], p = 7.11 × 10-15 ), and negative predictive value (NPV) (97.06% [82.95%-99.85%] vs 40.96% [30.46%-52.31%], p = 1.42 × 10-14 ). Specificity and positive predictive value (PPV) were not significantly differed. AI-assisted diagnosis demonstrated a smaller proportion of participants of interest (3.73%, [79/2117] vs.12.84% [272/2117], p = 1.59 × 10-58 ), a higher consistence between cytology and endoscopy (40.51% [32/79] vs. 12.13% [33/272], p = 1.54 × 10- 8), specificity (97.74% [96.98%-98.32%] vs 88.52% [87.05%-89.84%], p = 3.19 × 10-58 ), and PPV (40.51% [29.79%-52.15%] vs 12.13% [8.61%-16.75%], p = 1.54 × 10-8 ) in community-based screening. Sensitivity and NPV were not significantly differed. AI-assisted diagnosis as primary screening significantly reduced average cost for detecting positive cases. CONCLUSION: Our study provides a novel cytological method for detecting and screening early ESCC and HGIN.

Automatic segmentation for plan-of-the-day selection in CBCT-guided adaptive radiation therapy of cervical cancer.

Objective.Plan-of-the-day (PoD) adaptive radiation therapy (ART) is based on a library of treatment plans, among which, at each treatment fraction, the PoD is selected using daily images. However, this strategy is limited by PoD selection uncertainties. This work aimed to propose and evaluate a workflow to automatically and quantitatively identify the PoD for cervix cancer ART based on daily CBCT images.Approach.The quantification was based on the segmentation of the main structures of interest in the CBCT images (clinical target volume [CTV], rectum, bladder, and bowel bag) using a deep learning model. Then, the PoD was selected from the treatment plan library according to the geometrical coverage of the CTV. For the evaluation, the resulting PoD was compared to the one obtained considering reference CBCT delineations.Main results.In experiments on a database of 23 patients with 272 CBCT images, the proposed method obtained an agreement between the reference PoD and the automatically identified PoD for 91.5% of treatment fractions (99.6% when considering a 5% margin on CTV coverage).Significance.The proposed automatic workflow automatically selected PoD for ART using deep-learning methods. The results showed the ability of the proposed process to identify the optimal PoD in a treatment plan library.

Development and verification of radiomics framework for computed tomography image segmentation.

BACKGROUND: Radiomics has been considered an imaging marker for capturing quantitative image information (QII). The introduction of radiomics to image segmentation is desirable but challenging. PURPOSE: This study aims to develop and validate a radiomics-based framework for image segmentation (RFIS). METHODS: RFIS is designed using features extracted from volume (svfeatures) created by sliding window (swvolume). The 53 svfeatures are extracted from 11 phantom series. Outliers in the svfeature datasets are detected by isolation forest (iForest) and specified as the mean value. The percentage coefficient of variation (%COV) is calculated to evaluate the reproducibility of svfeatures. RFIS is constructed and applied to the gross target volume (GTV) segmentation from the peritumoral region (GTV with a 10 mm margin) to assess its feasibility. The 127 lung cancer images are enrolled. The test-retest method, correlation matrix, and Mann-Whitney U test (p < 0.05) are used to select non-redundant svfeatures of statistical significance from the reproducible svfeatures. The synthetic minority over-sampling technique is utilized to balance the minority group in the training sets. The support vector machine is employed for RFIS construction, which is tuned in the training set using 10-fold stratified cross-validation and then evaluated in the test sets. The swvolumes with the consistent classification results are grouped and merged. Mode filtering is performed to remove very small subvolumes and create relatively large regions of completely uniform character. In addition, RFIS performance is evaluated by the area under the receiver operating characteristic (ROC) curve (AUC), accuracy, sensitivity, specificity, and Dice similarity coefficient (DSC). RESULTS: 30249 phantom and 145008 patient image swvolumes were analyzed. Forty-nine (92.45% of 53) svfeatures represented excellent reproducibility(%COV<15). Forty-five features (91.84% of 49) included five categories that passed test-retest analysis. Thirteen svfeatures (28.89% of 45) svfeatures were selected for RFIS construction. RFIS showed an average (95% confidence interval) sensitivity of 0.848 (95% CI:0.844-0.883), a specificity of 0.821 (95% CI: 0.818-0.825), an accuracy of 83.48% (95% CI: 83.27%-83.70%), and an AUC of 0.906 (95% CI: 0.904-0.908) with cross-validation. The sensitivity, specificity, accuracy, and AUC were equal to 0.762 (95% CI: 0.754-0.770), 0.840 (95% CI: 0.837-0.844), 82.29% (95% CI: 81.90%-82.60%), and 0.877 (95% CI: 0.873-0.881) in the test set, respectively. GTV was segmented by grouping and merging swvolume with identical classification results. The mean DSC after mode filtering was 0.707 ± 0.093 in the training sets and 0.688 ± 0.072 in the test sets. CONCLUSION: Reproducible svfeatures can capture the differences in QII among swvolumes. RFIS can be applied to swvolume classification, which achieves image segmentation by grouping and merging the swvolume with similar QII.

Structure boundary-preserving U-Net for prostate ultrasound image segmentation.

Prostate cancer diagnosis is performed under ultrasound-guided puncture for pathological cell extraction. However, determining accurate prostate location remains a challenge from two aspects: (1) prostate boundary in ultrasound images is always ambiguous; (2) the delineation of radiologists always occupies multiple pixels, leading to many disturbing points around the actual contour. We proposed a boundary structure-preserving U-Net (BSP U-Net) in this paper to achieve precise prostate contour. BSP U-Net incorporates prostate shape prior to traditional U-Net. The prior shape is built by the key point selection module, which is an active shape model-based method. Then, the module plugs into the traditional U-Net structure network to achieve prostate segmentation. The experiments were conducted on two datasets: PH2 + ISBI 2016 challenge and our private prostate ultrasound dataset. The results on PH2 + ISBI 2016 challenge achieved a Dice similarity coefficient (DSC) of 95.94% and a Jaccard coefficient (JC) of 88.58%. The results of prostate contour based on our method achieved a higher pixel accuracy of 97.05%, a mean intersection over union of 93.65%, a DSC of 92.54%, and a JC of 93.16%. The experimental results show that the proposed BSP U-Net has good performance on PH2 + ISBI 2016 challenge and prostate ultrasound image segmentation and outperforms other state-of-the-art methods.

Landmark Localization for Cephalometric Analysis Using Multiscale Image Patch-Based Graph Convolutional Networks.

Accurate and robust cephalometric image analysis plays an essential role in orthodontic diagnosis, treatment assessment and surgical planning. This paper proposes a novel landmark localization method for cephalometric analysis using multiscale image patch-based graph convolutional networks. In detail, image patches with the same size are hierarchically sampled from the Gaussian pyramid to well preserve multiscale context information. We combine local appearance and shape information into spatialized features with an attention module to enrich node representations in graph. The spatial relationships of landmarks are built with the incorporation of three-layer graph convolutional networks, and multiple landmarks are simultaneously updated and moved toward the targets in a cascaded coarse-to-fine process. Quantitative results obtained on publicly available cephalometric X-ray images have exhibited superior performance compared with other state-of-the-art methods in terms of mean radial error and successful detection rate within various precision ranges. Our approach performs significantly better especially in the clinically accepted range of 2 mm and this makes it suitable in cephalometric analysis and orthognathic surgery.

An adaptive optimal viewing angle determination algorithm for TEVAR operation.

BACKGROUND: The determination of the right x-ray angiography viewing angle is an important issue during the treatment of thoracic endovascular aortic repair (TEVAR). An inaccurate projection angle (manually determined today by the physicians according to their personal experience) may affect the placement of the stent and cause vascular occlusion or endoleak. METHODS: Based on the acquisition of a computed tomography angiography (CTA) image before TEVAR, an adaptive optimization algorithm is proposed to determine the optimal viewing angle of the angiogram automatically. This optimal view aims at avoiding any overlapping between the left common carotid artery and the left subclavian artery. Moreover, the proposed optimal procedure exploits the patient-specific morphology to adaptively reduce the potential foreshortening effect. RESULTS: Experimental results conducted on thirty-five patients demonstrate that the optimal angiographic viewing angle based on the proposed method has no significant difference when compared with the expert practice (p = 0.0678). CONCLUSION: We propose a method that utilizes the CTA image acquired before TEVAR to automatically calculate the optimal C-arm angle. This method has the potential to assist surgeons during their interventional procedure by providing a shorter procedure time, less radiation exposure, and less contrast injection.

Meta grayscale adaptive network for 3D integrated renal structures segmentation.

Three-dimensional (3D) integrated renal structures (IRS) segmentation targets segmenting the kidneys, renal tumors, arteries, and veins in one inference. Clinicians will benefit from the 3D IRS visual model for accurate preoperative planning and intraoperative guidance of laparoscopic partial nephrectomy (LPN). However, no success has been reported in 3D IRS segmentation due to the inherent challenges in grayscale distribution: low contrast caused by the narrow task-dependent distribution range of regions of interest (ROIs), and the networks representation preferences caused by the distribution variation inter-images. In this paper, we propose the Meta Greyscale Adaptive Network (MGANet), the first deep learning framework to simultaneously segment the kidney, renal tumors, arteries and veins on CTA images in one inference. It makes innovations in two collaborate aspects: 1) The Grayscale Interest Search (GIS) adaptively focuses segmentation networks on task-dependent grayscale distributions via scaling the window width and center with two cross-correlated coefficients for the first time, thus learning the fine-grained representation for fine segmentation. 2) The Meta Grayscale Adaptive (MGA) learning makes an image-level meta-learning strategy. It represents diverse robust features from multiple distributions, perceives the distribution characteristic, and generates the model parameters to fuse features dynamically according to image's distribution, thus adapting the grayscale distribution variation. This study enrolls 123 patients and the average Dice coefficients of the renal structures are up to 87.9%. Fine selection of the task-dependent grayscale distribution ranges and personalized fusion of multiple representations on different distributions will lead to better 3D IRS segmentation quality. Extensive experiments with promising results on renal structures reveal powerful segmentation accuracy and great clinical significance in renal cancer treatment.

3D Morphologic Findings Before and After Thoracic Endovascular Aortic Repair for Type B Aortic Dissection.

BACKGROUND: Stanford type-B aortic dissection (TBAD) is commonly treated by thoracic endovascular aortic repair (TEVAR). Usually, the implanted stent-grafts will not cover the entire dissection-affected region for those patients with dissection extending beyond the thoracic aorta, thus the fate of the uncovered aortic segment is uncertain. This study used 3-dimensional measurement of aortic morphological changes to classify the different remodeling effects of TBAD patients after TEVAR, and hypothesized that not only initial morphological features, but also their change over time at follow-up are associated with the remodeling. METHODS: Forty-one TBAD patients underwent TEVAR and CT-angiography before and after the intervention (twice or more follow-ups) were included in this study. According to the false-lumen volume variations post-TEVAR, patients who had abdominal aortic expansion at the second follow-up were classified into the Enlarged (n =12, 29%) and remaining into the Stable group (n = 29, 71%). 3D morphological parameters were extracted on precise reconstruction of imaging datasets. Statistical differences in 3D morphological parameters over time between the 2 groups and the relationship among these parameters were analyzed. RESULTS: In the Enlarged group, the number of all tears before TEVAR was significantly higher (P = 0.022), and the size of all tears at the first and second follow-up post-TEVAR were significantly higher than that in the Stable group (P = 0.008 and P = 0.007). The location of the primary tear was significantly higher (P = 0.031) in the Stable group. The cross-sectional analysis of several slices below the primary tear before TEVAR shows different shape features of the false lumen in the Stable (cone-like) and Enlarged (hourglass-like) groups. The number of tears before TEVAR has a positive correlation with the post-TEVAR development of dissection (r = 0.683, P = 0.00). CONCLUSION: The results in this study indicated that the TBAD patients with larger tear areas, more re-entry tears and with the primary tear proximal to the arch would face a higher risk of negative remodeling after TEVAR.

HIFUNet: Multi-Class Segmentation of Uterine Regions From MR Images Using Global Convolutional Networks for HIFU Surgery Planning.

Accurate segmentation of uterus, uterine fibroids, and spine from MR images is crucial for high intensity focused ultrasound (HIFU) therapy but remains still difficult to achieve because of 1) the large shape and size variations among individuals, 2) the low contrast between adjacent organs and tissues, and 3) the unknown number of uterine fibroids. To tackle this problem, in this paper, we propose a large kernel Encoder-Decoder Network based on a 2D segmentation model. The use of this large kernel can capture multi-scale contexts by enlarging the valid receptive field. In addition, a deep multiple atrous convolution block is also employed to enlarge the receptive field and extract denser feature maps. Our approach is compared to both conventional and other deep learning methods and the experimental results conducted on a large dataset show its effectiveness.

Weakly-supervised convolutional neural networks of renal tumor segmentation in abdominal CTA images.

BACKGROUND: Renal cancer is one of the 10 most common cancers in human beings. The laparoscopic partial nephrectomy (LPN) is an effective way to treat renal cancer. Localization and delineation of the renal tumor from pre-operative CT Angiography (CTA) is an important step for LPN surgery planning. Recently, with the development of the technique of deep learning, deep neural networks can be trained to provide accurate pixel-wise renal tumor segmentation in CTA images. However, constructing the training dataset with a large amount of pixel-wise annotations is a time-consuming task for the radiologists. Therefore, weakly-supervised approaches attract more interest in research. METHODS: In this paper, we proposed a novel weakly-supervised convolutional neural network (CNN) for renal tumor segmentation. A three-stage framework was introduced to train the CNN with the weak annotations of renal tumors, i.e. the bounding boxes of renal tumors. The framework includes pseudo masks generation, group and weighted training phases. Clinical abdominal CT angiographic images of 200 patients were applied to perform the evaluation. RESULTS: Extensive experimental results show that the proposed method achieves a higher dice coefficient (DSC) of 0.826 than the other two existing weakly-supervised deep neural networks. Furthermore, the segmentation performance is close to the fully supervised deep CNN. CONCLUSIONS: The proposed strategy improves not only the efficiency of network training but also the precision of the segmentation.

Fast and accurate segmentation method of active shape model with Rayleigh mixture model clustering for prostate ultrasound images.

BACKGROUND AND OBJECTIVE: The prostate cancer interventions, which need an accurate prostate segmentation, are performed under ultrasound imaging guidance. However, prostate ultrasound segmentation is facing two challenges. The first is the low signal-to-noise ratio and inhomogeneity of the ultrasound image. The second is the non-standardized shape and size of the prostate. METHODS: For prostate ultrasound image segmentation, this paper proposed an accurate and efficient method of Active shape model (ASM) with Rayleigh mixture model Clustering (ASM-RMMC). Firstly, Rayleigh mixture model (RMM) is adopted for clustering the image regions which present similar speckle distributions. These content-based clustered images are then used to initialize and guide the deformation of an ASM model. RESULTS: The performance of the proposed method is assessed on 30 prostate ultrasound images using four metrics as Mean Average Distance (MAD), Dice Similarity Coefficient (DSC), False Positive Error (FPE) and False Negative Error (FNE). The proposed ASM-RMMC reaches high segmentation accuracy with 95% ± 0.81% for DSC, 1.86 ±â€¯0.02 pixels for MAD, 2.10% ± 0.36% for FPE and 2.78% ± 0.71% for FNE, respectively. Moreover, the average segmentation time is less than 8 s when treating a single prostate ultrasound image through ASM-RMMC. CONCLUSIONS: This paper presents a method for prostate ultrasound image segmentation, which achieves high accuracy with less computational complexity and meets the clinical requirements.

Prescription Value-Based Automatic Optimization of Importance Factors in Inverse Planning.

OBJECTIVE: An automatic method for the optimization of importance factors was proposed to improve the efficiency of inverse planning. METHODS: The automatic method consists of 3 steps: (1) First, the importance factors are automatically and iteratively adjusted based on our proposed penalty strategies. (2) Then, plan evaluation is performed to determine whether the obtained plan is acceptable. (3) If not, a higher penalty is assigned to the unsatisfied objective by multiplying it by a compensation coefficient. The optimization processes are performed alternately until an acceptable plan is obtained or the maximum iteration Nmax of step (3) is reached. RESULTS: Tested on 2 kinds of clinical cases and compared with manual method, the results showed that the quality of the proposed automatic plan was comparable to, or even better than, the manual plan in terms of the dose-volume histogram and dose distributions. CONCLUSIONS: The proposed algorithm has potential to significantly improve the efficiency of the existing manual adjustment methods for importance factors and contributes to the development of fully automated planning. Especially, the more the subobjective functions, the more obvious the advantage of our algorithm.

Fractional Wavelet Scattering Network and Applications.

OBJECTIVE: This study introduces a fractional wavelet scattering network (FrScatNet), which is a generalized translation invariant version of the classical wavelet scattering network. METHODS: In our approach, the FrScatNet is constructed based on the fractional wavelet transform (FRWT). The fractional scattering coefficients are iteratively computed using FRWTs and modulus operators. The feature vectors constructed by fractional scattering coefficients are usually used for signal classification. In this paper, an application example of the FrScatNet is provided in order to assess its performance on pathological images. First, the FrScatNet extracts feature vectors from patches of the original histological images under different orders. Then we classify those patches into target (benign or malignant) and background groups. And the FrScatNet property is analyzed by comparing error rates computed from different fractional orders, respectively. Based on the above pathological image classification, a gland segmentation algorithm is proposed by combining the boundary information and the gland location. RESULTS: The error rates for different fractional orders of FrScatNet are examined and show that the classification accuracy is improved in fractional scattering domain. We also compare the FrScatNet-based gland segmentation method with those proposed in the 2015 MICCAI Gland Segmentation Challenge and our method achieves comparable results. CONCLUSION: The FrScatNet is shown to achieve accurate and robust results. More stable and discriminative fractional scattering coefficients are obtained by the FrScatNet in this paper. SIGNIFICANCE: The added fractional order parameter is able to analyze the image in the fractional scattering domain.

Iterative spatial fuzzy clustering for 3D brain magnetic resonance image supervoxel segmentation.

BACKGROUND: Although supervoxel segmentation methods have been employed for brain Magnetic Resonance Image (MRI) processing and analysis, due to the specific features of the brain, including complex-shaped internal structures and partial volume effect, their performance remains unsatisfactory. NEW METHODS: To address these issues, this paper presents a novel iterative spatial fuzzy clustering (ISFC) algorithm to generate 3D supervoxels for brain MRI volume based on prior knowledge. This work makes use of the common topology among the human brains to obtain a set of seed templates from a population-based brain template MRI image. After selecting the number of supervoxels, the corresponding seed template is projected onto the considered individual brain for generating reliable seeds. Then, to deal with the influence of partial volume effect, an efficient iterative spatial fuzzy clustering algorithm is proposed to allocate voxels to the seeds and to generate the supervoxels for the overall brain MRI volume. RESULTS: The performance of the proposed algorithm is evaluated on two widely used public brain MRI datasets and compared with three other up-to-date methods. CONCLUSIONS: The proposed algorithm can be utilized for several brain MRI processing and analysis, including tissue segmentation, tumor detection and segmentation, functional parcellation and registration.

Edge-preserving denoising for intra-operative cone beam CT in endovascular aneurysm repair.

C-arm cone-beam computed tomography (CBCT) acquisition during endovascular aneurysm repair (EVAR) is an emergent technology with more and more applications. It offers real time imaging with a stationary patient and provides 3-D information to achieve guidance of intervention. However, there is growing concern on the overall radiation doses delivered to patients all along the endovascular management due to pre-, intra-, and post-operative X-ray imaging. Manufactures may have their low dose protocols to realize reduction of radiation dose, but CBCT with a low dose protocol has too many artifacts, particularly streak artifacts, and decreased contrast-to-noise ratio (CNR). To reduce noise and artifacts, a penalized weighted least-squares (PWLS) algorithm with an edge-preserving penalty is proposed. The proposed method is evaluated by quantitative parameters including a defined signal-to-noise ratio (SNR), CNR, and modulation transfer function (MTF) on clinical CBCT. Comparisons with PWLS algorithms with isotropic, TV, Huber, anisotropic penalties demonstrate that the proposed edge-preserving penalty performs well not only on edge preservation, but also on streak artifacts suppression, which may be crucial for observing guidewire and stentgraft in EVAR.