Automatic deep learning-based pleural effusion segmentation in lung ultrasound images.

BACKGROUND: Point-of-care lung ultrasound (LUS) allows real-time patient scanning to help diagnose pleural effusion (PE) and plan further investigation and treatment. LUS typically requires training and experience from the clinician to accurately interpret the images. To address this limitation, we previously demonstrated a deep-learning model capable of detecting the presence of PE on LUS at an accuracy greater than 90%, when compared to an experienced LUS operator. METHODS: This follow-up study aimed to develop a deep-learning model to provide segmentations for PE in LUS. Three thousand and forty-one LUS images from twenty-four patients diagnosed with PE were selected for this study. Two LUS experts provided the ground truth for training by reviewing and segmenting the images. The algorithm was then trained using ten-fold cross-validation. Once training was completed, the algorithm segmented a separate subset of patients. RESULTS: Comparing the segmentations, we demonstrated an average Dice Similarity Coefficient (DSC) of 0.70 between the algorithm and experts. In contrast, an average DSC of 0.61 was observed between the experts. CONCLUSION: In summary, we showed that the trained algorithm achieved a comparable average DSC at PE segmentation. This represents a promising step toward developing a computational tool for accurately augmenting PE diagnosis and treatment.

Voxel-based supervised machine learning of peripheral zone prostate cancer using noncontrast multiparametric MRI.

PURPOSE: The aim of this study was to develop and assess the performance of supervised machine learning technique to classify magnetic resonance imaging (MRI) voxels as cancerous or noncancerous using noncontrast multiparametric MRI (mp-MRI), comprised of T2-weighted imaging (T2WI), diffusion-weighted imaging (DWI), and advanced diffusion tensor imaging (DTI) parameters. MATERIALS AND METHODS: In this work, 191 radiomic features were extracted from mp-MRI from prostate cancer patients. A comprehensive set of support vector machine (SVM) models for T2WI and mp-MRI (T2WI + DWI, T2WI + DTI, and T2WI + DWI + DTI) were developed based on novel Bayesian parameters optimization method and validated using leave-one-patient-out approach to eliminate any possible overfitting. The diagnostic performance of each model was evaluated using the area under the receiver operating characteristic curve (AUROC). The average sensitivity, specificity, and accuracy of the models were evaluated using the test data set and the corresponding binary maps generated. Finally, the SVM plus sigmoid function of the models with the highest performance were used to produce cancer probability maps. RESULTS: The T2WI + DWI + DTI models using the optimal feature subset achieved the best performance in prostate cancer detection, with the average AUROC , sensitivity, specificity, and accuracy of 0.93 ± 0.03, 0.85 ± 0.05, 0.82 ± 0.07, and 0.83 ± 0.04, respectively. The average diagnostic performance of T2WI + DTI models was slightly higher than T2WI + DWI models (+3.52%) using the optimal radiomic features. CONCLUSIONS: Combination of noncontrast mp-MRI (T2WI, DWI, and DTI) features with the framework of a supervised classification technique and Bayesian optimization method are able to differentiate cancer from noncancer voxels with high accuracy and without administration of contrast agent. The addition of cancer probability maps provides additional functionality for image interpretation, lesion heterogeneity evaluation, and treatment management.

MRI geometric distortion: Impact on tangential whole-breast IMRT.

The purpose of this study was to determine the impact of magnetic resonance imaging (MRI) geometric distortions when using MRI for target delineation and planning for whole-breast, intensity-modulated radiotherapy (IMRT). Residual system distortions and combined systematic and patient-induced distortions are considered. This retrospective study investigated 18 patients who underwent whole-breast external beam radiotherapy, where both CT and MRIs were acquired for treatment planning. Distortion phantoms were imaged on two MRI systems, dedicated to radiotherapy planning (a wide, closed-bore 3T and an open-bore 1T). Patient scans were acquired on the 3T system. To simulate MRI-based planning, distortion maps representing residual system distortions were generated via deformable registration between phantom CT and MRIs. Patient CT images and structures were altered to match the residual system distortion measured by the phantoms on each scanner. The patient CTs were also registered to the corresponding patient MRI scans, to assess patient and residual system effects. Tangential IMRT plans were generated and optimized on each resulting CT dataset, then propagated to the original patient CT space. The resulting dose distributions were then evaluated with respect to the standard clinically acceptable DVH and visual assessment criteria. Maximum residual systematic distortion was measured to be 7.9 mm (95%<4.7mm) and 11.9 mm (95%<4.6mm) for the 3T and 1T scanners, respectively, which did not result in clinically unacceptable plans. Eight of the plans accounting for patient and systematic distortions were deemed clinically unacceptable when assessed on the original CT. For these plans, the mean difference in PTV V95 (volume receiving 95% prescription dose) was 0.13±2.51% and -0.73±1.93% for right- and left-sided patients, respectively. Residual system distortions alone had minimal impact on the dosimetry for the two scanners investigated. The combination of MRI systematic and patient-related distortions can result in unacceptable dosimetry for whole-breast IMRT, a potential issue when considering MRI-only radiotherapy treatment planning. PACS number(s): 87.61.-c, 87.57.cp, 87.57.nj, 87.55.D.

Investigation on the performance of dedicated radiotherapy positioning devices for MR scanning for prostate planning.

The purpose of this study was to investigate performance of the couch and coil mounts designed for MR-simulation prostate scanning using data from ten volunteers. Volunteers were scanned using the standard MR scanning protocol with the MR coil directly strapped on the external body and the volunteer lying on the original scanner table. They also were scanned using a MR-simulation table top and pelvic coil mounts. MR images from both setups were compared in terms of body contour variation and image quality effects within particular organs of interest. Six-field conformal plans were generated on the two images with assigned bulk density for dose calculation. With the MR-simulation devices, the anterior skin deformation was reduced by up to 1.7 cm. The hard tabletop minimizes the posterior body deformation which can be up to 2.3 cm on the standard table, depending on the weight of volunteer. The image signal-to-noise ratio reduced by 14% and 25% on large field of view (FOV) and small FOV images, respectively, after using the coil mount; the prostate volume contoured on two images showed difference of 1.05 ± 0.66 cm3. The external body deformation caused a mean dose reduction of 0.6 ± 0.3 Gy, while the coverage reduced by 22% ± 13% and 27% ± 6% in V98 and V100, respectively. A dedicated MR simulation setup for prostate radiotherapy is essential to ensure the agreement between planning anatomy and treatment anatomy. The image signal was reduced after applying the coil mount, but no significant effect was found on prostate contouring.

Automatic segmentation of tumour and organs at risk in 3D MRI for cervical cancer radiation therapy with anatomical variations.

Cervical cancer is a common cancer in women globally, with treatment usually involving radiation therapy (RT). Accurate segmentation for the tumour site and organ-at-risks (OARs) could assist in the reduction of treatment side effects and improve treatment planning efficiency. Cervical cancer Magnetic Resonance Imaging (MRI) segmentation is challenging due to a limited amount of training data available and large inter- and intra- patient shape variation for OARs. The proposed Masked-Net consists of a masked encoder within the 3D U-Net to account for the large shape variation within the dataset, with additional dilated layers added to improve segmentation performance. A new loss function was introduced to consider the bounding box loss during training with the proposed Masked-Net. Transfer learning from a male pelvis MRI data with a similar field of view was included. The approaches were compared to the 3D U-Net which was widely used in MRI image segmentation. The data used consisted of 52 volumes obtained from 23 patients with stage IB to IVB cervical cancer across a maximum of 7 weeks of RT with manually contoured labels including the bladder, cervix, gross tumour volume, uterus and rectum. The model was trained and tested with a 5-fold cross validation. Outcomes were evaluated based on the Dice Similarity Coefficients (DSC), the Hausdorff Distance (HD) and the Mean Surface Distance (MSD). The proposed method accounted for the small dataset, large variations in OAR shape and tumour sizes with an average DSC, HD and MSD for all anatomical structures of 0.790, 30.19mm and 3.15mm respectively.

Evaluating the relationship between contouring variability and modelled treatment outcome for prostate bed radiotherapy.

Objectives.Contouring similarity metrics are often used in studies of inter-observer variation and automatic segmentation but do not provide an assessment of clinical impact. This study focused on post-prostatectomy radiotherapy and aimed to (1) identify if there is a relationship between variations in commonly used contouring similarity metrics and resulting dosimetry and (2) identify the variation in clinical target volume (CTV) contouring that significantly impacts dosimetry.Approach.The study retrospectively analysed CT scans of 10 patients from the TROG 08.03 RAVES trial. The CTV, rectum, and bladder were contoured independently by three experienced observers. Using these contours reference simultaneous truth and performance level estimation (STAPLE) volumes were established. Additional CTVs were generated using an atlas algorithm based on a single benchmark case with 42 manual contours. Volumetric-modulated arc therapy (VMAT) treatment plans were generated for the observer, atlas, and reference volumes. The dosimetry was evaluated using radiobiological metrics. Correlations between contouring similarity and dosimetry metrics were calculated using Spearman coefficient (Γ). To access impact of variations in planning target volume (PTV) margin, the STAPLE PTV was uniformly contracted and expanded, with plans created for each PTV volume. STAPLE dose-volume histograms (DVHs) were exported for plans generated based on the contracted/expanded volumes, and dose-volume metrics assessed.Mainresults. The study found no strong correlations between the considered similarity metrics and modelled outcomes. Moderate correlations (0.5 <Γ< 0.7) were observed for Dice similarity coefficient, Jaccard, and mean distance to agreement metrics and rectum toxicities. The observations of this study indicate a tendency for variations in CTV contraction/expansion below 5 mm to result in minor dosimetric impacts.Significance. Contouring similarity metrics must be used with caution when interpreting them as indicators of treatment plan variation. For post-prostatectomy VMAT patients, this work showed variations in contours with an expansion/contraction of less than 5 mm did not lead to notable dosimetric differences, this should be explored in a larger dataset to assess generalisability.

Uncertainty estimation using a 3D probabilistic U-Net for segmentation with small radiotherapy clinical trial datasets.

BACKGROUND AND OBJECTIVES: Bio-medical image segmentation models typically attempt to predict one segmentation that resembles a ground-truth structure as closely as possible. However, as medical images are not perfect representations of anatomy, obtaining this ground truth is not possible. A surrogate commonly used is to have multiple expert observers define the same structure for a dataset. When multiple observers define the same structure on the same image there can be significant differences depending on the structure, image quality/modality and the region being defined. It is often desirable to estimate this type of aleatoric uncertainty in a segmentation model to help understand the region in which the true structure is likely to be positioned. Furthermore, obtaining these datasets is resource intensive so training such models using limited data may be required. With a small dataset size, differing patient anatomy is likely not well represented causing epistemic uncertainty which should also be estimated so it can be determined for which cases the model is effective or not. METHODS: We use a 3D probabilistic U-Net to train a model from which several segmentations can be sampled to estimate the range of uncertainty seen between multiple observers. To ensure that regions where observers disagree most are emphasised in model training, we expand the Generalised Evidence Lower Bound (ELBO) with a Constrained Optimisation (GECO) loss function with an additional contour loss term to give attention to this region. Ensemble and Monte-Carlo dropout (MCDO) uncertainty quantification methods are used during inference to estimate model confidence on an unseen case. We apply our methodology to two radiotherapy clinical trial datasets, a gastric cancer trial (TOPGEAR, TROG 08.08) and a post-prostatectomy prostate cancer trial (RAVES, TROG 08.03). Each dataset contains only 10 cases each for model development to segment the clinical target volume (CTV) which was defined by multiple observers on each case. An additional 50 cases are available as a hold-out dataset for each trial which had only one observer define the CTV structure on each case. Up to 50 samples were generated using the probabilistic model for each case in the hold-out dataset. To assess performance, each manually defined structure was matched to the closest matching sampled segmentation based on commonly used metrics. RESULTS: The TOPGEAR CTV model achieved a Dice Similarity Coefficient (DSC) and Surface DSC (sDSC) of 0.7 and 0.43 respectively with the RAVES model achieving 0.75 and 0.71 respectively. Segmentation quality across cases in the hold-out datasets was variable however both the ensemble and MCDO uncertainty estimation approaches were able to accurately estimate model confidence with a p-value < 0.001 for both TOPGEAR and RAVES when comparing the DSC using the Pearson correlation coefficient. CONCLUSIONS: We demonstrated that training auto-segmentation models which can estimate aleatoric and epistemic uncertainty using limited datasets is possible. Having the model estimate prediction confidence is important to understand for which unseen cases a model is likely to be useful.

Improving chest X-ray report generation by leveraging warm starting.

Automatically generating a report from a patient's Chest X-rays (CXRs) is a promising solution to reducing clinical workload and improving patient care. However, current CXR report generators-which are predominantly encoder-to-decoder models-lack the diagnostic accuracy to be deployed in a clinical setting. To improve CXR report generation, we investigate warm starting the encoder and decoder with recent open-source computer vision and natural language processing checkpoints, such as the Vision Transformer (ViT) and PubMedBERT. To this end, each checkpoint is evaluated on the MIMIC-CXR and IU X-ray datasets. Our experimental investigation demonstrates that the Convolutional vision Transformer (CvT) ImageNet-21K and the Distilled Generative Pre-trained Transformer 2 (DistilGPT2) checkpoints are best for warm starting the encoder and decoder, respectively. Compared to the state-of-the-art (M2 Transformer Progressive), CvT2DistilGPT2 attained an improvement of 8.3% for CE F-1, 1.8% for BLEU-4, 1.6% for ROUGE-L, and 1.0% for METEOR. The reports generated by CvT2DistilGPT2 have a higher similarity to radiologist reports than previous approaches. This indicates that leveraging warm starting improves CXR report generation. Code and checkpoints for CvT2DistilGPT2 are available at https://github.com/aehrc/cvt2distilgpt2.

Investigation of a water equivalent depth method for dosimetric accuracy evaluation of synthetic CT.

PURPOSE: To provide a metric that reflects the dosimetric utility of the synthetic CT (sCT) and can be rapidly determined. METHODS: Retrospective CT and atlas-based sCT of 62 (53 IMRT and 9 VMAT) prostate cancer patients were used. For image similarity measurements, the sCT and reference CT (rCT) were aligned using clinical registration parameters. Conventional image similarity metrics including the mean absolute error (MAE) and mean error (ME) were calculated. The water equivalent depth (WED) was automatically determined for each patient on the rCT and sCT as the distance from the skin surface to the treatment plan isocentre at 36 equidistant gantry angles, and the mean WED difference (ΔWED¯) between the two scans was calculated. Doses were calculated on each scan pair for the clinical plan in the treatment planning system. The image similarity measurements and ΔWED¯ were then compared to the isocentre dose difference (ΔDiso) between the two scans. RESULTS: While no particular relationship to dose was observed for the other image similarity metrics, the ME results showed a linear trend against ΔDiso with R2 = 0.6, and the 95 % prediction interval for ΔDiso between -1.2 and 1 %. The ΔWED¯ results showed an improved linear trend (R2 = 0.8) with a narrower 95 % prediction interval from -0.8 % to 0.8 %. CONCLUSION: ΔWED¯ highly correlates with ΔDiso for the reference and synthetic CT scans. This is easy to calculate automatically and does not require time-consuming dose calculations. Therefore, it can facilitate the process of developing and evaluating new sCT generation algorithms.

Clinical validation of MR imaging time reduction for substitute/synthetic CT generation for prostate MRI-only treatment planning.

Radiotherapy treatment planning based only on magnetic resonance imaging (MRI) has become clinically achievable. Though computed tomography (CT) is the gold standard for radiotherapy imaging, directly providing the electron density values needed for planning calculations, MRI has superior soft tissue visualisation to guide treatment planning decisions and optimisation. MRI-only planning removes the need for the CT scan, but requires generation of a substitute/synthetic/pseudo CT (sCT) for electron density information. Shortening the MRI imaging time would improve patient comfort and reduce the likelihood of motion artefacts. A volunteer study was previously carried out to investigate and optimise faster MRI sequences for a hybrid atlas-voxel conversion to sCT for prostate treatment planning. The aim of this follow-on study was to clinically validate the performance of the new optimised sequence for sCT generation in a treated MRI-only prostate patient cohort. 10 patients undergoing MRI-only treatment were scanned on a Siemens Skyra 3T MRI as part of the MRI-only sub-study of the NINJA clinical trial (ACTRN12618001806257). Two sequences were used, the standard 3D T2-weighted SPACE sequence used for sCT conversion which has been previously validated against CT, and a modified fast SPACE sequence, selected based on the volunteer study. Both were used to generate sCT scans. These were then compared to evaluate the fast sequence conversion for anatomical and dosimetric accuracy against the clinically approved treatment plans. The average Mean Absolute Error (MAE) for the body was 14.98 ± 2.35 HU, and for bone was 40.77 ± 5.51 HU. The external volume contour comparison produced a Dice Similarity Coefficient (DSC) of at least 0.976, and an average of 0.985 ± 0.004, and the bony anatomy contour comparison a DSC of at least 0.907, and an average of 0.950 ± 0.018. The fast SPACE sCT agreed with the gold standard sCT within an isocentre dose of -0.28% ± 0.16% and an average gamma pass rate of 99.66% ± 0.41% for a 1%/1 mm gamma tolerance. In this clinical validation study, the fast sequence, which reduced the required imaging time by approximately a factor of 4, produced an sCT with similar clinical dosimetric results compared to the standard sCT, demonstrating its potential for clinical use for treatment planning.

Prostate volume analysis in image registration for prostate cancer care: a verification study.

Combined magnetic resonance imaging (MRI) and positron emission tomography/computed tomography (PET/CT) may enhance diagnosis, aid surgical planning and intra-operative orientation for prostate biopsy and radical prostatectomy. Although PET-MRI may provide these benefits, PET-MRI machines are not widely available. Image fusion of Prostate specific membrane antigen PET/CT and MRI acquired separately may be a suitable clinical alternative. This study compares CT-MR registration algorithms for urological prostate cancer care. Paired whole-pelvis MR and CT scan data were used (n = 20). A manual prostate CTV contour was performed independently on each patients MR and CT image. A semi-automated rigid-, automated rigid- and automated non-rigid registration technique was applied to align the MR and CT data. Dice Similarity Index (DSI), 95% Hausdorff distance (95%HD) and average surface distance (ASD) measures were used to assess the closeness of the manual and registered contours. The automated non-rigid approach had a significantly improved performance compared to the automated rigid- and semi-automated rigid-registration, having better average scores and decreased spread for the DSI, 95%HD and ASD (all p < 0.001). Additionally, the automated rigid approach had similar significantly improved performance compared to the semi-automated rigid registration across all accuracy metrics observed (all p < 0.001). Overall, all registration techniques studied here demonstrated sufficient accuracy for exploring their clinical use. While the fully automated non-rigid registration algorithm in the present study provided the most accurate registration, the semi-automated rigid registration is a quick, feasible, and accessible method to perform image registration for prostate cancer care by urologists and radiation oncologists now.

Open-source, fully-automated hybrid cardiac substructure segmentation: development and optimisation.

Radiotherapy for thoracic and breast tumours is associated with a range of cardiotoxicities. Emerging evidence suggests cardiac substructure doses may be more predictive of specific outcomes, however, quantitative data necessary to develop clinical planning constraints is lacking. Retrospective analysis of patient data is required, which relies on accurate segmentation of cardiac substructures. In this study, a novel model was designed to deliver reliable, accurate, and anatomically consistent segmentation of 18 cardiac substructures on computed tomography (CT) scans. Thirty manually contoured CT scans were included. The proposed multi-stage method leverages deep learning (DL), multi-atlas mapping, and geometric modelling to automatically segment the whole heart, cardiac chambers, great vessels, heart valves, coronary arteries, and conduction nodes. Segmentation performance was evaluated using the Dice similarity coefficient (DSC), mean distance to agreement (MDA), Hausdorff distance (HD), and volume ratio. Performance was reliable, with no errors observed and acceptable variation in accuracy between cases, including in challenging cases with imaging artefacts and atypical patient anatomy. The median DSC range was 0.81-0.93 for whole heart and cardiac chambers, 0.43-0.76 for great vessels and conduction nodes, and 0.22-0.53 for heart valves. For all structures the median MDA was below 6 mm, median HD ranged 7.7-19.7 mm, and median volume ratio was close to one (0.95-1.49) for all structures except the left main coronary artery (2.07). The fully automatic algorithm takes between 9 and 23 min per case. The proposed fully-automatic method accurately delineates cardiac substructures on radiotherapy planning CT scans. Robust and anatomically consistent segmentations, particularly for smaller structures, represents a major advantage of the proposed segmentation approach. The open-source software will facilitate more precise evaluation of cardiac doses and risks from available clinical datasets.

Determination of acceptable Hounsfield units uncertainties via a sensitivity analysis for an accurate dose calculation in the context of prostate MRI-only radiotherapy.

Radiation therapy is moving from CT based to MRI guided planning, particularly for soft tissue anatomy. An important requirement of this new workflow is the generation of synthetic-CT (sCT) from MRI to enable treatment dose calculations. Automatic methods to determine the acceptable range of CT Hounsfield Unit (HU) uncertainties to avoid dose distribution errors is thus a key step toward safe MRI-only radiotherapy. This work has analysed the effects of controlled errors introduced in CT scans on the delivered radiation dose for prostate cancer patients. Spearman correlation coefficient has been computed, and a global sensitivity analysis performed following the Morris screening method. This allows the classification of different error factors according to their impact on the dose at the isocentre. sCT HU estimation errors in the bladder appeared to be the least influential factor, and sCT quality assessment should not only focus on organs surrounding the radiation target, as errors in other soft tissue may significantly impact the dose in the target volume. This methodology links dose and intensity-based metrics, and is the first step to define a threshold of acceptability of HU uncertainties for accurate dose planning.

Cone beam computed tomography image guidance within a magnetic resonance imaging-only planning workflow.

Background and purpose: Magnetic Resonance Imaging (MRI)-only planning workflows offer many advantages but raises challenges regarding image guidance. The study aimed to assess the viability of MRI to Cone Beam Computed Tomography (CBCT) based image guidance for MRI-only planning treatment workflows. Materials and methods: An MRI matching training package was developed. Ten radiation therapists, with a range of clinical image guidance experience and experience with MRI, completed the training package prior to matching assessment. The matching assessment was performed on four match regions: prostate gold seed, prostate soft tissue, rectum/anal canal and gynaecological. Each match region consisted of five patients, with three CBCTs per patient, resulting in fifteen CBCTs for each match region. The ten radiation therapists performed the CBCT image matching to CT and to MRI for all regions and recorded the match values. Results: The median inter-observer variation for MRI-CBCT matching and CT-CBCT matching for all regions were within 2 mm and 1 degree. There was no statistically significant association in the inter-observer variation in mean match values and radiation therapist image guidance experience levels. There was no statistically significant association in inter-observer variation in mean match values for MRI experience levels for prostate soft tissue and gynaecological match regions, while there was a statistically significant difference for prostate gold seed and rectum match regions. Conclusion: The results of this study support the concept that with focussed training, an MRI to CBCT image guidance approach can be successfully implemented in a clinical planning workflow.

Automatic classification of distal radius fracture using a two-stage ensemble deep learning framework.

Distal radius fractures (DRFs) are one of the most common types of wrist fracture and can be subdivided into intra- and extra-articular fractures. Compared with extra-articular DRFs which spare the joint surface, intra-articular DRFs extend to the articular surface and can be more difficult to treat. Identification of articular involvement can provide valuable information about the characteristics of fracture patterns. In this study, a two-stage ensemble deep learning framework was proposed to differentiate intra- and extra-articular DRFs automatically on posteroanterior (PA) view wrist X-rays. The framework firstly detects the distal radius region of interest (ROI) using an ensemble model of YOLOv5 networks, which imitates the clinicians' search pattern of zooming in on relevant regions to assess abnormalities. Secondly, an ensemble model of EfficientNet-B3 networks classifies the fractures in the detected ROIs into intra- and extra-articular. The framework achieved an area under the receiver operating characteristic curve of 0.82, an accuracy of 0.81, a true positive rate of 0.83 and a false positive rate of 0.27 (specificity of 0.73) for differentiating intra- from extra-articular DRFs. This study has demonstrated the potential in automatic DRF characterization using deep learning on clinically acquired wrist radiographs and can serve as a baseline for further research in incorporating multi-view information for fracture classification.

Clinical target volume delineation quality assurance for MRI-guided prostate radiotherapy using deep learning with uncertainty estimation.

BACKGROUND AND PURPOSE: Previous studies on automatic delineation quality assurance (QA) have mostly focused on CT-based planning. As MRI-guided radiotherapy is increasingly utilized in prostate cancer treatment, there is a need for more research on MRI-specific automatic QA. This work proposes a clinical target volume (CTV) delineation QA framework based on deep learning (DL) for MRI-guided prostate radiotherapy. MATERIALS AND METHODS: The proposed workflow utilized a 3D dropblock ResUnet++ (DB-ResUnet++) to generate multiple segmentation predictions via Monte Carlo dropout which were used to compute an average delineation and area of uncertainty. A logistic regression (LR) classifier was employed to classify the manual delineation as pass or discrepancy based on the spatial association between the manual delineation and the network's outputs. This approach was evaluated on a multicentre MRI-only prostate radiotherapy dataset and compared with our previously published QA framework based on AN-AG Unet. RESULTS: The proposed framework achieved an area under the receiver operating curve (AUROC) of 0.92, a true positive rate (TPR) of 0.92 and a false positive rate of 0.09 with an average processing time per delineation of 1.3 min. Compared with our previous work using AN-AG Unet, this method generated fewer false positive detections at the same TPR with a much faster processing speed. CONCLUSION: To the best of our knowledge, this is the first study to propose an automatic delineation QA tool using DL with uncertainty estimation for MRI-guided prostate radiotherapy, which can potentially be used for reviewing prostate CTV delineation in multicentre clinical trials.

Computed tomography synthesis from magnetic resonance imaging using cycle Generative Adversarial Networks with multicenter learning.

Background and Purpose: Addressing the need for accurate dose calculation in MRI-only radiotherapy, the generation of synthetic Computed Tomography (sCT) from MRI has emerged. Deep learning (DL) techniques, have shown promising results in achieving high sCT accuracies. However, existing sCT synthesis methods are often center-specific, posing a challenge to their generalizability. To overcome this limitation, recent studies have proposed approaches, such as multicenter training . Material and methods: The purpose of this work was to propose a multicenter sCT synthesis by DL, using a 2D cycle-GAN on 128 prostate cancer patients, from four different centers. Four cases were compared: monocenter cases, monocenter training and test on another center, multicenter trainings and a test on a center not included in the training and multicenter trainings with an included center in the test. Trainings were performed using 20 patients. sCT accuracy evaluation was performed using Mean Absolute Error, Mean Error and Peak-Signal-to-Noise-Ratio. Dose accuracy was assessed with gamma index and Dose Volume Histogram comparison. Results: Qualitative, quantitative and dose results show that the accuracy of sCTs for monocenter trainings and multicenter trainings using a seen center in the test did not differ significantly. However, when the test involved an unseen center, the sCT quality was inferior. Conclusions: The aim of this work was to propose generalizable multicenter training for MR-to-CT synthesis. It was shown that only a few data from one center included in the training cohort allows sCT accuracy equivalent to a monocenter study.

A deep learning model to generate synthetic CT for prostate MR-only radiotherapy dose planning: a multicenter study.

Introduction: For radiotherapy based solely on magnetic resonance imaging (MRI), generating synthetic computed tomography scans (sCT) from MRI is essential for dose calculation. The use of deep learning (DL) methods to generate sCT from MRI has shown encouraging results if the MRI images used for training the deep learning network and the MRI images for sCT generation come from the same MRI device. The objective of this study was to create and evaluate a generic DL model capable of generating sCTs from various MRI devices for prostate radiotherapy. Materials and methods: In total, 90 patients from three centers (30 CT-MR prostate pairs/center) underwent treatment using volumetric modulated arc therapy for prostate cancer (PCa) (60 Gy in 20 fractions). T2 MRI images were acquired in addition to computed tomography (CT) images for treatment planning. The DL model was a 2D supervised conditional generative adversarial network (Pix2Pix). Patient images underwent preprocessing steps, including nonrigid registration. Seven different supervised models were trained, incorporating patients from one, two, or three centers. Each model was trained on 24 CT-MR prostate pairs. A generic model was trained using patients from all three centers. To compare sCT and CT, the mean absolute error in Hounsfield units was calculated for the entire pelvis, prostate, bladder, rectum, and bones. For dose analysis, mean dose differences of D 99% for CTV, V 95% for PTV, Dmax for rectum and bladder, and 3D gamma analysis (local, 1%/1 mm) were calculated from CT and sCT. Furthermore, Wilcoxon tests were performed to compare the image and dose results obtained with the generic model to those with the other trained models. Results: Considering the image results for the entire pelvis, when the data used for the test comes from the same center as the data used for training, the results were not significantly different from the generic model. Absolute dose differences were less than 1 Gy for the CTV D 99% for every trained model and center. The gamma analysis results showed nonsignificant differences between the generic and monocentric models. Conclusion: The accuracy of sCT, in terms of image and dose, is equivalent to whether MRI images are generated using the generic model or the monocentric model. The generic model, using only eight MRI-CT pairs per center, offers robust sCT generation, facilitating PCa MRI-only radiotherapy for routine clinical use.

Training radiomics-based CNNs for clinical outcome prediction: Challenges, strategies and findings.

Radiological images play a central role in radiotherapy, especially in target volume delineation. Radiomic feature extraction has demonstrated its potential for predicting patient outcome and cancer risk assessment prior to treatment. However, inherent methodological challenges such as severe class imbalance, small training sample size, multi-centre data and weak correlation of image representations to outcomes are yet to be addressed adequately. Current radiomic analysis relies on segmented images (e.g., of tumours) for feature extraction, leading to loss of important context information in surrounding tissue. In this work, we examine the correlation between radiomics and clinical outcomes by combining two data modalities: pre-treatment computerized tomography (CT) imaging data and contours of segmented gross tumour volumes (GTVs). We focus on a clinical head & neck cancer dataset and design an efficient convolutional neural network (CNN) architecture together with appropriate machine learning strategies to cope with the challenges. During the training process on two cohorts, our algorithm learns to produce clinical outcome predictions by automatically extracting radiomic features. Test results on two other cohorts show state-of-the-art performance in predicting different clinical endpoints (i.e., distant metastasis: AUC = 0.91; loco-regional failure: AUC = 0.78; overall survival: AUC = 0.70 on segmented CT data) compared to prior studies. Furthermore, we also conduct extensive experiments both on the whole CT dataset and a combination of CT and GTV contours to investigate different learning strategies for this task. For example, further experiments indicate that overall survival prediction significantly improves to 0.83 AUC by combining CT and GTV contours as inputs, and the combination provides more intuitive visual explanations for patient outcome predictions.

Comparison of Synthetic Computed Tomography Generation Methods, Incorporating Male and Female Anatomical Differences, for Magnetic Resonance Imaging-Only Definitive Pelvic Radiotherapy.

PURPOSE: There are several means of synthetic computed tomography (sCT) generation for magnetic resonance imaging (MRI)-only planning; however, much of the research omits large pelvic treatment regions and female anatomical specific methods. This research aimed to apply four of the most popular methods of sCT creation to facilitate MRI-only radiotherapy treatment planning for male and female anorectal and gynecological neoplasms. sCT methods were validated against conventional computed tomography (CT), with regard to Hounsfield unit (HU) estimation and plan dosimetry. METHODS AND MATERIALS: Paired MRI and CT scans of 40 patients were used for sCT generation and validation. Bulk density assignment, tissue class density assignment, hybrid atlas, and deep learning sCT generation methods were applied to all 40 patients. Dosimetric accuracy was assessed by dose difference at reference point, dose volume histogram (DVH) parameters, and 3D gamma dose comparison. HU estimation was assessed by mean error and mean absolute error in HU value between each sCT and CT. RESULTS: The median percentage dose difference between the CT and sCT was <1.0% for all sCT methods. The deep learning method resulted in the lowest median percentage dose difference to CT at -0.03% (IQR 0.13, -0.31) and bulk density assignment resulted in the greatest difference at -0.73% (IQR -0.10, -1.01). The mean 3D gamma dose agreement at 3%/2 mm among all sCT methods was 99.8%. The highest agreement at 1%/1 mm was 97.3% for the deep learning method and the lowest was 93.6% for the bulk density method. Deep learning and hybrid atlas techniques gave the lowest difference to CT in mean error and mean absolute error in HU estimation. CONCLUSIONS: All methods of sCT generation used in this study resulted in similarly high dosimetric agreement for MRI-only planning of male and female cancer pelvic regions. The choice of the sCT generation technique can be guided by department resources available and image guidance considerations, with minimal impact on dosimetric accuracy.