Motion compensated cone-beam CT reconstruction using ana priorimotion model from CT simulation: a pilot study.

Objective. To combat the motion artifacts present in traditional 4D-CBCT reconstruction, an iterative technique known as the motion-compensated simultaneous algebraic reconstruction technique (MC-SART) was previously developed. MC-SART employs a 4D-CBCT reconstruction to obtain an initial model, which suffers from a lack of sufficient projections in each bin. The purpose of this study is to demonstrate the feasibility of introducing a motion model acquired during CT simulation to MC-SART, coined model-based CBCT (MB-CBCT).Approach. For each of 5 patients, we acquired 5DCTs during simulation and pre-treatment CBCTs with a simultaneous breathing surrogate. We cross-calibrated the 5DCT and CBCT breathing waveforms by matching the diaphragms and employed the 5DCT motion model parameters for MC-SART. We introduced the Amplitude Reassignment Motion Modeling technique, which measures the ability of the model to control diaphragm sharpness by reassigning projection amplitudes with varying resolution. We evaluated the sharpness of tumors and compared them between MB-CBCT and 4D-CBCT. We quantified sharpness by fitting an error function across anatomical boundaries. Furthermore, we compared our MB-CBCT approach to the traditional MC-SART approach. We evaluated MB-CBCT's robustness over time by reconstructing multiple fractions for each patient and measuring consistency in tumor centroid locations between 4D-CBCT and MB-CBCT.Main results. We found that the diaphragm sharpness rose consistently with increasing amplitude resolution for 4/5 patients. We observed consistently high image quality across multiple fractions, and observed stable tumor centroids with an average 0.74 ± 0.31 mm difference between the 4D-CBCT and MB-CBCT. Overall, vast improvements over 3D-CBCT and 4D-CBCT were demonstrated by our MB-CBCT technique in terms of both diaphragm sharpness and overall image quality.Significance. This work is an important extension of the MC-SART technique. We demonstrated the ability ofa priori5DCT models to provide motion compensation for CBCT reconstruction. We showed improvements in image quality over both 4D-CBCT and the traditional MC-SART approach.

Incidental findings and safety events from magnetic resonance imaging simulation for head and neck radiation treatment planning: A single institution experience.

Purpose: Having dedicated MRI scanners within radiation oncology departments may present unexpected challenges since radiation oncologists and radiation therapists are generally not trained in this modality and there are potential patient safety concerns. This study retrospectively reviews the incidental findings and safety events that were observed at a single institution during introduction of MRI sim for head and neck radiotherapy planning. Methods: Consecutive patients from March 1, 2020, to May 31, 2022, who were scheduled for MRI sim after having completed CT simulation for head and neck radiotherapy were included for analysis. Patients first underwent a CT simulation with a thermoplastic mask and in most cases with an intraoral stent. The same setup was then reproduced in the MRI simulator. Safety events were instances where scheduled MRI sims were not completed due to the MRI technologist identifying MRI-incompatible devices or objects at the time of sim. Incidental findings were identified during weekly quality assurance rounds as a joint enterprise of head and neck radiation oncology and neuroradiology. Categorical variables between completed and not completed MRI sims were compared using the Chi-Square test and continuous variables were compared using the Mann-Whitney U test with a p-value of < 0.05 considered to be statistically significant. Results: 148 of 169 MRI sims (88 %) were completed as scheduled and 21 (12 %) were not completed (Table 1). Among the 21 aborted MRI sims, the most common reason was due to safety events flagged by the MRI technologist (n = 8, 38 %) because of the presence of metal or a medical device that was not noted at the time of initial screening by the administrative coordinator. Patients who did not complete MRI sim were more likely to be treated for non-squamous head and neck primary tumor (p = 0.016) and were being treated post-operatively (p < 0.001). CT and MRI sim scans each had 17 incidental findings. CT simulation detected 3 cases of new metastases in lungs, which were outside the scan parameters of MRI sim. MRI sim detected one case of dural venous thrombosis and one case of cervical spine epidural abscess, which were not detected by CT simulation. Conclusions: Radiation oncology departments with dedicated MRI simulation scanners would benefit from diagnostic radiology review for incidental findings and having therapists with MRI safety credentialing to catch near-miss events.

End-to-end validation of fiducial tracking accuracy in robotic radiosurgery using MRI-only simulation imaging.

BACKGROUND: Image-guided radiation-therapy (IGRT)-based robotic radiosurgery using magnetic resonance imaging (MRI)-only simulation could allow for improved target definition with highly conformal radiotherapy treatments. Fiducial marker (FM)-based alignment is used with robotic radiosurgery treatments of sites such as the prostate because it aids in accurate target localization. Synthetic CT (sCT) images are generated in the MRI-only workflow but FMs used for IGRT appear as signal voids in MRIs and do not appear in MR-generated sCTs, hindering the ability to use sCTs for fiducial-based IGRT. PURPOSE: In this study we evaluate the fiducial tracking accuracy for a novel artificial fiducial insertion method in sCT images that allows for fiducial marker tracking in robotic radiosurgery, using MRI-only simulation imaging (MRI-only workflow). METHODS: Artificial fiducial markers were inserted into sCT images at the site of the real marker implantation as visible in MRI. Two phantoms were used in this study. A custom anthropomorphic pelvis phantom was designed to validate the tracking accuracy for a variety of artificial fiducials in an MRI-only workflow. A head phantom containing a hidden target and orthogonal film pair inserts was used to perform end-to-end tests of artificial fiducial configurations inserted in sCT images. The setup and end-to-end targeting accuracy of the MRI-only workflow were compared to the computed tomography (CT)-based standard. Each phantom had six FMs implanted with a minimum spacing of 2 cm. For each phantom a bulk-density sCT was generated, and artificial FMs were inserted at the implantation location. Several methods of FM insertion were tested including: (1) replacing HU with a fixed value (10000HU) (voxel-burned); (2) using a representative fiducial image derived from a linear combination of fiducial templates (composite-fiducial); (3) computationally simulating FM signal voids using a digital phantom containing FMs and inserting the corresponding signal void into sCT images (simulated-fiducial). All tests were performed on a CyberKnife system (Accuray, Sunnyvale, CA). Treatment plans and digital-reconstructed-radiographs were generated from the original CT and sCTs with embedded fiducials and used to align the phantom on the treatment couch. Differences in the initial phantom alignment (3D translations/rotations) and tracking parameters between CT-based plans and sCT-based plans were analyzed. End-to-end plans for both scenarios were generated and analyzed following our clinical protocol. RESULTS: For all plans, the fiducial tracking algorithm was able to identify the fiducial locations. The mean FM-extraction uncertainty for the composite and simulated FMs was below 48% for fiducials in both the anthropomorphic pelvis and end-to-end phantoms, which is below the 70% treatment uncertainty threshold. The total targeting error was within tolerance (<0.95 mm) for end-to-end tests of sCT images with the composite and head-on simulated FMs (0.26, 0.44, and 0.35 mm for the composite fiducial in sCT, head-on simulated fiducial in sCT, and fiducials in original CT, respectively. CONCLUSIONS: MRI-only simulation for robotic radiosurgery could potentially improve treatment accuracy and reduce planning margins. Our study has shown that using a composite-derived or simulated FM in conjunction with sCT images, MRI-only workflow can provide clinically acceptable setup accuracy in line with CT-based standards for FM-based robotic radiosurgery.

Evaluating the Hounsfield unit assignment and dose differences between CT-based standard and deep learning-based synthetic CT images for MRI-only radiation therapy of the head and neck.

BACKGROUND: Magnetic resonance image only (MRI-only) simulation for head and neck (H&N) radiotherapy (RT) could allow for single-image modality planning with excellent soft tissue contrast. In the MRI-only simulation workflow, synthetic computed tomography (sCT) is generated from MRI to provide electron density information for dose calculation. Bone/air regions produce little MRI signal which could lead to electron density misclassification in sCT. Establishing the dosimetric impact of this error could inform quality assurance (QA) procedures using MRI-only RT planning or compensatory methods for accurate dosimetric calculation. PURPOSE: The aim of this study was to investigate if Hounsfield unit (HU) voxel misassignments from sCT images result in dosimetric errors in clinical treatment plans. METHODS: Fourteen H&N cancer patients undergoing same-day CT and 3T MRI simulation were retrospectively identified. MRI was deformed to the CT using multimodal deformable image registration. sCTs were generated from T1w DIXON MRIs using a commercially available deep learning-based generator (MRIplanner, Spectronic Medical AB, Helsingborg, Sweden). Tissue voxel assignment was quantified by creating a CT-derived HU threshold contour. CT/sCT HU differences for anatomical/target contours and tissue classification regions including air (<250 HU), adipose tissue (-250 HU to -51 HU), soft tissue (-50 HU to 199 HU), spongy (200 HU to 499 HU) and cortical bone (>500 HU) were quantified. t-test was used to determine if sCT/CT HU differences were significant. The frequency of structures that had a HU difference > 80 HU (the CT window-width setting for intra-cranial structures) was computed to establish structure classification accuracy. Clinical intensity modulated radiation therapy (IMRT) treatment plans created on CT were retrospectively recalculated on sCT images and compared using the gamma metric. RESULTS: The mean ratio of sCT HUs relative to CT for air, adipose tissue, soft tissue, spongy and cortical bone were 1.7 ± 0.3, 1.1 ± 0.1, 1.0 ± 0.1, 0.9 ± 0.1 and 0.8 ± 0.1 (value of 1 indicates perfect agreement). T-tests (significance set at t = 0.05) identified differences in HU values for air, spongy and cortical bone in sCT images compared to CT. The structures with sCT/CT HU differences > 80 HU of note were the left and right (L/R) cochlea and mandible (>79% of the tested cohort), the oral cavity (for 57% of the tested cohort), the epiglottis (for 43% of the tested cohort) and the L/R TM joints (occurring > 29% of the cohort). In the case of the cochlea and TM joints, these structures contain dense bone/air interfaces. In the case of the oral cavity and mandible, these structures suffer the additional challenge of being positionally altered in CT versus MRI simulation (due to a non-MR safe immobilizing bite block requiring absence of bite block in MR). Finally, the epiglottis HU assignment suffers from its small size and unstable positionality. Plans recalculated on sCT yielded global/local gamma pass rates of 95.5% ± 2% (3 mm, 3%) and 92.7% ± 2.1% (2 mm, 2%). The largest mean differences in D95, Dmean , D50 dose volume histogram (DVH) metrics for organ-at-risk (OAR) and planning tumor volumes (PTVs) were 2.3% ± 3.0% and 0.7% ± 1.9% respectively. CONCLUSIONS: In this cohort, HU differences of CT and sCT were observed but did not translate into a reduction in gamma pass rates or differences in average PTV/OAR dose metrics greater than 3%. For sites such as the H&N where there are many tissue interfaces we did not observe large scale dose deviations but further studies using larger retrospective cohorts are merited to establish the variation in sCT dosimetric accuracy which could help to inform QA limits on clinical sCT usage.

Automatic triangulated mesh generation of pulmonary airways from segmented lung 3DCTs for computational fluid dynamics.

PURPOSE: Computational fluid dynamics (CFD) of lung airflow during normal and pathophysiological breathing provides insight into regional pulmonary ventilation. By integrating CFD methods with 4D lung imaging workflows, regions of normal pulmonary function can be spared during treatment planning. To facilitate the use of CFD simulations in a clinical setup, a robust, automated, and CFD-compliant airway mesh generation technique is necessary. METHODS: We define a CFD-compliant airway mesh to be devoid of blockages of airflow and leaks in the airway path, both of which are caused by airway meshing errors that occur when using conventional meshing techniques. We present an algorithm to create a CFD-compliant airway mesh in an automated manner. Beginning with a medial skeleton of the airway segmentation, the branches were tracked, and 3D points at which bifurcations occur were identified. Airway branches and bifurcation features were isolated to allow for automated and careful meshing that considered their anatomical nature. RESULTS: We present the meshing results from three state-of-the-art tools and compare them with the meshes generated by our algorithm. The results show that fully CFD-compliant meshes were automatically generated for an ideal geometry and patient-specific CT scans. Using an open-source smoothed-particle hydrodynamics CFD implementation, we compared the airflow using our approach and conventionally generated airway meshes. CONCLUSION: Our meshing algorithm was able to successfully generate a CFD-compliant mesh from pre-segmented lung CT scans, providing an automatic meshing approach that enables interventional CFD simulations to guide lung procedures such as radiotherapy or lung volume reduction surgery.

An Automatic Deep Learning-Based Workflow for Glioblastoma Survival Prediction Using Preoperative Multimodal MR Images: A Feasibility Study.

PURPOSE: Most radiomic studies use the features extracted from the manually drawn tumor contours for classification or survival prediction. However, large interobserver segmentation variations lead to inconsistent features and hence introduce more challenges in constructing robust prediction models. Here, we proposed an automatic workflow for glioblastoma (GBM) survival prediction based on multimodal magnetic resonance (MR) images. METHODS AND MATERIALS: Two hundred eighty-five patients with glioma (210 GBM, 75 low-grade glioma) were included. One hundred sixty-three of the patients with GBM had overall survival data. Every patient had 4 preoperative MR images and manually drawn tumor contours. A 3-dimensional convolutional neural network, VGG-Seg, was trained and validated using 122 patients with glioma for automatic GBM segmentation. The trained VGG-Seg was applied to the remaining 163 patients with GBM to generate their autosegmented tumor contours. The handcrafted and deep learning (DL)-based radiomic features were extracted from the autosegmented contours using explicitly designed algorithms and a pretrained convolutional neural network, respectively. One hundred sixty-three patients with GBM were randomly split into training (n = 122) and testing (n = 41) sets for survival analysis. Cox regression models were trained to construct the handcrafted and DL-based signatures. The prognostic powers of the 2 signatures were evaluated and compared. RESULTS: The VGG-Seg achieved a mean Dice coefficient of 0.86 across 163 patients with GBM for GBM segmentation. The handcrafted signature achieved a C-index of 0.64 (95% confidence interval, 0.55-0.73), whereas the DL-based signature achieved a C-index of 0.67 (95% confidence interval, 0.57-0.77). Unlike the handcrafted signature, the DL-based signature successfully stratified testing patients into 2 prognostically distinct groups. CONCLUSIONS: The VGG-Seg generated accurate GBM contours from 4 MR images. The DL-based signature achieved a numerically higher C-index than the handcrafted signature and significant patient stratification. The proposed automatic workflow demonstrated the potential of improving patient stratification and survival prediction in patients with GBM.

Scalable quorum-based deep neural networks with adversarial learning for automated lung lobe segmentation in fast helical free-breathing CTs.

PURPOSE: Fast helical free-breathing CT (FHFBCT) scans are widely used for 5DCT and 5D Cone Beam imaging protocols. For quantitative analysis of lung physiology and function, it is important to segment the lung lobes in these scans. Since the 5DCT protocols use up to 25 FHFBCT scans, it is important that this segmentation task be automated. In this paper, we present a deep neural network (DNN) framework for segmenting the lung lobes in near real time. METHODS: A total of 22 patient datasets (550 3D CT scans) were used for the study. Each of the lung lobes was manually segmented and considered ground-truth. A supervised and constrained generative adversarial network (CGAN) was employed for learning each set of lobe segmentations for each patient with 12 patients designated for training data. The resulting generator DNNs represented the lobe segmentations for each training dataset. A quorum-based algorithm was then implemented to test validation data consisting of 10 separate patient datasets (250 3D CTs). Each of the DNNs predicted their corresponding lobes for the validation data, and equal weights were given to the 12 generator CGANs. The quorum process worked by selecting the weighted average result of all 12 CGAN results for each lobe. RESULTS: When evaluated against ground-truth segmentations, the quorum-based lobe segmentation was observed to have average structural similarity index, normalized cross-correlation coefficient, and dice coefficient values of 0.929, 0.806, and 0.814, respectively, compared to values of 0.911, 0.698, and 0.696, respectively, using a conventional strategy. CONCLUSION: The proposed quorum-based approach computed segmentations with clinically acceptable accuracy in near real time using a multi-GPU-based computing setup. This method is scalable as more patient-specific CGANs can be added to the quorum over time.

Three-dimensional multipath DenseNet for improving automatic segmentation of glioblastoma on pre-operative multimodal MR images.

PURPOSE: Convolutional neural networks have achieved excellent results in automatic medical image segmentation. In this study, we proposed a novel three-dimensional (3D) multipath DenseNet for generating the accurate glioblastoma (GBM) tumor contour from four multimodal pre-operative MR images. We hypothesized that the multipath architecture could achieve more accurate segmentation than a singlepath architecture. METHODS: Two hundred and fifty-eight GBM patients were included in this study. Each patient had four MR images (T1-weighted, contrast-enhanced T1-weighted, T2-weighted, and FLAIR) and the manually segmented tumor contour. We built a 3D multipath DenseNet that could be trained to achieve an end-to-end mapping from four MR images to the corresponding GBM tumor contour. A 3D singlepath DenseNet was also built for comparison. Both DenseNets were based on the encoder-decoder architecture. All four images were concatenated and fed into a single encoder path in the singlepath DenseNet, while each input image had its own encoder path in the multipath DenseNet. The patient cohort was randomly split into a training set of 180 patients, a validation set of 39 patients, and a testing set of 39 patients. Model performance was evaluated using the Dice similarity coefficient (DSC), average surface distance (ASD), and 95% Hausdorff distance (HD95% ). Wilcoxon signed-rank tests were conducted to assess statistical significances. RESULTS: The singlepath DenseNet achieved the DSC of 0.911 ± 0.060, ASD of 1.3 ± 0.7 mm, and HD95% of 5.2 ± 7.1 mm, while the multipath DenseNet achieved the DSC of 0.922 ± 0.041, ASD of 1.1 ± 0.5 mm, and HD95% of 3.9 ± 3.3 mm. The P-values of all Wilcoxon signed-rank tests were less than 0.05. CONCLUSIONS: Both DenseNets generated GBM tumor contours in good agreement with the manually segmented contours from multimodal MR images. The multipath DenseNet achieved more accurate tumor segmentation than the singlepath DenseNet. Here presented the 3D multipath DenseNet that demonstrated an improved accuracy over comparable algorithms in the clinical task of GBM tumor segmentation.

A generative adversarial network-based (GAN-based) architecture for automatic fiducial marker detection in prostate MRI-only radiotherapy simulation images.

PURPOSE: Clinical sites utilizing magnetic resonance imaging (MRI)-only simulation for prostate radiotherapy planning typically use fiducial markers for pretreatment patient positioning and alignment. Fiducial markers appear as small signal voids in MRI images and are often difficult to discern. Existing clinical methods for fiducial marker localization require multiple MRI sequences and/or manual interaction and specialized expertise. In this study, we develop a robust method for automatic fiducial marker detection in prostate MRI simulation images and quantify the pretreatment alignment accuracy using automatically detected fiducial markers in MRI. METHODS AND MATERIALS: In this study, a deep learning-based algorithm was used to convert MRI images into labeled fiducial marker volumes. Seventy-seven prostate cancer patients who received marker implantation prior to MRI and CT simulation imaging were selected for this study. Multiple-Echo T1 -VIBE MRI images were acquired, and images were stratified (at the patient level) based on the presence of intraprostatic calcifications. Ground truth (GT) contours were defined by an expert on MRI using CT images. Training was done using the pix2pix generative adversarial network (GAN) image-to-image translation package and model testing was done using fivefold cross validation. For performance comparison, an experienced medical dosimetrist and a medical physicist each manually contoured fiducial markers in MRI images. The percent of correct detections and F1 classification scores are reported for markers detected using the automatic detection algorithm and human observers. The patient positioning errors were quantified by calculating the target registration errors (TREs) from fiducial marker driven rigid registration between MRI and CBCT images. Target registration errors were quantified for fiducial marker contours defined on MRI by the automatic detection algorithm and the two expert human observers. RESULTS: Ninety-six percent of implanted fiducial markers were correctly identified using the automatic detection algorithm. Two expert raters correctly identified 97% and 96% of fiducial markers, respectively. The F1 classification score was 0.68, 0.75, and 0.72 for the automatic detection algorithm and two human raters, respectively. The main source of false discoveries was intraprostatic calcifications. The mean TRE differences between alignments from automatic detection algorithm and human detected markers and GT were <1 mm. CONCLUSIONS: We have developed a deep learning-based approach to automatically detect fiducial markers in MRI-only simulation images in a clinically representative patient cohort. The automatic detection algorithm-predicted markers can allow for patient setup with similar accuracy to independent human observers.

A generalized system of tissue-mimicking materials for computed tomography and magnetic resonance imaging.

The advent of technologies such as magnetic resonance imaging (MRI)-guided radiation therapy has led to the need for phantom materials that are capable of producing tissue-like contrast on both MRI and computed tomography (CT) imaging modalities. The purpose of this work is to develop a system of easily made and formed materials with adjustable T1 and T2 relaxation times, and x-ray attenuation properties, for mimicking soft tissue and bone with both MRI and CT imaging modalities. The effects on T1/T2 relaxation times and CT numbers were quantified for a range of gadolinium contrast (0-25 µmol g-1), agarose (0%-8% w/w), glass microspheres (0%-10% w/w) and CaCO3 (0%-50% w/w) concentrations in a carrageenan-based gel. 105 gel samples were prepared with the additives, carrageenan and water. Samples were imaged in a 3D-printed holding structure to find the attainable range of T1/T2 relaxation time and CT number combinations. T1 and T2 relaxation time maps were generated using voxel-wise inversion-recovery and spin-echo techniques, respectively. A multivariate linear regression model was generated to allow the materials system to be generalized to semi-arbitrary T1/T2 relaxation times and CT numbers. Nine diverse tissue types were mimicked for fit model validation. The achievable T1/T2 relaxation times and CT numbers for the additive concentrations tested in this study spanned from 82 to 2180 ms, 12 to 475 ms, and -117 to +914 Hounsfield units (HU), respectively. The mean absolute error between the fit model predicted and measured T1/T2 relaxation times and CT numbers for the nine tested tissue types was 113 ± 64 ms, 16 ± 26 ms and 11 ± 14 HU, respectively. In conclusion, we have created a system of materials capable of producing tissue-like contrast for 3.0 T MRI and CT imaging modalities.

A novel anthropomorphic multimodality phantom for MRI-based radiotherapy quality assurance testing.

PURPOSE: Increased utilization of magnetic resonance imaging (MRI) in radiotherapy has caused a growing need for phantoms that provide tissue-like contrast in both computed tomography (CT) and MRI images. Such phantoms can be used to compare MRI-based processes with CT-based clinical standards. Here, we develop and demonstrate the clinical utility of a three-dimensional (3D)-printed anthropomorphic pelvis phantom containing materials capable of T1 , T2 , and electron density matching for a clinically relevant set of soft tissues and bone. METHODS: The phantom design was based on a male pelvic anatomy template with thin boundaries separating tissue types. Slots were included to allow insertion of various dosimeters. The phantom structure was created using a 3D printer. The tissue compartments were filled with carrageenan-based materials designed to match the T1 and T2 relaxation times and electron densities of the corresponding tissues. CT and MRI images of the phantom were acquired and used to compare phantom T1 and T2 relaxation times and electron densities to literature-reported values for human tissue. To demonstrate clinical utility, the phantom was used for end-to-end testing of an MRI-only treatment simulation and planning workflow. Based on a T2 -weighted MRI image, synthetic CT (sCT) images were created using a statistical decomposition algorithm (MRIPlanner, Spectronic Research AB, Sweden) and used for dose calculation of volumetric-modulated arc therapy (VMAT) and seven-field intensity-modulated radiation therapy (IMRT) prostate plans. The plans were delivered on a Truebeam STX (Varian Medical Systems, Palo Alto, CA), with film and a 0.3 cc ion chamber used to measure the delivered dose. Doses calculated on the CT and sCTs were compared using common dose volume histogram metrics. RESULTS: T1 and T2 relaxation time and electron density measurements for the muscle, prostate, and bone agreed well with literature-reported in vivo measurements. Film analysis resulted in a 99.7% gamma pass rate (3.0%, 3.0 mm) for both plans. The ion chamber-measured dose discrepancies at the isocenter were 0.36% and 1.67% for the IMRT and VMAT plans, respectively. The differences in PTV D98% and D95% between plans calculated on the CT and 1.5T/3.0 T-derived sCT images were under 3%. CONCLUSION: The developed phantom provides tissue-like contrast on MRI and CT and can be used to validate MRI-based processes through comparison with standard CT-based processes.

Generation of abdominal synthetic CTs from 0.35T MR images using generative adversarial networks for MR-only liver radiotherapy.

Electron density maps must be accurately estimated to achieve valid dose calculation in MR-only radiotherapy. The goal of this study is to assess whether two deep learning models, the conditional generative adversarial network (cGAN) and the cycle-consistent generative adversarial network (cycleGAN), can generate accurate abdominal synthetic CT (sCT) images from 0.35T MR images for MR-only liver radiotherapy. A retrospective study was performed using CT images and 0.35T MR images of 12 patients with liver (n = 8) and non-liver abdominal (n = 4) cancer. CT images were deformably registered to the corresponding MR images to generate deformed CT (dCT) images for treatment planning. Both cGAN and cycleGAN were trained using MR and dCT transverse slices. Four-fold cross-validation testing was conducted to generate sCT images for all patients. The HU prediction accuracy was evaluated by voxel-wise similarity metric between each dCT and sCT image for all 12 patients. dCT-based and sCT-based dose distributions were compared using gamma and dose-volume histogram (DVH) metric analysis for 8 liver patients. sCTcycleGAN achieved the average mean absolute error (MAE) of 94.1 HU, while sCTcGAN achieved 89.8 HU. In both models, the average gamma passing rates within all volumes of interest were higher than 95% using a 2%, 2 mm criterion, and 99% using a 3%, 3 mm criterion. The average differences in the mean dose and DVH metrics were within ±0.6% for the planning target volume and within ±0.15% for evaluated organs in both models. Results: demonstrated that abdominal sCT images generated by both cGAN and cycleGAN achieved accurate dose calculation for 8 liver radiotherapy plans. sCTcGAN images had smaller average MAE and achieved better dose calculation accuracy than sCTcyleGAN images. More abdominal patients will be enrolled in the future to further evaluate the two models.

Quantification of fiducial marker visibility for MRI-only prostate radiotherapy simulation.

To objectively compare the suitability of MRI pulse sequences and commercially available fiducial markers (FMs) for MRI-only prostate radiotherapy simulation. Most FMs appear as small signal voids in MRI images making them difficult to differentiate from tissue heterogeneities such as calcifications. In this study we use quantitative metrics to objectively evaluate the visibility of FMs in 27 patients and an anthropomorphic phantom with a variety of standard clinical MRI pulse sequences and commercially available FMs. FM visibility was quantified using the local contrast-to-noise-ratio (lCNR), the difference between the 80th and 20th percentile iso-intensity FM volumes (V fall) and the largest iso-intensity volume that can be distinguished from background: apparent-marker-volume (AMV). A larger lCNR and AMV, and smaller V fall represents a more easily identifiable FM. The number of non-marker objects visualized by each pulse sequence was calculated using FM-derived template-matching. The FM-based target-registration-error (TRE) between each MRI and the planning-CT image was calculated. Fiducial marker visibility was rated by two medical physicists with over three years of experience examining MRI-only prostate simulation images. The rater's classification accuracy was quantified using the F 1 score, which is the harmonic mean of the rater's precision and recall. These quantitative metrics and human observer ratings were used to evaluate FM identifiability in images from nine subtypes of T 1-weighted, T 2-weighted and gradient echo (GRE) pulse sequences in a 27-patient study. A phantom study was conducted to quantify the visibility of 8 commercially available FMs. In the patient study, the largest mean lCNR and AMV and, smallest normalized V fall were produced by the 3.0 T multiple-echo GRE pulse sequence (T 1-VIBE, 2° flip angle, 1.23 ms and 2.45 ms echo-times). This pulse sequence produced no false marker detections and TREs less than 2 mm in the left-right, anterior-posterior and cranial-caudal directions, respectively. Human observers rated the 1.23 ms echo-time GRE images with the best average marker visibility score of 100% and an F 1 score of 1. In the phantom study, the Gold-Anchor GA-200X-20-B (deployed in a folded configuration) produced the largest sequence averaged lCNR and AMV measurements at 16.1 and 16.7 mm3, respectively. Using quantitative visibility and distinguishability metrics and human observer ratings, the patient study demonstrated that multiple-echo GRE images produced the best gold FM visibility and distinguishability. The phantom study demonstrated that markers manufactured from platinum or iron-doped gold quantitatively produced superior visibility compared to their pure gold counterparts.

Deep learning approaches using 2D and 3D convolutional neural networks for generating male pelvic synthetic computed tomography from magnetic resonance imaging.

PURPOSE: The improved soft tissue contrast of magnetic resonance imaging (MRI) compared to computed tomography (CT) makes it a useful imaging modality for radiotherapy treatment planning. Even when MR images are acquired for treatment planning, the standard clinical practice currently also requires a CT for dose calculation and x-ray-based patient positioning. This increases workloads, introduces uncertainty due to the required inter-modality image registrations, and involves unnecessary irradiation. While it would be beneficial to use exclusively MR images, a method needs to be employed to estimate a synthetic CT (sCT) for generating electron density maps and patient positioning reference images. We investigated 2D and 3D convolutional neural networks (CNNs) to generate a male pelvic sCT using a T1-weighted MR image and compare their performance. METHODS: A retrospective study was performed using CTs and T1-weighted MR images of 20 prostate cancer patients. CTs were deformably registered to MR images to create CT-MR pairs for training networks. The proposed 2D CNN, which contained 27 convolutional layers, was modified from the state-of-the-art 2D CNN to save computational memory and prepare for building the 3D CNN. The proposed 2D and 3D models were trained from scratch to map intensities of T1-weighted MR images to CT Hounsfield Unit (HU) values. Each sCT was generated in a fivefold cross-validation framework and compared with the corresponding deformed CT (dCT) using voxel-wise mean absolute error (MAE). The sCT geometric accuracy was evaluated by comparing bone regions, defined by thresholding at 150 HU in the dCTs and the sCTs, using dice similarity coefficient (DSC), recall, and precision. To evaluate sCT patient positioning accuracy, bone regions in dCTs and sCTs were rigidly registered to the corresponding cone-beam CTs. The resulting paired Euler transformation vectors were compared by calculating translation vector distances and absolute differences of Euler angles. Statistical tests were performed to evaluate the differences among the proposed models and Han's model. RESULTS: Generating a pelvic sCT required approximately 5.5 s using the proposed models. The average MAEs within the body contour were 40.5 ± 5.4 HU (mean ± SD) and 37.6 ± 5.1 HU for the 2D and 3D CNNs, respectively. The average DSC, recall, and precision for the bone region (thresholding the CT at 150 HU) were 0.81 ± 0.04, 0.85 ± 0.04, and 0.77 ± 0.09 for the 2D CNN, and 0.82 ± 0.04, 0.84 ± 0.04, and 0.80 ± 0.08 for the 3D CNN, respectively. For both models, mean translation vector distances are less than 0.6 mm with mean absolute differences of Euler angles less than 0.5°. CONCLUSIONS: The 2D and 3D CNNs generated accurate pelvic sCTs for the 20 patients using T1-weighted MR images. Statistical tests indicated that the proposed 3D model was able to generate sCTs with smaller MAE and higher bone region precision compared to 2D models. Results of patient alignment tests suggested that sCTs generated by the proposed CNNs can provide accurate patient positioning. The accuracy of the dose calculation using generated sCTs will be tested and compared for the proposed models in the future.

Reconstruction of a high-quality volumetric image and a respiratory motion model from patient CBCT projections.

PURPOSE: To develop and evaluate a method of reconstructing a patient- and treatment day- specific volumetric image and motion model from free-breathing cone-beam projections and respiratory surrogate measurements. This Motion-Compensated Simultaneous Algebraic Reconstruction Technique (MC-SART) generates and uses a motion model derived directly from the cone-beam projections, without requiring prior motion measurements from 4DCT, and can compensate for both inter- and intrabin deformations. The motion model can be used to generate images at arbitrary breathing points, which can be used for estimating volumetric images during treatment delivery. METHODS: The MC-SART was formulated using simultaneous image reconstruction and motion model estimation. For image reconstruction, projections were first binned according to external surrogate measurements. Projections in each bin were used to reconstruct a set of volumetric images using MC-SART. The motion model was estimated based on deformable image registration between the reconstructed bins, and least squares fitting to model parameters. The model was used to compensate for motion in both projection and backprojection operations in the subsequent image reconstruction iterations. These updated images were then used to update the motion model, and the two steps were alternated between. The final output is a volumetric reference image and a motion model that can be used to generate images at any other time point from surrogate measurements. RESULTS: A retrospective patient dataset consisting of eight lung cancer patients was used to evaluate the method. The absolute intensity differences in the lung regions compared to ground truth were 50.8 ± 43.9 HU in peak exhale phases (reference) and 80.8 ± 74.0 in peak inhale phases (generated). The 50th percentile of voxel registration error of all voxels in the lung regions with >5 mm amplitude was 1.3 mm. The MC-SART was also applied to measured patient cone-beam projections acquired with a linac-mounted CBCT system. Results from this patient data demonstrate the feasibility of MC-SART and showed qualitative image quality improvements compared to other state-of-the-art algorithms. CONCLUSION: We have developed a simultaneous image reconstruction and motion model estimation method that uses Cone-beam computed tomography (CBCT) projections and respiratory surrogate measurements to reconstruct a high-quality reference image and motion model of a patient in treatment position. The method provided superior performance in both HU accuracy and positional accuracy compared to other existing methods. The resultant reference image and motion model can be combined with respiratory surrogate measurements to generate volumetric images representing patient anatomy at arbitrary time points.

A three-dimensional head-and-neck phantom for validation of multimodality deformable image registration for adaptive radiotherapy.

PURPOSE: To develop a three-dimensional (3D) deformable head-and-neck (H&N) phantom with realistic tissue contrast for both kilovoltage (kV) and megavoltage (MV) imaging modalities and use it to objectively evaluate deformable image registration (DIR) algorithms. METHODS: The phantom represents H&N patient anatomy. It is constructed from thermoplastic, which becomes pliable in boiling water, and hardened epoxy resin. Using a system of additives, the Hounsfield unit (HU) values of these materials were tuned to mimic anatomy for both kV and MV imaging. The phantom opens along a sagittal midsection to reveal radiotransparent markers, which were used to characterize the phantom deformation. The deformed and undeformed phantoms were scanned with kV and MV imaging modalities. Additionally, a calibration curve was created to change the HUs of the MV scans to be similar to kV HUs, (MC). The extracted ground-truth deformation was then compared to the results of two commercially available DIR algorithms, from Velocity Medical Solutions and mim software. RESULTS: The phantom produced a 3D deformation, representing neck flexion, with a magnitude of up to 8 mm and was able to represent tissue HUs for both kV and MV imaging modalities. The two tested deformation algorithms yielded vastly different results. For kV-kV registration, mim produced mean and maximum errors of 1.8 and 11.5 mm, respectively. These same numbers for Velocity were 2.4 and 7.1 mm, respectively. For MV-MV, kV-MV, and kV-MC Velocity produced similar mean and maximum error values. mim, however, produced gross errors for all three of these scenarios, with maximum errors ranging from 33.4 to 41.6 mm. CONCLUSIONS: The application of DIR across different imaging modalities is particularly difficult, due to differences in tissue HUs and the presence of imaging artifacts. For this reason, DIR algorithms must be validated specifically for this purpose. The developed H&N phantom is an effective tool for this purpose.