Artificial intelligence for treatment delivery: image-guided radiotherapy.

Radiation therapy (RT) is a highly digitized field relying heavily on computational methods and, as such, has a high affinity for the automation potential afforded by modern artificial intelligence (AI). This is particularly relevant where imaging is concerned and is especially so during image-guided RT (IGRT). With the advent of online adaptive RT (ART) workflows at magnetic resonance (MR) linear accelerators (linacs) and at cone-beam computed tomography (CBCT) linacs, the need for automation is further increased. AI as applied to modern IGRT is thus one area of RT where we can expect important developments in the near future. In this review article, after outlining modern IGRT and online ART workflows, we cover the role of AI in CBCT and MRI correction for dose calculation, auto-segmentation on IGRT imaging, motion management, and response assessment based on in-room imaging.

Generating synthetic computed tomography for radiotherapy: SynthRAD2023 challenge report.

Radiation therapy plays a crucial role in cancer treatment, necessitating precise delivery of radiation to tumors while sparing healthy tissues over multiple days. Computed tomography (CT) is integral for treatment planning, offering electron density data crucial for accurate dose calculations. However, accurately representing patient anatomy is challenging, especially in adaptive radiotherapy, where CT is not acquired daily. Magnetic resonance imaging (MRI) provides superior soft-tissue contrast. Still, it lacks electron density information, while cone beam CT (CBCT) lacks direct electron density calibration and is mainly used for patient positioning. Adopting MRI-only or CBCT-based adaptive radiotherapy eliminates the need for CT planning but presents challenges. Synthetic CT (sCT) generation techniques aim to address these challenges by using image synthesis to bridge the gap between MRI, CBCT, and CT. The SynthRAD2023 challenge was organized to compare synthetic CT generation methods using multi-center ground truth data from 1080 patients, divided into two tasks: (1) MRI-to-CT and (2) CBCT-to-CT. The evaluation included image similarity and dose-based metrics from proton and photon plans. The challenge attracted significant participation, with 617 registrations and 22/17 valid submissions for tasks 1/2. Top-performing teams achieved high structural similarity indices (≥0.87/0.90) and gamma pass rates for photon (≥98.1%/99.0%) and proton (≥97.3%/97.0%) plans. However, no significant correlation was found between image similarity metrics and dose accuracy, emphasizing the need for dose evaluation when assessing the clinical applicability of sCT. SynthRAD2023 facilitated the investigation and benchmarking of sCT generation techniques, providing insights for developing MRI-only and CBCT-based adaptive radiotherapy. It showcased the growing capacity of deep learning to produce high-quality sCT, reducing reliance on conventional CT for treatment planning.

Reduction of cone-beam CT artifacts in a robotic CBCT device using saddle trajectories with integrated infrared tracking.

BACKGROUND: Cone beam computed tomography (CBCT) is widely used in many medical fields. However, conventional CBCT circular scans suffer from cone beam (CB) artifacts that limit the quality and reliability of the reconstructed images due to incomplete data. PURPOSE: Saddle trajectories in theory might be able to improve the CBCT image quality by providing a larger region with complete data. Therefore, we investigated the feasibility and performance of saddle trajectory CBCT scans and compared them to circular trajectory scans. METHODS: We performed circular and saddle trajectory scans using a novel robotic CBCT scanner (Mobile ImagingRing (IRm); medPhoton, Salzburg, Austria). For the saddle trajectory, the gantry executed yaw motion up to ± 10 ∘ $\pm 10^{\circ }$ using motorized wheels driving on the floor. An infrared (IR) tracking device with reflective markers was used for online geometric calibration correction (mainly floor unevenness). All images were reconstructed using penalized least-squares minimization with the conjugate gradient algorithm from RTK with 0.5 × 0.5 × 0.5 mm 3 $0.5 \times 0.5\times 0.5 \text{ mm}^3$ voxel size. A disk phantom and an Alderson phantom were scanned to assess the image quality. Results were correlated with the local incompleteness value represented by tan ( ψ ) $\tan (\psi)$ , which was calculated at each voxel as a function of the source trajectory and the voxel's 3D coordinates. We assessed the magnitude of CB artifacts using the full width half maximum (FWHM) of each disk profile in the axial center of the reconstructed images. Spatial resolution was also quantified by the modulation transfer function at 10% (MTF10). RESULTS: When using the saddle trajectory, the region without CB artifacts was increased from 43 to 190 mm in the SI direction compared to the circular trajectory. This region coincided with low values for tan ( ψ ) $\tan (\psi)$ . When tan ( ψ ) $\tan (\psi)$ was larger than 0.02, we found there was a linear relationship between the FWHM and tan ( ψ ) $\tan (\psi)$ . For the saddle, IR tracking allowed the increase of MTF10 from 0.37 to 0.98 lp/mm. CONCLUSIONS: We achieved saddle trajectory CBCT scans with a novel CBCT system combined with IR tracking. The results show that the saddle trajectory provides a larger region with reliable reconstruction compared to the circular trajectory. The proposed method can be used to evaluate other non-circular trajectories.

Feasibility of Monte Carlo dropout-based uncertainty maps to evaluate deep learning-based synthetic CTs for adaptive proton therapy.

BACKGROUND: Deep learning has shown promising results to generate MRI-based synthetic CTs and to enable accurate proton dose calculations on MRIs. For clinical implementation of synthetic CTs, quality assurance tools that verify their quality and reliability are required but still lacking. PURPOSE: This study aims to evaluate the predictive value of uncertainty maps generated with Monte Carlo dropout (MCD) for verifying proton dose calculations on deep-learning-based synthetic CTs (sCTs) derived from MRIs in online adaptive proton therapy. METHODS: Two deep-learning models (DCNN and cycleGAN) were trained for CT image synthesis using 101 paired CT-MR images. sCT images were generated using MCD for each model by performing 10 inferences with activated dropout layers. The final sCT was obtained by averaging the inferred sCTs, while the uncertainty map was obtained from the HU variance corresponding to each voxel of 10 sCTs. The resulting uncertainty maps were compared to the observed HU-, range-, WET-, and dose-error maps between the sCT and planning CT. For range and WET errors, the generated uncertainty maps were projected along the 90-degree angle. To evaluate the dose distribution, a mask based on the 5%-isodose curve was applied to only include voxels along the beam paths. Pearson's correlation coefficients were calculated to determine the correlation between the uncertainty maps and HUs, range, WET, and dose errors. To evaluate the dosimetric accuracy of synthetic CTs, clinical proton treatment plans were recalculated and compared to the pCTs RESULTS: Evaluation of the correlation showed an average of r = 0.92 ± 0.03 and r = 0.92 ± 0.03 for errors between uncertainty-HU, r = 0.66 ± 0.09 and r = 0.62 ± 0.06 between uncertainty-range, r = 0.64 ± 0.06 and r = 0.58 ± 0.07 between uncertainty-WET, and r = 0.65 ± 0.09 and r = 0.67 ± 0.07 between uncertainty and dose difference for DCNN and cycleGAN model, respectively. Dosimetric comparison for target volumes showed an average 3%/3 mm gamma pass rate of 99.76 ± 0.43 (DCNN) and 99.10 ± 1.27 (cycleGAN). CONCLUSION: The observed correlations between uncertainty maps and the various metrics (HU, range, WET, and dose errors) demonstrated the potential of MCD-based uncertainty maps as a reliable QA tool to evaluate the accuracy of deep learning-based sCTs.

Technical note: Evaluation of deep learning based synthetic CTs clinical readiness for dose and NTCP driven head and neck adaptive proton therapy.

BACKGROUND: Adaptive proton therapy workflows rely on accurate imaging throughout the treatment course. Our centre currently utilizes weekly repeat CTs (rCTs) for treatment monitoring and plan adaptations. However, deep learning-based methods have recently shown to successfully correct CBCT images, which suffer from severe imaging artifacts, and generate high quality synthetic CT (sCT) images which enable CBCT-based proton dose calculations. PURPOSE: To compare daily CBCT-based sCT images to planning CTs (pCT) and rCTs of head and neck (HN) cancer patients to investigate the dosimetric accuracy of CBCT-based sCTs in a scenario mimicking actual clinical practice. METHODS: Data of 56 HN cancer patients, previously treated with proton therapy was used to generate 1.962 sCT images, using a previously developed and trained deep convolutional neural network. Clinical IMPT treatment plans were recalculated on the pCT, weekly rCTs and daily sCTs. The dosimetric accuracy of sCTs was compared to same day rCTs and the initial planning CT. As a reference, rCTs were also compared to pCTs. The dose difference between sCTs and rCTs/pCT was quantified by calculating the D98 difference for target volumes and Dmean difference for organs-at-risk. To investigate the clinical relevancy of possible dose differences, NTCP values were calculated for dysphagia and xerostomia. RESULTS: For target volumes, only minor dose differences were found for sCT versus rCT and sCT versus pCT, with dose differences mostly within ±1.5%. Larger dose differences were observed in OARs, where a general shift towards positive differences was found, with the largest difference in the left parotid gland. Delta NTCP values for grade 2 dysphagia and xerostomia were within ±2.5% for 90% of the sCTs. CONCLUSIONS: Target doses showed high similarity between rCTs and sCTs. Further investigations are required to identify the origin of the dose differences at OAR levels and its relevance in clinical decision making.

ScatterNet for projection-based 4D cone-beam computed tomography intensity correction of lung cancer patients.

Background and purpose: In radiotherapy, dose calculations based on 4D cone beam CTs (4DCBCTs) require image intensity corrections. This retrospective study compared the dose calculation accuracy of a deep learning, projection-based scatter correction workflow (ScatterNet), to slower workflows: conventional 4D projection-based scatter correction (CBCTcor) and a deformable image registration (DIR)-based method (4DvCT). Materials and methods: For 26 lung cancer patients, planning CTs (pCTs), 4DCTs and CBCT projections were available. ScatterNet was trained with pairs of raw and corrected CBCT projections. Corrected projections from ScatterNet and the conventional workflow were reconstructed using MA-ROOSTER, yielding 4DCBCTSN and 4DCBCTcor. The 4DvCT was generated by 4DCT to 4DCBCT DIR, as part of the 4DCBCTcor workflow. Robust intensity modulated proton therapy treatment plans were created on free-breathing pCTs. 4DCBCTSN was compared to 4DCBCTcor and the 4DvCT in terms of image quality and dose calculation accuracy (dose-volume-histogram parameters and 3%/3mm gamma analysis). Results: 4DCBCTSN resulted in an average mean absolute error of 87HU and 102HU when compared to 4DCBCTcor and 4DvCT respectively. High agreement was observed in targets with median dose differences of 0.4Gy (4DCBCTSN-4DCBCTcor) and 0.3Gy (4DCBCTSN-4DvCT). The gamma analysis showed high average 3%/3mm pass rates of 96% for both 4DCBCTSN vs. 4DCBCTcor and 4DCBCTSN vs. 4DvCT. Conclusions: Accurate 4D dose calculations are feasible for lung cancer patients using ScatterNet for 4DCBCT correction. Average scatter correction times could be reduced from 10min (4DCBCTcor) to 3.9s, showing the clinical suitability of the proposed deep learning-based method.

SynthRAD2023 Grand Challenge dataset: Generating synthetic CT for radiotherapy.

PURPOSE: Medical imaging has become increasingly important in diagnosing and treating oncological patients, particularly in radiotherapy. Recent advances in synthetic computed tomography (sCT) generation have increased interest in public challenges to provide data and evaluation metrics for comparing different approaches openly. This paper describes a dataset of brain and pelvis computed tomography (CT) images with rigidly registered cone-beam CT (CBCT) and magnetic resonance imaging (MRI) images to facilitate the development and evaluation of sCT generation for radiotherapy planning. ACQUISITION AND VALIDATION METHODS: The dataset consists of CT, CBCT, and MRI of 540 brains and 540 pelvic radiotherapy patients from three Dutch university medical centers. Subjects' ages ranged from 3 to 93 years, with a mean age of 60. Various scanner models and acquisition settings were used across patients from the three data-providing centers. Details are available in a comma separated value files provided with the datasets. DATA FORMAT AND USAGE NOTES: The data is available on Zenodo (https://doi.org/10.5281/zenodo.7260704, https://doi.org/10.5281/zenodo.7868168) under the SynthRAD2023 collection. The images for each subject are available in nifti format. POTENTIAL APPLICATIONS: This dataset will enable the evaluation and development of image synthesis algorithms for radiotherapy purposes on a realistic multi-center dataset with varying acquisition protocols. Synthetic CT generation has numerous applications in radiation therapy, including diagnosis, treatment planning, treatment monitoring, and surgical planning.

Deep learning-based 4D-synthetic CTs from sparse-view CBCTs for dose calculations in adaptive proton therapy.

BACKGROUND: Time-resolved 4D cone beam-computed tomography (4D-CBCT) allows a daily assessment of patient anatomy and respiratory motion. However, 4D-CBCTs suffer from imaging artifacts that affect the CT number accuracy and prevent accurate proton dose calculations. Deep learning can be used to correct CT numbers and generate synthetic CTs (sCTs) that can enable CBCT-based proton dose calculations. PURPOSE: In this work, sparse view 4D-CBCTs were converted into 4D-sCT utilizing a deep convolutional neural network (DCNN). 4D-sCTs were evaluated in terms of image quality and dosimetric accuracy to determine if accurate proton dose calculations for adaptive proton therapy workflows of lung cancer patients are feasible. METHODS: A dataset of 45 thoracic cancer patients was utilized to train and evaluate a DCNN to generate 4D-sCTs, based on sparse view 4D-CBCTs reconstructed from projections acquired with a 3D acquisition protocol. Mean absolute error (MAE) and mean error were used as metrics to evaluate the image quality of single phases and average 4D-sCTs against 4D-CTs acquired on the same day. The dosimetric accuracy was checked globally (gamma analysis) and locally for target volumes and organs-at-risk (OARs) (lung, heart, and esophagus). Furthermore, 4D-sCTs were also compared to 3D-sCTs. To evaluate CT number accuracy, proton radiography simulations in 4D-sCT and 4D-CTs were compared in terms of range errors. The clinical suitability of 4D-sCTs was demonstrated by performing a 4D dose reconstruction using patient specific treatment delivery log files and breathing signals. RESULTS: 4D-sCTs resulted in average MAEs of 48.1 ± 6.5 HU (single phase) and 37.7 ± 6.2 HU (average). The global dosimetric evaluation showed gamma pass ratios of 92.3% ± 3.2% (single phase) and 94.4% ± 2.1% (average). The clinical target volume showed high agreement in D98 between 4D-CT and 4D-sCT, with differences below 2.4% for all patients. Larger dose differences were observed in mean doses of OARs (up to 8.4%). The comparison with 3D-sCTs showed no substantial image quality and dosimetric differences for the 4D-sCT average. Individual 4D-sCT phases showed slightly lower dosimetric accuracy. The range error evaluation revealed that lung tissues cause range errors about three times higher than the other tissues. CONCLUSION: In this study, we have investigated the accuracy of deep learning-based 4D-sCTs for daily dose calculations in adaptive proton therapy. Despite image quality differences between 4D-sCTs and 3D-sCTs, comparable dosimetric accuracy was observed globally and locally. Further improvement of 3D and 4D lung sCTs could be achieved by increasing CT number accuracy in lung tissues.

Clinical suitability of deep learning based synthetic CTs for adaptive proton therapy of lung cancer.

PURPOSE: Adaptive proton therapy (APT) of lung cancer patients requires frequent volumetric imaging of diagnostic quality. Cone-beam CT (CBCT) can provide these daily images, but x-ray scattering limits CBCT-image quality and hampers dose calculation accuracy. The purpose of this study was to generate CBCT-based synthetic CTs using a deep convolutional neural network (DCNN) and investigate image quality and clinical suitability for proton dose calculations in lung cancer patients. METHODS: A dataset of 33 thoracic cancer patients, containing CBCTs, same-day repeat CTs (rCT), planning-CTs (pCTs), and clinical proton treatment plans, was used to train and evaluate a DCNN with and without a pCT-based correction method. Mean absolute error (MAE), mean error (ME), peak signal-to-noise ratio, and structural similarity were used to quantify image quality. The evaluation of clinical suitability was based on recalculation of clinical proton treatment plans. Gamma pass ratios, mean dose to target volumes and organs at risk, and normal tissue complication probabilities (NTCP) were calculated. Furthermore, proton radiography simulations were performed to assess the HU-accuracy of sCTs in terms of range errors. RESULTS: On average, sCTs without correction resulted in a MAE of 34 ± 6 HU and ME of 4 ± 8 HU. The correction reduced the MAE to 31 ± 4HU (ME to 2 ± 4HU). Average 3%/3 mm gamma pass ratios increased from 93.7% to 96.8%, when the correction was applied. The patient specific correction reduced mean proton range errors from 1.5 to 1.1 mm. Relative mean target dose differences between sCTs and rCT were below ± 0.5% for all patients and both synthetic CTs (with/without correction). NTCP values showed high agreement between sCTs and rCT (<2%). CONCLUSION: CBCT-based sCTs can enable accurate proton dose calculations for APT of lung cancer patients. The patient specific correction method increased the image quality and dosimetric accuracy but had only a limited influence on clinically relevant parameters.

Range probing as a quality control tool for CBCT-based synthetic CTs: In vivo application for head and neck cancer patients.

PURPOSE: Cone-beam CT (CBCT)-based synthetic CTs (sCT) produced with a deep convolutional neural network (DCNN) show high image quality, suggesting their potential usability in adaptive proton therapy workflows. However, the nature of such workflows involving DCNNs prevents the user from having direct control over their output. Therefore, quality control (QC) tools that monitor the sCTs and detect failures or outliers in the generated images are needed. This work evaluates the potential of using a range-probing (RP)-based QC tool to verify sCTs generated by a DCNN. Such a RP QC tool experimentally assesses the CT number accuracy in sCTs. METHODS: A RP QC dataset consisting of repeat CTs (rCT), CBCTs, and RP acquisitions of seven head and neck cancer patients was retrospectively assessed. CBCT-based sCTs were generated using a DCNN. The CT number accuracy in the sCTs was evaluated by computing relative range errors between measured RP fields and RP field simulations based on rCT and sCT images. RESULTS: Mean relative range errors showed agreement between measured and simulated RP fields, ranging from -1.2% to 1.5% in rCTs, and from -0.7% to 2.7% in sCTs. CONCLUSIONS: The agreement between measured and simulated RP fields suggests the suitability of sCTs for proton dose calculations. This outcome brings sCTs generated by DCNNs closer toward clinical implementation within adaptive proton therapy treatment workflows. The proposed RP QC tool allows for CT number accuracy assessment in sCTs and can provide means of in vivo range verification.

Comparison of the suitability of CBCT- and MR-based synthetic CTs for daily adaptive proton therapy in head and neck patients.

Cone-beam computed tomography (CBCT)- and magnetic resonance (MR)-images allow a daily observation of patient anatomy but are not directly suited for accurate proton dose calculations. This can be overcome by creating synthetic CTs (sCT) using deep convolutional neural networks. In this study, we compared sCTs based on CBCTs and MRs for head and neck (H&N) cancer patients in terms of image quality and proton dose calculation accuracy. A dataset of 27 H&N-patients, treated with proton therapy (PT), containing planning CTs (pCTs), repeat CTs, CBCTs and MRs were used to train two neural networks to convert either CBCTs or MRs into sCTs. Image quality was quantified by calculating mean absolute error (MAE), mean error (ME) and Dice similarity coefficient (DSC) for bones. The dose evaluation consisted of a systematic non-clinical analysis and a clinical recalculation of actually used proton treatment plans. Gamma analysis was performed for non-clinical and clinical treatment plans. For clinical treatment plans also dose to targets and organs at risk (OARs) and normal tissue complication probabilities (NTCP) were compared. CBCT-based sCTs resulted in higher image quality with an average MAE of 40 ± 4 HU and a DSC of 0.95, while for MR-based sCTs a MAE of 65 ± 4 HU and a DSC of 0.89 was observed. Also in clinical proton dose calculations, sCTCBCT achieved higher average gamma pass ratios (2%/2 mm criteria) than sCTMR (96.1% vs. 93.3%). Dose-volume histograms for selected OARs and NTCP-values showed a very small difference between sCTCBCT and sCTMR and a high agreement with the reference pCT. CBCT- and MR-based sCTs have the potential to enable accurate proton dose calculations valuable for daily adaptive PT. Significant image quality differences were observed but did not affect proton dose calculation accuracy in a similar manner. Especially the recalculation of clinical treatment plans showed high agreement with the pCT for both sCTCBCT and sCTMR.

Comparison of CBCT based synthetic CT methods suitable for proton dose calculations in adaptive proton therapy.

In-room imaging is a prerequisite for adaptive proton therapy. The use of onboard cone-beam computed tomography (CBCT) imaging, which is routinely acquired for patient position verification, can enable daily dose reconstructions and plan adaptation decisions. Image quality deficiencies though, hamper dose calculation accuracy and make corrections of CBCTs a necessity. This study compared three methods to correct CBCTs and create synthetic CTs that are suitable for proton dose calculations. CBCTs, planning CTs and repeated CTs (rCT) from 33 H&N cancer patients were used to compare a deep convolutional neural network (DCNN), deformable image registration (DIR) and an analytical image-based correction method (AIC) for synthetic CT (sCT) generation. Image quality of sCTs was evaluated by comparison with a same-day rCT, using mean absolute error (MAE), mean error (ME), Dice similarity coefficient (DSC), structural non-uniformity (SNU) and signal/contrast-to-noise ratios (SNR/CNR) as metrics. Dosimetric accuracy was investigated in an intracranial setting by performing gamma analysis and calculating range shifts. Neural network-based sCTs resulted in the lowest MAE and ME (37/2 HU) and the highest DSC (0.96). While DIR and AIC generated images with a MAE of 44/77 HU, a ME of -8/1 HU and a DSC of 0.94/0.90. Gamma and range shift analysis showed almost no dosimetric difference between DCNN and DIR based sCTs. The lower image quality of AIC based sCTs affected dosimetric accuracy and resulted in lower pass ratios and higher range shifts. Patient-specific differences highlighted the advantages and disadvantages of each method. For the set of patients, the DCNN created synthetic CTs with the highest image quality. Accurate proton dose calculations were achieved by both DCNN and DIR based sCTs. The AIC method resulted in lower image quality and dose calculation accuracy was reduced compared to the other methods.