Patient-specific deep learning for 3D protoacoustic image reconstruction and dose verification in proton therapy.

BACKGROUND: Protoacoustic (PA) imaging has the potential to provide real-time 3D dose verification of proton therapy. However, PA images are susceptible to severe distortion due to limited angle acquisition. Our previous studies showed the potential of using deep learning to enhance PA images. As the model was trained using a limited number of patients' data, its efficacy was limited when applied to individual patients. PURPOSE: In this study, we developed a patient-specific deep learning method for protoacoustic imaging to improve the reconstruction quality of protoacoustic imaging and the accuracy of dose verification for individual patients. METHODS: Our method consists of two stages: in the first stage, a group model is trained from a diverse training set containing all patients, where a novel deep learning network is employed to directly reconstruct the initial pressure maps from the radiofrequency (RF) signals; in the second stage, we apply transfer learning on the pre-trained group model using patient-specific dataset derived from a novel data augmentation method to tune it into a patient-specific model. Raw PA signals were simulated based on computed tomography (CT) images and the pressure map derived from the planned dose. The reconstructed PA images were evaluated against the ground truth by using the root mean squared errors (RMSE), structural similarity index measure (SSIM) and gamma index on 10 specific prostate cancer patients. The significance level was evaluated by t-test with the p-value threshold of 0.05 compared with the results from the group model. RESULTS: The patient-specific model achieved an average RMSE of 0.014 ( p < 0.05 ${{{p}}}<{0.05}$ ), and an average SSIM of 0.981 ( p < 0.05 ${{{p}}}<{0.05}$ ), out-performing the group model. Qualitative results also demonstrated that our patient-specific approach acquired better imaging quality with more details reconstructed when comparing with the group model. Dose verification achieved an average RMSE of 0.011 ( p < 0.05 ${{{p}}}<{0.05}$ ), and an average SSIM of 0.995 ( p < 0.05 ${{{p}}}<{0.05}$ ). Gamma index evaluation demonstrated a high agreement (97.4% [ p < 0.05 ${{{p}}}<{0.05}$ ] and 97.9% [ p < 0.05 ${{{p}}}<{0.05}$ ] for 1%/3  and 1%/5 mm) between the predicted and the ground truth dose maps. Our approach approximately took 6 s to reconstruct PA images for each patient, demonstrating its feasibility for online 3D dose verification for prostate proton therapy. CONCLUSIONS: Our method demonstrated the feasibility of achieving 3D high-precision PA-based dose verification using patient-specific deep-learning approaches, which can potentially be used to guide the treatment to mitigate the impact of range uncertainty and improve the precision. Further studies are needed to validate the clinical impact of the technique.

Hybrid-supervised deep learning for domain transfer 3D protoacoustic image reconstruction.

Objective. Protoacoustic imaging showed great promise in providing real-time 3D dose verification of proton therapy. However, the limited acquisition angle in protoacoustic imaging induces severe artifacts, which impairs its accuracy for dose verification. In this study, we developed a hybrid-supervised deep learning method for protoacoustic imaging to address the limited view issue.Approach. We proposed a Recon-Enhance two-stage deep learning method. In the Recon-stage, a transformer-based network was developed to reconstruct initial pressure maps from raw acoustic signals. The network is trained in a hybrid-supervised approach, where it is first trained using supervision by the iteratively reconstructed pressure map and then fine-tuned using transfer learning and self-supervision based on the data fidelity constraint. In the enhance-stage, a 3D U-net is applied to further enhance the image quality with supervision from the ground truth pressure map. The final protoacoustic images are then converted to dose for proton verification.Main results. The results evaluated on a dataset of 126 prostate cancer patients achieved an average root mean squared errors (RMSE) of 0.0292, and an average structural similarity index measure (SSIM) of 0.9618, out-performing related start-of-the-art methods. Qualitative results also demonstrated that our approach addressed the limit-view issue with more details reconstructed. Dose verification achieved an average RMSE of 0.018, and an average SSIM of 0.9891. Gamma index evaluation demonstrated a high agreement (94.7% and 95.7% for 1%/3 mm and 1%/5 mm) between the predicted and the ground truth dose maps. Notably, the processing time was reduced to 6 s, demonstrating its feasibility for online 3D dose verification for prostate proton therapy.Significance. Our study achieved start-of-the-art performance in the challenging task of direct reconstruction from radiofrequency signals, demonstrating the great promise of PA imaging as a highly efficient and accurate tool forinvivo3D proton dose verification to minimize the range uncertainties of proton therapy to improve its precision and outcomes.

Radiation-induced acoustic signal denoising using a supervised deep learning framework for imaging and therapy monitoring.

Radiation-induced acoustic (RA) imaging is a promising technique for visualizing the invisible radiation energy deposition in tissues, enabling new imaging modalities and real-time therapy monitoring. However, RA imaging signal often suffers from poor signal-to-noise ratios (SNRs), thus requiring measuring hundreds or even thousands of frames for averaging to achieve satisfactory quality. This repetitive measurement increases ionizing radiation dose and degrades the temporal resolution of RA imaging, limiting its clinical utility. In this study, we developed a general deep inception convolutional neural network (GDI-CNN) to denoise RA signals to substantially reduce the number of frames needed for averaging. The network employs convolutions with multiple dilations in each inception block, allowing it to encode and decode signal features with varying temporal characteristics. This design generalizes GDI-CNN to denoise acoustic signals resulting from different radiation sources. The performance of the proposed method was evaluated using experimental data of x-ray-induced acoustic, protoacoustic, and electroacoustic signals both qualitatively and quantitatively. Results demonstrated the effectiveness of GDI-CNN: it achieved x-ray-induced acoustic image quality comparable to 750-frame-averaged results using only 10-frame-averaged measurements, reducing the imaging dose of x-ray-acoustic computed tomography (XACT) by 98.7%; it realized proton range accuracy parallel to 1500-frame-averaged results using only 20-frame-averaged measurements, improving the range verification frequency in proton therapy from 0.5 to 37.5 Hz; it reached electroacoustic image quality comparable to 750-frame-averaged results using only a single frame signal, increasing the electric field monitoring frequency from 1 fps to 1k fps. Compared to lowpass filter-based denoising, the proposed method demonstrated considerably lower mean-squared-errors, higher peak-SNR, and higher structural similarities with respect to the corresponding high-frame-averaged measurements. The proposed deep learning-based denoising framework is a generalized method for few-frame-averaged acoustic signal denoising, which significantly improves the RA imaging's clinical utilities for low-dose imaging and real-time therapy monitoring.

Deep learning-based protoacoustic signal denoising for proton range verification.

Proton therapy is a type of radiation therapy that can provide better dose distribution compared to photon therapy by delivering most of the energy at the end of range, which is called the Bragg peak (BP). The protoacoustic technique was developed to determine the BP locationsin vivo, but it requires a large dose delivery to the tissue to obtain a high number of signal averaging (NSA) to achieve a sufficient signal-to-noise ratio (SNR), which is not suitable for clinical use. A novel deep learning-based technique has been proposed to denoise acoustic signals and reduce BP range uncertainty with much lower doses. Three accelerometers were placed on the distal surface of a cylindrical polyethylene (PE) phantom to collect protoacoustic signals. In total, 512 raw signals were collected at each device. Device-specific stack autoencoder (SAE) denoising models were trained to denoise the noise-containing input signals, which were generated by averaging only 1, 2, 4, 8, 16, or 24 raw signals (low NSA signals), while the clean signals were obtained by averaging 192 raw signals (high NSA). Both supervised and unsupervised training strategies were employed, and the evaluation of the models was based on mean squared error (MSE), SNR, and BP range uncertainty. Overall, the supervised SAEs outperformed the unsupervised SAEs in BP range verification. For the high accuracy detector, it achieved a BP range uncertainty of 0.20 ± 3.44 mm by averaging over 8 raw signals, while for the other two low accuracy detectors, they achieved the BP uncertainty of 1.44 ± 6.45 mm and -0.23 ± 4.88 mm by averaging 16 raw signals, respectively. This deep learning-based denoising method has shown promising results in enhancing the SNR of protoacoustic measurements and improving the accuracy in BP range verification. It greatly reduces the dose and time for potential clinical applications.

Experimental demonstration of accurate Bragg peak localization with ionoacoustic tandem phase detection (iTPD).

Accurate knowledge of the exact stopping location of ions inside the patient would allow full exploitation of their ballistic properties for patient treatment. The localized energy deposition of a pulsed particle beam induces a rapid temperature increase of the irradiated volume and leads to the emission of ionoacoustic (IA) waves. Detecting the time-of-flight (ToF) of the IA wave allows inferring information on the Bragg peak location and can henceforth be used forin-vivorange verification. A challenge for IA is the poor signal-to-noise ratio at clinically relevant doses and viable machines. We present a frequency-based measurement technique, labeled as ionoacoustic tandem phase detection (iTPD) utilizing lock-in amplifiers. The phase shift of the IA signal to a reference signal is measured to derive theToF. Experimental IA measurements with a 3.5 MHz lead zirconate titanate (PZT) transducer and lock-in amplifiers were performed in water using 22 MeV proton bursts. A digital iTPD was performedin-silicoat clinical dose levels on experimental data obtained from a clinical facility and secondly, on simulations emulating a heterogeneous geometry. For the experimental setup using 22 MeV protons, a localization accuracy and precision obtained through iTPD deviates from a time-based reference analysis by less than 15µm. Several methodological aspects were investigated experimentally in systematic manner. Lastly, iTPD was evaluatedin-silicofor clinical beam energies indicating that iTPD is in reach of sub-mm accuracy for fractionated doses < 5 Gy. iTPD can be used to accurately measure theToFof IA signals online via its phase shift in frequency domain. An application of iTPD to the clinical scenario using a single pulsed beam is feasible but requires further development to reach <1 Gy detection capabilities.