MPLA case: How do you lead as a lead physicist?

This work of fiction is part of a case study series developed by the Medical Physics Leadership Academy (MPLA). It is intended to facilitate the discussion of the managerial and leadership challenges faced by a clinical medical physicist. In this case, a physicist David used to work in a clinic where he thrived and felt like a leader, despite not having the title. After a job change, he is now officially the "Lead Physicist" at a hospital newly affiliated with a large academic healthcare system. He believes he will be equally successful. Yet he struggles to bring about changes and get buy-in from coworkers. In the end, he feels like giving up and considers changing his job. This case is in the scenario of Problem Diagnosis.i The intended use of this case, through group discussion or self-study, is to encourage readers to perform a comprehensive analysis that identifies the root cause of the problem. This case study falls under the scope of and is supported by the MPLA, a committee in the American Association of Physicists in Medicine (AAPM).

MPLA case: I didn't realize those were the expectations!

This work of fiction is part of a case study series developed by the Medical Physics Leadership Academy (MPLA). It is intended to facilitate the discussion of how students and advisors can better communicate expectations and navigate difficult conversations. In this case, a fourth-year Ph.D. student Emma learns that her advisor Dr. So is leaving the institution and has not arranged to bring any students with him. As Emma and Dr. So meet to discuss Emma's next steps, the conversation reveals misunderstandings and miscommunications of expectations, including a specific publication requirement for graduation from Dr. So. Having just learned of Dr. So's publication requirement, Emma realizes that graduating before the lab shuts down is not feasible. The intended use of this case, through group discussion or self-study, is to encourage readers to discuss the situation at hand and inspire professionalism and leadership thinking. This case study falls under the scope of and is supported by the MPLA, a committee in the American Association of Physicists in Medicine (AAPM).

Statistical process control to monitor use of a web-based autoplanning tool.

PURPOSE: To investigate the use of statistical process control (SPC) for quality assurance of an integrated web-based autoplanning tool, Radiation Planning Assistant (RPA). METHODS: Automatically generated plans were downloaded and imported into two treatment planning systems (TPSs), RayStation and Eclipse, in which they were recalculated using fixed monitor units. The recalculated plans were then uploaded back to the RPA, and the mean dose differences for each contour between the original RPA and the TPSs plans were calculated. SPC was used to characterize the RPA plans in terms of two comparisons: RayStation TPS versus RPA and Eclipse TPS versus RPA for three anatomical sites, and variations in the machine parameters dosimetric leaf gap (DLG) and multileaf collimator transmission factor (MLC-TF) for two algorithms (Analytical Anisotropic Algorithm [AAA]) and Acuros in the Eclipse TPS. Overall, SPC was used to monitor the process of the RPA, while clinics would still perform their routine patient-specific QA. RESULTS: For RayStation, the average mean percent dose differences across all contours were 0.65% ± 1.05%, -2.09% ± 0.56%, and 0.28% ± 0.98% and average control limit ranges were 1.89% ± 1.32%, 2.16% ± 1.31%, and 2.65% ± 1.89% for the head and neck, cervix, and chest wall, respectively. In contrast, Eclipse's average mean percent dose differences across all contours were -0.62% ± 0.34%, 0.32% ± 0.23%, and -0.91% ± 0.98%, while average control limit ranges were 1.09% ± 0.77%, 3.69% ± 2.67%, 2.73% ± 1.86%, respectively. Averaging all contours and removing outliers, a 0% dose difference corresponded with a DLG value of 0.202 ± 0.019 cm and MLC-TF value of 0.020 ± 0.001 for Acuros and a DLG value of 0.135 ± 0.031 cm and MLC-TF value of 0.015 ± 0.001 for AAA. CONCLUSIONS: Differences in mean dose and control limits between RPA and two separately commissioned TPSs were determined. With varying control limits and means, SPC provides a flexible and useful process quality assurance tool for monitoring a complex automated system such as the RPA.

Knowledge-based planning for the radiation therapy treatment plan quality assurance for patients with head and neck cancer.

This study aimed to investigate the feasibility of using a knowledge-based planning technique to detect poor quality VMAT plans for patients with head and neck cancer. We created two dose-volume histogram (DVH) prediction models using a commercial knowledge-based planning system (RapidPlan, Varian Medical Systems, Palo Alto, CA) from plans generated by manual planning (MP) and automated planning (AP) approaches. DVHs were predicted for evaluation cohort 1 (EC1) of 25 patients and compared with achieved DVHs of MP and AP plans to evaluate prediction accuracy. Additionally, we predicted DVHs for evaluation cohort 2 (EC2) of 25 patients for which we intentionally generated plans with suboptimal normal tissue sparing while satisfying dose-volume limits of standard practice. Three radiation oncologists reviewed these plans without seeing the DVH predictions. We found that predicted DVH ranges (upper-lower predictions) were consistently wider for the MP model than for the AP model for all normal structures. The average ranges of mean dose predictions among all structures was 9.7 Gy (MP model) and 3.4 Gy (AP model) for EC1 patients. RapidPlan models identified 7 MP plans as outliers according to mean dose or D1% for at least one structure, while none of AP plans were flagged. For EC2 patients, 22 suboptimal plans were identified by prediction. While re-generated AP plans validated that these suboptimal plans could be improved, 40 out of 45 structures with predicted poor sparing were also identified by oncologist reviews as requiring additional planning to improve sparing in the clinical setting. Our study shows that knowledge-based DVH prediction models can be sufficiently accurate for plan quality assurance purposes. A prediction model built by a small cohort automatically-generated plans was effective in detecting suboptimal plans. Such tools have potential to assist the plan quality assurance workflow for individual patients in the clinic.

MPLA Case 2: A junior physicist attempts to improve radiotherapy workflow.

This fictional case describes the challenging situation for a junior physicist, who joined her hometown's cancer center as a solo physicist after graduating from residency. She is concerned about providing optimal patient care as well as improving her work/life balance. She wonders how to move forward. The intended use of the case study, in either a facilitated learning session or self-study, is to inspire the readers to discuss the situation, analyze the institutional and personal factors, apply relevant leadership skills, and propose action plans. This case study falls under the scope of, and is supported by, the Medical Physics Leadership Academy (MPLA). A sample facilitator's guide or self-study guide is available upon request to the MPLA Cases Subcommittee.

MPLA Case 3: Don't criticize me in public!

This work of fiction re-enacts a scenario in which a medical physics resident was not able to address a physics call during patient simulation and was criticized by the supervising faculty physicist in front of the team and the patient. The resident and the faculty agreed to meet afterwards to debrief the situation, in the hope of establishing a better working relationship. The intended use of this case, through group discussion, self-study, or role-play, is to encourage readers to discuss the situation at hand, inspire professionalism and leadership thinking, and allow the practice of conflict management. Facilitator's notes are available upon request to the MPLA Cases Subcommittee. This case study falls under the scope of and is supported by the Medical Physics Leadership Academy (MPLA), a committee in the American Association of Physicists in Medicine (AAPM).

MPLA Case 1: Implementing Cone-Beam CT in a Community Hospital.

This fictional case describes a managerial situation of implementing cone-beam computed tomography faced by a solo medical physicist in a rural community hospital. The intended use of the case study, in either a facilitated learning session or self-study, is to inspire the readers to discuss the situation, analyze the institutional and personal factors, apply relevant leadership skills, and propose action plans. This case study falls under the scope of, and is supported by, the Medical Physics Leadership Academy (MPLA). A sample facilitator's guide or self-study guide is included in the manuscript for reference by users of this case study.

Deep learning-based statistical robustness evaluation of intensity-modulated proton therapy for head and neck cancer.

Objective. Previous methods for robustness evaluation rely on dose calculation for a number of uncertainty scenarios, which either fails to provide statistical meaning when the number is too small (e.g., ∼8) or becomes unfeasible in daily clinical practice when the number is sufficiently large (e.g., >100). Our proposed deep learning (DL)-based method addressed this issue by avoiding the intermediate dose calculation step and instead directly predicting the percentile dose distribution from the nominal dose distribution using a DL model. In this study, we sought to validate this DL-based statistical robustness evaluation method for efficient and accurate robustness quantification in head and neck (H&N) intensity-modulated proton therapy with diverse beam configurations and multifield optimization.Approach. A dense, dilated 3D U-net was trained to predict the 5th and 95th percentile dose distributions of uncertainty scenarios using the nominal dose and planning CT images. The data set comprised proton therapy plans for 582 H&N cancer patients. Ground truth percentile values were estimated for each patient through 600 dose recalculations, representing randomly sampled uncertainty scenarios. The comprehensive comparisons of different models were conducted for H&N cancer patients, considering those with and without a beam mask and diverse beam configurations, including varying beam angles, couch angles, and beam numbers. The performance of our model trained based on a mixture of patients with H&N and prostate cancer was also assessed in contrast with models trained based on data specific for patients with cancer at either site.Results. The DL-based model's predictions of percentile dose distributions exhibited excellent agreement with the ground truth dose distributions. The average gamma index with 2 mm/2%, consistently exceeded 97% for both 5th and 95th percentile dose volumes. Mean dose-volume histogram error analysis revealed that predictions from the combined training set yielded mean errors and standard deviations that were generally similar to those in the specific patient training data sets.Significance. Our proposed DL-based method for evaluation of the robustness of proton therapy plans provides precise, rapid predictions of percentile dose for a given confidence level regardless of the beam arrangement and cancer site. This versatility positions our model as a valuable tool for evaluating the robustness of proton therapy across various cancer sites.

A deep learning-based approach for statistical robustness evaluation in proton therapy treatment planning: a feasibility study.

Objective. Robustness evaluation is critical in particle radiotherapy due to its susceptibility to uncertainties. However, the customary method for robustness evaluation only considers a few uncertainty scenarios, which are insufficient to provide a consistent statistical interpretation. We propose an artificial intelligence-based approach that overcomes this limitation by predicting a set of percentile dose values at every voxel and allows for the evaluation of planning objectives at specific confidence levels.Approach. We built and trained a deep learning (DL) model to predict the 5th and 95th percentile dose distributions, which corresponds to the lower and upper bounds of a two-tailed 90% confidence interval (CI), respectively. Predictions were made directly from the nominal dose distribution and planning computed tomography scan. The data used to train and test the model consisted of proton plans from 543 prostate cancer patients. The ground truth percentile values were estimated for each patient using 600 dose recalculations representing randomly sampled uncertainty scenarios. For comparison, we also tested whether a common worst-case scenario (WCS) robustness evaluation (voxel-wise minimum and maximum) corresponding to a 90% CI could reproduce the ground truth 5th and 95th percentile doses.Main results. The percentile dose distributions predicted by DL yielded excellent agreements with the ground truth dose distributions, with mean dose errors below 0.15 Gy and average gamma passing rates (GPR) at 1 mm/1% above 93.9, which were substantially better than the WCS dose distributions (mean dose error above 2.2 Gy and GPR at 1 mm/1% below 54). We observed similar outcomes in a dose-volume histogram error analysis, where the DL predictions generally yielded smaller mean errors and standard deviations than the WCS evaluation doses.Significance. The proposed method produces accurate and fast predictions (∼2.5 s for one percentile dose distribution) for a given confidence level. Thus, the method has the potential to improve robustness evaluation.

A deep-learning-based dose verification tool utilizing fluence maps for a cobalt-60 compensator-based intensity-modulated radiation therapy system.

Background and purpose: A novel cobalt-60 compensator-based intensity-modulated radiation therapy (IMRT) system was developed for a resource-limited environment but lacked an efficient dose verification algorithm. The aim of this study was to develop a deep-learning-based dose verification algorithm for accurate and rapid dose predictions. Materials and methods: A deep-learning network was employed to predict the doses from static fields related to beam commissioning. Inputs were a cube-shaped phantom, a beam binary mask, and an intersecting volume of the phantom and beam binary mask, while output was a 3-dimensional (3D) dose. The same network was extended to predict patient-specific doses for head and neck cancers using two different approaches. A field-based method predicted doses for each field and combined all calculated doses into a plan, while the plan-based method combined all nine fluences into a plan to predict doses. Inputs included patient computed tomography (CT) scans, binary beam masks, and fluence maps truncated to the patient's CT in 3D. Results: For static fields, predictions agreed well with ground truths with average deviations of less than 0.5% for percent depth doses and profiles. Even though the field-based method showed excellent prediction performance for each field, the plan-based method showed better agreement between clinical and predicted dose distributions. The distributed dose deviations for all planned target volumes and organs at risk were within 1.3 Gy. The calculation speed for each case was within two seconds. Conclusions: A deep-learning-based dose verification tool can accurately and rapidly predict doses for a novel cobalt-60 compensator-based IMRT system.

A real-time contouring feedback tool for consensus-based contour training.

Purpose: Variability in contouring structures of interest for radiotherapy continues to be challenging. Although training can reduce such variability, having radiation oncologists provide feedback can be impractical. We developed a contour training tool to provide real-time feedback to trainees, thereby reducing variability in contouring. Methods: We developed a novel metric termed localized signed square distance (LSSD) to provide feedback to the trainee on how their contour compares with a reference contour, which is generated real-time by combining trainee contour and multiple expert radiation oncologist contours. Nine trainees performed contour training by using six randomly assigned training cases that included one test case of the heart and left ventricle (LV). The test case was repeated 30 days later to assess retention. The distribution of LSSD maps of the initial contour for the training cases was combined and compared with the distribution of LSSD maps of the final contours for all training cases. The difference in standard deviations from the initial to final LSSD maps, ΔLSSD, was computed both on a per-case basis and for the entire group. Results: For every training case, statistically significant ΔLSSD were observed for both the heart and LV. When all initial and final LSSD maps were aggregated for the training cases, before training, the mean LSSD ([range], standard deviation) was -0.8 mm ([-37.9, 34.9], 4.2) and 0.3 mm ([-25.1, 32.7], 4.8) for heart and LV, respectively. These were reduced to -0.1 mm ([-16.2, 7.3], 0.8) and 0.1 mm ([-6.6, 8.3], 0.7) for the final LSSD maps during the contour training sessions. For the retention case, the initial and final LSSD maps of the retention case were aggregated and were -1.5 mm ([-22.9, 19.9], 3.4) and -0.2 mm ([-4.5, 1.5], 0.7) for the heart and 1.8 mm ([-16.7, 34.5], 5.1) and 0.2 mm ([-3.9, 1.6],0.7) for the LV. Conclusions: A tool that uses real-time contouring feedback was developed and successfully used for contour training of nine trainees. In all cases, the utility was able to guide the trainee and ultimately reduce the variability of the trainee's contouring.

Synthetic Megavoltage Cone Beam Computed Tomography Image Generation for Improved Contouring Accuracy of Cardiac Pacemakers.

In this study, we aimed to enhance the contouring accuracy of cardiac pacemakers by improving their visualization using deep learning models to predict MV CBCT images based on kV CT or CBCT images. Ten pacemakers and four thorax phantoms were included, creating a total of 35 combinations. Each combination was imaged on a Varian Halcyon (kV/MV CBCT images) and Siemens SOMATOM CT scanner (kV CT images). Two generative adversarial network (GAN)-based models, cycleGAN and conditional GAN (cGAN), were trained to generate synthetic MV (sMV) CBCT images from kV CT/CBCT images using twenty-eight datasets (80%). The pacemakers in the sMV CBCT images and original MV CBCT images were manually delineated and reviewed by three users. The Dice similarity coefficient (DSC), 95% Hausdorff distance (HD95), and mean surface distance (MSD) were used to compare contour accuracy. Visual inspection showed the improved visualization of pacemakers on sMV CBCT images compared to original kV CT/CBCT images. Moreover, cGAN demonstrated superior performance in enhancing pacemaker visualization compared to cycleGAN. The mean DSC, HD95, and MSD for contours on sMV CBCT images generated from kV CT/CBCT images were 0.91 ± 0.02/0.92 ± 0.01, 1.38 ± 0.31 mm/1.18 ± 0.20 mm, and 0.42 ± 0.07 mm/0.36 ± 0.06 mm using the cGAN model. Deep learning-based methods, specifically cycleGAN and cGAN, can effectively enhance the visualization of pacemakers in thorax kV CT/CBCT images, therefore improving the contouring precision of these devices.

Deep learning-based dose prediction to improve the plan quality of volumetric modulated arc therapy for gynecologic cancers.

BACKGROUND: In recent years, deep-learning models have been used to predict entire three-dimensional dose distributions. However, the usability of dose predictions to improve plan quality should be further investigated. PURPOSE: To develop a deep-learning model to predict high-quality dose distributions for volumetric modulated arc therapy (VMAT) plans for patients with gynecologic cancer and to evaluate their usability in driving plan quality improvements. METHODS: A total of 79 VMAT plans for the female pelvis were used to train (47 plans), validate (16 plans), and test (16 plans) 3D dense dilated U-Net models to predict 3D dose distributions. The models received the normalized CT scan, dose prescription, and target and normal tissue contours as inputs. Three models were used to predict the dose distributions for plans in the test set. A radiation oncologist specializing in the treatment of gynecologic cancers scored the test set predictions using a 5-point scale (5, acceptable as-is; 4, prefer minor edits; 3, minor edits needed; 2, major edits needed; and 1, unacceptable). The clinical plans for which the dose predictions indicated that improvements could be made were reoptimized with constraints extracted from the predictions. RESULTS: The predicted dose distributions in the test set were of comparable quality to the clinical plans. The mean voxel-wise dose difference was -0.14 ± 0.46 Gy. The percentage dose differences in the predicted target metrics of D 1 % ${D}_{1{\mathrm{\% }}}$ and D 98 % ${D}_{98{\mathrm{\% }}}$ were -1.05% ± 0.59% and 0.21% ± 0.28%, respectively. The dose differences in the predicted organ at risk mean and maximum doses were -0.30 ± 1.66 Gy and -0.42 ± 2.07 Gy, respectively. A radiation oncologist deemed all of the predicted dose distributions clinically acceptable; 12 received a score of 5, and four received a score of 4. Replanning of flagged plans (five plans) showed that the original plans could be further optimized to give dose distributions close to the predicted dose distributions. CONCLUSIONS: Deep-learning dose prediction can be used to predict high-quality and clinically acceptable dose distributions for VMAT female pelvis plans, which can then be used to identify plans that can be improved with additional optimization.

Deep Learning-Based Dose Prediction for Automated, Individualized Quality Assurance of Head and Neck Radiation Therapy Plans.

PURPOSE: This study aimed to use deep learning-based dose prediction to assess head and neck (HN) plan quality and identify suboptimal plans. METHODS AND MATERIALS: A total of 245 volumetric modulated arc therapy HN plans were created using RapidPlan knowledge-based planning (KBP). A subset of 112 high-quality plans was selected under the supervision of an HN radiation oncologist. We trained a 3D Dense Dilated U-Net architecture to predict 3-dimensional dose distributions using 3-fold cross-validation on 90 plans. Model inputs included computed tomography images, target prescriptions, and contours for targets and organs at risk (OARs). The model's performance was assessed on the remaining 22 test plans. We then tested the application of the dose prediction model for automated review of plan quality. Dose distributions were predicted on 14 clinical plans. The predicted versus clinical OAR dose metrics were compared to flag OARs with suboptimal normal tissue sparing using a 2 Gy dose difference or 3% dose-volume threshold. OAR flags were compared with manual flags by 3 HN radiation oncologists. RESULTS: The predicted dose distributions were of comparable quality to the KBP plans. The differences between the predicted and KBP-planned D1%,D95%, and D99% across the targets were within -2.53% ± 1.34%, -0.42% ± 1.27%, and -0.12% ± 1.97%, respectively, and the OAR mean and maximum doses were within -0.33 ± 1.40 Gy and -0.96 ± 2.08 Gy, respectively. For the plan quality assessment study, radiation oncologists flagged 47 OARs for possible plan improvement. There was high interphysician variability; 83% of physician-flagged OARs were flagged by only one of 3 physicians. The comparative dose prediction model flagged 63 OARs, including 30 of 47 physician-flagged OARs. CONCLUSIONS: Deep learning can predict high-quality dose distributions, which can be used as comparative dose distributions for automated, individualized assessment of HN plan quality.

Automated Contouring and Planning in Radiation Therapy: What Is 'Clinically Acceptable'?

Developers and users of artificial-intelligence-based tools for automatic contouring and treatment planning in radiotherapy are expected to assess clinical acceptability of these tools. However, what is 'clinical acceptability'? Quantitative and qualitative approaches have been used to assess this ill-defined concept, all of which have advantages and disadvantages or limitations. The approach chosen may depend on the goal of the study as well as on available resources. In this paper, we discuss various aspects of 'clinical acceptability' and how they can move us toward a standard for defining clinical acceptability of new autocontouring and planning tools.

OpenKBP-Opt: an international and reproducible evaluation of 76 knowledge-based planning pipelines.

Objective.To establish an open framework for developing plan optimization models for knowledge-based planning (KBP).Approach.Our framework includes radiotherapy treatment data (i.e. reference plans) for 100 patients with head-and-neck cancer who were treated with intensity-modulated radiotherapy. That data also includes high-quality dose predictions from 19 KBP models that were developed by different research groups using out-of-sample data during the OpenKBP Grand Challenge. The dose predictions were input to four fluence-based dose mimicking models to form 76 unique KBP pipelines that generated 7600 plans (76 pipelines × 100 patients). The predictions and KBP-generated plans were compared to the reference plans via: the dose score, which is the average mean absolute voxel-by-voxel difference in dose; the deviation in dose-volume histogram (DVH) points; and the frequency of clinical planning criteria satisfaction. We also performed a theoretical investigation to justify our dose mimicking models.Main results.The range in rank order correlation of the dose score between predictions and their KBP pipelines was 0.50-0.62, which indicates that the quality of the predictions was generally positively correlated with the quality of the plans. Additionally, compared to the input predictions, the KBP-generated plans performed significantly better (P< 0.05; one-sided Wilcoxon test) on 18 of 23 DVH points. Similarly, each optimization model generated plans that satisfied a higher percentage of criteria than the reference plans, which satisfied 3.5% more criteria than the set of all dose predictions. Lastly, our theoretical investigation demonstrated that the dose mimicking models generated plans that are also optimal for an inverse planning model.Significance.This was the largest international effort to date for evaluating the combination of KBP prediction and optimization models. We found that the best performing models significantly outperformed the reference dose and dose predictions. In the interest of reproducibility, our data and code is freely available.

Technical Note: Dose prediction for head and neck radiotherapy using a three-dimensional dense dilated U-net architecture.

PURPOSE: Radiation therapy treatment planning is a time-consuming and iterative manual process. Consequently, plan quality varies greatly between and within institutions. Artificial intelligence shows great promise in improving plan quality and reducing planning times. This technical note describes our participation in the American Association of Physicists in Medicine Open Knowledge-Based Planning Challenge (OpenKBP), a competition to accurately predict radiation therapy dose distributions. METHODS: A three-dimensional (3D) densely connected U-Net with dilated convolutions was developed to predict 3D dose distributions given contoured CT images of head and neck patients as input. While traditional augmentation techniques such as rotations and translations were explored, it was found that training on random patches alone resulted in the greatest model performance. A custom-weighted mean squared error loss function was employed. Finally, an ensemble of best-performing networks was used to generate the final challenge predictions. RESULTS: Our team (SuperPod) placed second in the dose stream of the OpenKBP challenge. The average mean absolute difference between the predicted and clinical dose distributions of the testing dataset was 2.56 Gy. On average, the predicted normalized target DVH metrics were within 3% of the clinical plans, and the predicted organ at risk DVH metrics were within 2 Gy of the clinical plans. CONCLUSIONS: The developed 3D dense dilated U-Net architecture can accurately predict 3D radiotherapy dose distributions and can be used as part of a fully automated radiation therapy planning pipeline.