Evaluating automatically generated normal tissue contours for safe use in head and neck and cervical cancer treatment planning.

PURPOSE: Volumetric-modulated arc therapy (VMAT) is a widely accepted treatment method for head and neck (HN) and cervical cancers; however, creating contours and plan optimization for VMAT plans is a time-consuming process. Our group has created an automated treatment planning tool, the Radiation Planning Assistant (RPA), that uses deep learning models to generate organs at risk (OARs), planning structures and automates plan optimization. This study quantitatively evaluates the quality of contours generated by the RPA tool. METHODS: For patients with HN (54) and cervical (39) cancers, we retrospectively generated autoplans using the RPA. Autoplans were generated using deep-learning and RapidPlan models developed in-house. The autoplans were, then, applied to the original, physician-drawn contours, which were used as a ground truth (GT) to compare with the autocontours (RPA). Using a "two one-sided tests" (TOST) procedure, we evaluated whether the autocontour normal tissue dose was equivalent to that of the ground truth by a margin, δ, that we determined based on clinical judgement. We also calculated the number of plans that met established clinically accepted dosimetric criteria. RESULTS: For HN plans, 91.8% and 91.7% of structures met dosimetric criteria for automatic and manual contours, respectively; for cervical plans, 95.6% and 95.7% of structures met dosimetric criteria for automatic and manual contours, respectively. Autocontours were equivalent to the ground truth for 71% and 75% of common DVH metrics for the HN and cervix, respectively. CONCLUSIONS: This study shows that dosimetrically equivalent normal tissue contours can be created for HN and cervical cancers using deep learning techniques. In general, differences between the contours did not affect the passing or failing of clinical dose tolerances.

Artificial Intelligence-Based Radiotherapy Contouring and Planning to Improve Global Access to Cancer Care.

PURPOSE: Increased automation has been identified as one approach to improving global cancer care. The Radiation Planning Assistant (RPA) is a web-based tool offering automated radiotherapy (RT) contouring and planning to low-resource clinics. In this study, the RPA workflow and clinical acceptability were assessed by physicians around the world. METHODS: The RPA output for 75 cases was reviewed by at least three physicians; 31 radiation oncologists at 16 institutions in six countries on five continents reviewed RPA contours and plans for clinical acceptability using a 5-point Likert scale. RESULTS: For cervical cancer, RPA plans using bony landmarks were scored as usable as-is in 81% (with minor edits 93%); using soft tissue contours, plans were scored as usable as-is in 79% (with minor edits 96%). For postmastectomy breast cancer, RPA plans were scored as usable as-is in 44% (with minor edits 91%). For whole-brain treatment, RPA plans were scored as usable as-is in 67% (with minor edits 99%). For head/neck cancer, the normal tissue autocontours were acceptable as-is in 89% (with minor edits 97%). The clinical target volumes (CTVs) were acceptable as-is in 40% (with minor edits 93%). The volumetric-modulated arc therapy (VMAT) plans were acceptable as-is in 87% (with minor edits 96%). For cervical cancer, the normal tissue autocontours were acceptable as-is in 92% (with minor edits 99%). The CTVs for cervical cancer were scored as acceptable as-is in 83% (with minor edits 92%). The VMAT plans for cervical cancer were acceptable as-is in 99% (with minor edits 100%). CONCLUSION: The RPA, a web-based tool designed to improve access to high-quality RT in low-resource settings, has high rates of clinical acceptability by practicing clinicians around the world. It has significant potential for successful implementation in low-resource clinics.

Performance Analysis of a Radiation Oncology Educational Podcast.

PURPOSE: Asynchronous podcast education is a popular supplementary tool, with up to 88% of medical residents reporting its use. Radiation oncology podcasts remain scarce. The authors analyzed the early performance, listenership, and engagement of the first education-specific radiation oncology medical podcast. METHODS: Episode data and listener demographics were gathered from Spotify and Apple Podcasts. Episodes were case based, categorized by disease subsite, and reviewed by a board-certified radiation oncologist. Listenership was defined by the number of plays per day (ppd) on unique devices, averaged up to 60 days from publication. Episode engagement was defined as a percentage of plays on unique devices playing >40% of an episode within a single session. Quantitative end points included episode engagement and listenership. Pearson's correlation coefficient calculations were used for analysis. RESULTS: From July 2022 to March 2023, 20 total episodes had 13,078 total plays over 227 days. The median episode length was 13.8 min (range, 9.2-20.1 min). Listener demographics were as follows: 54.4% men, 44.0% women, 1.3% not specified, and 0.3% nonbinary, with ages 18 to 22 (1%), 23 to 27 (13%), 28 to 34 (58%), 35 to 44 (22%), 45 to 59 (4%), and ≥60 (2%) years. Episodes were played in 53 countries, with the most plays in North America (71.5%), followed by Asia (10.2%), Europe (8.2%), Oceania (8.0%), Africa (1.5%), and South America (0.5%). There was a 585.2% increase in listenership since initiation, with median growth of 46.0% per month. Median listenership and engagement were 11.3 ppd (interquartile range, 10.3-13.8 ppd) and 81.4% (interquartile range, 72.0%-84.2%) for all episodes, respectively. A significant negative relationship between episode length and engagement was observed (r[20] = -0.51, P = .02). There was no statistically significant relationship between ppd and episode length (r[20] = -0.19, P = .42). CONCLUSIONS: The significant rise in listenership, high episode engagement, and large international audience support a previously unmet need in radiation oncology medical education that may be supplemented by podcasts.

Patterns of failure for recurrent head and neck squamous cell carcinoma treated with salvage surgery and postoperative IMRT reirradiation.

Purpose/Objectives: The purpose of this study was to evaluate patterns of locoregional recurrence (LRR) after surgical salvage and adjuvant reirradiation with IMRT for recurrent head and neck squamous cell cancer (HNSCC). Materials/Methods: Patterns of LRR for 61 patients treated consecutively between 2003 and 2014 who received post-operative IMRT reirradiation to ≥ 60 Gy for recurrent HNSCC were determined by 2 methods: 1) physician classification via visual comparison of post-radiotherapy imaging to reirradiation plans; and 2) using deformable image registration (DIR). Those without evaluable CT planning image data were excluded. All recurrences were verified by biopsy or radiological progression. Failures were defined as in-field, marginal, or out-of-field. Logistic regression analyses were performed to identify predictors for LRR. Results: A total of 55 patients were eligible for analysis and 23 (42 %) had documented LRR after reirradiation. Location of recurrent disease prior to salvage surgery (lymphatic vs. mucosal) was the most significant predictor of LRR after post-operative reirradiation with salvage rate of 67 % for lymphatic vs. 33 % for mucosal sites (p = 0.037). Physician classification of LRR yielded 14 (61 %) in-field failures, 3 (13 %) marginal failures, and 6 (26 %) out-of-field failures, while DIR yielded 10 (44 %) in-field failures, 4 (17 %) marginal failures, and 9 (39 %) out-of-field failures. Most failures (57 %) occurred within the original site of recurrence or first echelon lymphatic drainage. Of patients who had a free flap placed during salvage surgery, 56 % of failures occurred within 1 cm of the surgical flap. Conclusion: Our study highlights the role of DIR in enhancing the accuracy and consistency of POF analysis. Compared to traditional visual inspection, DIR reduces interobserver variability and provides more nuanced insights into dose-specific and spatial parameters of locoregional recurrences. Additionally, the study identifies the location of the initial recurrence as a key predictor of subsequent locoregional recurrence after salvage surgery and re-IMRT.

Fully-automated, CT-only GTV contouring for palliative head and neck radiotherapy.

Planning for palliative radiotherapy is performed without the advantage of MR or PET imaging in many clinics. Here, we investigated CT-only GTV delineation for palliative treatment of head and neck cancer. Two multi-institutional datasets of palliative-intent treatment plans were retrospectively acquired: a set of 102 non-contrast-enhanced CTs and a set of 96 contrast-enhanced CTs. The nnU-Net auto-segmentation network was chosen for its strength in medical image segmentation, and five approaches separately trained: (1) heuristic-cropped, non-contrast images with a single GTV channel, (2) cropping around a manually-placed point in the tumor center for non-contrast images with a single GTV channel, (3) contrast-enhanced images with a single GTV channel, (4) contrast-enhanced images with separate primary and nodal GTV channels, and (5) contrast-enhanced images along with synthetic MR images with separate primary and nodal GTV channels. Median Dice similarity coefficient ranged from 0.6 to 0.7, surface Dice from 0.30 to 0.56, and 95th Hausdorff distance from 14.7 to 19.7 mm across the five approaches. Only surface Dice exhibited statistically-significant difference across these five approaches using a two-tailed Wilcoxon Rank-Sum test (p ≤ 0.05). Our CT-only results met or exceeded published values for head and neck GTV autocontouring using multi-modality images. However, significant edits would be necessary before clinical use in palliative radiotherapy.

Radiation Planning Assistant - A Web-based Tool to Support High-quality Radiotherapy in Clinics with Limited Resources.

Access to radiotherapy worldwide is limited. The Radiation Planning Assistant (RPA) is a fully automated, web-based tool that is being developed to offer fully automated radiotherapy treatment planning tools to clinics with limited resources. The goal is to help clinical teams scale their efforts, thus reaching more patients with cancer. The user connects to the RPA via a webpage, completes a Service Request (prescription and information about the radiotherapy targets), and uploads the patient's CT image set. The RPA offers two approaches to automated planning. In one-step planning, the system uses the Service Request and CT scan to automatically generate the necessary contours and treatment plan. In two-step planning, the user reviews and edits the automatically generated contours before the RPA continues to generate a volume-modulated arc therapy plan. The final plan is downloaded from the RPA website and imported into the user's local treatment planning system, where the dose is recalculated for the locally commissioned linac; if necessary, the plan is edited prior to approval for clinical use.

Identifying the optimal deep learning architecture and parameters for automatic beam aperture definition in 3D radiotherapy.

PURPOSE: Two-dimensional radiotherapy is often used to treat cervical cancer in low- and middle-income countries, but treatment planning can be challenging and time-consuming. Neural networks offer the potential to greatly decrease planning time through automation, but the impact of the wide range of hyperparameters to be set during training on model accuracy has not been exhaustively investigated. In the current study, we evaluated the effect of several convolutional neural network architectures and hyperparameters on 2D radiotherapy treatment field delineation. METHODS: Six commonly used deep learning architectures were trained to delineate four-field box apertures on digitally reconstructed radiographs for cervical cancer radiotherapy. A comprehensive search of optimal hyperparameters for all models was conducted by varying the initial learning rate, image normalization methods, and (when appropriate) convolutional kernel size, the number of learnable parameters via network depth and the number of feature maps per convolution, and nonlinear activation functions. This yielded over 1700 unique models, which were all trained until performance converged and then tested on a separate dataset. RESULTS: Of all hyperparameters, the choice of initial learning rate was most consistently significant for improved performance on the test set, with all top-performing models using learning rates of 0.0001. The optimal image normalization was not consistent across architectures. High overlap (mean Dice similarity coefficient = 0.98) and surface distance agreement (mean surface distance < 2 mm) were achieved between the treatment field apertures for all architectures using the identified best hyperparameters. Overlap Dice similarity coefficient (DSC) and distance metrics (mean surface distance and Hausdorff distance) indicated that DeepLabv3+ and D-LinkNet architectures were least sensitive to initial hyperparameter selection. CONCLUSION: DeepLabv3+ and D-LinkNet are most robust to initial hyperparameter selection. Learning rate, nonlinear activation function, and kernel size are also important hyperparameters for improving performance.

Addressing the Global Expertise Gap in Radiation Oncology: The Radiation Planning Assistant.

PURPOSE: Automation, including the use of artificial intelligence, has been identified as a possible opportunity to help reduce the gap in access and quality for radiotherapy and other aspects of cancer care. The Radiation Planning Assistant (RPA) project was conceived in 2015 (and funded in 2016) to use automated contouring and treatment planning algorithms to support the efforts of oncologists in low- and middle-income countries, allowing them to scale their efforts and treat more patients safely and efficiently (to increase access). DESIGN: In this review, we discuss the development of the RPA, with a particular focus on clinical acceptability and safety/risk across jurisdictions as these are important indicators for the successful future deployment of the RPA to increase radiotherapy availability and ameliorate global disparities in access to radiation oncology. RESULTS: RPA tools will be offered through a webpage, where users can upload computed tomography data sets and download automatically generated contours and treatment plans. All interfaces have been designed to maximize ease of use and minimize risk. The current version of the RPA includes automated contouring and planning for head and neck cancer, cervical cancer, breast cancer, and metastases to the brain. CONCLUSION: The RPA has been designed to bring high-quality treatment planning to more patients across the world, and it may encourage greater investment in treatment devices and other aspects of cancer treatment.

Adaptive Region-Specific Loss for Improved Medical Image Segmentation.

Defining the loss function is an important part of neural network design and critically determines the success of deep learning modeling. A significant shortcoming of the conventional loss functions is that they weight all regions in the input image volume equally, despite the fact that the system is known to be heterogeneous (i.e., some regions can achieve high prediction performance more easily than others). Here, we introduce a region-specific loss to lift the implicit assumption of homogeneous weighting for better learning. We divide the entire volume into multiple sub-regions, each with an individualized loss constructed for optimal local performance. Effectively, this scheme imposes higher weightings on the sub-regions that are more difficult to segment, and vice versa. Furthermore, the regional false positive and false negative errors are computed for each input image during a training step and the regional penalty is adjusted accordingly to enhance the overall accuracy of the prediction. Using different public and in-house medical image datasets, we demonstrate that the proposed regionally adaptive loss paradigm outperforms conventional methods in the multi-organ segmentations, without any modification to the neural network architecture or additional data preparation.

Deep Learning-Based Dose Prediction for Automated, Individualized Quality Assurance of Head and Neck Radiation Therapy Plans.

PURPOSE: This study aimed to use deep learning-based dose prediction to assess head and neck (HN) plan quality and identify suboptimal plans. METHODS AND MATERIALS: A total of 245 volumetric modulated arc therapy HN plans were created using RapidPlan knowledge-based planning (KBP). A subset of 112 high-quality plans was selected under the supervision of an HN radiation oncologist. We trained a 3D Dense Dilated U-Net architecture to predict 3-dimensional dose distributions using 3-fold cross-validation on 90 plans. Model inputs included computed tomography images, target prescriptions, and contours for targets and organs at risk (OARs). The model's performance was assessed on the remaining 22 test plans. We then tested the application of the dose prediction model for automated review of plan quality. Dose distributions were predicted on 14 clinical plans. The predicted versus clinical OAR dose metrics were compared to flag OARs with suboptimal normal tissue sparing using a 2 Gy dose difference or 3% dose-volume threshold. OAR flags were compared with manual flags by 3 HN radiation oncologists. RESULTS: The predicted dose distributions were of comparable quality to the KBP plans. The differences between the predicted and KBP-planned D1%,D95%, and D99% across the targets were within -2.53% ± 1.34%, -0.42% ± 1.27%, and -0.12% ± 1.97%, respectively, and the OAR mean and maximum doses were within -0.33 ± 1.40 Gy and -0.96 ± 2.08 Gy, respectively. For the plan quality assessment study, radiation oncologists flagged 47 OARs for possible plan improvement. There was high interphysician variability; 83% of physician-flagged OARs were flagged by only one of 3 physicians. The comparative dose prediction model flagged 63 OARs, including 30 of 47 physician-flagged OARs. CONCLUSIONS: Deep learning can predict high-quality dose distributions, which can be used as comparative dose distributions for automated, individualized assessment of HN plan quality.

Posttreatment FDG-PET/CT Hopkins criteria predict locoregional recurrence after definitive radiotherapy for oropharyngeal squamous cell carcinoma.

BACKGROUND: Metabolic response assessment for oropharyngeal squamous cell carcinoma (OPSCC) aids in identifying locoregional persistence/recurrence (LRR). The Hopkins Criteria are a standardized qualitative response assessment system using posttreatment FDG-PET/CT. METHODS: We conducted a retrospective cohort study of patients with node-positive OPSCC treated with definitive (chemo)radiotherapy. We assessed Hopkins Criteria performance for LRR, then developed and validated a competing-risks model. RESULTS: Between 2004 and 2018, 259 patients were included with median follow-up of 43 months. The Hopkins Criteria sensitivity, specificity, negative predictive value, and accuracy were 68%, 88%, 95%, and 85%. The 36-month cumulative incidence of LRR was greater with positive scores (45% vs. 5%, HR 12.60, p < 0.001). PET/CTs performed ≤10 weeks after radiotherapy were associated with a four-fold increase in pathologically negative biopsies/surgeries (36% vs. 9%, p = 0.03). The AUC for LRR was 0.89 using a model integrating the Hopkins score. CONCLUSIONS: The Hopkins Criteria predict LRR with high accuracy for OPSCC response assessment.

Assessing the practicality of using a single knowledge-based planning model for multiple linac vendors.

PURPOSE: Knowledge-based planning (KBP) has been shown to be an effective tool in quality control for intensity-modulated radiation therapy treatment planning and generating high-quality plans. Previous studies have evaluated its ability to create consistent plans across institutions and between planners within the same institution as well as its use as teaching tool for inexperienced planners. This study evaluates whether planning quality is consistent when using a KBP model to plan across different treatment machines. MATERIALS AND METHODS: This study used a RapidPlan model (Varian Medical Systems) provided by the vendor, to which we added additional planning objectives, maximum dose limits, and planning structures, such that a clinically acceptable plan is achieved in a single optimization. This model was used to generate and optimize volumetric-modulated arc therapy plans for a cohort of 50 patients treated for head-neck cancer. Plans were generated using the following treatment machines: Varian 2100, Elekta Versa HD, and Varian Halcyon. A noninferiority testing methodology was used to evaluate the hypothesis that normal and target metrics in our autoplans were no worse than a set of clinically-acceptable baseline plans by a margin of 1.8 Gy or 3% dose-volume. The quality of these plans were also compared through the use of common clinical dose-volume histogram criteria. RESULTS: The Versa HD met our noninferiority criteria for 23 of 34 normal and target metrics; while the Halcyon and Varian 2100 machines met our criteria for 24 of 34 and 26 of 34 metrics, respectively. The experimental plans tended to have less volume coverage for prescription dose planning target volume and larger hotspot volumes. However, comparable plans were generated across different treatment machines. CONCLUSIONS: These results support the use of a head-neck RapidPlan models in centralized planning workflows that support clinics with different linac models/vendors, although some fine-tuning for targets may be necessary.

Clinical acceptability of fully automated external beam radiotherapy for cervical cancer with three different beam delivery techniques.

PURPOSE: To fully automate CT-based cervical cancer radiotherapy by automating contouring and planning for three different treatment techniques. METHODS: We automated three different radiotherapy planning techniques for locally advanced cervical cancer: 2D 4-field-box (4-field-box), 3D conformal radiotherapy (3D-CRT), and volumetric modulated arc therapy (VMAT). These auto-planning algorithms were combined with a previously developed auto-contouring system. To improve the quality of the 4-field-box and 3D-CRT plans, we used an in-house, field-in-field (FIF) automation program. Thirty-five plans were generated for each technique on CT scans from multiple institutions and evaluated by five experienced radiation oncologists from three different countries. Every plan was reviewed by two of the five radiation oncologists and scored using a 5-point Likert scale. RESULTS: Overall, 87%, 99%, and 94% of the automatically generated plans were found to be clinically acceptable without modification for the 4-field-box, 3D-CRT, and VMAT plans, respectively. Some customizations of the FIF configuration were necessary on the basis of radiation oncologist preference. Additionally, in some cases, it was necessary to renormalize the plan after it was generated to satisfy radiation oncologist preference. CONCLUSION: Approximately, 90% of the automatically generated plans were clinically acceptable for all three planning techniques. This fully automated planning system has been implemented into the radiation planning assistant for further testing in resource-constrained radiotherapy departments in low- and middle-income countries.

Barriers and Facilitators of Implementing Automated Radiotherapy Planning: A Multisite Survey of Low- and Middle-Income Country Radiation Oncology Providers.

PURPOSE: Global access to radiotherapy (RT) is inequitable, with obstacles to implementing modern technologies in low- and middle- income countries (LMICs). The Radiation Planning Assistant (RPA) is a web-based automated RT planning software package intended to increase accessibility of high-quality RT planning. We surveyed LMIC RT providers to identify barriers and facilitators of future RPA deployment and uptake. METHODS: RT providers underwent a pilot RPA teaching session in sub-Saharan Africa (Botswana, South Africa, and Tanzania) and Central America (Guatemala). Thirty providers (30 of 33, 90.9% response rate) participated in a postsession survey. RESULTS: Respondents included physicians (n = 10, 33%), physicists (n = 9, 30%), dosimetrists (n = 8, 27%), residents/registrars (n = 1, 3.3%), radiation therapists (n = 1, 3.3%), and administrators (n = 1, 3.3%). Overall, 86.7% expressed interest in RPA; more respondents expected that RPA would be usable in 2 years (80%) compared with now (60%). Anticipated barriers were lack of reliable internet (80%), potential subscription fees (60%), and need for functionality in additional disease sites (48%). Expected facilitators included decreased workload (80%), decreased planning time (72%), and ability to treat more patients (64%). Forty-four percent anticipated that RPA would help transition from 2-dimensional to 3-dimensional techniques and 48% from 3-dimensional to intensity-modulated radiation treatment. Of a maximum acceptability/feasibility score of 60, physicians (45.6, standard deviation [SD] = 7.5) and dosimetrists (44.3, SD = 9.1) had lower scores than the mean for all respondents (48.3, SD = 7.7) although variation in scores by roles was not significantly different (P = .21). CONCLUSION: These data provide an early assessment and create an initial framework to identify stakeholder needs and establish priorities to address barriers and promote facilitators of RPA deployment and uptake across global sites, as well as to tailor to needs in LMICs.

Automatic contouring QA method using a deep learning-based autocontouring system.

PURPOSE: To determine the most accurate similarity metric when using an independent system to verify automatically generated contours. METHODS: A reference autocontouring system (primary system to create clinical contours) and a verification autocontouring system (secondary system to test the primary contours) were used to generate a pair of 6 female pelvic structures (UteroCervix [uterus + cervix], CTVn [nodal clinical target volume (CTV)], PAN [para-aortic lymph nodes], bladder, rectum, and kidneys) on 49 CT scans from our institution and 38 from other institutions. Additionally, clinically acceptable and unacceptable contours were manually generated using the 49 internal CT scans. Eleven similarity metrics (volumetric Dice similarity coefficient (DSC), Hausdorff distance, 95% Hausdorff distance, mean surface distance, and surface DSC with tolerances from 1 to 10 mm) were calculated between the reference and the verification autocontours, and between the manually generated and the verification autocontours. A support vector machine (SVM) was used to determine the threshold that separates clinically acceptable and unacceptable contours for each structure. The 11 metrics were investigated individually and in certain combinations. Linear, radial basis function, sigmoid, and polynomial kernels were tested using the combinations of metrics as inputs for the SVM. RESULTS: The highest contouring error detection accuracies were 0.91 for the UteroCervix, 0.90 for the CTVn, 0.89 for the PAN, 0.92 for the bladder, 0.95 for the rectum, and 0.97 for the kidneys and were achieved using surface DSCs with a thickness of 1, 2, or 3 mm. The linear kernel was the most accurate and consistent when a combination of metrics was used as an input for the SVM. However, the best model accuracy from the combinations of metrics was not better than the best model accuracy from a surface DSC as an input. CONCLUSIONS: We distinguished clinically acceptable contours from clinically unacceptable contours with an accuracy higher than 0.9 for the targets and critical structures in patients with cervical cancer; the most accurate similarity metric was surface DSC with a thickness of 1, 2, or 3 mm.