Credentialing of stereotactic radiosurgery and stereotactic body radiation therapy programs for quality and safety: The Novalis Certified Program.

The expectation of quality and safety is a fundamental tenet in all areas of healthcare, and a cornerstone of best practice is a process of continuous learning and continuous improvement. Independent audits and peer review of radiotherapy programs are an important mechanism for identifying process or technology gaps, for highlighting areas for improvement, and for incorporating within continuous improvement processes. In the field of radiotherapy, independent certification programs exist within various national and/or professional spheres, yet few focus specifically on specialty procedures such as radiosurgery or brachytherapy, despite several recommendations for such programs. In this manuscript we describe a specialized SRS/SBRT credentialing program founded on national/international standards and guidelines. We also present the results of an anonymous survey from institutions who have completed the program.

Artificial Intelligence-Guided Prediction of Dental Doses Before Planning of Radiation Therapy for Oropharyngeal Cancer: Technical Development and Initial Feasibility of Implementation.

Purpose: The aim was to develop a novel artificial intelligence (AI)-guided clinical decision support system, to predict radiation doses to subsites of the mandible using diagnostic computed tomography scans acquired before any planning of head and neck radiation therapy (RT). Methods and Materials: A dose classifier was trained using RT plans from 86 patients with oropharyngeal cancer; the test set consisted of an additional 20 plans. The classifier was trained to predict whether mandible subsites would receive a mean dose >50 Gy. The AI predictions were prospectively evaluated and compared with those of a specialist head and neck radiation oncologist for 9 patients. Positive predictive value (PPV), negative predictive value (NPV), Pearson correlation coefficient, and Lin concordance correlation coefficient were calculated to compare the AI predictions to those of the physician. Results: In the test data set, the AI predictions had a PPV of 0.95 and NPV of 0.88. For 9 patients evaluated prospectively, there was a strong correlation between the predictions of the AI algorithm and physician (P = .72, P < .001). Comparing the AI algorithm versus the physician, the PPVs were 0.82 versus 0.25, and the NPVs were 0.94 versus 1.0, respectively. Concordance between physician estimates and final planned doses was 0.62; this was 0.71 between AI-based estimates and final planned doses. Conclusion: AI-guided decision support increased precision and accuracy of pre-RT dental dose estimates.

An artificial intelligence framework integrating longitudinal electronic health records with real-world data enables continuous pan-cancer prognostication.

Despite widespread adoption of electronic health records (EHRs), most hospitals are not ready to implement data science research in the clinical pipelines. Here, we develop MEDomics, a continuously learning infrastructure through which multimodal health data are systematically organized and data quality is assessed with the goal of applying artificial intelligence for individual prognosis. Using this framework, currently composed of thousands of individuals with cancer and millions of data points over a decade of data recording, we demonstrate prognostic utility of this framework in oncology. As proof of concept, we report an analysis using this infrastructure, which identified the Framingham risk score to be robustly associated with mortality among individuals with early-stage and advanced-stage cancer, a potentially actionable finding from a real-world cohort of individuals with cancer. Finally, we show how natural language processing (NLP) of medical notes could be used to continuously update estimates of prognosis as a given individual's disease course unfolds.

Single- and Multi-Fraction Stereotactic Radiosurgery Dose Tolerances of the Optic Pathways.

PURPOSE: Dosimetric and clinical predictors of radiation-induced optic nerve/chiasm neuropathy (RION) after single-fraction stereotactic radiosurgery (SRS) or hypofractionated (2-5 fractions) radiosurgery (fSRS) were analyzed from pooled data that were extracted from published reports (PubMed indexed from 1990 to June 2015). This study was undertaken as part of the American Association of Physicists in Medicine Working Group on Stereotactic Body Radiotherapy, investigating normal tissue complication probability (NTCP) after hypofractionated radiation. METHODS AND MATERIALS: Eligible studies described dose delivered to optic nerve/chiasm and provided crude or actuarial toxicity risks, with visual endpoints (ie, loss of visual acuity, alterations in visual fields, and/or blindness/complete vision loss). Studies of patients with optic nerve sheath tumors, optic nerve gliomas, or ocular/uveal melanoma were excluded to obviate direct tumor effects on visual outcomes, as were studies not specifying causes of vision loss (ie, tumor progression vs RION). RESULTS: Thirty-four studies (1578 patients) were analyzed. Histologies included pituitary adenoma, cavernous sinus meningioma, craniopharyngioma, and malignant skull base tumors. Prior resection (76% of patients) did not correlate with RION risk (P = .66). Prior irradiation (6% of patients) was associated with a crude 10-fold increased RION risk versus no prior radiation therapy. In patients with no prior radiation therapy receiving SRS/fSRS in 1-5 fractions, optic apparatus maximum point doses resulting in <1% RION risks include 12 Gy in 1 fraction (which is greater than our recommendation of 10 Gy in 1 fraction), 20 Gy in 3 fractions, and 25 Gy in 5 fractions. Omitting multi-fraction data (and thereby eliminating uncertainties associated with dose conversions), a single-fraction dose of 10 Gy was associated with a 1% RION risk. Insufficient details precluded modeling of NTCP risks after prior radiation therapy. CONCLUSIONS: Optic apparatus NTCP and tolerance doses after single- and multi-fraction stereotactic radiosurgery are presented. Additional standardized dosimetric and toxicity reporting is needed to facilitate future pooled analyses and better define RION NTCP after SRS/fSRS.

NRG Oncology Survey on Practice and Technology Use in SRT and SBRT Delivery.

PURPOSE: To assess stereotactic radiotherapy (SRT)/stereotactic body radiotherapy (SBRT) practices by polling clinics participating in multi-institutional clinical trials. METHODS: The NRG Oncology Medical Physics Subcommittee distributed a survey consisting of 23 questions, which covered general technologies, policies, and procedures used in the Radiation Oncology field for the delivery of SRT/SBRT (9 questions), and site-specific questions for brain SRT, lung SBRT, and prostate SBRT (14 questions). Surveys were distributed to 1,996 radiotherapy institutions included on the membership rosters of the five National Clinical Trials Network (NCTN) groups. Patient setup, motion management, target localization, prescriptions, and treatment delivery technique data were reported back by 568 institutions (28%). RESULTS: 97.5% of respondents treat lung SBRT patients, 77.0% perform brain SRT, and 29.1% deliver prostate SBRT. 48.8% of clinics require a physicist present for every fraction of SBRT, 18.5% require a physicist present for the initial SBRT fraction only, and 14.9% require a physicist present for the entire first fraction, including set-up approval for all subsequent fractions. 55.3% require physician approval for all fractions, and 86.7% do not reposition without x-ray imaging. For brain SRT, most institutions (83.9%) use a planning target volume (PTV) margin of 2 mm or less. Lung SBRT PTV margins of 3 mm or more are used in 80.6% of clinics. Volumetric modulated arc therapy (VMAT) is the dominant delivery method in 62.8% of SRT treatments, 70.9% of lung SBRT, and 68.3% of prostate SBRT. CONCLUSION: This report characterizes SRT/SBRT practices in radiotherapy clinics participating in clinical trials. Data made available here allows the radiotherapy community to compare their practice with that of other clinics, determine what is achievable, and assess areas for improvement.

DoseGAN: a generative adversarial network for synthetic dose prediction using attention-gated discrimination and generation.

Deep learning algorithms have recently been developed that utilize patient anatomy and raw imaging information to predict radiation dose, as a means to increase treatment planning efficiency and improve radiotherapy plan quality. Current state-of-the-art techniques rely on convolutional neural networks (CNNs) that use pixel-to-pixel loss to update network parameters. However, stereotactic body radiotherapy (SBRT) dose is often heterogeneous, making it difficult to model using pixel-level loss. Generative adversarial networks (GANs) utilize adversarial learning that incorporates image-level loss and is better suited to learn from heterogeneous labels. However, GANs are difficult to train and rely on compromised architectures to facilitate convergence. This study suggests an attention-gated generative adversarial network (DoseGAN) to improve learning, increase model complexity, and reduce network redundancy by focusing on relevant anatomy. DoseGAN was compared to alternative state-of-the-art dose prediction algorithms using heterogeneity index, conformity index, and various dosimetric parameters. All algorithms were trained, validated, and tested using 141 prostate SBRT patients. DoseGAN was able to predict more realistic volumetric dosimetry compared to all other algorithms and achieved statistically significant improvement compared to all alternative algorithms for the V100 and V120 of the PTV, V60 of the rectum, and heterogeneity index.

Expert-augmented machine learning.

Machine learning is proving invaluable across disciplines. However, its success is often limited by the quality and quantity of available data, while its adoption is limited by the level of trust afforded by given models. Human vs. machine performance is commonly compared empirically to decide whether a certain task should be performed by a computer or an expert. In reality, the optimal learning strategy may involve combining the complementary strengths of humans and machines. Here, we present expert-augmented machine learning (EAML), an automated method that guides the extraction of expert knowledge and its integration into machine-learned models. We used a large dataset of intensive-care patient data to derive 126 decision rules that predict hospital mortality. Using an online platform, we asked 15 clinicians to assess the relative risk of the subpopulation defined by each rule compared to the total sample. We compared the clinician-assessed risk to the empirical risk and found that, while clinicians agreed with the data in most cases, there were notable exceptions where they overestimated or underestimated the true risk. Studying the rules with greatest disagreement, we identified problems with the training data, including one miscoded variable and one hidden confounder. Filtering the rules based on the extent of disagreement between clinician-assessed risk and empirical risk, we improved performance on out-of-sample data and were able to train with less data. EAML provides a platform for automated creation of problem-specific priors, which help build robust and dependable machine-learning models in critical applications.

Attention-Aware Discrimination for MR-to-CT Image Translation Using Cycle-Consistent Generative Adversarial Networks.

PURPOSE: To suggest an attention-aware, cycle-consistent generative adversarial network (A-CycleGAN) enhanced with variational autoencoding (VAE) as a superior alternative to current state-of-the-art MR-to-CT image translation methods. MATERIALS AND METHODS: An attention-gating mechanism is incorporated into a discriminator network to encourage a more parsimonious use of network parameters, whereas VAE enhancement enables deeper discrimination architectures without inhibiting model convergence. Findings from 60 patients with head, neck, and brain cancer were used to train and validate A-CycleGAN, and findings from 30 patients were used for the holdout test set and were used to report final evaluation metric results using mean absolute error (MAE) and peak signal-to-noise ratio (PSNR). RESULTS: A-CycleGAN achieved superior results compared with U-Net, a generative adversarial network (GAN), and a cycle-consistent GAN. The A-CycleGAN averages, 95% confidence intervals (CIs), and Wilcoxon signed-rank two-sided test statistics are shown for MAE (19.61 [95% CI: 18.83, 20.39], P = .0104), structure similarity index metric (0.778 [95% CI: 0.758, 0.798], P = .0495), and PSNR (62.35 [95% CI: 61.80, 62.90], P = .0571). CONCLUSION: A-CycleGANs were a superior alternative to state-of-the-art MR-to-CT image translation methods.© RSNA, 2020.

Integrated models incorporating radiologic and radiomic features predict meningioma grade, local failure, and overall survival.

BACKGROUND: We investigated prognostic models based on clinical, radiologic, and radiomic feature to preoperatively identify meningiomas at risk for poor outcomes. METHODS: Retrospective review was performed for 303 patients who underwent resection of 314 meningiomas (57% World Health Organization grade I, 35% grade II, and 8% grade III) at two independent institutions, which comprised primary and external datasets. For each patient in the primary dataset, 16 radiologic and 172 radiomic features were extracted from preoperative magnetic resonance images, and prognostic features for grade, local failure (LF) or overall survival (OS) were identified using the Kaplan-Meier method, log-rank tests and recursive partitioning analysis. Regressions and random forests were used to generate and test prognostic models, which were validated using the external dataset. RESULTS: Multivariate analysis revealed that apparent diffusion coefficient hypointensity (HR 5.56, 95% CI 2.01-16.7, P = .002) was associated with high grade meningioma, and low sphericity was associated both with increased LF (HR 2.0, 95% CI 1.1-3.5, P = .02) and worse OS (HR 2.94, 95% CI 1.47-5.56, P = .002). Both radiologic and radiomic predictors of adverse meningioma outcomes were significantly associated with molecular markers of aggressive meningioma biology, such as somatic mutation burden, DNA methylation status, and FOXM1 expression. Integrated prognostic models combining clinical, radiologic, and radiomic features demonstrated improved accuracy for meningioma grade, LF, and OS (area under the curve 0.78, 0.75, and 0.78, respectively) compared to models based on clinical features alone. CONCLUSIONS: Preoperative radiologic and radiomic features such as apparent diffusion coefficient and sphericity can predict tumor grade, LF, and OS in patients with meningioma.

Building more accurate decision trees with the additive tree.

The expansion of machine learning to high-stakes application domains such as medicine, finance, and criminal justice, where making informed decisions requires clear understanding of the model, has increased the interest in interpretable machine learning. The widely used Classification and Regression Trees (CART) have played a major role in health sciences, due to their simple and intuitive explanation of predictions. Ensemble methods like gradient boosting can improve the accuracy of decision trees, but at the expense of the interpretability of the generated model. Additive models, such as those produced by gradient boosting, and full interaction models, such as CART, have been investigated largely in isolation. We show that these models exist along a spectrum, revealing previously unseen connections between these approaches. This paper introduces a rigorous formalization for the additive tree, an empirically validated learning technique for creating a single decision tree, and shows that this method can produce models equivalent to CART or gradient boosted stumps at the extremes by varying a single parameter. Although the additive tree is designed primarily to provide both the model interpretability and predictive performance needed for high-stakes applications like medicine, it also can produce decision trees represented by hybrid models between CART and boosted stumps that can outperform either of these approaches.

Attention-enabled 3D boosted convolutional neural networks for semantic CT segmentation using deep supervision.

A deeply supervised attention-enabled boosted convolutional neural network (DAB-CNN) is presented as a superior alternative to current state-of-the-art convolutional neural networks (CNNs) for semantic CT segmentation. Spatial attention gates (AGs) were incorporated into a novel 3D cascaded CNN framework to prioritize relevant anatomy and suppress redundancies within the network. Due to the complexity and size of the network, incremental channel boosting was used to decrease memory usage and facilitate model convergence. Deep supervision was used to encourage semantically meaningful deep features and mitigate local minima traps during training. The accuracy of DAB-CNN is compared to seven architectures: a variation of U-Net (UNet), attention-enabled U-Net (A-UNet), boosted U-Net (B-UNet), deeply-supervised U-Net (D-UNet), U-Net with ResNeXt blocks (ResNeXt), life-long learning segmentation CNN (LL-CNN), and deeply supervised attention-enabled U-Net (DA-UNet). The accuracy of each method was assessed based on Dice score compared to manually delineated contours as the gold standard. One hundred and twenty patients who had definitive prostate radiotherapy were used in this study. Training, validation, and testing followed Kaggle competition rules, with 80 patients used for training, 20 patients used for internal validation, and 20 test patients used to report final accuracies. Comparator p -values indicate that DAB-CNN achieved significantly superior Dice scores than all alternative algorithms for the prostate, rectum, and penile bulb. This study demonstrated that attention-enabled boosted convolutional neural networks (CNNs) using deep supervision are capable of achieving superior prediction accuracy compared to current state-of-the-art automatic segmentation methods.

Predicting radiation pneumonitis in locally advanced stage II-III non-small cell lung cancer using machine learning.

BACKGROUND AND PURPOSE: Radiation pneumonitis (RP) is a radiotherapy dose-limiting toxicity for locally advanced non-small cell lung cancer (LA-NSCLC). Prior studies have proposed relevant dosimetric constraints to limit this toxicity. Using machine learning algorithms, we performed analyses of contributing factors in the development of RP to uncover previously unidentified criteria and elucidate the relative importance of individual factors. MATERIALS AND METHODS: We evaluated 32 clinical features per patient in a cohort of 203 stage II-III LA-NSCLC patients treated with definitive chemoradiation to a median dose of 66.6 Gy in 1.8 Gy daily fractions at our institution from 2008 to 2016. Of this cohort, 17.7% of patients developed grade ≥2 RP. Univariate analysis was performed using trained decision stumps to individually analyze statistically significant predictors of RP and perform feature selection. Applying Random Forest, we performed multivariate analysis to assess the combined performance of important predictors of RP. RESULTS: On univariate analysis, lung V20, lung mean, lung V10 and lung V5 were found to be significant RP predictors with the greatest balance of specificity and sensitivity. On multivariate analysis, Random Forest (AUC = 0.66, p = 0.0005) identified esophagus max (20.5%), lung V20 (16.4%), lung mean (15.7%) and pack-year (14.9%) as the most common primary differentiators of RP. CONCLUSIONS: We highlight Random Forest as an accurate machine learning method to identify known and new predictors of symptomatic RP. Furthermore, this analysis confirms the importance of lung V20, lung mean and pack-year as predictors of RP while also introducing esophagus max as an important RP predictor.

A convolutional neural network algorithm for automatic segmentation of head and neck organs at risk using deep lifelong learning.

PURPOSE: This study suggests a lifelong learning-based convolutional neural network (LL-CNN) algorithm as a superior alternative to single-task learning approaches for automatic segmentation of head and neck (OARs) organs at risk. METHODS AND MATERIALS: Lifelong learning-based convolutional neural network was trained on twelve head and neck OARs simultaneously using a multitask learning framework. Once the weights of the shared network were established, the final multitask convolutional layer was replaced by a single-task convolutional layer. The single-task transfer learning network was trained on each OAR separately with early stoppage. The accuracy of LL-CNN was assessed based on Dice score and root-mean-square error (RMSE) compared to manually delineated contours set as the gold standard. LL-CNN was compared with 2D-UNet, 3D-UNet, a single-task CNN (ST-CNN), and a pure multitask CNN (MT-CNN). Training, validation, and testing followed Kaggle competition rules, where 160 patients were used for training, 20 were used for internal validation, and 20 in a separate test set were used to report final prediction accuracies. RESULTS: On average contours generated with LL-CNN had higher Dice coefficients and lower RMSE than 2D-UNet, 3D-Unet, ST- CNN, and MT-CNN. LL-CNN required ~72 hrs to train using a distributed learning framework on 2 Nvidia 1080Ti graphics processing units. LL-CNN required 20 s to predict all 12 OARs, which was approximately as fast as the fastest alternative methods with the exception of MT-CNN. CONCLUSIONS: This study demonstrated that for head and neck organs at risk, LL-CNN achieves a prediction accuracy superior to all alternative algorithms.

The application of artificial intelligence in the IMRT planning process for head and neck cancer.

Artificial intelligence (AI) is beginning to transform IMRT treatment planning for head and neck patients. However, the complexity and novelty of AI algorithms make them susceptible to misuse by researchers and clinicians. Understanding nuances of new technologies could serve to mitigate potential clinical implementation pitfalls. This article is intended to facilitate integration of AI into the radiotherapy clinic by providing an overview of AI algorithms, including support vector machines (SVMs), random forests (RF), gradient boosting (GB), and several variations of deep learning. This document describes current AI algorithms that have been applied to head and neck IMRT planning and identifies rapidly growing branches of AI in industry that have potential applications to head and neck cancer patients receiving IMRT. AI algorithms have great clinical potential if used correctly but can also cause harm if misused, so it is important to raise the level of AI competence within radiation oncology so that the benefits can be realized in a controlled and safe manner.

DoseNet: a volumetric dose prediction algorithm using 3D fully-convolutional neural networks.

The goal of this study is to demonstrate the feasibility of a novel fully-convolutional volumetric dose prediction neural network (DoseNet) and test its performance on a cohort of prostate stereotactic body radiotherapy (SBRT) patients. DoseNet is suggested as a superior alternative to U-Net and fully connected distance map-based neural networks for non-coplanar SBRT prostate dose prediction. DoseNet utilizes 3D convolutional downsampling with corresponding 3D deconvolutional upsampling to preserve memory while simultaneously increasing the receptive field of the network. DoseNet was implemented on 2 Nvidia 1080 Ti graphics processing units and utilizes a 3 phase learning protocol to help achieve convergence and improve generalization. DoseNet was trained, validated, and tested with 151 patients following Kaggle completion rules. The dosimetric quality of DoseNet was evaluated by comparing the predicted dose distribution with the clinically approved delivered dose distribution in terms of conformity index, heterogeneity index, and various clinically relevant dosimetric parameters. The results indicate that the DoseNet algorithm is a superior alternative to U-Net and fully connected methods for prostate SBRT patients. DoseNet required ~50.1 h to train, and ~0.83 s to make a prediction on a 128 × 128 × 64 voxel image. In conclusion, DoseNet is capable of making accurate volumetric dose predictions for non-coplanar SBRT prostate patients, while simultaneously preserving computational efficiency.