Evaluating Danish Breast Cancer Group locoregional radiotherapy guideline adherence in clinical treatment data 2008-2016: The DBCG RT Nation study.

BACKGROUND AND PURPOSE: Guideline adherence in radiotherapy is crucial for maintaining treatment quality and consistency, particularly in non-trial patient settings where most treatments occur. The study aimed to assess the impact of guideline changes on treatment planning practices and compare manual registry data accuracy with treatment planning data. MATERIALS AND METHODS: This study utilised the DBCG RT Nation cohort, a collection of breast cancer radiotherapy data in Denmark, to evaluate adherence to guidelines from 2008 to 2016. The cohort included 7448 high-risk breast cancer patients. National guideline changes included, fractionation, introduction of respiratory gating, irradiation of the internal mammary lymph nodes, use of the simultaneous integrated boost technique and inclusion of the Left Anterior Descending coronary artery in delineation practice. Methods for structure name mapping, laterality detection, detection of temporal changes in population mean lung volume, and dose evaluation were presented and applied. Manually registered treatment characteristic data was obtained from the Danish Breast Cancer Database for comparison. RESULTS: The study found immediate and consistent adherence to guideline changes across Danish radiotherapy centres. Treatment practices before guideline implementation were documented and showed a variation among centres. Discrepancies between manual registry data and actual treatment planning data were as high as 10% for some measures. CONCLUSION: National guideline changes could be detected in the routine treatment data, with a high degree of compliance and short implementation time. Data extracted from treatment planning data files provides a more accurate and detailed characterisation of treatments and guideline adherence than medical register data.

Associations Between Radiation Oncologist Demographic Factors and Segmentation Similarity Benchmarks: Insights From a Crowd-Sourced Challenge Using Bayesian Estimation.

PURPOSE: The quality of radiotherapy auto-segmentation training data, primarily derived from clinician observers, is of utmost importance. However, the factors influencing the quality of clinician-derived segmentations are poorly understood; our study aims to quantify these factors. METHODS: Organ at risk (OAR) and tumor-related segmentations provided by radiation oncologists from the Contouring Collaborative for Consensus in Radiation Oncology data set were used. Segmentations were derived from five disease sites: breast, sarcoma, head and neck (H&N), gynecologic (GYN), and GI. Segmentation quality was determined on a structure-by-structure basis by comparing the observer segmentations with an expert-derived consensus, which served as a reference standard benchmark. The Dice similarity coefficient (DSC) was primarily used as a metric for the comparisons. DSC was stratified into binary groups on the basis of structure-specific expert-derived interobserver variability (IOV) cutoffs. Generalized linear mixed-effects models using Bayesian estimation were used to investigate the association between demographic variables and the binarized DSC for each disease site. Variables with a highest density interval excluding zero were considered to substantially affect the outcome measure. RESULTS: Five hundred seventy-four, 110, 452, 112, and 48 segmentations were used for the breast, sarcoma, H&N, GYN, and GI cases, respectively. The median percentage of segmentations that crossed the expert DSC IOV cutoff when stratified by structure type was 55% and 31% for OARs and tumors, respectively. Regression analysis revealed that the structure being tumor-related had a substantial negative impact on binarized DSC for the breast, sarcoma, H&N, and GI cases. There were no recurring relationships between segmentation quality and demographic variables across the cases, with most variables demonstrating large standard deviations. CONCLUSION: Our study highlights substantial uncertainty surrounding conventionally presumed factors influencing segmentation quality relative to benchmarks.

A joint ESTRO and AAPM guideline for development, clinical validation and reporting of artificial intelligence models in radiation therapy.

BACKGROUND AND PURPOSE: Artificial Intelligence (AI) models in radiation therapy are being developed with increasing pace. Despite this, the radiation therapy community has not widely adopted these models in clinical practice. A cohesive guideline on how to develop, report and clinically validate AI algorithms might help bridge this gap. METHODS AND MATERIALS: A Delphi process with all co-authors was followed to determine which topics should be addressed in this comprehensive guideline. Separate sections of the guideline, including Statements, were written by subgroups of the authors and discussed with the whole group at several meetings. Statements were formulated and scored as highly recommended or recommended. RESULTS: The following topics were found most relevant: Decision making, image analysis, volume segmentation, treatment planning, patient specific quality assurance of treatment delivery, adaptive treatment, outcome prediction, training, validation and testing of AI model parameters, model availability for others to verify, model quality assurance/updates and upgrades, ethics. Key references were given together with an outlook on current hurdles and possibilities to overcome these. 19 Statements were formulated. CONCLUSION: A cohesive guideline has been written which addresses main topics regarding AI in radiation therapy. It will help to guide development, as well as transparent and consistent reporting and validation of new AI tools and facilitate adoption.

Artificial Intelligence Uncertainty Quantification in Radiotherapy Applications - A Scoping Review.

Background/purpose: The use of artificial intelligence (AI) in radiotherapy (RT) is expanding rapidly. However, there exists a notable lack of clinician trust in AI models, underscoring the need for effective uncertainty quantification (UQ) methods. The purpose of this study was to scope existing literature related to UQ in RT, identify areas of improvement, and determine future directions. Methods: We followed the PRISMA-ScR scoping review reporting guidelines. We utilized the population (human cancer patients), concept (utilization of AI UQ), context (radiotherapy applications) framework to structure our search and screening process. We conducted a systematic search spanning seven databases, supplemented by manual curation, up to January 2024. Our search yielded a total of 8980 articles for initial review. Manuscript screening and data extraction was performed in Covidence. Data extraction categories included general study characteristics, RT characteristics, AI characteristics, and UQ characteristics. Results: We identified 56 articles published from 2015-2024. 10 domains of RT applications were represented; most studies evaluated auto-contouring (50%), followed by image-synthesis (13%), and multiple applications simultaneously (11%). 12 disease sites were represented, with head and neck cancer being the most common disease site independent of application space (32%). Imaging data was used in 91% of studies, while only 13% incorporated RT dose information. Most studies focused on failure detection as the main application of UQ (60%), with Monte Carlo dropout being the most commonly implemented UQ method (32%) followed by ensembling (16%). 55% of studies did not share code or datasets. Conclusion: Our review revealed a lack of diversity in UQ for RT applications beyond auto-contouring. Moreover, there was a clear need to study additional UQ methods, such as conformal prediction. Our results may incentivize the development of guidelines for reporting and implementation of UQ in RT.

End-to-end framework for automated collection of large multicentre radiotherapy datasets demonstrated in a Danish Breast Cancer Group cohort.

Large Digital Imaging and Communications in Medicine (DICOM) datasets are key to support research and the development of machine learning technology in radiotherapy (RT). However, the tools for multi-centre data collection, curation and standardisation are not readily available. Automated batch DICOM export solutions were demonstrated for a multicentre setup. A Python solution, Collaborative DICOM analysis for RT (CORDIAL-RT) was developed for curation, standardisation, and analysis of the collected data. The setup was demonstrated in the DBCG RT-Nation study, where 86% (n = 7748) of treatments in the inclusion period were collected and quality assured, supporting the applicability of the end-to-end framework.

Development of a national deep learning-based auto-segmentation model for the heart on clinical delineations from the DBCG RT nation cohort.

BACKGROUND: This study aimed at investigating the feasibility of developing a deep learning-based auto-segmentation model for the heart trained on clinical delineations. MATERIAL AND METHODS: This study included two different datasets. The first dataset contained clinical heart delineations from the DBCG RT Nation study (1,561 patients). The second dataset was smaller (114 patients), but with corrected heart delineations. Before training the model on the clinical delineations an outlier-detection was performed, to remove cases with gross deviations from the delineation guideline. No outlier detection was performed for the dataset with corrected heart delineations. Both models were trained with a 3D full resolution nnUNet. The models were evaluated with the dice similarity coefficient (DSC), 95% Hausdorff distance (HD95) and Mean Surface Distance (MSD). The difference between the models were tested with the Mann-Whitney U-test. The balance of dataset quantity versus quality was investigated, by stepwise reducing the cohort size for the model trained on clinical delineations. RESULTS: During the outlier-detection 137 patients were excluded from the clinical cohort due to non-compliance with delineation guidelines. The model trained on the curated clinical cohort performed with a median DSC of 0.96 (IQR 0.94-0.96), median HD95 of 4.00 mm (IQR 3.00 mm-6.00 mm) and a median MSD of 1.49 mm (IQR 1.12 mm-2.02 mm). The model trained on the dedicated and corrected cohort performed with a median DSC of 0.95 (IQR 0.93-0.96), median HD95 of 5.65 mm (IQR 3.37 mm-8.62 mm) and median MSD of 1.63 mm (IQR 1.35 mm-2.11 mm). The difference between the two models were found non-significant for all metrics (p > 0.05). Reduction of cohort size showed no significant difference for all metrics (p > 0.05). However, with the smallest cohort size, a few outlier structures were found. CONCLUSIONS: This study demonstrated a deep learning-based auto-segmentation model trained on curated clinical delineations which performs on par with a model trained on dedicated delineations, making it easier to develop multi-institutional auto-segmentation models.

Determining The Role Of Radiation Oncologist Demographic Factors On Segmentation Quality: Insights From A Crowd-Sourced Challenge Using Bayesian Estimation.

BACKGROUND: Medical image auto-segmentation is poised to revolutionize radiotherapy workflows. The quality of auto-segmentation training data, primarily derived from clinician observers, is of utmost importance. However, the factors influencing the quality of these clinician-derived segmentations have yet to be fully understood or quantified. Therefore, the purpose of this study was to determine the role of common observer demographic variables on quantitative segmentation performance. METHODS: Organ at risk (OAR) and tumor volume segmentations provided by radiation oncologist observers from the Contouring Collaborative for Consensus in Radiation Oncology public dataset were utilized for this study. Segmentations were derived from five separate disease sites comprised of one patient case each: breast, sarcoma, head and neck (H&N), gynecologic (GYN), and gastrointestinal (GI). Segmentation quality was determined on a structure-by-structure basis by comparing the observer segmentations with an expert-derived consensus gold standard primarily using the Dice Similarity Coefficient (DSC); surface DSC was investigated as a secondary metric. Metrics were stratified into binary groups based on previously established structure-specific expert-derived interobserver variability (IOV) cutoffs. Generalized linear mixed-effects models using Markov chain Monte Carlo Bayesian estimation were used to investigate the association between demographic variables and the binarized segmentation quality for each disease site separately. Variables with a highest density interval excluding zero - loosely analogous to frequentist significance - were considered to substantially impact the outcome measure. RESULTS: After filtering by practicing radiation oncologists, 574, 110, 452, 112, and 48 structure observations remained for the breast, sarcoma, H&N, GYN, and GI cases, respectively. The median percentage of observations that crossed the expert DSC IOV cutoff when stratified by structure type was 55% and 31% for OARs and tumor volumes, respectively. Bayesian regression analysis revealed tumor category had a substantial negative impact on binarized DSC for the breast (coefficient mean ± standard deviation: -0.97 ± 0.20), sarcoma (-1.04 ± 0.54), H&N (-1.00 ± 0.24), and GI (-2.95 ± 0.98) cases. There were no clear recurring relationships between segmentation quality and demographic variables across the cases, with most variables demonstrating large standard deviations and wide highest density intervals. CONCLUSION: Our study highlights substantial uncertainty surrounding conventionally presumed factors influencing segmentation quality. Future studies should investigate additional demographic variables, more patients and imaging modalities, and alternative metrics of segmentation acceptability.

A simple single-cycle interactive strategy to improve deep learning-based segmentation of organs-at-risk in head-and-neck cancer.

Background and purpose: Interactive segmentation seeks to incorporate human knowledge into segmentation models and thereby reducing the total amount of editing of auto-segmentations. By performing only interactions which provide new information, segmentation performance may increase cost-effectively. The aim of this study was to develop, evaluate and test feasibility of a deep learning-based single-cycle interactive segmentation model with the input being computer tomography (CT) and a small amount of information rich contours. Methods and Materials: A single-cycle interactive segmentation model, which took CT and the most cranial and caudal contour slices for each of 16 organs-at-risk for head-and-neck cancer as input, was developed. A CT-only model served as control. The models were evaluated with Dice similarity coefficient, Hausdorff Distance 95th percentile and average symmetric surface distance. A subset of 8 organs-at-risk were selected for a feasibility test. In this, a designated radiation oncologist used both single-cycle interactive segmentation and atlas-based auto-contouring for three cases. Contouring time and added path length were recorded. Results: The medians of Dice coefficients increased with single-cycle interactive segmentation in the range of 0.004 (Brain)-0.90 (EyeBack_merged) when compared to CT-only. In the feasibility test, contouring time and added path length were reduced for all three cases as compared to editing atlas-based auto-segmentations. Conclusion: Single-cycle interactive segmentation improved segmentation metrics when compared to the CT-only model and was clinically feasible from a technical and usability point of view. The study suggests that it may be cost-effective to add a small amount of contouring input to deep learning-based segmentation models.

Patient anatomy-specific trade-offs between sub-clinical disease coverage and normal tissue dose reduction in head-and-neck cancer.

PURPOSE: Risk of subclinical disease decreases with increasing distance from the GTV in head- and-neck squamous cell carcinoma (HNSCC). Depending on individual patient anatomy, OAR sparing could be improved by reducing target coverage in regions with low risk of subclinical spread. Using automated multi-criteria optimization, we investigate patient-specific optimal trade-offs between target periphery coverage and OAR sparing. METHODS: VMAT plans for 39 HNSCC patients were retrospectively created following our clinical three-target-level protocol: high-risk (PTV1), intermediate-risk (PTV2, 5 mm expansion from PTV1), and elective (PTV3). A baseline plan fulfilling clinical constraints (D 99 % ≥95 % for all PTVs) was compared to three plans with reduced PTV2 coverage (goals: PTV2 D 99 % ≥90 % or 85 %, or no PTV2) at the outer edge of PTV2. Plans were compared on PTV D 99 %, OAR D mean, and NTCP (xerostomia/dysphagia). RESULTS: Trade-offs between PTV2 coverage and OAR doses varied considerably between patients. For plans with PTV2 D 99 % -goal 90 %, median PTV2 D 99 % was 91.5 % resulting in xerostomia (≥grade 4) and dysphagia (≥grade 2) NTCP decrease of median [maximum] 1.9 % [5.3 %] and 1.1 % [4.1 %], respectively, compared to nominal PTV2 D 99 % -goal 95 %. For PTV2 D 99 % -goal 85 % median PTV D 99 % was 87 % with NTCP improvements of 4.6 % [9.9 %] and 1.5 % [5.4 %]. For no-margin plans, PTV2 D 99 % decreased to 83.3 % with NTCP reductions of 5.1 % [10.2 %] and 1.4 % [6.1 %]. CONCLUSION: Clinically relevant, patient-specific reductions in OARs and NTCP were observed at limited cost in target under-coverage at the outermost PTV edge. Given the observed inter-patient variations, individual evaluation is warranted to determine whether trade- offs would benefit a specific patient.

Towards interactive deep-learning for tumour segmentation in head and neck cancer radiotherapy.

Background and purpose: With deep-learning, gross tumour volume (GTV) auto-segmentation has substantially been improved, but still substantial manual corrections are needed. With interactive deep-learning (iDL), manual corrections can be used to update a deep-learning tool while delineating, minimising the input to achieve acceptable segmentations. We present an iDL tool for GTV segmentation that took annotated slices as input and simulated its performance on a head and neck cancer (HNC) dataset. Materials and methods: Multimodal image data of 204 HNC patients with clinical tumour and lymph node GTV delineations were used. A baseline convolutional neural network (CNN) was trained (n = 107 training, n = 22 validation) and tested (n = 24). Subsequently, user input was simulated on initial test set by replacing one or more of predicted slices with ground truth delineation, followed by re-training the CNN. The objective was to optimise re-training parameters and simulate slice selection scenarios while limiting annotations to maximally-five slices. The remaining 51 patients were used as an independent test set, where Dice similarity coefficient (DSC), mean surface distance (MSD), and 95% Hausdorff distance (HD95%) were assessed at baseline and after every update. Results: Median segmentation accuracy at baseline was DSC = 0.65, MSD = 4.3 mm, HD95% = 17.5 mm. Updating CNN using three slices equally sampled from the craniocaudal axis of the GTV in the first round, followed by two rounds of annotating one extra slice, gave the best results. The accuracy improved to DSC = 0.82, MSD = 1.6 mm, HD95% = 4.8 mm. Every CNN update took 30 s. Conclusions: The presented iDL tool achieved substantial segmentation improvement with only five annotated slices.

Evaluating principal component analysis models for representing anatomical changes in head and neck radiotherapy.

Background and purpose: Anatomical changes during radiotherapy pose a challenge to robustness of plans. Principal component analysis (PCA) is commonly used to model such changes. We propose a toolbox to evaluate how closely a given PCA model can represent actual deformations seen in the patient and highlight regions where the model struggles to capture these changes. Materials and methods: We propose to calculate a residual error map from the difference between an actual displacement vector field (DVF) and the closest DVF that the PCA model can produce. This was done by taking the inner product of the DVF with the PCA components from the model. As a global measure of error, the 90th percentile of the residual errors ( M res 90 ) across the whole scan was used. As proof of principle, we demonstrated this approach on both patient-specific cases and a population-based PCA in head and neck (H&N) cancer patients. These models were created using deformation data from deformable registrations between the planning computed tomography and cone-beam computed tomography (CBCTs), and were evaluated against DVFs from registrations of CBCTs not used to create the model. Results: For our example cases, the oropharyngeal and the nasal cavity regions showed the largest local residual error, indicating the PCA models struggle to predict deformations seen in these regions. M res 90 ranged from 0.4 mm to 6.3 mm across the different models. Conclusions: A method to quantitatively evaluate how well PCA models represent observed anatomical changes was proposed. We demonstrated our approach on H&N PCA models, but it can be applied to other sites.

The 3rd ESTRO-EFOMP core curriculum for medical physics experts in radiotherapy.

PURPOSE: To update the 2011 ESTRO-EFOMP core curriculum (CC) for education and training of medical physics experts (MPE)s working in radiotherapy (RT), in line with recent EU guidelines, and to provide a framework for European countries to develop their own curriculum. MATERIAL AND METHODS: Since September 2019, 27 European MPEs representing ESTRO, EFOMP and National Societies, with expertise covering all subfields of RT physics, have revised the CC for recent advances in RT. The ESTRO and EFOMP Education Councils, all European National Societies and international stakeholders have been involved in the revision process. RESULTS: A 4-year training period has been proposed, with a total of 240 ECTS (European Credit Transfer and Accumulation System). Training entrance levels have been defined ensuring the necessary physics and mathematics background. The concept of competency-based education has been reinforced by introducing the CanMEDS role framework. The updated CC includes (ablative) stereotactic-, MR-guided- and adaptive RT, particle therapy, advanced automation, complex quantitative data analysis (big data/artificial intelligence), use of biological images, and personalized treatments. Due to the continuously increasing RT complexity, more emphasis has been given to quality management. Clear requirements for a research project ensure a proper preparation of MPE residents for their central role in science and innovation in RT. CONCLUSION: This updated, 3rd edition of the CC provides an MPE training framework for safe and effective practice of modern RT, while acknowledging the significant efforts needed in some countries to reach this level. The CC can contribute to further harmonization of MPE training in Europe.

Target coverage and local recurrences after radiotherapy for sinonasal cancer in Denmark 2008-2015. A DAHANCA study.

PURPOSE: The study aimed to investigate the pattern of failure and describe compromises in the definition and coverage of the target for patients treated with curatively intended radiotherapy (RT) for sinonasal cancer (SNC). METHODS AND MATERIAL: Patients treated with curatively intended RT in 2008-2015 in Denmark for SNC were eligible for the retrospective cohort study. Information regarding diagnosis and treatment was retrieved from the national database of the Danish Head and Neck Cancer Group (DAHANCA). Imaging from the diagnosis of recurrences was collected, and the point of origin (PO) of the recurrent tumour was estimated. All treatment plans were collected and reviewed with the focus on target coverage, manual modifications of target volumes, and dose to organs at risk (OARs) above defined constraints. RESULTS: A total of 184 patients were included in the analysis, and 76 (41%) relapsed. The majority of recurrences involved T-site (76%). Recurrence imaging of 39 patients was evaluated, and PO was established. Twenty-nine POs (74%) were located within the CTV, and the minimum dose to the PO was median 64.1 Gy (3.1-70.7). The criteria for target coverage (V95%) was not met in 89/184 (48%) of the CTV and 131/184 (71%) of the PTV. A total of 24% of CTVs had been manually modified to spare OARs of high-dose irradiation. No difference in target volume modifications was observed between patients who suffered recurrence and patients with lasting remission. CONCLUSION: The majority of relapses after radical treatment of SNC were located in the T-site (the primary tumour site). Multiple compromises with regards to target coverage and tolerance levels for OARs in the sinonasal region, as defined from RT guidelines, were taken. No common practice in this respect could be derived from the study.

A systematically compiled set of quantitative metrics to describe spatial characteristics of radiotherapy dose distributions and aid in treatment planning.

PURPOSE: Many quantitative metrics have been proposed in literature for characterization of spatial dose properties. The aim of this study is to work towards much-needed consensus in the radiotherapy community on which of these metrics to use. We do this by comparing characteristics of the metrics and providing a systematically selected set of metrics to comprehensively quantify properties of the spatial dose distribution. METHODS: We searched the literature for metrics to quantitatively evaluate dose conformity, homogeneity, gradient (overall and directional), and distribution and location of over- and under-dosed sub-volumes. For each spatial dose property, we compared the responses of its corresponding metrics to simulated dose variations in a virtual water phantom. Selection criteria were a metric's ability to describe simulated scenarios robustly and to be visualized in an intuitive way. RESULTS: We saw substantial differences in the responses of metrics to the simulated dose variations. Some conformity and homogeneity metrics were unable to quantify certain types of changes (e.g. target under-coverage). Others showed a large dependency on the shape and volume of targets and isodoses. Metric values differed between calculations in a static plan and in simulated full treatment courses including setup errors, especially for metrics quantifying distribution and location of hot and cold spots. We provide an Eclipse plugin script to calculate and visualize selected metrics. CONCLUSION: The selected set of metrics provides complementary and comprehensive quantitative information about the spatial dose distribution. This work serves as a step towards broader consensus on the use of spatial dose metrics.

Comparing different CT, PET and MRI multi-modality image combinations for deep learning-based head and neck tumor segmentation.

BACKGROUND: Manual delineation of gross tumor volume (GTV) is essential for radiotherapy treatment planning, but it is time-consuming and suffers inter-observer variability (IOV). In clinics, CT, PET, and MRI are used to inform delineation accuracy due to their different complementary characteristics. This study aimed to investigate deep learning to assist GTV delineation in head and neck squamous cell carcinoma (HNSCC) by comparing various modality combinations. MATERIALS AND METHODS: This retrospective study had 153 patients with multiple sites of HNSCC including their planning CT, PET, and MRI (T1-weighted and T2-weighted). Clinical delineations of gross tumor volume (GTV-T) and involved lymph nodes (GTV-N) were collected as the ground truth. The dataset was randomly divided into 92 patients for training, 31 for validation, and 30 for testing. We applied a residual 3 D UNet as the deep learning architecture. We independently trained the UNet with four different modality combinations (CT-PET-MRI, CT-MRI, CT-PET, and PET-MRI). Additionally, analogical to post-processing, an average fusion of three bi-modality combinations (CT-PET, CT-MRI, and PET-MRI) was produced as an ensemble. Segmentation accuracy was evaluated on the test set, using Dice similarity coefficient (Dice), Hausdorff Distance 95 percentile (HD95), and Mean Surface Distance (MSD). RESULTS: All imaging combinations including PET provided similar average scores in range of Dice: 0.72-0.74, HD95: 8.8-9.5 mm, MSD: 2.6-2.8 mm. Only CT-MRI had a lower score with Dice: 0.58, HD95: 12.9 mm, MSD: 3.7 mm. The average of three bi-modality combinations reached Dice: 0.74, HD95: 7.9 mm, MSD: 2.4 mm. CONCLUSION: Multimodal deep learning-based auto segmentation of HNSCC GTV was demonstrated and inclusion of the PET image was shown to be crucial. Training on combined MRI, PET, and CT data provided limited improvements over CT-PET and PET-MRI. However, when combining three bimodal trained networks into an ensemble, promising improvements were shown.