A virtual audit system for intensity-modulated radiation therapy credentialing in Japan Clinical Oncology Group clinical trials: A pilot study.

PURPOSE: The Medical Physics Working Group of the Radiation Therapy Study Group at the Japan Clinical Oncology Group is currently developing a virtual audit system for intensity-modulated radiation therapy dosimetry credentialing. The target dosimeters include films and array detectors, such as ArcCHECK (Sun Nuclear Corporation, Melbourne, Florida, USA) and Delta4 (ScandiDos, Uppsala, Sweden). This pilot study investigated the feasibility of our virtual audit system using previously acquired data. METHODS: We analyzed 46 films (32 and 14 in the axial and coronal planes, respectively) from 29 institutions. Global gamma analysis between measured and planned dose distributions used the following settings: 3%/3 mm criteria (the dose denominator was 2 Gy), 30% threshold dose, no scaling of the datasets, and 90% tolerance level. In addition, 21 datasets from nine institutions were obtained for array evaluation. Five institutions used ArcCHECK, while the others used Delta4. Global gamma analysis was performed with 3%/2 mm criteria (the dose denominator was the maximum calculated dose), 10% threshold dose, and 95% tolerance level. The film calibration and gamma analysis were conducted with in-house software developed using Python (version 3.9.2). RESULTS: The means ± standard deviations of the gamma passing rates were 99.4 ± 1.5% (range, 92.8%-100%) and 99.2 ± 1.0% (range, 97.0%-100%) in the film and array evaluations, respectively. CONCLUSION: This pilot study demonstrated the feasibility of virtual audits. The proposed virtual audit system will contribute to more efficient, cheaper, and more rapid trial credentialing than on-site and postal audits; however, the limitations should be considered when operating our virtual audit system.

IAEA methodology for on-site end-to-end IMRT/VMAT audits: an international pilot study.

Background: The IAEA has developed and tested an on-site, end-to-end IMRT/VMAT dosimetry audit methodology for head and neck cases using an anthropomorphic phantom. The audit methodology is described, and the results of the international pilot testing are presented.Material and methods: The audit utilizes a specially designed, commercially available anthropomorphic phantom capable of accommodating a small volume ion chamber (IC) in four locations (three in planning target volumes (PTVs) and one in an organ at risk (OAR)) and a Gafchromic film in a coronal plane for the absorbed dose to water and two-dimensional dose distribution measurements, respectively. The audit consists of a pre-visit and on-site phases. The pre-visit phase is carried out remotely and includes a treatment planning task and a set of computational exercises. The on-site phase aims at comparing the treatment planning system (TPS) calculations with measurements in the anthropomorphic phantom following an end-to-end approach. Two main aspects were tested in the pilot study: feasibility of the planning constraints and the accuracy of IC and film results in comparison with TPS calculations. Treatment plan quality was scored from 0 to 100.Results: Forty-two treatment plans were submitted by 14 institutions from 10 countries, with 79% of them having a plan quality score over 90. Seventeen sets of IC measurement results were collected, and the average measured to calculated dose ratio was 0.988 ± 0.016 for PTVs and 1.020 ± 0.029 for OAR. For 13 film measurement results, the average gamma passing rate was 94.1% using criteria of 3%/3 mm, 20% threshold and global gamma.Conclusions: The audit methodology was proved to be feasible and ready to be adopted by national dosimetry audit networks for local implementation.

Improving the modelling of a multi-leaf collimator with tilted leaf sides used in radiotherapy.

Background and purpose: Multi-leaf collimators (MLCs) with tilted leaf sides have a complex transmission behaviour that is not easily matched by radiotherapy treatment planning systems (TPSs). We sought to develop an MLC model that can accurately match test fields and clinically relevant plans at different centres. Materials and methods: Two new MLC models were developed and evaluated within a research version of a commercial TPS. Prototype I used adjusted-constant transmissions and Prototype II used variable transmissions at the tongue-and-groove and leaf-tip regions. Three different centres evaluated these prototypes for a tilted MLC and compared them with their initial MLC model using test fields and patient-specific quality-assurance measurements of clinically relevant plans. For the latter, gamma passing rates (GPR) at 2 %/2mm were recorded. Results: For the prototypes the same set of MLC parameters could be used at all centres, with only a slight adjustment of the offset parameter. For centres A and C, average GPR were >95 % and within 0.5 % GPR difference between the standard, and prototype models. In center B, prototypes I and II improved the agreement in clinically relevant plans, with an increase in GPR of 2.3 % ± 0.8 % and 3.0 ± 0.8 %, respectively. Conclusions: The prototype MLC models were either similar or superior to the initial MLC model, and simpler to configure because fewer trade-offs were required. Prototype I performed comparably to the more sophisticated Prototype II and its configuration can be easily standardized, which can be useful to reduce variability and improve safety in clinical practice.

Technical recommendations for implementation of Volumetric Modulated Arc Therapy and Helical Tomotherapy Total Body Irradiation.

As a component of myeloablative conditioning before allogeneic hematopoietic stem cell transplantation (HSCT), Total Body Irradiation (TBI) is employed in radiotherapy centers all over the world. In recent and coming years, many centers are changing their technical setup from a conventional TBI technique to multi-isocenter conformal arc therapy techniques such as Volumetric Modulated Arc Therapy (VMAT) or Helical Tomotherapy (HT). These techniques allow better homogeneity and control of the target prescription dose, and provide more freedom for individualized organ-at-risk sparing. The technical design of multi-isocenter/multi-plan conformal TBI is complex and should be developed carefully. A group of early adopters with conformal TBI experience using different treatment machines and treatment planning systems came together to develop technical recommendations and share experiences, in order to assist departments wishing to implement conformal TBI, and to provide ideas for standardization of practices.

A critical evaluation of the PTW 2D-ARRAY seven29 and OCTAVIUS II phantom for IMRT and VMAT verification.

Quality assurance (QA) for intensity- and volumetric-modulated radiotherapy (IMRT and VMAT) has evolved substantially. In recent years, various commercial 2D and 3D ionization chamber or diode detector arrays have become available, allowing for absolute verification with near real time results, allowing for streamlined QA. However, detector arrays are limited by their resolution, giving rise to concerns about their sensitivity to errors. Understanding the limitations of these devices is therefore critical. In this study, the sensitivity and resolution of the PTW 2D-ARRAY seven29 and OCTAVIUS II phantom combination was comprehensively characterized for use in dynamic sliding window IMRT and RapidArc verification. Measurement comparisons were made between single acquisition and a multiple merged acquisition techniques to improve the effective resolution of the 2D-ARRAY, as well as comparisons against GAFCHROMIC EBT2 film and electronic portal imaging dosimetry (EPID). The sensitivity and resolution of the 2D-ARRAY was tested using two gantry angle 0° modulated test fields. Deliberate multileaf collimator (MLC) errors of 1, 2, and 5 mm and collimator rotation errors were inserted into IMRT and RapidArc plans for pelvis and head & neck sites, to test sensitivity to errors. The radiobiological impact of these errors was assessed to determine the gamma index passing criteria to be used with the 2D-ARRAY to detect clinically relevant errors. For gamma index distributions, it was found that the 2D-ARRAY in single acquisition mode was comparable to multiple acquisition modes, as well as film and EPID. It was found that the commonly used gamma index criteria of 3% dose difference or 3 mm distance to agreement may potentially mask clinically relevant errors. Gamma index criteria of 3%/2 mm with a passing threshold of 98%, or 2%/2 mm with a passing threshold of 95%, were found to be more sensitive. We suggest that the gamma index passing thresholds may be used for guidance, but also should be combined with a visual inspection of the gamma index distribution and calculation of the dose difference to assess whether there may be a clinical impact in failed regions.

Optimised conformal total body irradiation: a heterogeneous practice, so where next?

The use of volumetric arc therapy and inverse planning has been in routine use in radiotherapy for two decades. However, use in total body irradiation (TBI) has been more recent and few guidelines exist as to how to plan or verify. This has led to heterogeneous approaches. The goal of this review is to provide an overview of current advanced planning and dosimetry verification protocols used in optimised conformal TBI as a basis for investigating the need for greater standardisation in TBI.

Evaluation of a novel phantom for the quality assurance of a six-degree-of-freedom couch 3D-printed at multiple centres.

This study aimed to validate a bespoke 3D-printed phantom for use in quality assurance (QA) of a 6 degrees-of-freedom (6DoF) treatment couch. A novel phantom design comprising a main body with internal cube structures, was fabricated at five centres using Polylactic Acid (PLA) material, with an additional phantom produced incorporating a PLA-stone hybrid material. Correctional setup shifts were determined using image registration by 3D-3D matching of high HU cube structures between obtained cone-beam computer tomography (CBCT) images to reference CTs, containing cubes with fabricated rotational offsets of 3.5°, 1.5° and -2.5° in rotation, pitch, and roll, respectively. Average rotational setup shifts were obtained for each phantom. The reproducibility of 3D-printing was probed by comparing the internal cube size as well as Hounsfield Units between each of the uniquely produced phantoms. For the five PLA phantoms, the average rot, pitch and roll correctional differences from the fabricated offsets were -0.3 ± 0.2°, -0.2 ± 0.5° and 0.2 ± 0.3° respectively, and for the PLA hybrid these differences were -0.09 ± 0.14°, 0.30 ± 0.00° and 0.03 ± 0.10°. There was found to be no statistically significant difference in average cube size between the five PLA printed phantoms, with the significant difference (P < 0.05) in HU of one phantom compared to the others attributed to setup choice and material density. This work demonstrated the capability producing a novel 3D-printed 6DoF couch QA phantom design, at multiple centres, with each unique model capable of sub-degree couch correction.

Prioritizing clinical trial quality assurance for photons and protons: A failure modes and effects analysis (FMEA) comparison.

BACKGROUND AND PURPOSE: The Global Clinical Trials RTQA Harmonization Group (GHG) set out to evaluate and prioritize clinical trial quality assurance. METHODS: The GHG compiled a list of radiotherapy quality assurance (QA) tests performed for proton and photon therapy clinical trials. These tests were compared between modalities to assess whether there was a need for different types of assessments per modality. A failure modes and effects analysis (FMEA) was performed to assess the risk of each QA failure. RESULTS: The risk analysis showed that proton and photon therapy shared four out of five of their highest-risk failures (end-to-end anthropomorphic phantom test, phantom tests using respiratory motion, pre-treatment patient plan review of contouring/outlining, and on-treatment/post-treatment patient plan review of dosimetric coverage). While similar trends were observed, proton therapy had higher risk failures, driven by higher severity scores. A sub-analysis of occurrence × severity scores identified high-risk scores to prioritize for improvements in RTQA detectability. A novel severity scaler was introduced to account for the number of patients affected by each failure. This scaler did not substantially alter the ranking of tests, but it elevated the QA program evaluation to the top 20th percentile. This is the first FMEA performed for clinical trial quality assurance. CONCLUSION: The identification of high-risk errors associated with clinical trials is valuable to prioritize and reduce errors in radiotherapy and improve the quality of trial data and outcomes, and can be applied to optimize clinical radiotherapy QA.

Universal evaluation of MLC models in treatment planning systems based on a common set of dynamic tests.

PURPOSE: To demonstrate the feasibility of characterising MLCs and MLC models implemented in TPSs using a common set of dynamic beams. MATERIALS AND METHODS: A set of tests containing synchronous (SG) and asynchronous sweeping gaps (aSG) was distributed among twenty-five participating centres. Doses were measured with a Farmer-type ion chamber and computed in TPSs, which provided a dosimetric characterisation of the leaf tip, tongue-and-groove, and MLC transmission of each MLC, as well as an assessment of the MLC model in each TPS. Five MLC types and four TPSs were evaluated, covering the most frequent combinations used in radiotherapy departments. RESULTS: Measured differences within each MLC type were minimal, while large differences were found between MLC models implemented in clinical TPSs. This resulted in some concerning discrepancies, especially for the HD120 and Agility MLCs, for which differences between measured and calculated doses for some MLC-TPS combinations exceeded 10%. These large differences were particularly evident for small gap sizes (5 and 10 mm), as well as for larger gaps in the presence of tongue-and-groove effects. A much better agreement was found for the Millennium120 and Halcyon MLCs, differences being within ± 5% and ± 2.5%, respectively. CONCLUSIONS: The feasibility of using a common set of tests to assess MLC models in TPSs was demonstrated. Measurements within MLC types were very similar, but TPS dose calculations showed large variations. Standardisation of the MLC configuration in TPSs is necessary. The proposed procedure can be readily applied in radiotherapy departments and can be a valuable tool in IMRT and credentialing audits.

Volumetric modulated arc therapy (VMAT): a review of clinical outcomes-what is the clinical evidence for the most effective implementation?

Modern conformal radiation therapy using techniques such as modulation, image guidance and motion management have changed the face of radiotherapy today offering superior conformity, efficiency, and reproducibility to clinics worldwide. This review assesses the impact of these advanced radiotherapy techniques on patient toxicity and survival rates reported from January 2017 to September 2020. The main aims are to establish if dosimetric and efficiency gains correlate with improved survival and reduced toxicities and to answer the question 'What is the clinical evidence for the most effective implementation of VMAT?'. Compared with 3DCRT, improvements have been reported with VMAT in prostate, locally advanced cervical carcinoma and various head and neck applications, leading to the shift in technology to VMAT. Other sites such as thoracic neoplasms and nasopharyngeal carcinomas have observed some improvement with VMAT although not in line with improved dosimetric measures, and the burden of toxicity and the incidence of cancer related deaths remain high, signaling the need to further mitigate toxicity and increase survival. As technological advancement continues, large randomised long-term clinical trials are required to determine the way-forward and offer site-specific recommendations. These studies are usually expensive and time consuming, therefore utilising pooled real-world data in a prospective nature can be an alternative solution to comprehensively assess the efficacy of modern radiotherapy techniques.

SEAFARER - A new concept for validating radiotherapy patient specific QA for clinical trials and clinical practice.

BACKGROUND: The quality of radiotherapy delivery has been shown to significantly impact clinical outcomes including patient survival. To identify errors, institutions perform Patient Specific Quality Assurance (PSQA) assessing each individual radiotherapy plan prior to starting patient treatments. Externally administered Dosimetry Audits have found problems despite institutions passing their own PSQA. Hence a new audit concept which assesses the institution's ability to detect errors with their routine PSQA is needed. METHODS: Purposefully introduced edits which simulated treatment delivery errors were embedded into radiation treatment plans of participating institutions. These were designed to produce clinically significant changes yet were mostly within treatment delivery specifications. Actual impact was centrally assessed for each plan. Institutions performed PSQA on each plan, without knowing which contained errors. RESULTS: Seventeen institutions using six radiation treatment planning systems and two delivery systems performed PSQA on twelve plans each. Seventeen erroneous plans (across seven institutions) passed PSQA despite causing >5% increase in spinal cord dose relative to the original plans. Six plans (from four institutions) passed despite a >10% increase. CONCLUSIONS: This novel audit concept evolves beyond testing an institution's ability to deliver a single test case, to increasing the number of errors caught by institutions themselves, thus increasing quality of radiation therapy and impacting every patient treated. Administered remotely this audit also provides advantages in cost, environmental impact, and logistics.

The 3rd ESTRO-EFOMP core curriculum for medical physics experts in radiotherapy.

PURPOSE: To update the 2011 ESTRO-EFOMP core curriculum (CC) for education and training of medical physics experts (MPE)s working in radiotherapy (RT), in line with recent EU guidelines, and to provide a framework for European countries to develop their own curriculum. MATERIAL AND METHODS: Since September 2019, 27 European MPEs representing ESTRO, EFOMP and National Societies, with expertise covering all subfields of RT physics, have revised the CC for recent advances in RT. The ESTRO and EFOMP Education Councils, all European National Societies and international stakeholders have been involved in the revision process. RESULTS: A 4-year training period has been proposed, with a total of 240 ECTS (European Credit Transfer and Accumulation System). Training entrance levels have been defined ensuring the necessary physics and mathematics background. The concept of competency-based education has been reinforced by introducing the CanMEDS role framework. The updated CC includes (ablative) stereotactic-, MR-guided- and adaptive RT, particle therapy, advanced automation, complex quantitative data analysis (big data/artificial intelligence), use of biological images, and personalized treatments. Due to the continuously increasing RT complexity, more emphasis has been given to quality management. Clear requirements for a research project ensure a proper preparation of MPE residents for their central role in science and innovation in RT. CONCLUSION: This updated, 3rd edition of the CC provides an MPE training framework for safe and effective practice of modern RT, while acknowledging the significant efforts needed in some countries to reach this level. The CC can contribute to further harmonization of MPE training in Europe.

Quantification of the uncertainties within the radiotherapy dosimetry chain and their impact on tumour control.

BACKGROUND AND PURPOSE: Dose delivered during radiotherapy has uncertainty arising from a number of sources including machine calibration, treatment planning and delivery and can impact outcomes. Any systematic uncertainties will impact all patients and can continue for extended periods. The impact on tumour control probability (TCP) of the uncertainties within the radiotherapy calibration process has been assessed. MATERIALS AND METHODS: The linear-quadratic model was used to simulate the TCP from two prostate cancer and a head and neck (H&N) clinical trial. The uncertainty was separated into four components; 1) initial calibration, 2) systematic shift due to output drift, 3) drift during treatment and 4) daily fluctuations. Simulations were performed for each clinical case to model the variation in TCP present at the end of treatment arising from the different components. RESULTS: Overall uncertainty in delivered dose was +/-2.1% (95% confidence interval (CI)), consisting of uncertainty standard deviations of 0.7% in initial calibration, 0.8% due to subsequent calibration shift due to output drift, 0.1% due to drift during treatment, and 0.2% from daily variations. The overall uncertainty of TCP (95% CI) for a population of patients treated on different machines was +/-3%, +/-5%, and +/-3% for simulations based on the two prostate trials and H&N trial respectively. CONCLUSION: The greatest variation in delivered target volume dose arose from calibration shift due to output drift. Careful monitoring of beam output following initial calibration remains vital and may have a significant impact on clinical outcomes.

Clinical use, challenges, and barriers to implementation of deformable image registration in radiotherapy - the need for guidance and QA tools.

OBJECTIVE: The aim of this study was to evaluate the current status of the clinical use of deformable image registration (DIR) in radiotherapy and to gain an understanding of the challenges faced by centres in clinical implementation of DIR, including commissioning and quality assurance (QA), and to determine the barriers faced. The goal was to inform whether additional guidance and QA tools were needed. METHODS: A survey focussed on clinical use, metrics used, how centres would like to use DIR in the future and challenges faced, was designed and sent to 71 radiotherapy centres in the UK. Data were gathered specifically on which centres we using DIR clinically, which applications were being used, what commissioning and QA tests were performed, and what barriers were preventing the integration of DIR into the clinical workflow. Centres that did not use DIR clinically were encouraged to fill in the survey and were asked if they have any future plans and in what timescale. RESULTS: 51 out of 71 (70%) radiotherapy centres responded. 47 centres reported access to a commercial software that could perform DIR. 20 centres already used DIR clinically, and 22 centres had plans to implement an application of DIR within 3 years of the survey. The most common clinical application of DIR was to propagate contours from one scan to another (19 centres). In each of the applications, the types of commissioning and QA tests performed varied depending on the type of application and between centres. Some of the key barriers were determining when a DIR was satisfactory including which metrics to use, and lack of resources. CONCLUSION: The survey results highlighted that there is a need for additional guidelines, training, better tools for commissioning DIR software and for the QA of registration results, which should include developing or recommending which quantitative metrics to use. ADVANCES IN KNOWLEDGE: This survey has given a useful picture of the clinical use and lack of use of DIR in UK radiotherapy centres. The survey provided useful insight into how centres commission and QA DIR applications, especially the variability among centres. It was also possible to highlight key barriers to implementation and determine factors that may help overcome this which include the need for additional guidance specific to different applications, better tools and metrics.

Quality assurance of dysphagia-optimised intensity modulated radiotherapy treatment planning for head and neck cancer.

This study aimed to assess the impact of the margin applied to the clinical target volume, to create the planning target volume, on plan quality of a novel dysphagia-optimised intensity modulated radiotherapy technique developed within a head and neck cancer multicentre randomised controlled trial. Protocol compliant plans were used for a single benchmark planning case. Larger margins were associated with higher doses to adjacent organs at risk, particularly the inferior pharyngeal constrictor muscle, but coincided with some improved low dose target coverage. A 3 mm margin is recommended for this technique if local practices allow.

Towards an updated ESTRO-EFOMP core curriculum for education and training of medical physics experts in radiotherapy - A survey of current education and training practice in Europe.

PURPOSE: ESTRO-EFOMP intend to update the core curriculum (CC) for education and training of medical physicists in radiotherapy in line with the European Commission (EC) guidelines on Medical Physics Experts (MPE), the CanMEDS methodology and recent developments in radiotherapy. As input, a survey of the current structure of radiotherapy MPE national training schemes (NTS) in Europe was carried out. METHODS: A 35-question survey was sent to all European medical physics national societies (NS) with a focus on existence of an NTS, its format and duration, required entry-level education, and financial support for trainees. RESULTS: Twenty-six of 36 NS responded. Twenty had an NTS. Minimum required pre-training education varied from BSc in physics or related sciences (5/2) to MSc in medical physics, physics or related sciences (6/5/2) with 50-210 ECTS in fundamental physics and mathematics. The training period varied from 1 to 5 years (median 3 years with 50% dedicated to radiotherapy). The ratio of time spent on university lectures versus hospital training was most commonly 25%/75%. In 14 of 20 countries with an NTS, a research project was mandatory. Residents were paid in 17 of 20 countries. The recognition was mostly obtained by examination. Medical physics is recognised as a healthcare profession in 19 of 26 countries. CONCLUSIONS: The NTS entrance level, duration and curriculum showed significant variations. This survey serves to inform the design of the updated CC to define a realistic minimum training level for safe and effective practice aiming at further harmonization in line with EC guidelines.

Professional practice changes in radiotherapy physics during the COVID-19 pandemic.

BACKGROUND AND PURPOSE: The COVID-19 pandemic has imposed changes in radiotherapy (RT) departments worldwide. Medical physicists (MPs) are key healthcare professionals in maintaining safe and effective RT. This study reports on MPs experience during the first pandemic peak and explores the consequences on their work. METHODS: A 39-question survey on changes in departmental and clinical practice and on the impact for the future was sent to the global MP community. A total of 433 responses were analysed by professional role and by country clustered on the daily infection numbers. RESULTS: The impact of COVID-19 was bigger in countries with high daily infection rate. The majority of MPs worked in alternation at home/on-site. Among practice changes, implementation and/or increased use of hypofractionation was the most common (47% of the respondents). Sixteen percent of respondents modified patient-specific quality assurance (QA), 21% reduced machine QA, and 25% moved machine QA to weekends/evenings. The perception of trust in leadership and team unity was reversed between management MPs (towards increased trust and unity) and clinical MPs (towards a decrease). Changes such as home-working and increased use of hypofractionation were welcomed. However, some MPs were concerned about pressure to keep negative changes (e.g. weekend work). CONCLUSION: COVID-19 affected MPs through changes in practice and QA procedures but also in terms of trust in leadership and team unity. Some changes were welcomed but others caused worries for the future. This report forms the basis, from a medical physics perspective, to evaluate long-lasting changes within a multi-disciplinary setting.

Report dose-to-medium in clinical trials where available; a consensus from the Global Harmonisation Group to maximize consistency.

PURPOSE: To promote consistency in clinical trials by recommending a uniform framework as it relates to radiation transport and dose calculation in water versus in medium. METHODS: The Global Quality Assurance of Radiation Therapy Clinical Trials Harmonisation Group (GHG; www.rtqaharmonization.org) compared the differences between dose to water in water (Dw,w), dose to water in medium (Dw,m), and dose to medium in medium (Dm,m). This was done based on a review of historical frameworks, existing literature and standards, clinical issues in the context of clinical trials, and the trajectory of radiation dose calculations. Based on these factors, recommendations were developed. RESULTS: No framework was found to be ideal or perfect given the history, complexity, and current status of radiation therapy. Nevertheless, based on the evidence available, the GHG established a recommendation preferring dose to medium in medium (Dm,m). CONCLUSIONS: Dose to medium in medium (Dm,m) is the preferred dose calculation and reporting framework. If an institution's planning system can only calculate dose to water in water (Dw,w), this is acceptable.

Multivariate log file analysis for multi-leaf collimator failure prediction in radiotherapy delivery.

BACKGROUND AND PURPOSE: Motor failure in multi-leaf collimators (MLC) is a common reason for unscheduled accelerator maintenance, disrupting the workflow of a radiotherapy treatment centre. Predicting MLC replacement needs ahead of time would allow for proactive maintenance scheduling, reducing the impact MLC replacement has on treatment workflow. We propose a multivariate approach to analysis of trajectory log data, which can be used to predict upcoming MLC replacement needs. MATERIALS AND METHODS: Trajectory log files from two accelerators, spanning six and seven months respectively, have been collected and analysed. The average error in each of the parameters for each log file was calculated and used for further analysis. A performance index (PI) was generated by applying moving window principal component analysis to the prepared data. Drops in the PI were thought to indicate an upcoming MLC replacement requirement; therefore, PI was tracked with exponentially weighted moving average (EWMA) control charts complete with a lower control limit. RESULTS: The best compromise of fault detection and minimising false alarm rate was achieved using a weighting parameter (λ) of 0.05 and a control limit based on three standard deviations and an 80 data point window. The approach identified eight out of thirteen logged MLC replacements, one to three working days in advance whilst, on average, raising a false alarm, on average, 1.1 times a month. CONCLUSIONS: This approach to analysing trajectory log data has been shown to enable prediction of certain upcoming MLC failures, albeit at a cost of false alarms.

Automatic evaluation of contours in radiotherapy planning utilising conformity indices and machine learning.

BACKGROUND AND PURPOSE: Peer-review of Target Volume (TV) and Organ at Risk (OAR) contours in radiotherapy planning are typically conducted visually; this can be time consuming and subject to interobserver variation. This study investigated automatic evaluation of contouring using conformity indices and supervised machine learning. METHODS: A total of 393 contours from 253 Stereotactic Ablative Body Radiotherapy (SABR) benchmark cases (adrenal gland, liver, pelvic lymph node and spine), delineated by 132 clinicians from 25 centres, were visually evaluated for conformity against gold standard contours. Contours were scored as "pass" or "fail" on visual peer review and six Conformity Indices (CIs) were applied. CI values were mapped to pass/fail scores for each contour and used to train supervised machine learning models. A 5-fold cross validation method was employed to determine the predictive accuracies of each model. RESULTS: The stomach structure produced models with the highest predictive accuracy overall (96% using Support Vector Machine and Ensemble models), whilst the liver GTV produced models with the lowest predictive accuracy (76% using Logistic Regression). Predictive accuracies across all models ranged from 68-96% (68-87% for TV and 71-96% for OARs). CONCLUSIONS: Although a final visual review by an experienced clinician is still required, the automatic contour evaluation method could reduce the time for benchmark case reviews by identifying gross contouring errors. This method could be successfully implemented to support departmental training and the continuous assessment of outlining for clinical staff in the peer-review process, to reduce interobserver variability in contouring and improve interpretation of radiological anatomy.