Perceptions on and roadblocks to implementation of standardized nomenclature in radiation oncology: A survey from TG-263U1.

PURPOSE: AAPM Task Group No. 263U1 (Update to Report No. 263 - Standardizing Nomenclatures in Radiation Oncology) disseminated a survey to receive feedback on utilization, gaps, and means to facilitate further adoption. METHODS: The survey was created by TG-263U1 members to solicit feedback from physicists, dosimetrists, and physicians working in radiation oncology. Questions on the adoption of the TG-263 standard were coupled with demographic information, such as clinical role, place of primary employment (e.g., private hospital, academic center), and size of institution. The survey was emailed to all AAPM, AAMD, and ASTRO members. RESULTS: The survey received 463 responses with 310 completed survey responses used for analysis, of whom most had the clinical role of medical physicist (73%) and the majority were from the United States (83%). There were 83% of respondents who indicated that they believe that having a nomenclature standard is important or very important and 61% had adopted all or portions of TG-263 in their clinics. For those yet to adopt TG-263, the staffing and implementation efforts were the main cause for delaying adoption. Fewer respondents had trouble adopting TG-263 for organs at risk (29%) versus target (44%) nomenclature. Common themes in written feedback were lack of physician support and available resources, especially in vendor systems, to facilitate adoption. CONCLUSIONS: While there is strong support and belief in the benefit of standardized nomenclature, the widespread adoption of TG-263 has been hindered by the effort needed by staff for implementation.  Feedback from the survey is being utilized to drive the focus of the update efforts and create tools to facilitate easier adoption of TG-263.

Commissioning and clinical evaluation of the IDENTIFYTM surface imaging system for frameless stereotactic radiosurgery.

PURPOSE: To commission and assess the clinical performance of a new commercial surface imaging (SI) system by analyzing intra-fraction motion from the initial cohort of patients treated with frameless stereotactic radiosurgery (fSRS). METHODS: The IDENTIFYTM SI system was commissioned for clinical use on an Edge (Varian Medical Systems, Palo Alto, CA) linear accelerator. All patients who received intracranial radiotherapy with HyperArcTM (Varian Medical Systems, Palo Alto, CA) were immobilized with the EncompassTM (Qfix, Avondale, PA) thermoplastic mask and monitored for intra-fraction motion with SI. IDENTIFYTM log files were correlated with trajectory log files to correlate treatment parameters with SI-reported offsets. IDENTIFYTM reported offsets were correlated with gantry and couch angles to assess system performance for obstructed and clear camera field of view. Data were stratified by race to evaluate performance differences due to skin tone. RESULTS: All commissioning data were found to meet recommended tolerances. IDENTIFYTM was used to monitor intra-fraction motion on 1164 fractions from 386 patients. The median magnitude of translational SI reported offsets at the end of treatment was 0.27 mm. SI reported offsets were shown to increase when camera pods are blocked by the gantry with larger increases seen at non-zero couch angles. With camera obstruction, the median magnitude of the SI reported offset was 0.50 and 0.80 mm for White and Black patients, respectively. CONCLUSIONS: IDENTIFYTM performance during fSRS is comparable to other commercially available SI systems where offsets are shown to increase at non-zero couch angles and during camera pod blockage.

Analysis of a surface imaging system using a six degree-of-freedom couch.

PURPOSE: To validate surface imaging (SI)-reported offsets using a six degree-of-freedom couch and an anthropomorphic phantom for commissioning and routine quality assurance of an SI system used for stereotactic radiosurgery (SRS). METHODS: An anthropomorphic phantom with a radiopaque ball bearing (BB) placed either anterior, midline, or posterior, was tracked with SI with a typical SRS region of interest. Couch motion in all six degrees of freedom was programmed and delivered on a linac. SI system logs were synchronized with linac trajectory logs. Ten random couch positions were selected at couch 0°, 45°, 90°, 270°, 315° with megavolt (MV) images taken to account for couch walkout. The SI residual error (ε), the difference between SI reported offset and MV or trajectory log position, was calculated. Residual errors were measured with and without one SI pod blocked. RESULTS: The median [range] of magnitude of translational ε was 0.13 [0.07, 0.21], 0.16 [0.11, 0.26], 0.61 [0.50, 0.68], 0.49 [0.42, 0.55], 0.55 [0.38, 0.72] mm for couch rotations of 0°, 45°, 90°, 270°, 315°, respectively, for the midline BB and no pod blocked. The range of all translational ε from all couch angles (with and without pod block) at different BB positions is [0.05, 0.96] mm. The absolute range of difference when changing BB position when no pod is blocked in median translational ε is [0.01, 0.40] mm with the maximum at BB posterior. The absolute range of difference when not changing BB positions with and without pod block in median translational ε is [0.01, 0.37] mm with the maximum at BB posterior and couch 315°. CONCLUSION: SI system and linac trajectory log analysis can be used to assess SI system performance with automated couch motion to validate SI accuracy.

Code Wisely: Risk assessment and mitigation for custom clinical software.

PURPOSE: The task of software development has become an increasing part of the medical physicist's role. Many physicists who are untrained in the best practices of software development have begun creating scripts for clinical use. There is an increasing need for guidance for both developers and medical physicists to code wisely in the clinic. MATERIALS AND METHODS: We created a novel model for assessing risk for custom clinical software analogous to failure modes and effects analysis and propose minimum best practices that should be followed to mitigate the risks. Using this risk model, we integrated a literature review and institutional experience to form a practical guide for risk mitigation. RESULTS: Using this new risk assessment model, we outlined several risk mitigation techniques including unit testing, code review, source control, end-user testing, and commissioning from the literature while sharing our institutional guidelines for evaluating software for risk and implementing these strategies. CONCLUSION: We found very little literature for custom software development guidelines targeted at medical physicists. We have shared our institutional experience and guidelines to help facilitate safe software development for the evolving role of the medical physicist.

Evaluation of a two-dimensional diode array for patient-specific quality assurance of HyperArc.

PURPOSE: To evaluate a two-dimensional diode array for patient-specific quality assurance of VMAT stereotactic radiosurgery (SRS) plans. METHODS: The diode array, an SRS MapCHECK (SRSMC), was composed of a 77 mm ×77 mm face-centered array having a spacing of 2.47 mm. Sixty SRS plans were selected from our clinical database, 30 for treatment of a single target and 30 for multiple targets. The target sizes ranged from 2.4 mm to 44.7 mm equivalent diameter (median 8.7 mm). The plans were delivered to the diode array. For multiple target plans, two measurements were obtained at two locations, one corresponding to the largest target and the other to the smallest target. Gamma using a 3%/1 mm criteria and the dose to the center diode were compared with radiochromic film (RCF). Dose to selected regions of the detector electronics was calculated. RESULTS: The mean difference between the center diode and RCF was -1.2%. For a threshold of at least 95% of detectors/pixels having gamma < 1 for a 3%/1 mm criteria, SRSMC and RCF gave consistent results for 79 of the 90 measurements. For plans with an arc having a patient support angle of 90° or 270°, the median dose to the electronics was 0.65% of the prescription dose. CONCLUSIONS: SRSMC is an efficient tool for accurate patient-specific quality assurance of VMAT single and multiple target radiosurgery, yielding similar clinical decisions as radiochromic film.

Technical Note: Use of automation to eliminate shift errors.

PURPOSE: To create automated tools within the treatment planning system (TPS) that eliminate the common error pathway of providing incorrect shift instructions to therapists. MATERIALS/METHODS: Two scripts were created within the TPS using the Eclipse API (Varian Medical Systems, Palo Alto, CA). One script detects whether or not the user origin has been placed correctly at the intersection of the simulation markers while the other calculates a shift instruction sheet that can be printed for treatment. RESULTS: Analysis of our RO-ILS database identified eight errors caused by improper setting of the user origin in the treatment planning system. The user origin script flagged all of the treatment plans for markers inconsistent with user origin. Automated calculation of shifts eliminated the error pathway of miscalculating or transcribing shift values. CONCLUSION: Automation can eliminate the common error pathway of providing the wrong shifts to therapists. The scripts have been made available as open-source software for implementation at other radiotherapy clinics.

Surface guided imaging during stereotactic radiosurgery with automated delivery.

PURPOSE: To report on the use of surface guided imaging during frameless intracranial stereotactic radiotherapy with automated delivery via HyperArcTM (Varian Medical Systems, Palo Alto, CA). METHODS: All patients received intracranial radiotherapy with HyperArcTM and were monitored for intrafraction motion by the AlignRT® (VisionRT, London, UK) surface imaging (SI) system. Immobilization was with the EncompassTM (Qfix, Avondale, PA) aquaplast mask device. AlignRT® log files were correlated with trajectory log files to correlate treatment parameters with SI reported offsets. SI reported offsets were correlated with gantry angle and analyzed for performance issues at non-zero couch angles and during camera-pod blockage during gantry motion. Demographics in the treatment management system were used to identify race and determine if differences in SI reported offsets are due to skin tone settings. RESULTS: A total of 981 fractions were monitored over 14 months and 819 were analyzed. The median AlignRT® reported motion from beginning to the end of treatment was 0.24 mm. The median offset before beam on at non-zero couch angles was 0.55 mm. During gantry motion when camera pods are blocked, the median magnitude was below 1 mm. Median magnitude of offsets at non-zero couch angles was not found to be significantly different for patients stratified by race. CONCLUSIONS: Surface image guidance is a viable alternative to scheduled mid-treatment imaging for monitoring intrafraction motion during stereotactic radiosurgery with automated delivery.

Technical Note: An open source solution for improving TG-263 compliance.

PURPOSE: Compliance with TG-263 nomenclature standards can be challenging. We introduce an open source solution to this problem and evaluate its impact on compliance within our institution. MATERIALS/METHODS: The TG-236 nomenclature standards were implemented in our clinic in two phases. In phase 1, we deployed TG-263 compliant templates for each disease site. In phase 2, we developed and deployed a script for evaluating compliance which presented errors to the user. After each phase the compliance was recorded. RESULTS: Mean compliance errors prior to phase 1 was 31.8% ± 17.4%. Error rates dropped to 8.1% ± 12.2% across phase 1 and dropped further to 2.2% ± 6.9% during the automation system deployed in phase 2. CONCLUSION: Both structure templates and automation scripts are very useful for increasing compliance with structure naming standards. Our software solution is made available on GitHub for other institutions to implement.

Use of a plastic scintillator detector for patient-specific quality assurance of VMAT SRS.

PURPOSE: To evaluate a scintillator detector for patient-specific quality assurance of VMAT radiosurgery plans. METHODS: The detector was comprised of a 1 mm diameter, 1 mm high scintillator coupled to an acrylic optical fiber. Sixty VMAT SRS plans for treatment of single targets having sizes ranging from 3 mm to 30.2 mm equivalent diameter (median 16.3 mm) were selected. The plans were delivered to a 20 cm × 20 cm x 15 cm water equivalent plastic phantom having either the scintillator detector or radiochromic film at the center. Calibration films were obtained for each measurement session. The films were scanned and converted to dose using a 3-channel technique. RESULTS: The mean difference between scintillator and film was -0.45% (95% confidence interval -0.1% to 0.8%). For target equivalent diameter smaller than the median, the mean difference was 1.1% (95% confidence interval 0.5% to 1.7%). For targets larger than the median, the mean difference was -0.2% (95% confidence interval -0.7% to 0.1%). CONCLUSIONS: The scintillator detector response is independent of target size for targets as small as 3 mm and is well-suited for patient-specific quality assurance of VMAT SRS plans. Further work is needed to evaluate the accuracy for VMAT plans that treat multiple targets using a single isocenter.

Assessing the feasibility of single target radiosurgery quality assurance with portal dosimetry.

PURPOSE: To assess the feasibility of using portal dosimetry (PD) for pre-treatment quality assurance of single target, flattening filter free (FFF), volumetric arc therapy intracranial radiosurgery plans. METHODS: A PD algorithm was created for a 10X FFF beam on a Varian Edge linear accelerator (Varian Inc, Palo Alto, CA, USA). Treatment plans that were previously evaluated with Gafchromic EBT-XD (Ashland, Bridgewater, NJ, USA) film were measured via PD and analyzed with the ARIA Portal Dosimetry workspace. Absolute dose evaluation for film and PD was done by computing the mean dose in the region receiving greater than or equal to 90% of the max dose and comparing to the mean dose in the same region calculated by the treatment planning system (TPS). Gamma analysis with 10% threshold and 3%/2 mm passing criteria was performed on film and portal images. RESULTS: Thirty-six PD verification plans were delivered and analyzed. The average PD to TPS dose was 0.989 ± 0.01 while film to TPS dose was 1.026 ± 0.01. All PD plans passed the gamma analysis with 100% of points having gamma <1. Overall, PD to TPS dose agreement was found to be target size dependent. As target size decreases, PD to TPS dose ratio decreased from 1.004 for targets with diameters between 15-31 mm and 0.978 for targets with diameters less than 15 mm. CONCLUSION: The agreement of PD to TPS mean dose in the high dose region was found to be dependent on target size. Film measurements did not exhibit size dependence. All PD plans passed the 3%/2 mm gamma analysis, but caution should be used when using PD to assess overall dosimetric accuracy of the treatment plan for small targets.

Optical surface guidance for submillimeter monitoring of patient position during frameless stereotactic radiotherapy.

PURPOSE: To evaluate the accuracy of monitoring intrafraction motion during stereotactic radiotherapy with the optical surface monitoring system. Prior studies showing a false increase in the magnitude of translational offsets at non-coplanar couch positions prompted the vendor to implement software changes. This study evaluated two software improvements intended to address false offsets. METHODS: The vendor implemented two software improvements: a volumetric (ACO) rather than planar calibration and, approximately 6 months later, an improved calibration workflow (CIB) designed to better compensate for thermal drift. Offsets relative to the reference position, obtained at table angle 0 following image-guided setup, were recorded before beam-on at each table position and at the end of treatment the table returned to 0° for patients receiving SRT. RESULTS: Prior to ACO, between ACO and CIB, and after CIB, 223, 155, and 436 fractions were observed respectively. The median magnitude of translational offsets at the end of treatment was similar for all three intervals: 0.29, 0.33, and 0.27 mm. Prior to ACO, the offset magnitude for non-zero table positions had a median of 0.79 mm and was found to increase with increasing distance from isocenter to the anterior patient surface. After ACO, the median magnitude was 0.74 mm, but the dependence on surface-to-isocenter distance was eliminated. After CIB, the median magnitude for non-zero table positions was reduced to 0.57 mm. CONCLUSION: Ongoing improvements in software and calibration procedures have decreased reporting of false offsets at non-zero table angles. However, the median magnitude for non-zero table angles is larger than that observed at the end of treatment, indicating that accuracy remains better when the table is not rotated.

Revisiting fetal dose during radiation therapy: evaluating treatment techniques and a custom shield.

To create a comprehensive dataset of peripheral dose (PD) measurements from a new generation of linear accelerators with and without the presence of a newly designed fetal shield, PD measurements were performed to evaluate the effects of depth, field size, distance from the field edge, collimator angle, and beam modi-fiers for common treatment protocols and modalities. A custom fetal lead shield was designed and made for our department that allows external beam treatments from multiple angles while minimizing the need to adjust the shield during patient treatments. PD measurements were acquired for a comprehensive series of static fields on a stack of Solid Water. Additionally, PDs from various clinically relevant treatment scenarios for pregnant patients were measured using an anthropomorphic phantom that was abutted to a stack of Solid Water. As expected, the PD decreased as the distance from the field edge increased and the field size decreased. On aver-age, a PD reduction was observed when a 90° collimator rotation was applied and/or when the tertiary MLCs and jaws defined the field aperture. However, the effect of the collimator rotation (90° versus 0°) in PD reduction was not found to be clini-cally significant when the tertiary MLCs were used to define the field aperture. In the presence of both the MLCs and the fetal shield, the PD was reduced by 58% at a distance of 10 cm from the field edge. The newly designed fetal shield may effectively reduce fetal dose and is relatively easy to setup. Due to its design, we are able to use a broad range of treatment techniques and beam angles. We believe the acquired comprehensive PD dataset collected with and without the fetal shield will be useful for treatment teams to estimate fetal dose and help guide decisions on treat-ment techniques without the need to perform pretreatment phantom measurements.

Improving treatment plan evaluation with automation.

The goal of this work is to evaluate the effectiveness of Plan-Checker Tool (PCT) which was created to improve first-time plan quality, reduce patient delays, increase the efficiency of our electronic workflow, and standardize and automate the phys-ics plan review in the treatment planning system (TPS). PCT uses an application programming interface to check and compare data from the TPS and treatment management system (TMS). PCT includes a comprehensive checklist of automated and manual checks that are documented when performed by the user as part of a plan readiness check for treatment. Prior to and during PCT development, errors identified during the physics review and causes of patient treatment start delays were tracked to prioritize which checks should be automated. Nineteen of 33checklist items were automated, with data extracted with PCT. There was a 60% reduction in the number of patient delays in the six months after PCT release. PCT was suc-cessfully implemented for use on all external beam treatment plans in our clinic. While the number of errors found during the physics check did not decrease, automation of checks increased visibility of errors during the physics check, which led to decreased patient delays. The methods used here can be applied to any TMS and TPS that allows queries of the database.

Order From Chaos: The Benefits of Standardized Nomenclature in Radiation Oncology.

Although standardization has been shown to improve patient safety and improve the efficiency of workflows, implementation of standards can take considerable effort and requires the engagement of all clinical stakeholders. Engaging team members includes increasing awareness of the proposed benefit of the standard, a clear implementation plan, monitoring for improvements, and open communication to support successful implementation. The benefits of standardization often focus on large institutions to improve research endeavors, yet all clinics can benefit from standardization to increase quality and implement more efficient or automated workflow. The benefits of nomenclature standardization for all team members and institution sizes, including success stories, are discussed with practical implementation guides to facilitate the adoption of standardized nomenclature in radiation oncology.

Gender-Based Discrimination and Sexual Harassment in Medical Physics.

PURPOSE: Gender-based discrimination and sexual harassment have been well-studied in the fields of science, technology, engineering, math, and medicine. However, less is known about these topics and their effect within the profession of medical physics. We aimed to better understand and clarify the views and experiences of practicing medical physicists and medical physics residents regarding gender-based discrimination and sexual harassment. METHODS AND MATERIALS: We conducted in-depth, semistructured, and confidential interviews with 32 practicing medical physicists and medical physics residents across the United States. The interviews were broad and covered the topics of discrimination, mentorship, and work/life integration. All participants were associated with a department with a residency program accredited by the Commission on Accreditation of Medical Physics Education Programs and had appointments with a clinical component. RESULTS: Participants shared views about gender-based discrimination and sexual harassment that were polarized. Some perceived that discrimination and harassment were a current concern within medical physics, while some either perceived that they were not a concern or that discrimination positively affected women and minoritized populations. Many participants shared personal experiences of discrimination and harassment, including those related to unequal compensation, discrimination against mothers, discrimination during the hiring process, gender-biased assumptions about behaviors or goals, communication biases, and overt and persistent sexual harassment. CONCLUSIONS: There is an urgent need to acknowledge, better understand, and address gender-based discrimination and sexual harassment in the field of medical physics.

A Holographic Augmented Reality Guidance System for Patient Alignment: A Feasibility Study.

Purpose To evaluate the accuracy of an augmented reality holographic guidance system for potential use in patient alignment in radiotherapy applications. Methods A cubic phantom was scanned on a CT simulator and a 3D mesh was extracted using the Eclipse Scripting API. An application was created for the Microsoft HoloLens to allow users to see the scanned mesh as a hologram overlaid in the treatment vault. Six therapists were equipped with the HoloLens glasses and instructed to move the real phantom to align with the perceived spatial hologram using only couch controls. The initial couch coordinates were recorded and then recorded at each step as the therapist moved the phantom to each new location. The application varied the position of the virtual phantom to 10 preprogrammed locations within a 40-cm cubic volume in a combination of vertical, longitudinal, and lateral axis shifts. The absolute position difference between the holographic world and real-world phantom was recorded at each step. Also, the relative position from one position to the next was recorded. Results Fifty shifts were collected across the six therapists. The mean difference between the physical position and instructed holographic position was 0.58 ± 0.31 cm for relative shifts and 0.51 ± 0.33 cm for absolute position. The maximum difference between the holographic position and the actual post shift position was 1.53 cm for relative and 1.58 cm for absolute. Conclusion Holographic augmented reality guidance using the Microsoft HoloLens provides adequate accuracy for initial treatment alignment but lacks the fine alignment accuracy of X-ray imaging systems.

A Low-Cost Method to Assess the Performance of Surface Guidance Imaging Systems at Non-Zero Couch Angles.

A procedure is presented to assess performance at non-zero couch angles and perform routine quality assurance (QA) on surface-guided radiotherapy (SGRT) imaging systems used for stereotactic radiosurgery (SRS). A low-cost anthropomorphic phantom was used to assess the system under patient-like conditions. The phantom is embedded with a tungsten ball bearing (BB) to facilitate the use of surface imaging (SI) with concurrent megavoltage (MV) imaging to cross-compare and validate SI-reported offsets. Data analysis is done via in-house software that utilized the SGRT system's log files for automated analysis. This procedure enables users to assess and inter-compare MV-reported offsets with their SGRT system. The analysis provides SGRT system residual error so that users are aware of inherent offsets present in addition to increases in translational offsets due to couch walkout. The procedure was validated with two commercial SGRT systems. The procedure can be used with any surface imaging system and linear accelerator system.

Transition From Manual to Automated Planning and Delivery of Volumetric Modulated Arc Therapy Stereotactic Radiosurgery: Clinical, Dosimetric, and Quality Assurance Results.

PURPOSE: Properly planned single isocenter volumetric modulated arc therapy (VMAT) radiosurgery plans exhibit high quality and efficiency. We report here the largest clinical experience to date, to our knowledge, comparing manual planning with a new automated platform designed to standardize and simplify radiosurgery planning and delivery processes. METHODS: We treated 693 patients with single isocenter VMAT radiosurgical plans generated by either our conventional manual (mVMAT) or a recently implemented automated (HyperArcTM) technique. All plans targeted the gross tumor volume without margin. Radiochromic film was used for patient-specific quality assurance (PSQA). We evaluated local control and toxicity data for a subgroup of 107 patients having 377 metastatic tumors that were treated with HyperArc. RESULTS: The median Radiation Therapy Oncology Group (RTOG) conformity index was 1.14 and was not different between the 2 techniques. The median Paddick gradient index was 5.42 for HyperArc versus 7.09 for mVMAT (P < .001). The median mean brain doses were 4.6% and 5.1% for HyperArc and mVMAT, respectively (P = .04). The PSQA for both techniques met clinical criteria, but 97% of the HyperArc plans satisfied the gamma tolerance limit recommended by the American Association of Physicists in Medicine Task Group No. 218, compared with 94% of the mVMAT plans (P = .02). The median treatment-planning times were not significantly different. The median treatment times were 10.5 and 11.4 minutes for HyperArc and mVMAT, respectively (P < .001). The Kaplan-Meier estimate of local control was 90.1% at 1 year. CONCLUSIONS: HyperArc produces high-quality radiosurgical plans that are at least as good as mVMAT plans created by an expert manual planner with easier planning and more efficient delivery workflow. A less experienced planner can produce very high-quality radiosurgical plans even for patients with more than 10 targets. The use of a single-isocenter technique for multiple targets with no PTV margin did not compromise clinical outcomes, and 1-year local control for treated targets remained congruent with historical series.

Accuracy of dose-volume metric calculation for small-volume radiosurgery targets.

PURPOSE: For stereotactic radiosurgery (SRS), accurate evaluation of dose-volume metrics for small structures is necessary. The purpose of this study was to compare the DVH metric capabilities of five commercially available SRS DVH analysis tools (Eclipse, Elements, Raystation, MIM, and Velocity). METHODS: DICOM RTdose and RTstructure set files created using MATLAB were imported and evaluated in each of the tools. Each structure set consisted of 50 randomly placed spherical targets. The dose distributions were created on a 1-mm grid using an analytic model such that the dose-volume metrics of the spheres were known. Structure sets were created for 3, 5, 7, 10, 15, and 20 mm diameter spheres. The reported structure volume, V100% [cc], and V50% [cc], and the RTOG conformity index and Paddick Gradient Index, were compared with the analytical values. RESULTS: The average difference and range across all evaluated target sizes for the reported structure volume was - 4.73%[-33.2,0.2], 0.11%[-10.9, 9.5], -0.39%[-12.1, 7.0], -2.24%[-21.0, 1.3], and 1.15%[-15.1,0.8], for TPS-A through TPS-E, respectively. The average difference and range for the V100%[cc] (V20Gy[cc]) was - 0.4[-24.5,9.8], -2.73[-23.6, 1.1], -3.01[-23.6, 0.6], -3.79[-27.3, 1.3], and 0.26[-6.1,2.6] for TPS-A through TPS-E, respectively. For V50%[cc](V10Gy[cc]) in TPS-A through TPS-E the average and ranger were - 0.05[-0.8,0.4], -0.18[-1.2, 0.5], -0.44[-1.4, 0.3], -0.26[-1.8, 2.6], and 0.09[-1.4,2.7]. CONCLUSION: This study expanded on the previously published literature to quantitatively compare the DVH analysis capabilities of software commonly used for SRS plan evaluation and provides freely available and downloadable analytically derived set of ground truth DICOM dose and structure files for the use of radiotherapy clinics. The differences between systems highlight the need for standardization and/or transparency between systems, especially when evaluating plan quality for multi-institutional clinical trials.