Assessment and improvement of radiation oncology trainee contouring ability utilizing consensus-based penalty metrics.

INTRODUCTION: The objective of this study was to develop and assess the feasibility of utilizing consensus-based penalty metrics for the purpose of critical structure and organ at risk (OAR) contouring quality assurance and improvement. METHODS: A Delphi study was conducted to obtain consensus on contouring penalty metrics to assess trainee-generated OAR contours. Voxel-based penalty metric equations were used to score regions of discordance between trainee and expert contour sets. The utility of these penalty metric scores for objective feedback on contouring quality was assessed by using cases prepared for weekly radiation oncology radiation oncology trainee treatment planning rounds. RESULTS: In two Delphi rounds, six radiation oncology specialists reached agreement on clinical importance/impact and organ radiosensitivity as the two primary criteria for the creation of the Critical Structure Inter-comparison of Segmentation (CriSIS) penalty functions. Linear/quadratic penalty scoring functions (for over- and under-contouring) with one of four levels of severity (none, low, moderate and high) were assigned for each of 20 OARs in order to generate a CriSIS score when new OAR contours are compared with reference/expert standards. Six cases (central nervous system, head and neck, gastrointestinal, genitourinary, gynaecological and thoracic) then were used to validate 18 OAR metrics through comparison of trainee and expert contour sets using the consensus derived CriSIS functions. For 14 OARs, there was an improvement in CriSIS score post-educational intervention. CONCLUSIONS: The use of consensus-based contouring penalty metrics to provide quantitative information for contouring improvement is feasible.

Pain and symptom assessment during multiple fractions of gynecologic high-dose-rate brachytherapy.

PURPOSE: A prospective assessment of tolerability of gynecologic brachytherapy was completed to determine adequacy of analgesia and symptom control for patients undergoing CT-guided brachytherapy, with multiple fractions delivered during a single applicator insertion. METHODS AND MATERIALS: Seventeen patients receiving high-dose-rate brachytherapy for gynecologic cancer (other than vaginal vault) completed ratings of pain intensity, anxiety, and nausea at five key time points before, during, and after brachytherapy. Symptoms were assessed with patient-reported scores using an 11-point numeric rating scale. The patient population included cervical (n=12), endometrial (n=3), and vulvar-vaginal (n=2) malignancies. Patients underwent general anesthesia for applicator placement. Analgesia consisted of subcutaneous route opioid, and oral opioid and/or nonopioid as needed for the duration of the treatment planning and delivery. RESULTS: The mean scores for pain were highest after patients were transferred to the CT scanner, 3.3±2.6, compared with baseline scores of 0.9±1.7. Pain scores were 2.3±2.3 during the remainder of the procedure, and 2.7±2.1 after the removal of the applicator. The highest mean anxiety scores occurred before the brachytherapy procedure, 4.3±3.4, with resolution of anxiety during the procedure to 1.3±1.6. The mode of nausea scoring during the procedure was 0. CONCLUSION: For most of the patients, the delivery of multiple fractions of image-guided high-dose-rate brachytherapy is well tolerated with maximum scores of mild-moderate pain and distress, and no significant nausea. This can be accomplished with applicator placement under general anesthesia and standard medical management.