Can We Identify Predictors of Success in Contouring Education for Radiation Oncology Trainees? An Analysis of the Anatomy and Radiology Contouring Bootcamp.

PURPOSE: Although several different contouring instructional programs are available to radiation oncologists and trainees, very little is known about which methods and resources benefit learners most, and whether some learners may need alternate forms of instruction. This study aimed to determine the factors that were predictors of learners' success in anatomy, radiology, and contouring education. METHODS AND MATERIALS: Participants in the online and face-to-face Anatomy and Radiology Contouring (ARC) Bootcamp completed pre- and postintervention evaluations that assessed anatomy/radiology knowledge, contouring skills, self-confidence, and spatial ability. Baseline factors were assessed as predictors of outcomes across multiple educational domains. RESULTS: One hundred and eighty (face-to-face: n = 40; online: n = 140) participants enrolled in the ARC Bootcamp, and 57 (face-to-face: n = 30; online: n = 27) participants completed both evaluations. Of the participants enrolled, 37% were female, and most were radiation oncology residents (62%). In the anatomy/radiology knowledge testing, all quartiles (based on baseline performance) improved numerically; however, the largest improvements occurred in learners with the lowest baseline scores (P < .001). At the end of the Bootcamp, learners with lower-performing scores did not reach the level of learners with the highest baseline scores (Bonferroni-corrected P < .001). Regarding the contouring assessment, improvements were only evident for the participants with lower-performing baseline scores (P < .05). Spatial anatomy skills, as measured by the spatial anatomy task, were correlated to contouring ability. Overall, the greatest improvements were seen for learners in postgraduate year 1 to 3, those with no previous rotation experience in a given discipline, and those who attended from other programs (ie, medical physics residents and medical students). CONCLUSIONS: The ARC Bootcamp improved all levels of performers' anatomy and radiology knowledge but only lower-performers' contouring ability. The course alone does not help lower-performing learners reach the abilities of higher-performers. The ARC Bootcamp tends to be most beneficial for participants with less radiation oncology experience. Curriculum modifications can be made to help support ARC Bootcamp participants with lower performing scores.

Is Remote Learning as Effective as In-Person Learning for Contouring Education? A Prospective Comparison of Face-to-Face versus Online Delivery of the Anatomy and Radiology Contouring Bootcamp.

PURPOSE: The Anatomy and Radiology Contouring (ARC) Bootcamp was a face-to-face (F2F) intervention providing integrated education for radiation oncology (RO) residents and medical physicists. To increase access, we launched an online offering in 2019. We evaluated the effect of the online course on participants' knowledge acquisition, contouring skills, and self-confidence by comparing it with the F2F course. METHODS AND MATERIALS: Using modules, the online course offers content similar to that of the F2F comparator. Participants from the 2019 F2F and the 2019-2020 online course completed pre- and postevaluations assessing anatomy and radiology knowledge, contouring skills, self-confidence, and course satisfaction. RESULTS: There were 180 individuals enrolled (F2F: n = 40; online: n = 140); 57 participants (F2F: n = 30; online: n = 27) completed both evaluations. The online course had a wider geographic participation (19 countries) than F2F (4 countries). F2F had primarily RO resident participation (80%), compared with online (41%). Both cohorts demonstrated similar improvements in self-confidence pertaining to anatomy and radiology knowledge, contouring skills, and interpreting radiology images (all P < .001). Both the online (mean ± SD improvement: 6.6 ± 6.7 on a 40-point scale; P < .001) and F2F (3.7 ± 5.7; P = .002) groups showed anatomy and radiology knowledge improvement. Only the F2F group demonstrated improvement with the contouring assessment (F2F: 0.10 ± 0.17 on a 1-point Dice scale; P = .004; online: 0.07 ± 0.16; P = .076). Both cohorts perceived the course as a positive experience (F2F: 4.8 ± 0.4 on a 5-point scale; online: 4.5 ± 0.6), stated it would improve their professional practice (F2F: 4.6 ± 0.5; online: 4.2 ± 0.8), and said they would recommend it to others (F2F: 4.8 ± 0.4; online: 4.4 ± 0.6). CONCLUSIONS: The online ARC Bootcamp demonstrated improved self-confidence, knowledge scores, and high satisfaction levels among participants. The offering had lower completion rates but was more accessible to geographic regions, provided a flexible learning experience, and allowed for ongoing education during the COVID-19 pandemic.

Implementation and evaluation of an online anatomy, radiology and contouring bootcamp for radiation therapists.

BACKGROUND: As new treatments and technologies have been introduced in radiation oncology, the clinical roles of radiation therapists (RTs) have expanded. However, there are few formal learning opportunities for RTs. An online, anatomy, radiology and contouring bootcamp (ARC Bootcamp) originally designed for medical residents was identified as a prospective educational tool for RTs. The purpose of this study was to evaluate an RT edition of the ARC Bootcamp on knowledge, contouring, and confidence, as well as to identify areas for future modification. METHODS: Fifty licensed RTs were enrolled in an eight-week, multidisciplinary, online RT ARC Bootcamp. Contouring practice was available throughout the course using an online contouring platform. Outcomes were evaluated using a pre-course and post-course multiple-choice quiz (MCQ), contouring evaluation and qualitative self-efficacy and satisfaction survey. RESULTS: Of the fifty enrolled RTs, 30 completed the course, and 26 completed at least one of the post-tests. Nineteen contouring dice similarity coefficient (DSC) scores were available for paired pre- and post-course analysis. RTs demonstrated a statistically significant increase in mean DSC scoring pooled across all contouring structures (mean ± SD improvement: 0.09 ± 0.18 on a scale from 0 to 1, p=0.020). For individual contouring structures, 3/15 reached significance in contouring improvement. MCQ scores were available for 26 participants and increased after RT ARC Bootcamp participation with a mean ± SD pre-test score of 18.6 ± 4.2 (46.5%); on a 40-point scale vs. post-test score of 24.5 ± 4.3 (61.4%) (p < 0.001). RT confidence in contouring, anatomy knowledge and radiographic identification improved after course completion (p < 0.001). Feedback from RTs recommended more contouring instruction, less in-depth anatomy review and more time to complete the course. CONCLUSIONS: The RT ARC Bootcamp was an effective tool for improving anatomy and radiographic knowledge among RTs. The course demonstrated improvements in contouring and overall confidence. However, only approximately half of the enrolled RTs completed the course, limiting statistical power. Future modifications will aim to increase relevance to RTs and improve completion rates.

Development, Implementation, and Initial Participant Feedback of an Online Anatomy and Radiology Contouring Bootcamp in Radiation Oncology.

BACKGROUND: The Anatomy and Radiology Contouring (ARC) Bootcamp was a face-to-face (F2F) course designed to ensure radiation oncology residents were equipped with the knowledge and skillset to use radiation therapy techniques properly. The ARC Bootcamp was proven to be a useful educational intervention for improving learners' knowledge of anatomy and radiology and contouring ability. An online version of the course was created to increase accessibility to the ARC Bootcamp and provide a flexible, self-paced learning environment. This study aimed to describe the instructional design model used to create the online offering and report participants' motivation to enroll in the course and the online ARC Bootcamp's strengths and improvement areas. METHODS: The creation of the online course followed the analysis, design, development, implementation, and evaluation (ADDIE) framework. The course was structured in a linear progression of locked modules consisting of radiology and contouring lectures, anatomy labs, and integrated evaluations. RESULTS: The online course launched on the platform Teachable in November 2019, and by January 2021, 140 participants had enrolled in the course, with 27 participants completing all course components. The course had broad geographic participation with learners from 19 different countries. Of the participants enrolled, 34% were female, and most were radiation oncology residents (56%), followed by other programs (24%), such as medical physics residents or medical students. The primary motivator for participants to enroll was to improve their subject knowledge/skill (44%). The most common strength identified by participants was the course's quality (41%), and the most common improvement area was to incorporate more course content (41%). CONCLUSIONS: The creation of the online ARC Bootcamp using the ADDIE framework was feasible. The course is accessible to diverse geographic regions and programs and provides a flexible learning environment; however, the course completion rate was low. Participants' feedback regarding their experiences will inform future offerings of the online course.

Evaluation of a 3-Dimensional-Printed Head Simulation Technique for Teaching Flexible Nasopharyngoscopy to Radiation Oncology Residents.

PURPOSE: Simulation-based medical education is an effective tool for medical teaching, but simulation-based medical education deployment in radiation oncology (RO) is limited. Flexible nasopharyngoscopy (FNP), an essential skill for RO residents, requires practice that typically occurs on volunteer patients, introducing the potential for stress and discomfort. We sought to develop a high-fidelity simulator and intervention that provides RO residents the opportunity to develop FNP skills in a low-pressure environment. METHODS AND MATERIALS: Computed tomography images were used to create an anatomically accurate 3-dimensional-printed model of the head and neck region. An intervention incorporating didactic instruction, multimedia content, and FNP practice on the model was designed and administered to RO residents attending the Anatomy and Radiology Contouring Bootcamp. Participants completed pre- and postintervention evaluations of the training session and model fidelity, and self-assessments of FNP skill and confidence performing FNP. Participants were video recorded performing FNP pre- and postintervention. Videos were scored by a blinded observer on a predefined rubric. Changes in scores were evaluated using the Wilcoxon signed-rank test. RESULTS: Twenty-four participants from 17 institutions and 4 countries completed the intervention, 50% were women, and most were senior residents. Postintervention, FNP confidence and FNP performance improved significantly (mean ± standard deviation on a 10-point scale: 1.8 ± 1.8, P < .001; 2.2 ± 2.0, P < .001, respectively). Participants felt the model was helpful (mean ± standard deviation on a 5-point scale: 4.2 ± 0.6), anatomically correct (4.1 ± 0.9), and aided in spatial comprehension (4.3 ± 0.8). Overall satisfaction for the intervention was high (4.3 ± 0.8). Participants strongly agreed the intervention should be integrated into RO training programs (4.3 ± 0.8). CONCLUSIONS: A 3-dimensional-printed model and associated intervention were effective at improving FNP performance and the teaching method was rated highly by participants. RO residents may benefit from broader dissemination of this technique to improve trainee performance.