Routine Assessment of Surgical Resident Wellness-Related Concerns During Biannual Review.

BACKGROUND: Surgery residency confers stress burdens on trainees. To monitor and mitigate areas of concerns, our education team implemented a 6-item biannual survey querying potential stressors. We reviewed the initial 5-year experience to assess for trends and improve efforts in maintaining resident well-being. STUDY DESIGN: Surgery residents from all postgraduate years were asked to complete a survey of common concerns, prioritizing them in order of importance. The items to be ranked were: needs of family/friends; nonwork time for study; financial concerns; personal well-being needs; concerns for clinical performance; and administrative demands. Changes in ranking were trended across 10 review periods. Results were analyzed using a Kruskal-Wallis test. RESULTS: A completion rate of 96.5% was rendered from the completion of 333 surveys. Rankings changed significantly for nonwork time for study (p = 0.04), personal well-being needs (p = 0.03) and concerns for clinical performance (p = 0.004). Nonwork time for study and concerns on clinical performance were consistently ranked as top two stressors over study period, except for spring 2020. Personal well-being needs ranked highest in spring 2020; 41% of residents placed this as top 2 rankings. A decrease in concerns for clinical performance was observed in spring 2020, corresponding to the coronavirus disease 2019 (COVID-19) pandemic emergency declaration. CONCLUSIONS: Surgery residents generally prioritized time for study and concerns for assessment of clinical performance as highest areas of concern. With the occurrence of a pandemic, increased prioritization of personal well-being was observed. Used routinely with biannual reviews, the survey was able to identify plausible changes in resident concerns. Determination of levels of actual stress and actual association with the pandemic requires additional study.

Impact of Time Delay on Simulated Operative Video Telementoring: A Pilot Study.

INTRODUCTION: As NASA and private spaceflight companies push forward with plans for missions to cis-lunar and interplanetary space, the risk of surgical emergency increases. At latencies above 500 ms, telesurgery is not likely to be successful, so near-real-time telementoring is a more viable option. We examined the effect of a 700-ms time delay on the performance of first year surgical residents on a simulated task requiring significant feedback from a mentor in a pilot study.METHODS: A simulated surgical task requiring precision and accuracy with built-in error detection was used. Each resident underwent two trials, one with a mentor in the same room and one with the mentor using a teleconference with time delay. Outcomes measured included time to complete task, game pieces successfully removed, number of errors, and scores on the NASA Task Load Index by both mentor and operator. Data were analyzed using paired t-tests.RESULTS: The time delay group removed significantly fewer pieces successfully than the real time group (3.0 vs. 1.6, P = 0.02). There was no difference in the NASA Task Load Index (TLX) scores for the operators between the two groups, but the mentor reported significantly higher scores on Mental Demand (5.6 vs. 12.0, P = 0.04) and Effort (6.2 vs. 11.8, P = 0.05) during the time-delayed trials.DISCUSSION: A 750-ms time delay significantly degraded performance on the task. Though operator TLX scores were not affected, mentor TLX scores indicated significantly increased mental load. Telementoring is viable, but more onerous than in-person mentoring.Kamine TH, Smith BW, Fernandez GL. Impact of time delay on simulated operative video telementoring: a pilot study. Aerosp Med Hum Perform. 2022; 93(2):123-127.

Perioperative Considerations During Emergency General Surgery in the Era of COVID-19: A U.S. Experience.

The novel coronavirus SARS-CoV-2 (COVID-19) strain has caused a pandemic that affects everyday clinical practice. Care of patients with acute surgical problems is adjusted to minimize exposing health care providers to this highly contagious virus. Our goal is to describe a specific and reproducible perioperative protocol aiming to keep health care providers safe and, simultaneously, not compromise standard of care for surgical patients.

Boot Camp in a Box: Initial Experience with Pretraining Skills Preparation for New Interns.

PURPOSE: In order to increase selected skills at onset of training, we provided newly matched PGY-1 trainees with materials and instructions to practice these skills, as well as the opportunity to share video-recorded performance and receive feedback based on these videos. METHODS: Knot tying and suturing kits, instruments and supplies, and video instructions for task performance were sent to newly matched trainees to our program (n = 10), with instructions to practice 4 tasks (1- and 2-handed knot tying, interrupted and running suturing) until self-assessed comfort with each task was achieved or the 8-week time point before start of training was reached. Each trainee returned a video of each task, which was graded by blinded reviewers for time and errors using an itemized evaluation instrument (12 items for suturing and five items for knot-tying). Feedback (annotations of submitted videos) was provided after grading was completed. Task performance was repeated and reassessed at the time of new intern "Boot Camp" and again 8 weeks after start of training. Performance scores were compared for the 3 time points and with scores of PGY 2-4 residents using ANOVA with posthoc tests. RESULTS: Compliance with instruction for practice and return of video recorded tasks in the months before start of PGY-1 training was high, with only 1 of 10 failing to return knot-tying videos. A significant pattern of performance change (p < 0.05) was observed for all tasks with an initial decrease between the pre-employment practice period and the Boot Camp test followed by an increase to the highest level of performance 2 months after start of training. At that point, scores were not significantly different than those of more senior residents. CONCLUSIONS: A high level of compliance was achieved with requested skills practice and video documentation of performance. We attribute the consistently lower scores on the tasks during Boot Camp tests to higher stress test environment which was apt to be less favorable than having the trainee choose to submit their best possible preresidency video recording of performance in a low-stress situation. Subsequent achievement of significantly higher performance even compared to more senior residents may have been helped by incentivized pretraining practice.

Simulation center best practices: A review of ACS-accredited educational institutes' best practices, 2011 to present.

BACKGROUND: Since the inception of American College of Surgeons' Accredited Educational Institute (ACS-AEI) Consortium, accreditation reviews have identified best practices in simulation-based education and center operations. A review of best practices would support the communication of these best practices, offer recognition of exemplar institutes, and facilitate discussion and sharing of resources amongst AEIs. METHODS: We examined 5 years of ACS AEI accreditation best practices identified across all standards and criteria. The goal was to identify resources that could be shared among AEIs and recognize AEI champions that have promoted best practices in surgical simulation. RESULTS: From 149 site reviews (July 2011-June 2016), reviewers identified 197 best practices across 83 AEIs (52.9% of all sites reviewed received a best practice). A total of 52.5% of best practices were associated with curriculum development, delivery of effective education and assessment, and 25 available resources were identified that could be shared among AEIs. The majority of best practices (n = 117, 59.3%) were identified at 24 AEIs, with the highest number of best practices identified at Banner Simulation Center and New Orleans Learning Center (10 each over 2 reviews). Twenty-two other institutes presented 97 best practices, with between 3 to 8 per institute (mean = 4.4, standard deviation = 1.6). Specific best practices, criteria, and AEI champions are highlighted. CONCLUSION: Review of AEI accreditation best practices identified common themes for surgical simulation programs and identified tools that could be shared to advance all programs and champion AEIs that have promoted best practices in surgical simulation.

Single incision laparoscopic proficiency correlates with residency training level.

BACKGROUND: With experience, certain psychomotor skills should translate from standard laparoscopy to single-incision laparoscopy (SIL). We proposed to compare all surgical postgraduate year (PGY) levels and determine if experience translated to improved SIL skills. METHODS: Surgical residents of all PGY levels (1-5) at our institution were included. Baseline surveys were obtained to determine resident level of exposure to both SIL and standard laparoscopic cases. Participants performed the following tasks: running of the bowel, endoloop placement, extracorporeal suture tying, and intracorporeal suture tying. Tasks were performed on a commercially provided simulated inanimate organ model. Participants were given 5 min to complete each task. Data were collected and analyzed by an impartial-certified Fundamentals of Laparoscopic Surgery proctor. RESULTS: A total of 31 residents participated in the study. Overall, there was minimal SIL exposure among all residents. As expected, PGY level correlated with increased ability to complete assigned tasks within the allotted time. There was a statistically significant difference in the number of individuals able to complete a task based on PGY level for all given tasks (P = 0.005). With increased difficulty, the percentage of higher level residents able to complete the task decreased (100% PGY5 completed running of bowel versus 0% intracorporeal knot tying). CONCLUSIONS: Certain psychomotor skills did appear to translate to SIL skills. However, further dedicated SIL training may help to better develop certain laparoscopic skills devoted to SIL.

Putting the MeaT into TeaM Training: Development, Delivery, and Evaluation of a Surgical Team-Training Workshop.

BACKGROUND: Despite importance to patient care, team training is infrequently used in surgical education. To address this, a workshop was developed by the Association for Surgical Education Simulation Committee to teach team training using high-fidelity patient simulators and the American College of Surgeons-Association of Program Directors in Surgery team-training curriculum. METHODS: Workshops were conducted at 3 national meetings. Participants completed preworkshop and postworkshop questionnaires to define experience, confidence in using simulation, intention to implement, as well as workshop content quality. The course consisted of (A) a didactic review of Preparation, Implementation, and Debriefing and (B) facilitated small group simulation sessions followed by debriefings. RESULTS: Of 78 participants, 51 completed the workshops. Overall, 65% indicated that residents at their institutions used patient simulation, but only 33% used the American College of Surgeons-the Association of Program Directors in Surgery team-training modules. The workshop increased confidence to implement simulation team training (3.4 ± 1.3 vs 4.5 ± 0.9). Quality and importance were rated highly (5.4 ± 00.6, highest score = 6). CONCLUSIONS: Preparation for simulation-based team training is possible in this workshop setting, although the effect on actual implementation remains to be determined.

Boot cAMP: educational outcomes after 4 successive years of preparatory simulation-based training at onset of internship.

PURPOSE: Preparatory training for new trainees beginning residency has been used by a variety of programs across the country. To improve the clinical orientation process for our new postgraduate year (PGY)-1 residents, we developed an intensive preparatory training curriculum inclusive of cognitive and procedural skills, training activities considered essential for early PGY-1 clinical management. We define our surgical PGY-1 Boot Camp as preparatory simulation-based training implemented at the onset of internship for introduction of skills necessary for basic surgical patient problem assessment and management. This orientation process includes exposure to simulated patient care encounters and technical skills training essential to new resident education. We report educational results of 4 successive years of Boot Camp training. Results were analyzed to determine if performance evidenced at onset of training was predictive of later educational outcomes. METHODS: Learners were PGY-1 residents, in both categorical and preliminary positions, at our medium-sized surgical residency program. Over a 4-year period, from July 2007 to July 2010, all 30 PGY-1 residents starting surgical residency at our institution underwent specific preparatory didactic and skills training over a 9-week period. This consisted of mandatory weekly 1-hour and 3-hour sessions in the Simulation Center, representing a 4-fold increase in time in simulation laboratory training compared with the remainder of the year. Training occurred in 8 procedural skills areas (instrument use, knot-tying, suturing, laparoscopic skills, airway management, cardiopulmonary resuscitation, central venous catheter, and chest tube insertion) and in simulated patient care (shock, surgical emergencies, and respiratory, cardiac, and trauma management) using a variety of high- and low-tech simulation platforms. Faculty and senior residents served as instructors. All educational activities were structured to include preparatory materials, pretraining briefing sessions, and immediate in-training or post-training review and debriefing. Baseline cognitive skills were assessed with written tests on basic patient management. Post-Boot Camp tests similarly evaluated cognitive skills. Technical skills were assessed using a variety of task-specific instruments, and expressed as a mean score for all activities for each resident. All measurements were expressed as percent (%) best possible score. Cognitive and technical performance in Boot Camp was compared with subsequent clinical and core curriculum evaluations including weekly quiz scores, annual American Board of Surgery In-Training Examination (ABSITE) scores, program in-training evaluations (New Innovations, Uniontown, Ohio), and operative assessment instrument scores (OP-Rate, Baystate Medical Center, Springfield, Massachusetts) for the remainder of the PGY-1 year. RESULTS: Performance data were available for 30 PGY-1 residents over 4 years. Baseline cognitive skills were lower for the first year of Boot Camp as compared with subsequent years (71 ± 13, 83 ± 9, 84 ± 11, and 86 ± 6, respectively; p = 0.028, analysis of variance; ANOVA). Performance improved between pretests and final testing (81 ± 11 vs 89 ± 7; p < 0.001 paired t test). There was statistically significant correlation between Boot Camp final cognitive test results and American Board of Surgery In-Training Examination scores (p = 0.01; n = 22), but not quite significant for weekly curriculum quiz scores (p = 0.055; n = 22) and New Innovations cognitive assessments (p = 0.09; n = 25). Statistically significant correlation was also noted between Boot Camp mean overall skills and New Innovations technical skills assessments (p = 0.002; n = 25) and OP-Rate assessments (p = 0.01; n = 12). CONCLUSIONS: Individual simulation-based Boot Camp performance scores for cognitive and procedural skills assessments in PGY-1 residents correlate with subjective and objective clinical performance evaluations. This concurrent correlation with multiple traditional evaluation methods used to express competency in our residency program supports the use of Boot Camp performance measures as needs assessment tools as well as adjuncts to cumulative resident evaluation data.

Implementation of full patient simulation training in surgical residency.

PURPOSE: Simulated patient care has gained acceptance as a medical education tool but is underused in surgical training. To improve resident clinical management in critical situations relevant to the surgical patient, high-fidelity full patient simulation training was instituted at Baystate Medical Center in 2005 and developed during successive years. We define surgical patient simulation as clinical management performed in a high fidelity environment using a manikin simulator. This technique is intended to be specifically modeled experiential learning related to the knowledge, skills, and behaviors that are fundamental to patient care. We report 3 academic years' use of a patient simulation curriculum. METHODS: Learners were PGY 1-3 residents; 26 simulated patient care experiences were developed based on (1) designation as a critical management problem that would otherwise be difficult to practice, (2) ability to represent the specific problem in simulation, (3) relevance to the American Board of Surgery (ABS) certifying examination, and/or (4) relevance to institutional quality or morbidity and mortality reports. Although training started in 2005, data are drawn from the period of systematic and mandatory training spanning from July 2006 to June 2009. Training occurred during 1-hour sessions using a computer-driven manikin simulator (METI, Sarasota, Florida). Educational content was provided either before or during presimulation briefing sessions. Scenario areas included shock states, trauma and critical care case management, preoperative processes, and postoperative conditions and complications. All sessions were followed by facilitated debriefing. Likert scale-based multi-item assessments of core competency in medical knowledge, patient care, diagnosis, management, communication, and professionalism were used to generate a performance score for each resident for each simulation (percentage of best possible score). Performance was compared across PGYs by repeated-measures analysis of variance and Wilcoxon rank sum tests. RESULTS: Residents participated in 4.5 ± 1.4 sessions per academic year. Compliance with scheduled training was 88%, 90%, and 99% over successive years. Performance data were available for 39 PGY1, 2, and 3 residents. Ten individual residents could be followed between PGY1 and PGY2. For these individuals, improvement in mean performance was detected for the PGY2 (81% ± 5% vs 86% ± 4%; p < 0.01). Performance improvement was also detected for 4 individual residents who could be followed during all 3 years (82% ± 4%, 86% ± 2%, and 91% ± 1%, respectively, p < 0.005). Internal consistency for multi-item assessments was high (Cronbach's alpha = 0.80). Of note, 8 of 39 residents had performance scores >2 standard deviations below mean for the PGY level and 5 of these had deficiencies in clinical performance noted by other evaluation methods. CONCLUSIONS: Patient simulation training was implemented successfully with good compliance in this medium-sized surgical residency training program, but clear challenges were encountered with issues related to the number and range of experiences available per resident, competition with other educational activities, and fidelity and realism. Initial experience suggests that the associated assessment methods can detect predictable improvements in patient management skills across successive residency years, as well as potentially deficient management. Additional work is required to determine the educational effect of this training on resident clinical competency.