Speed and quality goals in procedural skills learning: A randomized experiment.

Purpose: Compare time (speed) and product quality goals in a surgical procedural task.Methods: Secondary school students participating in a medical simulation-based training activity participated in a randomized experiment. Each participant completed eight repetitions of a blood vessel ligation. Once, between repetitions four and five, each participant received a randomly-assigned speed goal or quality goal. Outcomes included time and leak-free ligatures.Results: 80 students participated. The speed-goal group performed 18% faster on the final repetition than the quality-goal group, with adjusted fold change (FC) 0.82 (95% confidence interval [CI], 0.71, 0.94; p = 0.01). Conversely, the speed-goal group had fewer high-quality (leak-free) ligatures (odds ratio [OR] 0.36 [95% CI, 0.22, 0.58; p < 0.001]). For the quality-goal group, leaky ligatures took longer post-intervention than leak-free ligatures (FC 1.09 [95% CI, 1.02, 1.17; p = 0.01]), whereas average times for leaky and leak-free ligatures were similar for the speed-goal group (FC 0.97 [95% CI, 0.91, 1.04; p = 0.38]). For a given performance time, the speed-goal group had more leaks post-intervention than the quality-goal group (OR 3.35 [95% CI, 1.58, 7.10; p = 0.002]).Conclusions: Speed and quality goals promote different learning processes and outcomes among novices. Use of both speed and quality goals may facilitate more effective and efficient learning.

Mindfulness Meditation and Interprofessional Cardiopulmonary Resuscitation: A Mixed-Methods Pilot Study.

PROBLEM: Mindfulness training includes mindfulness meditation, which has been shown to improve both attention and self-awareness. Medical providers in the intensive care unit often deal with difficult situations with strong emotions, life-and-death decisions, and both interpersonal and interprofessional conflicts. The effect of mindfulness meditation training on healthcare providers during acute care tasks such as cardiopulmonary resuscitation remains unknown. Mindfulness meditation has the potential to improve provider well-being and reduce stress in individuals involved in resuscitation teams, which could then translate into better team communication and delivery of care under stress. A better understanding of this process could lead to more effective training approaches, improved team performance, and better patient outcomes. INTERVENTION: All participants were instructed to use a mindfulness meditation device (Muse™ headband) at home for 7 min twice a day or 14 min daily over the 4-week training period. This device uses brainwave sensors to monitor active versus relaxing brain activity and provides real-time feedback. CONTEXT: We conducted a single-group pretest-posttest convergent mixed-methods study. We enrolled 24 healthcare providers, comprising 4 interprofessional code teams, including physicians, nurses, respiratory therapists, and pharmacists. Each team participated in a simulation session immediately before and after the mindfulness training period. Each session consisted of two simulated cardiopulmonary arrest scenarios. Both quantitative and qualitative outcomes were assessed. OUTCOME: The median proportion of participants who used the device as prescribed was 85%. Emotional balance, as measured by the critical positivity ratio, improved significantly from pretraining to posttraining (p = .02). Qualitative findings showed that mindfulness meditation changed how participants responded to work-related stress, including stress in real-code situations. Participants described the value of time for self-guided practice with feedback from the device, which then helped them develop individual approaches to meditation not reliant on the technology. Time measures during the simulated scenarios improved, specifically, time to epinephrine in Scenario 1 (p = .03) and time to defibrillation in Scenario 2 (p = .02), improved. In addition, team performance, such as teamwork (p = .04), task management (p = .01), and overall performance (p = .04), improved significantly after mindfulness meditation training. Physiologic stress (skin conductance) improved but did not reach statistical significance (p = .11). LESSONS LEARNED: Mindfulness meditation practice may improve individual well-being and team function in high-stress clinical environments. Our results may represent a foundation to design larger confirmatory studies.

Course Design and Learning Outcomes of a Practical Online Ergonomics Course for Surgical Residents.

OBJECTIVE: Course content was designed and the learning outcomes assessed for an online ergonomics course for surgical residents. This course could fulfill an optional Surgical Council on Resident Education (SCORE) curriculum on Surgical Ergonomics. DESIGN: The online course included five 5-minute modules within the residents' learning system, each ending with an ungraded knowledge question, and a final 5-question multiple-choice retention quiz that allowed infinite attempts. The course was designed by ergonomists and surgeons at a quaternary academic hospital system. Participants were given two weeks to complete the modules. An electronic survey with questions assessing ergonomics knowledge and understanding on a 5-point Likert scale (strongly disagree - strongly agree) was distributed both before and after the course. The post-course survey included three additional questions to elicit feedback regarding learning experience and course design. Descriptive statistics and nonparametric paired comparisons were used to evaluate learning outcomes. SETTING: General surgery residency program at an academic medical center in the U.S. PARTICIPANTS: Twenty-two general surgery post graduate year 1 residents (PGY1s) were recruited to participate and completed the pre-course survey. Eight out of the 22 participants (36%) completed the online course and quiz; seven (32%) completed the course, quiz, and the post-course survey. RESULTS: Participants had high pre-course awareness of the importance of surgical ergonomics, benefits of work-related musculoskeletal disorder (WMSD) prevention, as well as awkward intraoperative postures being an WMSD risk factor. Participants' confidence increased significantly from pre- to post-course in ability to assess risk (p = 0.021), but not in ability or willingness to mitigate risky surgical postures. Participants who completed the quiz answered a median of 4 (IQR: [4, 5]) questions correctly. All participants indicated that they would recommend this course to other residents. CONCLUSIONS: These short practical ergonomics online learning modules increased surgical residents' confidence in assessing surgical WMSD risks.

Influencing Mindsets and Motivation in Procedural Skills Learning: Two Randomized Studies.

OBJECTIVES: An incremental (growth) theory of intelligence (mindset), compared with an entity (fixed) mindset, has been associated with improved motivation and performance. Interventions to induce incremental beliefs have improved performance on non-surgical motor tasks. We sought to evaluate the impact of 2 brief interventions to induce incremental beliefs in the context of learning a surgical task. DESIGN: Two randomized experiments. PARTICIPANTS AND SETTING: Secondary school students participating in medical simulation-based training activities at an academic medical center. INTERVENTIONS: We created 4 instructional messages intended to influence mindsets (two 60-second videos in Study 1, 2 fabricated "journal articles" in Study 2). In each study, one message emphasized that ability improves with practice (incremental); the other emphasized that ability is fixed (entity). After reviewing their randomly-assigned message, participants completed a laparoscopic cutting task as many times as they desired. Measurements included performance (product quality, self-reported task, and completion time), task persistence (repetitions), and entity beliefs. RESULTS: Two hundred and three students completed Study 1. Postevent entity beliefs (1 = lowest, 6 = highest) were similar between groups (incremental, 2.0vs entity, 2.0; p = 0.78). Contrary to hypothesis, the incremental video group demonstrated slower time (276vs 191 seconds; p < 0.0001), lower product quality (7.2vs 3.8mm deviation; p < 0.0001), and fewer task repetitions (1.4vs 1.8; p = 0.02). In Study 2, 113 participants provided outcomes related to mindset beliefs, but only 14 provided usable performance outcomes. Postevent entity beliefs were lower in the incremental article group (1.7vs 2.4; p < 0.0001). Task time (507vs 585 seconds; p = 0.40) and quality (7.1vs 7.5mm deviation; p = 0.85) were similar between groups. CONCLUSIONS: Brief motivational interventions can influence procedural performance and motivation. We need to better understand motivation and other affective influences on procedural skills learning. Mindset theory shows promise in this regard.

Measuring Mindsets and Achievement Goal Motivation: A Validation Study of Three Instruments.

PURPOSE: To evaluate the validity of scores from three instruments measuring achievement goal motivation-related constructs: a shortened version of Dweck's Implicit Theories of Intelligence Scale (ITIS-S), measuring incremental and entity mindsets; Elliot's Achievement Goal Questionnaire-Revised (AGQ-R), measuring mastery-approach, mastery-avoidance, performance-approach, and performance-avoidance achievement goals; and Midgley's Patterns of Adaptive Learning Scales (PALS), measuring mastery, performance-approach, and performance-avoidance achievement goals. METHOD: High school students participating in a medical simulation training activity in May 2017 completed each instrument. The authors evaluated internal structure using reliability and factor analysis and relations with other variables using the multitrait-multimethod matrix. RESULTS: There were 178 participants. Internal consistency reliability (Cronbach alpha) was > 0.70 for all subscores. Confirmatory factor analysis of ITIS-S scores demonstrated good model fit. Confirmatory factor analysis of AGQ-R scores demonstrated borderline fit; exploratory factor analysis suggested a three-domain model (approach, mastery-avoidance, performance-avoidance). Confirmatory factor analysis of PALS scores also demonstrated borderline fit; exploratory factor analyses suggested consistent distinction between mastery and performance goals but inconsistent distinction between performance-approach and performance-avoidance goals. Correlations among AGQ-R and PALS scores were large for mastery (r = 0.72) and moderate for performance (≥ 0.45) domains; correlations among incremental and mastery scores were moderate (≥ 0.34). Contrary to expectations, correlations between entity and performance scores were negligible. Correlations between conceptually unrelated domains were small or negligible. CONCLUSIONS: All instrument scores had good internal consistency and generally appropriate relations with other variables, but empirically determined domain structures did not consistently match theory.

Is Speed a Desirable Difficulty for Learning Procedures? An Initial Exploration of the Effects of Chronometric Pressure.

PURPOSE: To determine whether "chronometric pressure" (i.e., a verbal prompt to increase speed) could predictably alter medical learners' speed-accuracy trade-off during a simulated surgical task, thus modifying the challenge. METHOD: The authors performed a single-task, interrupted time-series study, enrolling surgery residents and medical students from two institutions in September and October 2015. Participants completed 10 repetitions of a simulated blood vessel ligation (placement of two ligatures 1 cm apart). Between repetitions 5 and 6, participants were verbally encouraged to complete the next repetition 20% faster than the previous one. Outcomes included time and accuracy (ligature tightness, placement distance). Data were analyzed using random-coefficients spline models. RESULTS: The authors analyzed data from 78 participants (25 medical students, 16 first-year residents, 37 senior [second-year or higher] residents). Overall, time decreased from the 1st (mean [standard deviation] 39.8 seconds [18.4]) to the 10th (29.6 [12.5]) repetition. The spline model showed a decrease in time between repetitions 5 and 6 of 8.6 seconds (95% confidence interval: -11.1, -6.1). The faster time corresponded with declines in ligature tightness (unadjusted difference -19%; decrease in odds 0.86 [0.76, 0.98]) and placement accuracy (unadjusted difference -5%; decrease in odds 0.86 [0.75, 0.99]). Significant differences in the speed-accuracy trade-off were seen by training level, with senior residents demonstrating the greatest decline in accuracy as speed increased. CONCLUSIONS: Chronometric pressure influenced the speed-accuracy trade-off and modified the challenge level in a simulated surgical task. It may help unmask correctable deficiencies or false plateaus in learners' skill development.

Personalized video feedback improves suturing skills of incoming general surgery trainees.

BACKGROUND: The American Board of Surgery encourages graduating medical students to prepare for surgical residency before day 1. We sought to determine the impact of personalized video feedback on an advance preparation task. METHODS: We conducted a nonrandomized study comparing video feedback versus no feedback. We sent incoming surgical interns a preparatory package 2 months before starting residency. Trainees video-recorded themselves performing a subcuticular wound closure, 3 times at 3-week intervals, and submitted these for appraisal. A staff surgeon provided personalized feedback on each video as a narrated voiceover. The voiced-over videos were then returned to trainees. We compared performance (time and completion rate) on suturing in a multistation assessment against residents from the previous year (no-feedback group). RESULTS: The feedback group had a higher completion rate for the suturing assessment than the no-feedback group (23/28 [82%] vs. 8/27 [30%], P < .0001). The feedback group also completed the suturing station at a faster rate than those without feedback (hazard ratio 4.9 [95% confidence interval (CI): 2.2,11.2), P < .0001). Global rating scores were significantly higher for the feedback group (mean difference [5-point scale] = 0.7 [95% CI: 0.3, 1.1]). However, Objective Structured Assessment of Technical Skills scores indicated no significant difference between groups (mean difference [5-point scale] = 0.3 [95% CI: 0.0, 0.6]). Within the feedback group, we found significant improvement from baseline to final performances (mean difference = 109 seconds [95% CI: 79, 140]). CONCLUSION: Personalized narrated feedback as part of a home-based advance preparation package for incoming residents is associated with higher performance on early objective assessments.

Validation of a Novel Inverted Peg Transfer Task: Advancing Beyond the Regular Peg Transfer Task for Surgical Simulation-Based Assessment.

OBJECTIVE: To evaluate the validity of a novel inverted peg transfer (iPT) task for assessing laparoscopic skills of novices and experts and compare iPT to the regular PT (rPT) task to ensure surgical trainee acquisition of an adequate advanced laparoscopic skills level for safe laparoscopic practice in the operating room. DESIGN: Prospective crossover study. SETTING: Multidisciplinary simulation center and motion analysis laboratory, Mayo Clinic. PARTICIPANTS: Novices were medical students and surgical interns without laparoscopic experience. Experts were surgeons with at least 3 years of experience in laparoscopic surgery. METHODS: This was the first exposure to iPT for both groups. Completion time and performance metrics were recorded. A scoring rubric was used to calculate a normalized performance score between 0 and 100. Wilcoxon rank sum and Mann-Whitney tests were performed with α = 0.05. Receiver-operating characteristic curves were graphed for the 2 task scores to assess the tasks' sensitivity and specificity in differentiating laparoscopic experience level. MAIN OUTCOME MEASURES: Performance measures of completion time, transferred triangles, dropped triangles (errors), and the overall performance score on both tasks between- and within-subjects (i.e., novices and experts). RESULTS: Thirty-six novices and eight experts participated. Both experts and novices had longer completion time and lower scores during iPT than rPT (p < 0.05). Within iPT, novice completion times were 144 seconds longer (p = 0.04), and performance score was 35 points lower than experts (p < 0.01). No differences between novices and experts were observed for completion time or performance scores (p > 0.05) for rPT. The iPT scores had a higher sensitivity and specificity than the rPT (area under the receiver-operating characteristic curve: iPT = 0.91; rPT = 0.69). CONCLUSIONS: iPT is a valid assessment of advanced laparoscopic skills for surgical trainees with higher specificity and sensitivity than rPT. As advanced minimally invasive surgery becomes more common, it is important that tasks such as iPT be included in surgical simulation curricula and training assessment.

Influence of Social Media on the Dissemination of a Traditional Surgical Research Article.

OBJECTIVE: Many institutions use social media to share research with the general public. However, the influence of social media on the dissemination of a surgical research article itself is unknown. Our objective was to determine whether a blog post highlighting the findings of a surgical research article would lead to increased dissemination of the article itself. DESIGN: We prospectively followed the online page views of an article that was published online in Surgery in May 2015 and published in print in August 2015. The authors subsequently released a blog post in October 2015 to promote the research. The number of article page views from the journal's website was obtained before and after the blog post, along with the page views from the blog post itself. Social media influence data were collected, including social activity in the form of mentions on social media sites, scholarly activity in online libraries, and scholarly commentary. RESULTS: The article's online activity peaked in the first month after online publication (475 page views). Online activity plateaued by 4 months after publication, with 118 monthly page views, and a blog post was subsequently published. The blog post was viewed by 1566 readers, and readers spent a mean of 2.5 minutes on the page. When compared to the projected trend, the page views increased by 33% in the month after the blog post. The blog post resulted in a 9% increase in the social media influence score and a 5% absolute increase in total article page views. CONCLUSIONS: Social media is an important tool for sharing surgical research. Our data suggest that social media can increase distribution of an article's message and also potentially increase dissemination of the article itself. We believe that authors should consider using social media to increase the dissemination of traditionally published articles.

Does scripting operative plans in advance lead to better preparedness of trainees? A pilot study.

BACKGROUND: We pondered if preoperative scripting might better prepare residents for the operating room (OR). METHODS: Interns rotating on a general surgeon's service were instructed to script randomized cases prior to entering the OR. Scripts contained up to 20 points highlighting patient information perceived important for surgical management. The attending was blinded to the scripting process and completed a feedback sheet (Likert scale) following each procedure. Feedback questions were categorized into "preparedness" (aware of patient specific details, etc.) and "performance" (provided better assistance, etc.). RESULTS: Eight surgical interns completed 55 scripted and 61 non-scripted cases. Total scores were higher in scripted cases (p = 0.02). Performance scores were higher for scripted cases (3.31 versus 3.13, p = 0.007), while preparedness did not differ (3.65 and 3.62, p = 0.51). CONCLUSIONS: This pilot study suggests scripting cases may be a useful preoperative planning tool to increase interns' operative and patient care performance but may not affect perceived preparedness.

At Home Preresidency Preparation for General Surgery Internship: A Pilot Study.

OBJECTIVE: To create a novel "at-home" preresidency preparatory adjunct for medical students entering surgical residency. DESIGN: Preparatory resources were mailed to match medical students before residency matriculation in 2015. This included "how-to" videos, low-cost models, and surgical instruments for 5 "stations" (arterial blood gas analysis, anatomy and imaging knowledge, knot tying ability, and suturing dexterity) of our program's biannual general surgery intern objective assessment activity (Surgical Olympics: total 13 stations, 10 points each). Scores from 2015 were compared with 2014 historical controls in a retrospective manner using the Student's t-test. SETTING: Academic, tertiary care referral center with a large general surgery training program. PARTICIPANTS: Postgraduate year 1 general surgery trainees (interns) from the years 2014 and 2015. RESULTS: Twenty-six interns participated in the 2015 assessment and were compared to thirty-two 2014 interns. Overall mean scores were low, but higher (19.7 vs. 15.4, p = 0.04) in the 2015 class. The largest increase was noted in the anatomy knowledge station (mean = 5.0 vs. 1.9, p < 0.01). Scores in stations assessing technical competence were similar to controls. The number of perfect scores among the 5 stations was higher (10 vs. 5) in the 2015 group. Mean scores from the other 8 stations, for which no resources were mailed, showed no difference (29.3 vs. 28.3, p = 0.75). CONCLUSIONS: Enacting a simple, home-based curriculum for medical students before surgical residency, improved performance on early knowledge assessments.

A Comparison of Objective Assessment Data for the United States and International Medical Graduates in a General Surgery Residency.

OBJECTIVE: To compare objective assessment scores between international medical graduates (IMGs) and United States Medical Graduates. Scores of residents who completed a preliminary year, who later matched into a categorical position, were compared to those who matched directly into a categorical position at the Mayo Clinic, Rochester. DESIGN: Postgraduate year (PGY) 1 to 5 residents participate in a biannual multistation, OSCE-style assessment event as part of our surgical training program. Assessment data were, retrospectively, reviewed and analyzed from 2008 to 2016 for PGY-1 and from 2013 to 2016 for PGY 2 to 5 categorical residents. SETTING: Academic medical center. PARTICIPANTS: Categorical PGY 1 to 5 General Surgery (GS) residents at Mayo Clinic Rochester, MN. RESULTS: A total of 86 GS residents were identified. Twenty-one residents (1 United States Medical Graduates [USMG] and 20 IMGs) completed a preliminary GS year, before matching into a categorical position and 68 (58 USMGs and 10 IMGs) residents, who matched directly into a categorical position, were compared. Mean scores (%) for the summer and winter multistation assessments were higher for PGY-1 trainees with a preliminary year than those without (summer: 59 vs. 37, p < 0.001; winter: 69 vs. 61, p = 0.05). Summer and winter PGY-2 scores followed the same pattern (74 vs. 64, p < 0.01; 85 vs. 71, p < 0.01). For the PGY 3 to 5 assessments, differences in scores between these groups were not observed. IMGs and USMGs scored equivalently on all assessments. Overall, junior residents showed greater score improvement between tests than their senior colleagues (mean score increase: PGY 1-2 = 18 vs. PGY 3-5 = 3, p < 0.001). CONCLUSIONS: Residents with a previous preliminary GS year at our institution scored higher on initial assessments compared to trainees with no prior GS training at our institution. The scoring advantage of an added preliminary year decreased as trainees progressed through residency.

Objective Assessment of General Surgery Residents Followed by Remediation.

OBJECTIVE: Surgical training programs often lack objective assessment strategies. Complicated scheduling characteristics frequently make it difficult for surgical residents to undergo formal assessment; actually having the time and opportunity to remediate poor performance is an even greater problem. We developed a novel methodology of assessment for residents and created an efficient remediation system using a combination of simulation, online learning, and self-assessment options. DESIGN: Postgraduate year (PGY) 2 to 5 general surgery (GS) residents were tested in a 5 station, objective structured clinical examination style event called the Surgical X-Games. Stations were 15 minutes in length and tested both surgical knowledge and technical skills. Stations were scored on a scale of 1 to 5 (1 = Fail, 2 = Mediocre, 3 = Pass, 4 = Good, and 5 = Stellar). Station scores ≤ 2 were considered subpar and required remediation to a score ≥ 4. Five remediation sessions allowed residents the opportunity to practice the stations with staff surgeons. Videos of each skill or test of knowledge with clear instructions on how to perform at a stellar level were offered. Trainees also had the opportunity to checkout take-home task trainers to practice specific skills. Residents requiring remediation were then tested again in-person or sent in self-made videos of their performance. SETTING: Academic medical center. PARTICIPANTS: PGY2, 3, 4, and 5 GS residents at Mayo Clinic in Rochester, MN. RESULTS: A total of, 35 residents participated in the Surgical X-Games in the spring of 2015. Among all, 31 (89%) had scores that were deemed subpar on at least 1 station. Overall, 18 (58%) residents attempted remediation. All 18 (100%) achieved a score ≥ 4 on the respective stations during a makeup attempt. Overall X-Games scores and those of PGY2s, 3s, and 4s were higher after remediation (p < 0.05). No PGY5s attempted remediation. CONCLUSIONS: Despite difficulties with training logistics and busy resident schedules, it is feasible to objectively assess most GS trainees and offer opportunities to remediate if performance is poor. Our multifaceted remediation methodology allowed 18 residents to achieve good or stellar performance on each station after deliberate practice. Enticing chief residents to participate in remediation efforts in the spring of their final year of training remains a work in progress.

Catch me if you can early simulation efforts affect fundamental surgical skill assessment scores.

BACKGROUND: We evaluated whether early exposure to a simulation curriculum enhances acquired surgical skills. METHODS: The "Surgical Olympics" evaluates interns on basic surgical skills and knowledge. After the Summer Olympics (July), interns were randomly divided into groups: "A" participated in a 7-week curriculum once a week, whereas "B" attended 7 weeks of lectures once a week. All interns then participated in the October Olympics. The 2 groups then switched. Finally, all interns completed a January Olympics. RESULTS: Scores were tabulated for the July, October, and January Olympics. Mean scores (A = 182 ± 42, Group B = 188 ± 34; P = .70) were similar in July; in October, group A (mean score = 237 ± 31) outperformed group B (mean score = 200 ± 32; P = .01). Mean total scores in January (A = 290 ± 34, B = 276 ± 34; P = .32) were similar. CONCLUSIONS: Early exposure to a surgical simulation curriculum enhances surgical intern performance in our Surgical Olympics. Subsequent simulation experience helps learners close this gap.

Annual Surgeon Volume and Patient Outcomes Following Laparoscopic Totally Extraperitoneal Inguinal Hernia Repairs.

PURPOSE: Data on laparoscopic totally extraperitoneal inguinal hernia repairs (TEP-IHRs) suggest that approximately 250 operations are needed to gain mastery, but the annual volume required to maintain high-quality outcomes is unknown. MATERIALS AND METHODS: A retrospective review was performed of every patient undergoing a TEP-IHR at the Mayo Clinic (Rochester, MN) from 1995 to 2011. Analysis focused on the annual volume of 21 staff surgeons and their specific patient outcomes broken up into three groups: Group 1 (G1) (n = 1 surgeon) performed >30 repairs per year; Group 2 (G2) (n = 3 surgeons), 15-30 repairs; and Group 3 (G3) (n = 17), <15 repairs. RESULTS: In total, 1601 patients underwent 2410 TEP-IHRs, with no significant patient demographic differences among groups. Greater annual surgeon volume (G1 > G2 > G3) was associated with improved outcomes as shown by the respective rates for intra- (1%, 2.6%, and 5.6%) and postoperative (13%, 27%, and 36%) complications, need for overnight stay (17%, 23%, and 29%), and hernia recurrence (1%, 4%, and 4.3%) (all P < .05). Surgeons with greater annual operative volumes were more likely to operate on patients with bilateral and recurrent hernias. Surgeons performing at least 15 repairs per year (G1 and G2) showed improvements in quality metrics over time. CONCLUSIONS: Annual operative volumes of >30 repairs per year are associated with the highest quality outcomes for TEP-IHR. Operative volumes of at least 15 repairs per year are associated with improvements in quality metrics over time. Mentorship and operative assistance of low-volume TEP-IHR surgeons may be useful in improving patient outcomes.

Do You See What I See? How We Use Video as an Adjunct to General Surgery Resident Education.

OBJECTIVE: Preparation of learners for surgical operations varies by institution, surgeon staff, and the trainees themselves. Often the operative environment is overwhelming for surgical trainees and the educational experience is substandard due to inadequate preparation. We sought to develop a simple, quick, and interactive tool that might assess each individual trainee's knowledge baseline before participating in minimally invasive surgery (MIS). DESIGN: A 4-minute video with 5 separate muted clips from laparoscopic procedures (splenectomy, gastric band removal, cholecystectomy, adrenalectomy, and inguinal hernia repair) was created and shown to medical students (MS), general surgery residents, and staff surgeons. Participants were asked to watch the video and commentate (provide facts) on the operation, body region, instruments, anatomy, pathology, and surgical technique. Comments were scored using a 100-point grading scale (100 facts agreed upon by 8 surgical staff and trainees) with points deducted for incorrect answers. All participants were video recorded. Performance was scored by 2 separate raters. SETTING: An academic medical center. PARTICIPANTS: MS = 10, interns (n = 8), postgraduate year 2 residents (PGY)2s (n = 11), PGY3s (n = 10), PGY4s (n = 9), PGY5s (n = 7), and general surgery staff surgeons (n = 5). RESULTS: Scores ranged from -5 to 76 total facts offered during the 4-minute video examination. MS scored the lowest (mean, range; 5, -5 to 8); interns were better (17, 4-29), followed by PGY2s (31, 21-34), PGY3s (33, 10-44), PGY4s (44, 19-47), PGY5s (48, 28-49), and staff (48, 17-76), p < 0.001. Rater concordance was 0.98-measured using a concordance correlation coefficient (95% CI: 0.96-0.99). Only 2 of 8 interns acknowledged the critical view during the laparoscopic cholecystectomy video clip vs 10 of 11 PGY2 residents (p < 0.003). Of 8 interns, 7 misperceived the spleen as the liver in the splenectomy clip vs 2 of 7 chief residents (p = 0.02). CONCLUSIONS: Not surprisingly, more experienced surgeons were able to relay a larger number of laparoscopic facts during a 4-minute video clip of 5 MIS operations than inexperienced trainees. However, even tenured staff surgeons relayed very few facts on procedures they were unfamiliar with. The potential differentiating capabilities of such a quick and inexpensive effort has pushed us to generate better online learning tools (operative modules) and hands-on simulation resources for our learners. We aim to repeat this and other studies to see if our learners are better prepared for video assessment and ultimately, MIS operations.