Case Difficulty, Postgraduate Year, and Resident Surgeon Stress: Effects on Operative Times.

OBJECTIVE: We aimed to evaluate resident operative times in relation to postgraduate year (PGY), case difficulty and resident stress while performing a single surgical procedure. DESIGN: We prospectively examined operative times for 268 laparoscopic cholecystectomies, and analyzed relationships between PGY, case difficulty, and resident surgeon stress utilizing electrodermal activity. Each case operative times were divided into 3 separate time periods. Case Start and End times were recorded, as well as the time between the start of the operation and the time until the cystic structures were divided (Division). Case difficulty was determined by multiple trained observers with a high inter-rater concordance. SETTING: University of Missouri, a tertiary academic medical institution. PARTICIPANTS: All categorical general surgery residents at our institution. RESULTS: For each operative time period examined during laparoscopic cholecystectomy, operative time increased, with each incremental increase in difficulty resulting in approximately 130% longer times. Minimal differences in operative times were seen between PGY levels, except during the easiest cases (Start-End times: 38.5 ± 10.4 minutes vs 34.2 ± 10.8 minutes vs 28.9 ± 10.9 minutes, p 0.002). Resident stress poorly correlated with operative times regardless of case difficulty (Pearson coefficient range 0.0-0.22). CONCLUSIONS: Operative times are longer with increasing case difficulty. PGY level and resident surgeon stress appear to have minimal to no correlation with operative times, regardless of case difficulty.

Surgical resident technical skill self-evaluation: increased precision with training progression.

BACKGROUND: Surgical resident ability to accurately evaluate one's own skill level is an important part of educational growth. We aimed to determine if differences exist between self and observer technical skill evaluation of surgical residents performing a single procedure. MATERIALS AND METHODS: We prospectively enrolled 14 categorical general surgery residents (six post-graduate year [PGY] 1-2, three PGY 3, and five PGY 4-5). Over a 6-month period, following each laparoscopic cholecystectomy, residents and seven faculty each completed the Objective Structured Assessment of Technical Skills (OSATS). Spearman's coefficient was calculated for three groups: senior (PGY 4-5), PGY3, and junior (PGY 1-2). Rho (ρ) values greater than 0.8 were considered well correlated. RESULTS: Of the 125 paired assessments (resident-faculty each evaluating the same case), 58 were completed for senior residents, 54 for PGY3 residents, and 13 for junior residents. Using the mean from all OSATS categories, trainee self-evaluations correlated well to faculty (senior ρ 0.97, PGY3 ρ 0.9, junior ρ 0.9). When specific OSATS categories were analyzed, junior residents exhibited poor correlation in categories of respect for tissue (ρ -0.5), instrument handling (ρ 0.71), operative flow (ρ 0.41), use of assistants (ρ 0.05), procedural knowledge (ρ 0.32), and overall comfort with the procedure (ρ 0.73). PGY3 residents lacked correlation in two OSATS categories, operative flow (ρ 0.7) and procedural knowledge (ρ 0.2). Senior resident self-evaluations exhibited strong correlations to observers in all areas. CONCLUSIONS: Surgical residents improve technical skill self-awareness with progressive training. Less-experienced trainees have a tendency to over-or-underestimate technical skill.

Objective Measurement of Clinical Competency in Surgical Education Using Electrodermal Activity.

OBJECTIVE: Within the realm of surgical education, there is a need for objective means to determine surgical competence and resident readiness to operate independently. We propose a novel, objective method of assessing resident confidence and clinical competence based on measurement of electrodermal activity (EDA) during live surgical procedures. We hypothesized that with progressive training, EDA responses to the stress of performing surgery would exhibit decline, elucidating an objective correlate of clinical competence. DESIGN: EDA was measured using galvanic skin response sensors worn by residents performing laparoscopic cholecystectomy on sequential live human patients over an 8-month period. Baseline, phasic (peak) and tonic EDA responses were measured as a fractional change from baseline. SETTING: University of Missouri, Columbia, Missouri, an academic tertiary care facility. PARTICIPANTS: Fourteen categorical general surgery residents and 5 faculty surgeons were voluntarily enrolled and participated through completion. RESULTS: Tonic fractional change (FCTONIC) was highest in PGY3 residents compared with postgraduate year (PGY) 1 and 2 residents (7.199 vs. 2.100, p = 0.004, 95% CI: 8.58-1.61 and PGY4 and 5 residents (7.199 vs. 2.079, p = 0.002, 95% CI: 8.38-0.29). Phasic fractional change in EDA (FCPHASIC) exhibited a progressive decline across resident training levels, with PGY1 and 2 residents having the highest response, and faculty displaying the lowest FCPHASIC responses. Statistical differences were seen between FCPHASIC faculty and PGY4 and 5 (3.596 vs. 6.180, p = 0.004, 95% CI: 0.80-4.36), PGY4 and 5, and PGY3 (6.180 vs. 15.998, p = 0.003, 95% CI: 3.33-16.3), as well as among all residents and faculty (13.057 vs. 3.596, p = 0.004, 95% CI: 15.8-3.1). CONCLUSION: Phasic EDA changes decrease with increasing clinical competence. For those participants with the lowest and highest levels of competence, tonic EDA changes are minimal. Tonic EDA changes follow an inverse-U shape with differing levels of clinical competence.