Mortality and Severe Complications Among Newly Graduated Surgeons in the United States.

OBJECTIVE: To evaluate severe complications and mortality over years of independent practice among general surgeons. BACKGROUND: Despite concerns that newly graduated general surgeons may be unprepared for independent practice, it is unclear whether patient outcomes differ between early and later career surgeons. METHODS: We used Medicare claims for patients discharged between July 1, 2007 and December 31, 2019 to evaluate 30-day severe complications and mortality for 26 operations defined as core procedures by the American Board of Surgery. Generalized additive mixed models were used to assess the association between surgeon years in practice and 30-day outcomes while adjusting for differences in patient, hospital, and surgeon characteristics. RESULTS: The cohort included 1,329,358 operations performed by 14,399 surgeons. In generalized mixed models, the relative risk (RR) of mortality was higher among surgeons in their first year of practice compared with surgeons in their 15th year of practice [5.5% (95% CI: 4.1%-7.3%) vs 4.7% (95% CI: 3.5%-6.3%), RR: 1.17 (95% CI: 1.11-1.22)]. Similarly, the RR of severe complications was higher among surgeons in their first year of practice compared with surgeons in their 15th year of practice [7.5% (95% CI: 6.6%-8.5%) versus 6.9% (95% CI: 6.1%-7.9%), RR: 1.08 (95% CI: 1.03-1.14)]. When stratified by individual operation, 21 operations had a significantly higher RR of mortality and all 26 operations had a significantly higher RR of severe complications in the first compared with the 15th year of practice. CONCLUSIONS: Among general surgeons performing common operations, rates of mortality and severe complications were higher among newly graduated surgeons compared with later career surgeons.

Is Initial Board Certification Associated With Better Early Career Surgical Outcomes?

OBJECTIVE: To determine if initial American Board of Surgery certification in general surgery is associated with better risk-adjusted patient outcomes for Medicare patients undergoing partial colectomy by an early career surgeon. BACKGROUND: Board certification is a voluntary commitment to professionalism, continued learning, and delivery of high-quality patient care. Not all surgeons are certified, and some have questioned the value of certification due to limited evidence that board-certified surgeons have better patient outcomes. In response, we examined the outcomes of certified versus noncertified early career general surgeons. METHODS: We identified Medicare patients who underwent a partial colectomy between 2008 and 2016 and were operated on by a non-subspecialty trained surgeon within their first 5 years of practice. Surgeon certification status was determined using the American Board of Surgery data. Generalized linear mixed models were used to control for patient-, procedure-, and hospital-level effects. Primary outcomes were the occurrence of severe complications and occurrence of death within 30 days. RESULTS: We identified 69,325 patients who underwent a partial colectomy by an early career general surgeon. The adjusted rate of severe complications after partial colectomy by certified (n = 4239) versus noncertified (n = 191) early-career general surgeons was 9.1% versus 10.7% (odds ratio 0.83, P = 0.03). Adjusted mortality rate for certified versus noncertified early-career general surgeons was 4.9% versus 6.1% (odds ratio 0.79, P = 0.01). CONCLUSION: Patients undergoing partial colectomy by an early career general surgeon have decreased odds of severe complications and death when their surgeon is board certified.

Association of Surgical Resident Competency Ratings With Patient Outcomes.

PURPOSE: Accurate assessment of clinical performance is essential to ensure graduating residents are competent for unsupervised practice. The Accreditation Council for Graduate Medical Education milestones framework is the most widely used competency-based framework in the United States. However, the relationship between residents' milestones competency ratings and their subsequent early career clinical outcomes has not been established. It is important to examine the association between milestones competency ratings of U.S. general surgical residents and those surgeons' patient outcomes in early career practice. METHOD: A retrospective, cross-sectional study was conducted using a sample of national Medicare claims for 23 common, high-risk inpatient general surgical procedures performed between July 1, 2015, and November 30, 2018 (n = 12,400 cases) by nonfellowship-trained U.S. general surgeons. Milestone ratings collected during those surgeons' last year of residency (n = 701 residents) were compared with their risk-adjusted rates of mortality, any complication, or severe complication within 30 days of index operation during their first 2 years of practice. RESULTS: There were no associations between mean milestone competency ratings of graduating general surgery residents and their subsequent early career patient outcomes, including any complication (23% proficient vs 22% not yet proficient; relative risk [RR], 0.97, [95% CI, 0.88-1.08]); severe complication (9% vs 9%, respectively; RR, 1.01, [95% CI, 0.86-1.19]); and mortality (5% vs 5%; RR, 1.07, [95% CI, 0.88-1.30]). Secondary analyses yielded no associations between patient outcomes and milestone ratings specific to technical performance, or between patient outcomes and composites of operative performance, professionalism, or leadership milestones ratings ( P ranged .32-.97). CONCLUSIONS: Milestone ratings of graduating general surgery residents were not associated with the patient outcomes of those surgeons when they performed common, higher-risk procedures in a Medicare population. Efforts to improve how milestones ratings are generated might strengthen their association with early career outcomes.

Evaluating Educational Outcomes Using Patient Outcomes of New Surgeons Performing Partial Colectomy Compared to Cholecystectomy.

PURPOSE: Despite ongoing efforts to improve surgical education, surgical residents face gaps in their training. However, it is unknown if differences in the training of surgeons are reflected in the patient outcomes of those surgeons once they enter practice. This study aimed to compare the patient outcomes among new surgeons performing partial colectomy-a common procedure for which training is limited-and cholecystectomy-a common procedure for which training is robust. METHOD: The authors retrospectively analyzed all adult Medicare claims data for patients undergoing inpatient partial colectomy and inpatient cholecystectomy between 2007 and 2018. Generalized additive mixed models were used to investigate the associations between surgeon years in practice and risk-adjusted rates of 30-day serious complications and death for patients undergoing partial colectomy and cholecystectomy. RESULTS: A total of 14,449 surgeons at 4,011 hospitals performed 340,114 partial colectomy and 355,923 cholecystectomy inpatient operations during the study period. Patients undergoing a partial colectomy by a surgeon in their 1st vs 15th year of practice had higher rates of serious complications (5.22% [95% CI, 4.85%-5.60%] vs 4.37% [95% CI, 4.22%-4.52%]; P < .01) and death (3.05% [95% CI, 2.92%-3.17%] vs 2.83% [95% CI, 2.75%-2.91%]; P < .01). Patients undergoing a cholecystectomy by a surgeon in their 1st vs 15th year of practice had similar rates of 30-day serious complications (4.11% vs 3.89%; P = .11) and death (1.71% vs 1.70%; P = .93). CONCLUSIONS: Patients undergoing partial colectomy faced a higher risk of serious complications and death when the operation was performed by a new surgeon compared to an experienced surgeon. Conversely, patient outcomes following cholecystectomy were similar for new and experienced surgeons. More attention to partial colectomy during residency training may benefit patients.

Using a Mobile Application for Evaluation of Procedural Learning in Neurosurgery.

BACKGROUND: Feedback is a major component of any educational process. Competency assessment and feedback are essential tools for teaching surgical skills. Most current systems of assessment within neurosurgical residency programs use evaluations aggregated over a period of time, which lead to significant bias, rather than case-specific feedback. We describe the use of a mobile device application called SIMPL (System for Improving and Measuring Procedural Learning) to allow for immediate surgical competency assessment and improve the quality of feedback after every operative experience. METHODS: We retrospectively assessed our use of this program and neurosurgery residents' response to the program. Institutional review board approval was not required, and no patients were involved in the study. This application has already been implemented within general surgery programs with promising results. We document its implementation in a neurosurgery program and the output of the program for residents and program directors. RESULTS: This is the first documentation of such an application within a neurosurgical residency program. In a 6-month period at a single institution, around 300 evaluations were completed by residents and faculty, with a >80% response rate within both groups. Furthermore, these evaluations were companied by a 60% dictation rate from faculty, which contains verbal feedback that is available to residents for playback at any time. CONCLUSIONS: The telephone-based SIMPL application allows for assessment of surgical competency and remains quick and easy to use, giving it the potential to improve individual neurosurgical training experiences across the United States.

Concordance Between Expert and Nonexpert Ratings of Condensed Video-Based Trainee Operative Performance Assessment.

OBJECTIVE: We examined the impact of video editing and rater expertise in surgical resident evaluation on operative performance ratings of surgical trainees. DESIGN: Randomized independent review of intraoperative video. SETTING: Operative video was captured at a single, tertiary hospital in Boston, MA. PARTICIPANTS: Six common general surgery procedures were video recorded of 6 attending-trainee dyads. Full-length and condensed versions (n = 12 videos) were then reviewed by 13 independent surgeon raters (5 evaluation experts, 8 nonexperts) using a crossed design. Trainee performance was rated using the Operative Performance Rating Scale, System for Improving and Measuring Procedural Learning (SIMPL) Performance scale, the Zwisch scale, and ten Cate scale. These ratings were then standardized before being compared using Bayesian mixed models with raters and videos treated as random effects. RESULTS: Editing had no effect on the Operative Performance Rating Scale Overall Performance (-0.10, p = 0.30), SIMPL Performance (0.13, p = 0.71), Zwisch (-0.12, p = 0.27), and ten Cate scale (-0.13, p = 0.29). Additionally, rater expertise (evaluation expert vs. nonexpert) had no effect on the same scales (-0.16 (p = 0.32), 0.18 (p = 0.74), 0.25 (p = 0.81), and 0.25 (p = 0.17). CONCLUSIONS: There is little difference in operative performance assessment scores when raters use condensed videos or when raters who are not experts in surgical resident evaluation are used. Future validation studies of operative performance assessment scales may be facilitated by using nonexpert surgeon raters viewing videos condensed using a standardized protocol.

Identifying and Addressing High Priority Issues in General Surgery Training and Education.

BACKGROUND: Complex problems are often easier to address when multiple entities collaborate. The Procedural Learning and Safety Collaborative (PLSC) was established to address complex problems in general surgery residency training by connectively engaging multiple residency programs in addressing progressive research questions. STUDY DESIGN: Recently, PLSC members held a national symposium which included leadership from several leading surgical societies to come to a consensus on what are the most critical issues in general surgery education. RESULTS: This paper describes the process used and the end result of this process. This paper describes the process used and the end result of this process.