Differences in coaching in single- versus dual-console robotic cases: a mixed-methods study.

BACKGROUND: A growing importance has been placed on development of trainee robotic surgical skills through simulation curricula and intraoperative experience. However, few studies have examined how console case type impacts learning outcomes. We sought to evaluate how intraoperative coaching and resident autonomy differ based on the use of a single- versus dual-console robot. METHODS: Robotic single- and dual-console cases from February to September 2023 at a single institution were included. Faculty and trainees wore microphones to capture audio during the case. Pre/post surveys were administered, which included metrics on faculty coaching based on the Wisconsin Surgical Coaching Rubric (WiSCoR) and on trainee technical performance based on the Global Evaluative Assessment of Robotic Skills (GEARS). Statistical analysis of survey data was performed using SPSS. Audio from cases was coded by 2 researchers with a deductive approach using WiSCoR as a framework. RESULTS: Data were collected for 7 (38.9%) single and 11 (61.1%) dual-console cases across 9 case types from 4 surgical specialties. Chi-square analysis demonstrated no significant difference in percentage of case trainee spent in the operating surgeon role based on trainee level or console case type. Independent t-tests showed no significant difference in trainee autonomy, trainee performance, or faculty coaching scores based on console case type. Trainees rated faculty highest in WiSCoR Domains 1 (sharing responsibility) and 3 (providing constructive feedback). Qualitative analysis showed that for single-console cases, Domain 4 (goal setting) was most represented (34.0% of comments), while for dual-console cases, Domain 1 was most represented (37.0% of comments). CONCLUSIONS: Qualitative analysis highlights that despite similar survey-based faculty ratings across domains, coaching on self-reflection (Domain 2) is infrequently done, highlighting an opportunity for improvement in this area of coaching during robotic surgery.

Looking Beyond the Numbers: A Comparison of Operative Self-Efficacy, Supervision, and Case Volume in General Surgery Residency.

Background A national survey of general surgery residents revealed significant self-assessed deficits in preparation for independent practice, with only 7.7% of graduating postgraduate year 5 residents (n=1145) reporting self-efficacy for all 10 commonly performed operations surveyed. Objective We sought to understand why this phenomenon occurs. We hypothesized that self-efficacy would be positively correlated with both operative independence and case volume. Methods We compared 3 independent datasets: case information for the same 10 previously surveyed operations for residents graduating in 2020 (dataset 1), operative independence data obtained through the SIMPL OR app, an operative self-assessment tool (dataset 2), and case volume data obtained through the Accreditation Council for Graduate Medical Education National Data Report (dataset 3). Operations were categorized into high, middle (mid), and low self-efficacy tiers; analysis of variance was used to compare operative independence and case volume per tier. Results There were significant differences in self-efficacy between high (87.7%), mid (68.3%), and low (25.4%) tiers (P=.008 [95% CI 6.2, 32.7] for high vs mid, P<.001 for high vs low [49.1, 75.6], and P<.001 for mid vs low [28.7, 57.1]). The percentage of cases completed with operative independence followed similar trends (high 32.7%, mid 13.8%, low 4.9%, P=.006 [6.4, 31.4] for high vs mid, P<.001 [15.3, 40.3] for high vs low, P=.23 [-4.5, 22.3] for mid vs low). The total volume of cases decreased from high to mid to low self-efficacy tiers (average 91.8 to 20.8 to 11.1) but did not reach statistical significance on post-hoc analysis. Conclusions In this analysis of US surgical residents, operative independence was strongly correlated with self-efficacy.

Impact of a coaching program on resident perceptions of communication confidence and feedback quality.

BACKGROUND: While communication is an essential skill for providing effective medical care, it is infrequently taught or directly assessed, limiting targeted feedback and behavior change. We sought to evaluate the impact of a multi-departmental longitudinal residency communication coaching program. We hypothesized that program implementation would result in improved confidence in residents' communication skills and higher-quality faculty feedback. METHODS: The program was implemented over a 3-year period (2019-2022) for surgery and neurology residents at a single institution. Trained faculty coaches met with assigned residents for coaching sessions. Each session included an observed clinical encounter, self-reflection, feedback, and goal setting. Eligible residents completed baseline and follow-up surveys regarding their perceptions of feedback and communication. Quantitative responses were analyzed using paired t-tests; qualitative responses were analyzed using content analysis. RESULTS: The baseline and follow-up survey response rates were 90.0% (126/140) and 50.5% (46/91), respectively. In a paired analysis of 40 respondents, residents reported greater confidence in their ability to communicate with patients (inpatient: 3.7 vs. 4.3, p < 0.001; outpatient: 3.5 vs. 4.2, p < 0.001), self-reflect (3.3 vs. 4.3, p < 0.001), and set goals (3.6 vs. 4.3, p < 0.001), as measured on a 5-point scale. Residents also reported greater usefulness of faculty feedback (3.3 vs. 4.2, p = 0.001). The content analysis revealed helpful elements of the program, challenges, and opportunities for improvement. Receiving mentorship, among others, was indicated as a core program strength, whereas solving session coordination and scheduling issues, as well as lowering the coach-resident ratio, were suggested as some of the improvement areas. CONCLUSIONS: These findings suggest that direct observation of communication in clinical encounters by trained faculty coaches can facilitate long-term trainee growth across multiple core competencies. Future studies should evaluate the impact on patient outcomes and workplace-based assessments.

Tips for developing a coaching program in medical education.

This article provides structure to developing, implementing, and evaluating a successful coaching program that effectively meets the needs of learners. We highlight the benefits of coaching in medical education and recognize that many educators desiring to build coaching programs seek resources to guide this process. We align 12 tips with Kern's Six Steps for Curriculum Development and integrate theoretical frameworks from the literature to inform the process. Our tips include defining the reasons a coaching program is needed, learning from existing programs and prior literature, conducting a needs assessment of key stakeholders, identifying and obtaining resources, developing program goals, objectives, and approach, identifying coaching tools, recruiting and training coaches, orienting learners, and evaluating program outcomes for continuous program improvement. These tips can serve as a framework for initial program development as well as iterative program improvement.

More is not better: A scoping review of simulation in transition to residency programs.

BACKGROUND: Transition to residency programs frequently use simulation to promote clinical skills but place limited emphasis on non-clinical skills. We conducted a scoping review to determine how simulation is being used in transition to residency programs and the key non-clinical skills addressed by simulation activities and tools in these programs. METHODS: We searched PubMed, Scopus, and Embase to identify articles addressing transition to residency, simulation, and non-clinical skills/attributes. Two authors independently screened all abstracts and full-text articles and identified non-clinical attributes elicited in each study. Using descriptive statistics, we characterized the simulation activities and tools and the number and type of non-clinical attributes captured in the programs. Using analysis of variance, we compared the number of non-clinical attributes elicited based on the number of simulation activities used and compared the number of non-clinical attributes elicited based on the number of simulation tools used. RESULTS: We identified 38 articles that met the study criteria. We characterized simulation activities as mock paging (37%), case-based scenarios (74%), and/or procedural skills training (39%). We found that the most common simulation tools were standardized patients (64.8%), and the most elicited non-clinical attributes were communication skills, critical thinking, and teamwork. Using more simulation activity categories or simulation tools did not increase the number of non-clinical skills elicited. CONCLUSION: Simulation is used broadly in transition to residency programs but provides training in a few of the non-clinical skills required for a successful transition. Incorporating more simulation activities or tools does not increase the number of non-clinical attributes elicited, illustrating the importance of developing more targeted simulation activities to promote non-clinical skills more effectively.

Usability of ENTRUST as an Assessment Tool for Entrustable Professional Activities (EPAs): A Mixed Methods Analysis.

OBJECTIVE: As the American Board of Surgery transitions to a competency-based model of surgical education centered upon entrustable professional activities (EPAs), there is a growing need for objective tools to determine readiness for entrustment. This study evaluates the usability of ENTRUST, an innovative virtual patient simulation platform to assess surgical trainees' decision-making skills in preoperative, intra-operative, and post-operative settings. DESIGN: This is a mixed-methods analysis of the usability of the ENTRUST platform. Quantitative data was collected using the system usability scale (SUS) and Likert responses. Analysis was performed with descriptive statistics, bivariate analysis, and multivariable linear regression. Qualitative analysis of open-ended responses was performed using the Nielsen-Shneiderman Heuristics framework. SETTING: This study was conducted at an academic institution in a proctored exam setting. PARTICIPANTS: The analysis includes n = 47 (PGY 1-5) surgical residents who completed an online usability survey following the ENTRUST Inguinal Hernia EPA Assessment. RESULTS: The ENTRUST platform had a median SUS score of 82.5. On bivariate and multivariate analyses, there were no significant differences between usability based on demographic characteristics (all p > 0.05), and SUS score was independent of ENTRUST performance (r = 0.198, p = 0.18). Most participants agreed that the clinical workup of the patient was engaging (91.5%) and felt realistic (85.1%). The most frequent heuristics represented in the qualitative analysis included feedback, visibility, match, and control. Additional themes of educational value, enjoyment, and ease-of-use highlighted participants' perspectives on the usability of ENTRUST. CONCLUSIONS: ENTRUST demonstrates high usability in this population. Usability was independent of ENTRUST score performance and there were no differences in usability identified in this analysis based on demographic subgroups. Qualitative analysis highlighted the acceptability of ENTRUST and will inform ongoing development of the platform. The ENTRUST platform holds potential as a tool for the assessment of EPAs in surgical residency programs.

An Open-Source Curriculum to Teach Practical Academic Research Skills.

Academic productivity is important for career advancement, yet not all trainees have access to structured research programs. Without formal teaching, acquiring practical skills for research can be challenging. A comprehensive research course that teaches practical skills to translate ideas into publications could accelerate trainees' productivity and liberate faculty mentors' time. We share our experience designing and teaching "A Practical Introduction to Academic Research", a course that teaches practical skills including building productive habits, recognizing common statistical pitfalls, writing cover letters, succinct manuscripts, responding to reviewers, and delivering effective presentations. We share open-source educational material used during the Winter 2022 iteration to facilitate curriculum adoption at peer institutions.

The domino effect: the impact of gender on operative self-efficacy.

BACKGROUND: Studies suggest that there are key differences in operative experience based on a trainee's gender. A large-scale self-efficacy (SE) survey, distributed to general surgery residents after the American Board of Surgery In-Training Examination in 2020, found that female gender was associated with decreased SE in graduating PGY5 residents for all 4 laparoscopic procedures included on the survey (cholecystectomy, appendectomy, right hemicolectomy, and diagnostic laparoscopy). We sought to determine whether these differences were reflected at the case level when considering operative performance and supervision using an operative assessment tool (SIMPL OR). METHODS: Supervision and performance data reported through the SIMPL OR platform for the same 4 laparoscopic procedures included in the SE survey were aggregated for residents who were PGY5s in 2020. Independent t-tests and multiple linear regression were used to determine the relationship between trainee gender and supervision/performance ratings. RESULTS: For laparoscopic cases in aggregate (n = 2708), male residents rated their performance higher than females (3.57 vs. 3.26, p < 0.001, 1 = critical deficiency, 5 = exceptional performance) and reported less supervision (3.15 vs. 2.85, p < 0.001, 1 = show and tell, 4 = supervision only); similar findings were seen when looking at attending reports of resident supervision and performance. A multiple linear regression model showed that attending gender did not significantly predict resident-reported supervision or performance levels, while case complexity and trainee gender significantly affected both supervision and performance (p < 0.001). DISCUSSION: Female residents perceive themselves to be less self-efficacious at core laparoscopic procedures compared to their male colleagues. Comparison to more case-specific data confirm that female residents receive more supervision and lower performance ratings. This may create a domino effect in which female residents receive less operative independence, preventing the opportunity to establish SE. Further research should identify opportunities to break this cycle and consider gender identity beyond the male/female construct.

We Need to Do Better: A Scoping Review of Wellness Programs In Surgery Residency.

OBJECTIVE: Burnout, depression, and fatigue are common among surgical residents. Most published wellness studies in surgery only focus on a cross-sectional view of attitudes and perceptions around wellness in training. While much of this literature calls for interventions and presents strategies for improving resident well-being, there is a paucity of published wellness initiatives, and even fewer with programmatic evaluation. DESIGN: A scoping review was designed to address: (1) What wellness initiatives are used in surgery residency programs? (2) Which wellness domains do these programs address? and (3) How are program outcomes evaluated? A formal literature search was conducted using PubMed, Embase, and Scopus databases to identify English-language studies conducted in the United States that described wellness-focused initiatives for surgery residents. Two authors independently screened all abstracts and full texts for inclusion. Data were extracted including wellness domain(s) and outcomes evaluation methods with associated Kirkpatrick level(s) (1-reaction, 2-learning, 3-behavior, 4-results). Study quality was examined using the medical education research study quality index (MERSQI) score. RESULTS: A total of 2237 abstracts were screened with 115 full texts reviewed for eligibility. Fifty-one studies were included in the final analysis, representing 39 distinct wellness programs. The most common domains of wellness addressed were emotional (19/39, 48.7%), occupational (17/39, 43.6%), and physical (16/39, 41.0%). Of the 51 studies reviewed, 8 (15.7%) did not conduct any program evaluation, 27 (52.9%) evaluated level 1, 30 (58.8%) evaluated level 2, 3 (5.9%) evaluated level 3, and none evaluated level 4 outcomes. The mean MERSQI score was 9.16 (SD 1.8). CONCLUSIONS: Wellness is an established problem in surgical training. This review reveals a small number of published wellness interventions and even fewer that incorporate programmatic evaluation at the level of behavior and results change. Effective change will require rigorous and deliberate programming that addresses multiple domains and evaluation levels.

What are essential laparoscopic skills these days? Results of the SAGES Fundamentals of Laparoscopic Surgery (FLS) Committee technical skills survey.

INTRODUCTION: The Fundamentals of Laparoscopic Surgery (FLS) program tests basic knowledge and skills required to perform laparoscopic surgery. Educational experiences in laparoscopic training and development of associated competencies have evolved since FLS inception, making it important to review the definition of fundamental laparoscopic skills. The Society of American Gastrointestinal and Endoscopic Surgeons (SAGES) assigned an FLS Technical Skills Working Group to characterize technical skills used in basic laparoscopic surgery in current practice contexts and their possible application to future FLS tests. METHODS: A group of subject matter experts defined an inventory of 65 laparoscopic skills using a Nominal Group Technique. From these, a survey was developed rating these items for importance, frequency of use, and priority for testing for FLS certification. This survey was distributed to SAGES members, recent recipients of FLS certification, and members of the Association of Program Directors in Surgery (APDS). Results were collected using a secure web-based survey platform. RESULTS: Complete data were available for 1742 surveys. Of these, 1143 comprised results for post-residency participants who performed advanced procedures. Seventeen competencies were identified for FLS testing prioritization by determining the proportion of respondents who identified them of highest priority, at median (50th percentile) of the maximum survey scale rating. These included basic peritoneal access, laparoscope and instrument use, tissue manipulation, and specific problem management skills. Sixteen could be used to show appropriateness of the domain construct by confirmatory factor analysis. Of these 8 could be characterized as manipulative tasks. Of these 5 mapped to current FLS tasks. CONCLUSIONS: This survey-identified competencies, some of which are currently assessed in FLS, with a high level of priority for testing. Further work is needed to determine if this should prompt consideration of changes or additions to the FLS technical skills test component.

Correlation of Performance on ENTRUST and Traditional Oral Objective Structured Clinical Examination for High-Stakes Assessment in the College of Surgeons of East, Central, and Southern Africa.

BACKGROUND: To address the global need for accessible evidence-based tools for competency-based education, we developed ENTRUST, an innovative online virtual patient simulation platform to author and securely deploy case scenarios to assess surgical decision-making competence. STUDY DESIGN: In partnership with the College of Surgeons of East, Central, and Southern Africa, ENTRUST was piloted during the Membership of the College of Surgeons (MCS) 2021 examination. Examinees (n = 110) completed the traditional 11-station oral objective structured clinical examinations (OSCEs), followed by 3 ENTRUST cases, authored to query similar clinical content of 3 corresponding OSCE cases. ENTRUST scores were analyzed for associations with MCS Examination outcome using independent sample t tests. Correlation of ENTRUST scores to MCS Examination Percentage and OSCE station scores was calculated with Pearson correlations. Bivariate and multivariate analyses were performed to evaluate predictors of performance. RESULTS: ENTRUST performance was significantly higher in examinees who passed the MCS examination compared with those who failed (p < 0.001). The ENTRUST score was positively correlated with MCS Examination Percentage (p < 0.001) and combined OSCE station scores (p < 0.001). On multivariate analysis, there was a strong association between MCS Examination Percentage and ENTRUST Grand Total Score (p < 0.001), Simulation Total Score (p = 0.018), and Question Total Score (p < 0.001). Age was a negative predictor for ENTRUST Grand Total and Simulation Total Score, but not for Question Total Score. Sex, native language status, and intended specialty were not associated with performance on ENTRUST. CONCLUSIONS: This study demonstrates feasibility and initial validity evidence for the use of ENTRUST in a high-stakes examination context for assessment of surgical decision-making. ENTRUST holds potential as an accessible learning and assessment platform for surgical trainees worldwide.

Developing an Inpatient Relationship Centered Communication Curriculum (I-RCCC) rounding framework for surgical teams.

BACKGROUND: Morning rounds by an acute care surgery (ACS) service at a level one trauma center are uniquely demanding, given the fast pace, high acuity, and increased patient volume. These demands notwithstanding, communication remains integral to the success of surgical teams. Yet there are limited published curricula that address trauma inpatient communication needs. Observations at our institution confirmed that the surgical team lacked a shared mental model for communication. We hypothesized that creating a relationship-centered rounding conceptual framework model would enhance the provider-patient experience. STUDY DESIGN: A mixed-methods approach was used for this study. A multi-pronged needs assessment was conducted. Provider communion items for Press Ganey and Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) surveys were used to measure patients' expressed needs. Faculty with experience in relationship-centered communication observed morning rounds and documented demonstrated behaviors. A five-hour workshop was designed based on the identified needs. A pre-and post-course Assessment and course evaluation were conducted. Provider-related patient satisfaction items were measured six months before the course and six months after the workshop. RESULTS: Needs assessment revealed a lack of a shared communication framework and a lack of leadership skills for senior trauma residents. Barriers included: time constraints, patient load, and interruptions during rounds. The curriculum was very well received. The self-reflected behaviors that demonstrated the most dramatic change between the pre and post-workshop surveys were: I listened without interrupting; I spoke clearly and at a moderate pace; I repeated key points; and I checked that the patient understood. All these changed from being performed by 50% of respondents "about half of the time" to 100% of them "always". Press Ganey top box likelihood to recommend (LTR) and provider-related top box items showed a trend towards improvement after implementing the training with a percentage difference of up to 20%. CONCLUSION: The Inpatient Relationship Centered Communication Curriculum (I-RCCC) targeting senior residents and Nurse Practitioners (NP) was feasible, practical, and well-received by participants. There was a trend of an increase in LTRs and provider-specific patient satisfaction items. This curriculum will be refined based on the study results and potentially scalable to other surgical specialties.

The Program Director Perspective: Perceptions of PGY5 Residents' Operative Self-Efficacy and Entrustment.

INTRODUCTION: A 2020 survey of post-graduate year 5 (PGY5) general surgery residents linked to the American Board of Surgery In-Training Examination (ABSITE) revealed significant deficits in self-efficacy (SE), or personal judgment of one's ability to complete a task, for 10 commonly performed operations. Identifying whether this deficit is similarly perceived by program directors (PDs) has not been well established. We hypothesized that PDs would perceive higher levels of operative SE compared to PGY5s. METHODS: A survey was distributed through the Association of Program Directors in Surgery listserv; PDs were queried about their PGY5 residents' ability to perform the same 10 operations independently and their accuracy of patient assessments and operative plans for components of several core entrustable professional activities (EPAs). Results of this survey were compared to PGY5 residents' perception of their SE and entrustment based on the 2020 post-ABSITE survey. Chi-squared tests were used for statistical analysis. RESULTS: 108 responses were received, representing ∼32% (108/342) of general surgery programs. Perceptions from PDs of PGY5 residents' operative SE were highly concordant with resident perceptions; no significant differences were observed for 9 of 10 procedures. Both PGY5 residents and PDs perceived adequate levels of entrustment; no significant differences were observed for 6 of 8 EPA components. CONCLUSIONS: These findings show concordance between PDs and PGY5 residents in their perceptions of operative SE and entrustment. Though both groups perceive adequate levels of entrustment, PDs corroborate the previously described operative SE deficit, illustrating the importance of improved preparation for independent practice.

The fundamentals of laparoscopic surgery in general surgery residency: fundamental for junior residents' self-efficacy.

BACKGROUND: Implementation of the Fundamentals of Laparoscopic Surgery (FLS) by the Society of American Gastrointestinal and Endoscopic Surgeons (SAGES) has served a need for educational structure for laparoscopic skill within General Surgery training since 2004. This study looks at how FLS affects resident self-efficacy (SE) with laparoscopic procedures. METHODS: We conducted a national survey, linked to the 2020 American Board of Surgery In-Training Examination (ABSITE), in which 9275 residents from 325 US General Surgery Training Programs participated. The online survey included multimodal questions that analyzed whether participants felt they could perform the most commonly-logged laparoscopic operations among residents [Laparoscopic Appendectomy (LA), Laparoscopic Cholecystectomy (LC), Laparoscopic Right Hemicolectomy (LRH), Diagnostic Laparoscopy (DL)] without faculty assistance. This used a 5-point scaled assessment, ranging from "not able to" to "definitely able to." Multivariate analyses determined if completion of FLS made a difference for resident self-efficacy, stratified by post-graduate year (PGY). RESULTS: At the time of the survey, 2300 reported completion of FLS. The percentage of FLS completion increased from PGY1 to PGY5 (4.2% n = 59 vs 85.8% n = 893). PGY1 residents who completed FLS, from 48 diverse institutions, demonstrated the most significant increases in SE (p < 0.05) with significantly higher perceived self-efficacy in LA (p = 0.001) and LRH (p = 0.012). PGY2 and PGY3 residents indicated increased SE in DL (p = 0.037, p = 0.015, respectively), based on FLS completion. These FLS effects were less evident in the more senior classes. CONCLUSIONS: Completion of FLS arguably has the greatest benefits for more junior residents, as it establishes a foundation of laparoscopic knowledge and skill, upon which further residency training can build. Successful completion of the curriculum and assessment offered by the Fundamentals of Laparoscopic Surgery leads to greater sense of ability in early trainees.

Validity Evidence for ENTRUST as an Assessment of Surgical Decision-Making for the Inguinal Hernia Entrustable Professional Activity (EPA).

OBJECTIVE: As the American Board of Surgery (ABS) moves toward implementation of Entrustable Professional Activities (EPAs), there is a growing need for objective evaluation of readiness for entrustment of residents. This requires not only assessment of technical skills and knowledge, but also surgical decision-making in preoperative, intraoperative, and postoperative settings. We developed and piloted an Inguinal Hernia EPA Assessment on ENTRUST, a serious game-based online virtual patient simulation platform to assess trainees' decision-making competence. DESIGN: This is a prospective analysis of resident performance on the ENTRUST Inguinal Hernia EPA Assessment using bivariate analyses. SETTING: This study was conducted at an academic institution in a proctored exam setting. PARTICIPANTS: Forty-three surgical residents completed the ENTRUST Inguinal Hernia EPA Assessment. RESULTS: Four case scenarios for the Inguinal Hernia EPA and corresponding scoring algorithms were iteratively developed by expert consensus aligned with ABS EPA descriptions and functions. ENTRUST Inguinal Hernia Grand Total Score was positively correlated with PGY-level (p < 0.0001). Preoperative, Intraoperative, and Postoperative Total Scores were also positively correlated with PGY-level (p = 0.001, p = 0.006, and p = 0.038, respectively). Total Case Scores were positively correlated with PGY-level for cases representing elective unilateral inguinal hernia (p = 0.0004), strangulated inguinal hernia (p < 0.0001), and elective bilateral inguinal hernia (p = 0.0003). Preoperative Sub-Scores were positively correlated with PGY-level for all cases (p < 0.01). Intraoperative Sub-Scores were positively correlated with PGY-level for strangulated inguinal hernia and bilateral inguinal hernia (p = 0.0007 and p = 0.0002, respectively). Grand Total Score and Intraoperative Sub-Score were correlated with prior operative experience (p < 0.0001). Prior video game experience did not correlate with performance on ENTRUST (p = 0.56). CONCLUSIONS: Performance on the ENTRUST Inguinal Hernia EPA Assessment was positively correlated to PGY-level and prior inguinal hernia operative performance, providing initial validity evidence for its use as an objective assessment for surgical decision-making. The ENTRUST platform holds potential as tool for assessment of ABS EPAs in surgical residency programs.

EQIP's First Year: A Step Closer to Higher Quality in Surgical Education.

OBJECTIVE: To describe the first year of the Educational Quality Improvement Program (EQIP) DESIGN: The Educational Quality Improvement Program (EQIP) was formed by the Association of Program Directors in Surgery (APDS) in 2018 as a continuous educational quality improvement program. Over 18 months, thirteen discrete goals for the establishment of EQIP were refined and executed through a collaborative effort involving leaders in surgical education. Alpha and beta pilots were conducted to refine the data queries and collection processes. A highly-secure, doubly-deidentified database was created for the ingestion of resident and program data. SETTING & PARTICIPANTS: 36 surgical training programs with 1264 trainees and 1500 faculty members were included in the dataset. 51,516 ERAS applications to programs were also included. Uni- and multi-variable analysis was then conducted. RESULTS: EQIP was successfully deployed within the timeline described in 2020. Data from the ACGME, ABS, and ERAS were merged with manually entered data by programs and successfully ingested into the EQIP database. Interactive dashboards have been constructed for use by programs to compare to the national cohort. Risk-adjusted multivariable analysis suggests that increased time in a technical skills lab was associated with increased success on the ABS's Qualifying Examination, alone. Increased time in a technical skills lab and the presence of a formal teaching curriculum were associated with increased success on both the ABS's Qualifying and Certifying Examination. Program type may be of some consequence in predicting success on the Qualifying Examination. CONCLUSIONS: The APDS has proved the concept that a highly secure database for the purpose of continuous risk-adjusted quality improvement in surgical education can be successfully deployed. EQIP will continue to improve and hopes to include an increasing number of programs as the barriers to participation are overcome.

Do Individual Surgeon Preferences Affect Procedural Outcomes?

OBJECTIVES: Surgeon preferences such as instrument and suture selection and idiosyncratic approaches to individual procedure steps have been largely viewed as minor differences in the surgical workflow. We hypothesized that idiosyncratic approaches could be quantified and shown to have measurable effects on procedural outcomes. METHODS: At the American College of Surgeons (ACS) Clinical Congress, experienced surgeons volunteered to wear motion tracking sensors and be videotaped while evaluating a loop of porcine intestines to identify and repair 2 preconfigured, standardized enterotomies. Video annotation was used to identify individual surgeon preferences and motion data was used to quantify surgical actions. χ 2 analysis was used to determine whether surgical preferences were associated with procedure outcomes (bowel leak). RESULTS: Surgeons' (N=255) preferences were categorized into 4 technical decisions. Three out of the 4 technical decisions (repaired injuries together, double-layer closure, corner-stitches vs no corner-stitches) played a significant role in outcomes, P <0.05. Running versus interrupted did not affect outcomes. Motion analysis revealed significant differences in average operative times (leak: 6.67 min vs no leak: 8.88 min, P =0.0004) and work effort (leak-path length=36.86 cm vs no leak-path length=49.99 cm, P =0.001). Surgeons who took the riskiest path but did not leak had better bimanual dexterity (leak=0.21/1.0 vs no leak=0.33/1.0, P =0.047) and placed more sutures during the repair (leak=4.69 sutures vs no leak=6.09 sutures, P =0.03). CONCLUSIONS: Our results show that individual preferences affect technical decisions and play a significant role in procedural outcomes. Future analysis in more complex procedures may make major contributions to our understanding of contributors to procedure outcomes.

The APDS General Surgery Education Quality Improvement Program (EQIP).

BACKGROUND: Although the ACGME has called for outcomes-based evaluation of residency programs, few metrics or benchmarks exist connecting educational processes with resident educational outcomes. To address this deficiency, a national Education Quality Improvement Program (EQIP) for General Surgery training is proposed. METHODS: We describe the initial efforts to create this platform. In addition, a national survey was administered to 330 Program Directors to assess their interest in and concerns about a continuous educational quality improvement project. RESULTS: We demonstrate that through a collaborative process and the support of the Association of Program Directors in Surgery (APDS), we were able to develop the groundwork for a national surgical educational improvement project, now called EQIP. The survey response rate was 45.8% (152 of 332 programs) representing a mix of university (55.3%), university-affiliated (18.4%), independent (24.3%), and military (2.0%) programs. Most respondents (66.2%) had not previously heard of EQIP. Most respondents (69.7%) believe that educational outcomes can be measured. The majority of respondents indicated they believed EQIP could be successful (57%). Only 2.3% thought EQIP would not be successful. Almost all programs (98.7%) expressed a willingness to participate, although 19.1% did not believe that they had adequate resources to participate. CONCLUSION: The APDS EQIP platform holds promise as a useful and achievable method to obtain educational outcomes data. These data can be used as a basis for continuous surgical educational quality improvement. General Surgery Program Directors have expressed enthusiasm for EQIP and are willing to participate in the program examining outcomes of General Surgery training programs, with an ultimate goal of improving overall residency training.

Diversity, equity, and inclusion in presidential leadership of academic medical and surgical societies.

BACKGROUND: Our aim was to identify gender and racial disparities in presidential leadership for national medical and surgical organizations. METHODS: We located publicly sourced information on national medical organizations. Years between or since the first diverse presidents were analyzed using descriptive statistics and Mann Whitney U tests. RESULTS: Sixty-seven national medical and surgical organizations were surveyed. 70.8% (n = 34) diversified via gender first (White-female), whereas 26.1% (n = 14) had racial diversity first. Organizations with gender diversity first followed with an African American male president sooner than organizations who first diversified by race (14.7 ± 11.8 v. 27.6 ± 11.3 years, p = 0.018). No significant difference was observed for the third tier of diversification. CONCLUSIONS: Significant gender and racial leadership disparities in national medical organizations are still present. It is notable that organizations with female leaders had a shorter timeline to racial diversity. These findings help to inform strategies to promote and increase diversity, equity, and inclusion in national leadership.