American College of Surgeons Resident Objective Structured Clinical Examination: a national program to assess clinical readiness of entering postgraduate year 1 surgery residents.

OBJECTIVE: This report describes the development, initial implementation, and reliability of American College of Surgeons Resident Objective Structured Clinical Examination (ACS OSCE). BACKGROUND: Variability in clinical knowledge and skills of entering surgery residents has been demonstrated. The ACS OSCE was developed to evaluate and help remediate residents' knowledge and skills in managing patients with life-threatening conditions. METHODS: A task force of surgeons and professional educators developed 10 standardized clinical case stations, evaluation checklists, and rating scales. Standardized patients (SPs) evaluated each resident's clinical skills (history taking, physical examination, communication, and SP-global scores). Residents completed checklists on diagnosis and management. Coefficient alpha and item-total correlations were used, respectively, to assess internal consistency of metrics and station validity. The resident's overall performance for each station was calculated by combining scores of the individual skills. Analysis of variance compared performance across different institutions. RESULTS: A total of 103 postgraduate year 1 residents from 7 institutions completed the OSCE. Reliability coefficients of skills ranged from 0.38 for diagnosis to 0.68 for global scores. For overall performance on individual stations, the reliability coefficients ranged from 0.51 to 0.82. Using total percent correct scores from highly reliable stations (α > 0.8), wide variability in resident performance was demonstrated within and between the 7 institutions. CONCLUSIONS: The ACS OSCE was successfully implemented across diverse institutions. It had moderate reliability and demonstrated variability among entering surgery residents. The ACS OSCE is now available for broader implementation. It should help reduce resident variability and address the requirements of Accreditation Council for Graduate Medical Education for resident supervision.

Geriatric motor vehicle collision survival: the role of institutional trauma volume.

BACKGROUND: Links between trauma center volumes and outcomes have been inconsistent in previous studies. This study examines the role of institutional trauma volume parameters in geriatric motor vehicle collision (MVC) survival. METHODS: The New York Statewide Planning and Research Cooperative Systems database was analyzed for all trauma admissions to state-designated Level I and II trauma centers from 1996 to 2003. For each center, the volume of patients was calculated in each of the following four categories: Young adult (age, 17-64 years) MVC and non-MVC, and geriatric (65 years and older) MVC and non-MVC. Logistic regression analysis was used to predict patient survival to hospital discharge based on the four volume parameters of the center at which they were treated, age, gender, ICISS, year of admission, and type of center. RESULTS: Five thousand three hundred sixty-five geriatric MVC victims were admitted to Level I (n = 3,541) or II (n = 1,824) centers in New York State excluding New York City. Four thousand eight hundred ninety-eight (91%) patients were discharged alive. Volume of geriatric MVC at the center at which the patient was treated was an independent significant predictor of survival (odds ratio, 32.6; 95% confidence interval, 2.8-377.0; p = 0.005) as were younger age, female gender, increased ICISS, and later year of discharge. Young adult non-MVC volume was an independent significant predictor of nonsurvival of geriatric patients (odds ratio, 0.8; 95% confidence interval, 0.64-0.99; p = 0.042). Type of center was unrelated to outcome. CONCLUSIONS: There may be a risk-adjusted survival advantage for geriatric MVC patients treated at trauma centers with relatively higher volumes of geriatric MVC trauma and lower volumes of young adult non-MVC trauma. These results support consideration of age in trauma center transfer criteria.

Promoting self-efficacy in minimally invasive surgery training.

Many surgeons continue to actively pursue surgical approaches that are less invasive for their patients. This pursuit requires the surgeon to adapt to new instruments, techniques, technologies, knowledge bases, visual perspectives, and motor skills, among other changes. The premise of this paper is that surgeons adopting minimally invasive approaches are particularly obligated to maintain an accurate perception of their own competencies and learning needs in these areas (ie, self-efficacy). The psychological literature on the topic of self-efficacy is vast and provides valuable information that can help assure that an individual develops and maintains accurate self-efficacy beliefs. The current paper briefly summarizes the practical implications of psychological research on self-efficacy for minimally invasive surgery training. Specific approaches to training and the provision of feedback are described in relation to potential types of discrepancies that may exist between perceived and actual efficacy.

Epidemiology of Sports Related Concussion in Brazilian Jiu-Jitsu: A Cross-Sectional Study.

Brazilian Jiu-Jitsu (BJJ) is a rapidly growing grappling sport with a wide spectrum of participants. This cross-sectional study examined the lifetime prevalence of concussion in adult BJJ practitioners in the United States using a 17-item survey. A total of 778 (11.4% female) BJJ practitioners with a median age of 31 years completed the survey. Overall, the lifetime prevalence of the self-reported BJJ-related concussion was 25.2%. However, the prevalence was higher among females than males (43.0% versus 22.9%; X²(1,740) = 15.129; p < 0.001). Factors independently associated with significantly increased odds of having sustained a BJJ-related concussion included a prior history of concussion (OR 1.76, 95% CI 1.14⁻2.74; p = 0.011) and female gender (OR 1.95, 95% CI 1.04⁻3.65; p = 0.037). The median return to sports time was three days, with 30.3% of participants returning on the same day as being concussed. The present study represents the first epidemiological research examining the concussions in BJJ. The results underscore the need for increased education on concussions and return to sports guidelines among BJJ coaches and practitioners.

Systemic blood pressure trends and antihypertensive utilization following continuous-flow left ventricular assist device implantation: an analysis of the interagency registry for mechanically assisted circulatory support.

BACKGROUND: Elevated systemic blood pressure (SBP) has been linked to complications in Continuous-flow left ventricular assist devices (CF-LVADs), including stroke and pump thrombosis. We queried Interagency Registry for Mechanically Assisted Circulatory Support (INTERMACS) to describe the response of SBP to CF-LVAD implantation and to delineate contemporary trends in antihypertensive (AH) utilization for patients with these pumps. METHODS: We identified all CF-LVAD implantations in patients older than 18 years from 2006-2014, excluding those whose durations were less than 30 days. Pre-implant patient demographics and characteristics were obtained for each record. SBPs [i.e., mean arterial pressures (MAPs)], AH-use data, and vital status were tabulated, extending up to 5 years following implantation. RESULTS: A total of 10,329 CF-LVAD implantations were included for study. Post-implant, SBPs increased rapidly during the first 3 months but plateaued thereafter; AH utilization mirrored this trend. By 6 months, mean MAPs climbed 12.2% from 77.6 mmHg (95% CI: 77.4-77.8) pre-implantation to 87.1 mmHg (95% CI: 86.7-87.4) and patients required a mean of 1.8 AH medications (95% CI: 1.75-1.78) -a 125% increase from AH use at 1-week post-implantation (0.8 AHs/patient, 95% CI: 0.81-0.83) but a 5.3% decrease from pre-implant utilization (1.9 AHs/patient, 95% CI: 1.90-1.92). Once medication changes stabilized, the most common AH regimens were lone beta blockade (15%, n=720) and a beta blocker plus an ACE inhibitor (14%, n=672). CONCLUSIONS: SBP rises rapidly after CF-LVAD implantation, stabilizing after 3 months, and is matched by concomitant changes in AH utilization; this AH use has increased over consecutive implant years.

Validation of the Omni: A Novel, Multimodality, and Longitudinal Surgical Skills Assessment.

OBJECTIVE: The breadth of technical skills included in general surgery training continues to expand. The current competency-based training model requires assessment tools to measure acquisition, learning, and mastery of technical skill longitudinally in a reliable and valid manner. This study describes a novel skills assessment tool, the Omni, which evaluates performance in a broad range of skills over time. DESIGN: The 5 Omni tasks, consisting of open bowel anastomosis, knot tying, laparoscopic clover pattern cut, robotic needle drive, and endoscopic bubble pop, were developed by general surgery faculty. Component performance metrics assessed speed, accuracy, and quality, which were scaled into an overall score ranging from 0 to 10 for each task. For each task, ANOVAs with Scheffé's post hoc comparisons and Pearson's chi-squared tests compared performance between 6 resident cohorts (clinical years (CY1-5) and research fellows (RF)). Paired samples t-tests evaluated changes in performance across academic years. Cronbach's alpha coefficient determined the internal consistency of the Omni as an overall assessment. SETTING: The Omni was developed by the Department of Surgery at Duke University. Annual assessment and this research study took place in the Surgical Education and Activities Lab. PARTICIPANTS: All active general surgery residents in 2 consecutive academic years spanning 2015 to 2017. RESULTS: A total of 62 general surgery residents completed the Omni and 39 (67.2%) of those residents completed the assessment in 2 consecutive years. Based on data from all residents' first assessment, statistically significant differences (p < 0.05) were observed among CY cohorts for bowel anastomosis, robotic, and laparoscopic task metrics. By pair-wise comparisons, mean bowel anastomosis scores distinguished CY1 from CY3-5 and CY2 from CY5. Mean robotic scores distinguished CY1 from RF, and mean laparoscopic scores distinguished CY1 from RF, CY3, and CY5 in addition to CY2 from CY3. Mean scores in performance on the knot tying and endoscopic tasks were not significantly different. Statistically significant improvement in mean scores was observed for all tasks from year 1 to year 2 (all p < 0.02). The internal consistency analysis revealed an alpha coefficient of 0.656. CONCLUSIONS: The Omni is a novel composite assessment tool for surgical technical skill that utilizes objective measures and scoring algorithms to evaluate performance. In this pilot study, 3 tasks demonstrated discriminative ability of performance by CY, and all 5 tasks demonstrated construct validity by showing longitudinal improvement in performance. Additionally, the Omni has adequate internal consistency for a formative assessment. These results suggest the Omni holds promise for the evaluation of resident technical skill and early identification of outliers requiring intervention.

Management of adverse surgical events: a structured education module for residents.

BACKGROUND: This pilot project involved the development of a structured, experiential, educational module using a bench model technical skills simulation and standardized patients. It integrated teaching and assessment of clinical, technical, and interpersonal skills, as well as professionalism within the context of an adverse surgical event. METHODS: General surgery residents (postgraduate year [PGY] 2, 3) were asked to participate in the pre-, intra-, and postoperative management of a patient with a retroperitoneal sarcoma. Residents' performances during the module were assessed by standardized patients and faculty, and residents were provided feedback during debriefing sessions. RESULTS: Resident performance during the module was appropriate for the level of training. Residents found this module to be a realistic, challenging, and beneficial learning experience. CONCLUSIONS: Novel educational modules such as this one may serve as a useful addition to resident education in surgery residency programs, particularly in addressing patient safety and the core competencies. Reliability of the model may be enhanced by modifications of the module.

Injury prevention priority score: a new method for trauma centers to prioritize injury prevention initiatives.

BACKGROUND: Trauma centers are expected to develop injury prevention programs that address needs of the local population. A relatively simple, objective, and quantitative method is needed for prioritizing local injury prevention initiatives based on both injury frequency and severity. STUDY DESIGN: Pediatric trauma patients (16 years or younger; n= 7,958) admitted to two Level I regional trauma centers (Johns Hopkins Children Center and Westchester Medical Center) from 1993 to 1999 were grouped by injury causal mechanism according to ICD-9 external cause codes. An Injury Prevention Priority Score (IPPS), balancing the influences of severity (based on the Injury Severity Score) and frequency, was calculated for each mechanism and mechanisms were ranked accordingly. RESULTS: IPPS-based rank lists differed across centers. The highest ranked mechanism of injury among children presenting to Johns Hopkins Children Center was "pedestrian struck by motor vehicle," and at Westchester Medical Center it was "motor vehicle crash." Different age groups also had specific injury prevention priorities, eg, "child abuse" was ranked second highest among infants at both centers. IPPS was found to be stable (r = 0.82 to 0.93, p < 0.05) across alternate measures of injury severity. CONCLUSIONS: IPPS is a relatively simple and objective tool that uses data available in trauma center registries to rank injury causes according to both frequency and severity. Differences between two centers and across age groups suggest IPPS may be useful in tailoring injury prevention programs to local population needs.

Visual spatial perception and surgical competence.

BACKGROUND: Proficiency in visual spatial perception (VSP) is a hypothetical component of surgical competence. METHODS: Four tests of VSP, taken from the Cognitive Laterality Battery (CLB), were administered to 301 surgeons and surgical residents. Mean scores on each test were compared by Student t tests to those of the normative sample (n = 251) on which the test was originally standardized. RESULTS: Mean scores on two of the tests (Orientation, Touching Blocks) were significantly greater (P <0.01) for the study sample than for the normative sample, while mean scores on the other two subtests (Form Completion, Localization) were not. CONCLUSIONS: Surgeons tend to outperform the general population on tests of high-level VSP abilities (ie, envisioning depth and mentally manipulating two-dimensional representations of three-dimensional structures) identified previously as correlates of surgical skill acquisition. VSP proficiency is a valid component of surgical competence that should perhaps be included in career selection discussions with medical students and in assessment of the competence of surgeons.

Assessing educational validity of the Morbidity and Mortality conference: a pilot study.

PURPOSE: To assess inter-rater agreement in perceptions of cases presented during Morbidity & Mortality conference (M&M) and changes associated with initiation of a modified M&M. METHODS: Faculty, residents, fellows, and students at weekly M&M between June 2001 and March 2002 voluntarily completed an anonymous questionnaire after each M&M case presentation, which asked: if the complication was avoidable (yes/no/not sure), if consensus was reached among participants (yes/no/not sure), the primary cause of the complication (diagnostic error, technical error, judgment error, nature of disease, other), when the primary cause occurred (preoperatively, intraoperatively, postoperatively), and which, if any, of 16 listed actions could prevent similar future problems. On September 24, 2001, the conference was lengthened and modified. Data collected before (n = 30 cases) and after M&M modification (n = 46 cases) were compared. RESULTS: A total of 76 cases were evaluated for a total of 860 completed forms. In 57 cases (75%), majority opinion (ie, > or =50% of participants) indicated that the complication resulted from either nature of disease (n = 32, 41%), or error in diagnosis (n = 5, 7%), technique (n = 8, 11%) or judgment (n = 12, 17%). There was no clear majority for the remainder of the cases. Relative to cases presented prior to M&M modification, for those presented post-modification, the majority perceived that consensus was reached more often (96% of cases vs. 70% of cases, p<.01), and that complications were more often avoidable (54% of cases vs. 23% of cases, p <.05), more likely caused during the preoperative period (26% of cases vs. 7% of cases, p <.01) and less likely caused during the postoperative period (28% of cases vs. 67% of cases, p <.01). CONCLUSIONS: The variability in questionnaire responses suggests that an evaluation instrument such as that reported here can be useful in assessing educational needs, quantifying the efficacy of case presentations, and assessing the effects of modifications to conference content and structure. Modifying M&M in accordance with published recommendations appears to improve case analysis and consensus among participants.

Advanced surgical skills for exposure in trauma: a new surgical skills cadaver course for surgery residents and fellows.

BACKGROUND: Surgical education is changing owing to workforce and economic demands. Simulation and other technical teaching methods are used to acquire skills transferable to the operating room. Operative management of traumatic injuries has declined, making it difficult to acquire and maintain competence. The ASSET course was developed by the Committee on Trauma's Surgical Skills Committee to fill a surgical skills need in resident and fellow education. Using a human cadaver, standardized rapid exposure of vital structures in the extremities, neck, thorax, abdomen, retroperitoneum, and pelvis is taught. METHODS: A retrospective analysis of 79 participants in four ASSET courses was performed. Operative experience data were collected, and self-efficacy questionnaires (SEQs) were administered before and after the course. Course evaluations and instructor evaluation data were analyzed. Student's and paired samples t tests as well as analysis of variance and Spearman ρ correlation coefficient analysis were performed using α at p < 0.05. We hypothesized that the ASSET course would teach new surgical techniques and that learner self-assessed ability would improve. RESULTS: Participants included 27 PGY-4, 20 PGY-5, 24 PGY-6 or PGY-7 and PGY-8 at other levels of training. Self-assessed confidence improved in all body regions (p < 0.001), with the greatest increase in upper extremity and chest. Pre- and post-SEQ scores correlated with trauma operative experience. Precourse SEQ scores differed by level of training. Instructor evaluations correlated with previous experience on a trauma service. Program evaluations averaged 4.73 on a 5-point scale, with gaining new knowledge rated at 4.8 and learning new techniques at 4.72. CONCLUSION: A standardized cadaver-based surgical exposures course offered to senior surgical residents adds new surgical skills and improves participant self-assessed ability to perform emergent surgical exposure of vital structures.

Women in surgery residency programs: evolving trends from a national perspective.

BACKGROUND: Similar numbers of men and women are currently graduating from United States (US) medical schools; therefore, surgery residency programs need to attract graduates of both genders. This study compared gender distributions of allopathic US medical graduates (USMG) from academic years 1999-2000 through 2004-2005. In addition, the gender distributions of USMG and international medical graduates (IMG; analyzed separately) entering accredited general surgery (GS) programs and USMG entering other surgical specialty programs were compared across academic years 2000-2001 through 2005-2006. STUDY DESIGN: Data were extracted from the American College of Surgeons Resident Master File and the Association of American Medical Colleges FACTS Website and Data Warehouse. Chi-square statistics compared gender distributions across years for all USMG graduating and applying to GS programs each year between 1999-2000 and 2004-2005 and for USMG and IMG entering training between 2000-2001 and 2005-2006. RESULTS: During the study period, the proportion of women increased significantly (p < 0.001) among USMG (43% to 47%), USMG applying to GS programs (27% to 33%), and USMG entering GS residencies (32% to 40%); the percentages of women among IMG entering GS residencies ranged from 11% to 18%, with no apparent linear increase. Proportions of women among USMG entering training increased in most surgical specialties examined. CONCLUSIONS: The gender gap among USMG entering GS training appears to be closing, concurrent with that of USMG overall during the study period. Surgery programs must continue to recruit and retain women to attract the best and brightest trainees.

Efforts to enhance operating room teaching.

OBJECTIVE: To identify the learning needs of faculty members who are not perceived by residents as outstanding teachers in the operating room. DESIGN: General surgery residents electronically evaluated each faculty surgeon with whom they had significant contact upon completion of each clinical rotation between July 2005 and October 2006. Evaluation forms requested global ratings (1-5 scale ranging from poor to excellent) in 10 separate teaching-related areas, 1 of which was operating room teaching. Residents also rated faculty on 10 specific operating room teaching behaviors identified during a previous observational study. RESULTS: In total, 134 faculty surgeons were evaluated by 63 residents. Faculty who were evaluated by at least 5 residents (n = 99) were included in the study (mean = 21.9; range, 5-118 evaluations). The ratings of overall operating room teaching (M +/- SD: 4.46 +/- 0.52) correlated significantly (p < 0.001) with ratings of overall performance (r = 0.80) and each of the 10 teaching behaviors (range, r = 0.65 {confident in role as teacher and surgeon} to r = 0.85 {teaches with enthusiasm}). Stepwise multiple regression analysis (R2 = 0.76, p < 0.01) identified ratings of the following teaching behaviors as independently significant predictors (p < 0.05) of global ratings of operating room teaching: allows learners to "feel pathology" (B = 0.38), teaches with enthusiasm (B = 0.31), and remains calm and courteous (B = 0.17). CONCLUSIONS: Resident perceptions of operating room teaching by faculty surgeons are strongly associated with overall perceptions of the surgeon and with perceptions of specific teaching behaviors exhibited in the operating room. Regression analysis suggests that approximately 76% of the variability in resident evaluations of operating room teaching may be associated with the extent to which a surgeon demonstrates a positive attitude toward teaching, remains calm and courteous, and provides a "hands on" learning experience. Faculty development efforts aimed at operating room teaching that focus on reinforcing or modifying these behaviors may contribute to improved overall perceptions of faculty by residents.

Reactions of surgical program directors to a web-based interactive educational program focusing on cognitive skills.

OBJECTIVE: To assess reactions by program directors (PDs) to a preview of a scenario from the Fundamentals of Surgery Curriculum (FSC), which is a case-based interactive curriculum developed by the American College of Surgeons's (ACS) Division of Education and designed to be delivered online to first-year (PGY-1) surgical residents. DESIGN: After previewing a scenario, each PD completed a questionnaire requesting age and ratings of comfort using computers, the scenario's utility in addressing 9 educational goals (eg, provides a solid foundation for future learning), and 6 separate features of the scenario (eg, ease of use and feasibility). All ratings were based on a 1-9 scale. For items related to educational goals, ratings were anchored: 1-3 = poor/needs revision; 4-6 = adequate/as good as current methods; 7-9 = excellent/superior to current methods. Informal discussions were also conducted and comments were collected. SETTING: October 2007 ACS Clinical Congress. PARTICIPANTS: In all, 31 PDs participated in the study. RESULTS: Most PDs perceived that the scenario addressed 8 of the 9 educational goals in a manner superior to current methods [eg, provides a solid foundation for future learning (97%), challenges residents (90%), and delivers content consistent with current practices and/or evidence (90%)]. The mean ratings of all scenario features were 7 or greater on the 9-point scale. CONCLUSION: Most PDs reacted very positively to a preview of FSC perceiving that it can address several important educational goals in a manner superior to existing methods. Comments from PDs suggest a high level of interest in incorporating FSC into their residency programs as well as participating in a coordinated multi-institutional evaluation project. The results provide baseline data concerning PD expectations of the utility of FSC that will help to guide and evaluate further developments and applications of this curriculum.

Comparison of resident self-assessments with trained faculty and standardized patient assessments of clinical and technical skills in a structured educational module.

BACKGROUND: This study assessed the reliability of surgical resident self-assessment in comparison with faculty and standardized patient (SP) assessments during a structured educational module focused on perioperative management of a simulated adverse event. METHODS: Seven general surgery residents participated in this module. Residents were assessed during videotaped preoperative and postoperative SP encounters and when dissecting a tumor off of a standardized inanimate vena cava model in a simulated operating room. RESULTS: Preoperative and postoperative assessments by SPs correlated significantly (P < .05) with faculty assessments (r = .75 and r = .79, respectively), but not resident self-assessments. Coefficient alpha was greater than .70 for all assessments except resident preoperative self-assessments. CONCLUSIONS: Faculty and SP assessments can provide reliable data useful for formative feedback. Although resident self-assessment may be useful for the formative assessment of technical skills, results suggest that in the absence of training, residents are not reliable self-assessors of preoperative and postoperative interactions with SPs.

Multi-institutional validation of a web-based core competency assessment system.

OBJECTIVE: The Association of Program Directors in Surgery and the Division of Education of the American College of Surgeons developed and implemented a web-based system for end-of-rotation faculty assessment of ACGME core competencies of residents. This study assesses its reliability and validity across multiple programs. METHODS: Each assessment included ratings (1-5 scale) on 23 items reflecting the 6 core competencies. A total of 4241 end-of-rotation assessments were completed for 332 general surgery residents (> or =5 evaluations each) at 5 sites during the 2004-2005 and 2005-2006 academic years. The mean rating for each resident on each item was computed for each academic year. The mean rating of items representing each competency was computed for each resident. Additional data included USMLE and ABSITE scores, PGY, and status in program (categorical, designated preliminary, and undesignated preliminary). RESULTS: Coefficient alpha was greater than 0.90 for each competency score. Mean ratings for each competency increased significantly (p < 0.01) as a function of PGY. Mean ratings for professionalism and interpersonal/communication skills (IPC) were significantly higher than all other competencies at all PGY levels. Competency ratings of PGY 1 residents correlated significantly with USMLE Step I, ranging from (r = 0.26, p < 0.01) for Professionalism to (r = 0.41, p < 0.001) for Systems-Based Practice. Ratings of Knowledge (r = 0.31, p < 0.01), Practice-Based Learning & Improvement (PBLI; r = 0.22, p < 0.05), and Systems-Based Practice (r = 0.20, p < 0.05) correlated significantly with 2005 ABSITE Total Percentile. Ratings of all competencies correlated significantly with the 2006 ABSITE Total Percentile Score (range: r = 0.20, p < 0.05 for professionalism to r = 0.35, p < 0.001 for knowledge). Categorical and designated preliminary residents received significantly higher ratings (p < 0.05) than nondesignated preliminaries for knowledge, patient care, PBLI, and systems-based practice only. CONCLUSIONS: Faculty ratings of core competencies are internally consistent. The pattern of statistically significant correlations between competency ratings and USMLE and ABSITE scores supports the postdictive and concurrent validity, respectively, of faculty perceptions of resident knowledge. The pattern of increased ratings as a function of PGY supports the construct validity of faculty ratings of resident core competencies.