American College of Surgeons Objective Assessment of Skills in Surgery (ACS OASIS): A Formative Assessment of Junior Residents' Technical Skills.

OBJECTIVE: The objective assessment of technical skills of junior residents is essential in implementing competency-based training and providing specific feedback regarding areas for improvement. An innovative assessment that can be easily implemented by training programs nationwide has been developed by expert surgeon educators under the aegis of the American College of Surgeons (ACS) Division of Education. This assessment, ACS Objective Assessment of Skills in Surgery (ACS OASIS) uses eight stations to address technical skills important for junior residents within the domains of laparoscopic appendectomy, excision of lipoma, central line placement, laparoscopic cholecystectomy, trocar placement, exploratory laparotomy, repair of enterotomy, and tube thoracostomy. The purpose of this study was to implement ACS OASIS at a number of sites to study its psychometric rigor. DESIGN: The ACS OASIS was pre-piloted at two programs to establish feasibility and to gather information regarding implementation. Each skills station was 12 minutes long, and the faculty completed a checklist with 5 to 15 items, and a global assessment scale. The study was then repeated at three pilot sites and included 29 junior residents who were assessed by a total of 44 faculty. Psychometric data for the stations and checklists were collected and analyzed. SETTING: The pre-pilot sites were Geisinger and University of Tennessee Knoxville.Data were gathered from pilot sites that included Wellspan Health, Duke University, and University of California Los Angeles. RESULTS: The mean checklist score for all learners was 76% (IQR of 66%-85%). The average global rating was 3.36 on a 5-point scale with a standard deviation of 0.56. The overall cut score derived using the borderline group method was at 68% with 34% of performances requiring remediation. Using this criterion, the average number of stations that were completed by each learner without need for remediation was five.The station discrimination index ranged from 0.27 to 0.65 (all above the threshold of 0.25), demonstrating solid psychometric characteristics at the station level. The internal-consistency reliability was 0.76 with SEM of 5.8%. The inter-rater reliability (intraclass correlation) was high at 0.73 with general agreement of 79% between the two raters. The station discrimination was at 0.45 (range of 0.27 to 0.65) indicating a high level of differentiation between high and low performers. Using the generalizability theory, the G-coefficient reliability was at 0.72 with the reliability projection flattening after 8 stations. Overall, 75% to 82% the faculty and learners rated ACS OASIS as realistic and beneficial. CONCLUSIONS: ACS OASIS is a psychometrically sound technical skills assessment tool that can provide useful information for feedback to junior residents and support efforts to remediate gaps in performance.

The Challenges of Program Accreditation Decisions in 2021 for the ACMGE Review Committee for Surgery.

Through only a few months, the COVID-19 pandemic has greatly impacted the daily activities and education of surgical residents and fellows and the programs in which they are enrolled. The pandemic has also forced many changes for the Accreditation Council for Graduate Medical Education and its Review Committee for Surgery. This article details some of those changes and their effect on the process of conferring 2021 accreditation decisions by the Review Committee.

Concordance of Resident and Patient Perceptions of Culturally Dexterous Patient Care Skills.

PURPOSE: Disparities in surgical care persist. To mitigate these disparities, we are implementing and testing the Provider Awareness and Cultural dexterity Toolkit for Surgeons (PACTS), a curriculum to improve surgical residents' cultural dexterity during clinical encounters. We analyzed baseline data to look for concordance between residents' self-perceived cultural dexterity skills and patients' perceptions of their skills. We hypothesized that residents would rate their skills in cultural dexterity higher than patients would perceive those skills. METHODS: Prior to the implementation of the curriculum, surgical residents at 5 academic medical centers completed a self-assessment of their skills in culturally dexterous patient care using a modified version of the Cross-Cultural Care Survey. Randomly selected surgical inpatients at these centers completed a similar survey about the quality of culturally dexterous care provided by a surgery resident on their service. Likert scale responses for both assessments were classified as high (agree/strongly agree) or low (neutral/disagree/strongly disagree) competency. Resident and patient ratings of cultural dexterity were compared. Assessments were considered dexterous if 75% of responses were in the high category. Univariate and multivariate analysis was conducted using STATA 16. RESULTS: A total of 179 residents from 5 surgical residency programs completed self-assessments prior to receiving the PACTS curriculum, including 88 (49.2%) women and 97 (54.2%) junior residents (PGY 1-2s), of whom 54.7% were White, 19% were Asian, and 8.9% were Black/African American. A total of 494 patients with an average age of 55.1 years were surveyed, of whom 238 (48.2%) were female and 320 (64.8%) were White. Fifty percent of residents viewed themselves as culturally dexterous, while 57% of patients reported receiving culturally dexterous care; this difference was not statistically significant (p = 0.09). Residents who perceived themselves to be culturally dexterous were more likely to self-identify as non-White as compared to White (p < 0.05). On multivariate analysis, White patients were more likely to report highly dexterous care, whereas Black patients were more likely to report poorly dexterous care (p < 0.05). CONCLUSIONS: At baseline, half of patients reported receiving culturally dexterous care from surgical residents at 5 academic medical centers in the United States. This was consistent with residents' self-assessment of their cultural dexterity skills. White patients were more likely to report receiving culturally dexterous care as compared to non-White patients. Non-White residents were more likely to feel confident in their cultural dexterity skills. A novel curriculum has been designed to improve these interactions between patients and surgical residents.

Aminoglycoside Dosing and Volume of Distribution in Critically Ill Surgery Patients.

Background: At a tertiary referral and Level I trauma center, current institutional guidelines suggest initial aminoglycoside doses of gentamicin or tobramycin 4 mg/kg and amikacin 16 mg/kg for patients admitted to surgical intensive care units (SICUs) with suspected gram-negative infection. The objective of this study was to evaluate initial aminoglycoside dosing and peak serum drug concentrations in critically ill surgery patients to characterize the aminoglycoside volume of distribution (Vd) and determine an optimal standardized dosing strategy. Methods: This retrospective, observational, single-center study included adult SICU patients who received an aminoglycoside for additional gram-negative coverage. Descriptive statistics were used to evaluate the patient population, aminoglycoside dosing, and Vd. Multivariable linear regression was applied to determine variables associated with greater aminoglycoside Vd. The mortality rate was compared in patients who achieved adequate initial peak concentrations versus those who did not. Results: One hundred seventeen patients received an aminoglycoside in the SICUs, of whom 58 had an appropriately timed peak concentration measurement. The mean Acute Physiology, Age, and Chronic Health Evaluation (APACHE) II score was 27.8 ± 8.9. The Vd in patients receiving gentamicin, tobramycin, and amikacin was 0.49 ± 0.10, 0.41 ± 0.09, and 0.53 ± 0.13 L/kg, respectively. Together, the mean aminoglycoside Vd was 0.50 ± 0.12 L/kg. Gentamicin or tobramycin 5 mg/kg achieved goal peak concentrations in 24 patients (63.2%), and amikacin 20 mg/kg achieved the desired concentrations in nine patients (50.0%). Net fluid status, Body Mass Index, and vasopressor use were not predictive of Vd. There was no difference in the in-hospital mortality rate in patients who achieved adequate peak concentrations versus those who did not (26.8% versus 26.7%; p = 0.99). Conclusion: High aminoglycoside doses are needed in critically ill surgery patients to achieve adequate initial peak concentrations because of the high Vd. Goal peak concentrations were optimized at doses of gentamicin or tobramycin 5 mg/kg, and amikacin 20 mg/kg.

Executive Summary: Implementing an Antibiotic Stewardship Program: Guidelines by the Infectious Diseases Society of America and the Society for Healthcare Epidemiology of America.

Evidence-based guidelines for implementation and measurement of antibiotic stewardship interventions in inpatient populations including long-term care were prepared by a multidisciplinary expert panel of the Infectious Diseases Society of America and the Society for Healthcare Epidemiology of America. The panel included clinicians and investigators representing internal medicine, emergency medicine, microbiology, critical care, surgery, epidemiology, pharmacy, and adult and pediatric infectious diseases specialties. These recommendations address the best approaches for antibiotic stewardship programs to influence the optimal use of antibiotics.

Implementing an Antibiotic Stewardship Program: Guidelines by the Infectious Diseases Society of America and the Society for Healthcare Epidemiology of America.

Evidence-based guidelines for implementation and measurement of antibiotic stewardship interventions in inpatient populations including long-term care were prepared by a multidisciplinary expert panel of the Infectious Diseases Society of America and the Society for Healthcare Epidemiology of America. The panel included clinicians and investigators representing internal medicine, emergency medicine, microbiology, critical care, surgery, epidemiology, pharmacy, and adult and pediatric infectious diseases specialties. These recommendations address the best approaches for antibiotic stewardship programs to influence the optimal use of antibiotics.

Graduating Students' and Surgery Program Directors' Views of the Association of American Medical Colleges Core Entrustable Professional Activities for Entering Residency: Where are the Gaps?

OBJECTIVE: Residency program directors have increasingly expressed concern about the preparedness of some medical school graduates for residency training. The Association of American Medical Colleges recently defined 13 core entrustable professional activities (EPAs) for entering residency that residents should be able to perform without direct supervision on the first day of training. It is not known how students' perception of their competency with these activities compares with that of surgery program directors'. DESIGN: Cross-sectional survey. SETTING: All surgery training programs in the United States. PARTICIPANTS: All program directors (PDs) in the Association of Program Directors in Surgery (APDS) database (n = 222) were invited to participate in an electronic survey, and 119 complete responses were received (53.6%). Among the respondents, 83% were men and 35.2% represented community hospital programs. PDs' responses were compared with questions asking students to rate their confidence in performance of each EPA from the Association of American Medical Colleges Graduation Questionnaire (95% response). RESULTS: PDs rated their confidence in residents' performance without direct supervision for every EPA significantly lower when compared with the rating by graduating students. Although PDs' ratings continued to be lower than students' ratings, PDs from academic programs (those associated with a medical school) gave higher ratings than those from community programs. PDs generally ranked all 13 EPAs as important to being a trustworthy physician. PDs from programs without preliminary residents gave higher ratings for confidence with EPA performance as compared with PDs with preliminary residents. Among PDs with preliminary residents, there were equal numbers of those who agreed and those who disagreed that there are no identifiable differences between categorical and preliminary residents (42.7% and 41.8%, respectively). CONCLUSIONS: A large gap exists between confidence in performance of the 13 core EPAs for entering residency without direct supervision for graduating medical students and surgery program directors. Both the groups identified several key areas for improvement that may be addressed by medical school curricular interventions or expanding surgical boot camps in hopes to improve resident performance and patient safety.

Unconscious race and social class bias among acute care surgical clinicians and clinical treatment decisions.

IMPORTANCE: Significant health inequities persist among minority and socially disadvantaged patients. Better understanding of how unconscious biases affect clinical decision making may help to illuminate clinicians' roles in propagating disparities. OBJECTIVE: To determine whether clinicians' unconscious race and/or social class biases correlate with patient management decisions. DESIGN, SETTING, AND PARTICIPANTS: We conducted a web-based survey among 230 physicians from surgery and related specialties at an academic, level I trauma center from December 1, 2011, through January 31, 2012. INTERVENTIONS: We administered clinical vignettes, each with 3 management questions. Eight vignettes assessed the relationship between unconscious bias and clinical decision making. We performed ordered logistic regression analysis on the Implicit Association Test (IAT) scores and used multivariable analysis to determine whether implicit bias was associated with the vignette responses. MAIN OUTCOMES AND MEASURES: Differential response times (D scores) on the IAT as a surrogate for unconscious bias. Patient management vignettes varied by patient race or social class. Resulting D scores were calculated for each management decision. RESULTS: In total, 215 clinicians were included and consisted of 74 attending surgeons, 32 fellows, 86 residents, 19 interns, and 4 physicians with an undetermined level of education. Specialties included surgery (32.1%), anesthesia (18.1%), emergency medicine (18.1%), orthopedics (7.9%), otolaryngology (7.0%), neurosurgery (7.0%), critical care (6.0%), and urology (2.8%); 1.9% did not report a departmental affiliation. Implicit race and social class biases were present in most respondents. Among all clinicians, mean IAT D scores for race and social class were 0.42 (95% CI, 0.37-0.48) and 0.71 (95% CI, 0.65-0.78), respectively. Race and class scores were similar across departments (general surgery, orthopedics, urology, etc), race, or age. Women demonstrated less bias concerning race (mean IAT D score, 0.39 [95% CI, 0.29-0.49]) and social class (mean IAT D score, 0.66 [95% CI, 0.57-0.75]) relative to men (mean IAT D scores, 0.44 [95% CI, 0.37-0.52] and 0.82 [95% CI, 0.75-0.89], respectively). In univariate analyses, we found an association between race/social class bias and 3 of 27 possible patient-care decisions. Multivariable analyses revealed no association between the IAT D scores and vignette-based clinical assessments. CONCLUSIONS AND RELEVANCE: Unconscious social class and race biases were not significantly associated with clinical decision making among acute care surgical clinicians. Further studies involving real physician-patient interactions may be warranted.

A blended online curriculum in the basic surgery clerkship: a pilot study.

BACKGROUND: A "lectures plus clinical experiences" curriculum for surgical clerkships has significant faculty demand. A less faculty-intense blended online curriculum (BOC) could provide similar/improved academic performance compared with traditional curricula (TCs). METHODS: Following an initial pilot study, students in the surgery clerkship at Johns Hopkins during 2013 to 2014 experienced a BOC (n = 129). Students the preceding year (2012 to 2013) experienced the TC (n = 108). Performance and satisfaction were compared between groups using clinical evaluations, National Board of Medical Examiners examination scores, and clerkship evaluations. RESULTS: No significant differences in academic performance between BOC and TC students were observed on National Board of Medical Examiners examination or clinical evaluation scores. After multivariable adjustment, student year was the only significant predictor of student performance. Clerkship teaching ratings were higher for BOC students than TC students (4.25/5 vs 3.98/5, P = .03). CONCLUSIONS: BOC incorporation in the basic surgery clerkship resulted in noninferior academic outcomes and significantly improved student satisfaction.

Unconscious race and class bias: its association with decision making by trauma and acute care surgeons.

BACKGROUND: Recent studies have found that unconscious biases may influence physicians' clinical decision making. The objective of our study was to determine, using clinical vignettes, if unconscious race and class biases exist specifically among trauma/acute care surgeons and, if so, whether those biases impact surgeons' clinical decision making. METHODS: A prospective Web-based survey was administered to active members of the Eastern Association for the Surgery of Trauma. Participants completed nine clinical vignettes, each with three trauma/acute care surgery management questions. Race Implicit Association Test (IAT) and social class IAT assessments were completed by each participant. Multivariable, ordered logistic regression analysis was then used to determine whether implicit biases reflected on the IAT tests were associated with vignette responses. RESULTS: In total, 248 members of the Eastern Association for the Surgery of Trauma participated. Of these, 79% explicitly stated that they had no race preferences and 55% stated they had no social class preferences. However, 73.5% of the participants had IAT scores demonstrating an unconscious preference toward white persons; 90.7% demonstrated an implicit preference toward upper social class persons. Only 2 of 27 vignette-based clinical decisions were associated with patient race or social class on univariate analyses. Multivariable analyses revealed no relationship between IAT scores and vignette-based clinical assessments. CONCLUSION: Unconscious preferences for white and upper-class persons are prevalent among trauma and acute care surgeons. In this study, these biases were not statistically significantly associated with clinical decision making. Further study of the factors that may prevent implicit biases from influencing patient management is warranted. LEVEL OF EVIDENCE: Epidemiologic study, level II.