A Multi-Institutional Needs Assessment in the Development of a Robotic Surgery Curriculum: Perceptions From Resident and Faculty Surgeons.

BACKGROUND: The growing adoption of robotic-assisted surgery mandates residents must acquire robotic skills. No standardized curriculum for robotic surgery exists. Therefore, programs have developed their own curricula, which are often unstructured and based on resource availability. With this strategy programs may not adhere to scholarly approaches in curriculum development. We aimed to obtain a multi-institutional needs assessment to address training needs and identify integral components of a formalized robotic surgery curriculum. METHODS: A 10-question survey was distributed to general surgery residents. A separate 7-question survey was sent to robotic faculty surgeons at 3 institutions. Survey questions queried demographics, opinions regarding robotic training, proficiency definitions, and identification of procedures and instructional strategies for a curriculum. Mann- Whitney U test and Fisher's exact test were performed to compare responses amongst residents and faculty. Spearman's correlation was used to identify relationships between experience or post-graduate year (PGY) with response selection. RESULTS: Both residents and faculty believed robotic training should start in the PGY1 (55.1% vs 52%; p = 0.58). Faculty recognized robotic training to be more important compared to residents (84% vs 58.1%; p < 0.05). Both groups considered a minimum of 21 to 40 robotic cases to be sufficient exposure during training (p = 0.30). Cholecystectomy (82.4% vs 72%; p = 0.261), ventral hernia repair (89.2% vs 88%; p = 1.0), inguinal hernia repair (91.9% vs 92%; p = 1.0), and right colectomy (83.8% vs 80%; p = 0.7) were considered to be the most appropriate robotic procedures during training. Both groups concurred that bedside (91.9% vs 100%; p = 0.33) and console skills training (97.3% vs 100%; p = 1.0), small group simulation (94.6% vs 72% p = 0.005), and independent practice (87.8% vs 92% p = 0.73), were instructional strategies vital to a curriculum. Faculty considered online didactic modules (96% vs 59.5%; p < 0.05) to be more important, whereas residents favored small group experiences for fundamental skills (94.6% vs. 72%; p < 0.05) and procedure-based simulation (96% vs 64%; p < 0.05). CONCLUSIONS: Our targeted needs assessment identified requisite components of a robotics curriculum, which are feasible and accepted by both residents and faculty. Medical educators can use this as a resource to develop a formal robotics training curriculum.

American College of Surgeons Objective Assessment of Skills in Surgery (ACS OASIS): A Formative Assessment of Junior Residents' Technical Skills.

OBJECTIVE: The objective assessment of technical skills of junior residents is essential in implementing competency-based training and providing specific feedback regarding areas for improvement. An innovative assessment that can be easily implemented by training programs nationwide has been developed by expert surgeon educators under the aegis of the American College of Surgeons (ACS) Division of Education. This assessment, ACS Objective Assessment of Skills in Surgery (ACS OASIS) uses eight stations to address technical skills important for junior residents within the domains of laparoscopic appendectomy, excision of lipoma, central line placement, laparoscopic cholecystectomy, trocar placement, exploratory laparotomy, repair of enterotomy, and tube thoracostomy. The purpose of this study was to implement ACS OASIS at a number of sites to study its psychometric rigor. DESIGN: The ACS OASIS was pre-piloted at two programs to establish feasibility and to gather information regarding implementation. Each skills station was 12 minutes long, and the faculty completed a checklist with 5 to 15 items, and a global assessment scale. The study was then repeated at three pilot sites and included 29 junior residents who were assessed by a total of 44 faculty. Psychometric data for the stations and checklists were collected and analyzed. SETTING: The pre-pilot sites were Geisinger and University of Tennessee Knoxville.Data were gathered from pilot sites that included Wellspan Health, Duke University, and University of California Los Angeles. RESULTS: The mean checklist score for all learners was 76% (IQR of 66%-85%). The average global rating was 3.36 on a 5-point scale with a standard deviation of 0.56. The overall cut score derived using the borderline group method was at 68% with 34% of performances requiring remediation. Using this criterion, the average number of stations that were completed by each learner without need for remediation was five.The station discrimination index ranged from 0.27 to 0.65 (all above the threshold of 0.25), demonstrating solid psychometric characteristics at the station level. The internal-consistency reliability was 0.76 with SEM of 5.8%. The inter-rater reliability (intraclass correlation) was high at 0.73 with general agreement of 79% between the two raters. The station discrimination was at 0.45 (range of 0.27 to 0.65) indicating a high level of differentiation between high and low performers. Using the generalizability theory, the G-coefficient reliability was at 0.72 with the reliability projection flattening after 8 stations. Overall, 75% to 82% the faculty and learners rated ACS OASIS as realistic and beneficial. CONCLUSIONS: ACS OASIS is a psychometrically sound technical skills assessment tool that can provide useful information for feedback to junior residents and support efforts to remediate gaps in performance.

Impact of opioid use disorder on resource utilization and readmissions after operative trauma.

BACKGROUND: Although patients with opioid use disorder have been shown to be more susceptible to traumatic injury, the impact of opioid use disorder after trauma-related admission remains poorly characterized. The present nationally representative study evaluated the association of opioid use disorder on clinical outcomes after traumatic injury warranting operative intervention. METHODS: The 2010 to 2018 Nationwide Readmissions Database was used to identify adult trauma victims who underwent major operative procedures. Injury severity was quantified using International Classification of Diseases Trauma Mortality Prediction Model. Entropy balancing was used to adjust for intergroup differences. Multivariable regression models were developed to assess the association of opioid use disorder on in-hospital mortality, perioperative complications, resource utilization, and readmissions. RESULTS: Of an estimated 5,089,003 hospitalizations, 54,097 (1.06%) had a diagnosis of opioid use disorder with increasing prevalence during the study period. Compared with others, opioid use disorder had a lower proportion of extremity injuries and falls but greater predicted mortality measured by Trauma Mortality Prediction Model. After adjustment, opioid use disorder was associated with decreased odds of in-hospital mortality (adjusted odds ratio: 0.61; 95% confidence interval, 0.53-0.70) but had greater likelihood of pneumonia, infectious complications, and acute kidney injury. Additionally, opioid use disorder was associated with longer hospitalization duration as well as greater index costs and risk of readmission within 30 days (adjusted odds ratio: 1.36; 95% confidence interval, 1.25-1.49). CONCLUSION: Opioid use disorder in operative trauma has significantly increased in prevalence and is associated with decreased in-hospital index mortality but greater resource utilization and readmission.

Persistence of Gender Bias Over Four Decades of Surgical Training.

OBJECTIVE: Female surgeons face gender-specific obstacles during residency training, yet longitudinal data on gender bias experienced by female surgery residents are lacking. We aimed to investigate the evolution of gender bias, identify obstacles experienced by female general surgery residents, and discuss approaches to supporting female surgeons during residency training. METHODS: Between August 2019 and January 2021, we conducted a retrospective cohort study using structured telephone interviews of female graduates of the UCLA General Surgery Residency training program. Responses of early graduates (1981-2009) were compared with those of recent graduates (2010-2020). Quantitative data were compared with Fisher's exact tests and Chi-squared tests. Interview responses were reviewed to catalog gender bias, obstacles experienced by female surgeons, and advice offered to training programs to address women's concerns. RESULTS: Of 61 female surgery residency graduates, 37 (61%) participated. Compared to early graduates (N = 20), recent graduates (N = 17) were significantly more likely to pursue fellowship training (100% vs. 65%, p < 0.01) and have children before or during residency (65% vs. 25%, p = 0.02). A substantial proportion in each cohort experienced some form of gender bias (71% vs. 85%, p = 0.43). Compared to early graduates, recent graduates were significantly less likely to report experiencing explicit gender bias (12% vs. 50%, p = 0.02) but equally likely to report implicit gender bias (71% vs. 55%, p = 0.50). Female graduates across the decades advocated for specific measures to champion work-life balance in residency (51%), strengthen female mentorship (49%), increase childcare support (41%), and promote women into leadership positions (32%). CONCLUSIONS: While having children during residency has become more common and accepted over the decades, female surgery residents continue to experience implicit gender bias in the workplace. Female surgeons advocate for targeted interventions to establish systems for parental leave, address gender bias, and strengthen female mentorship.

The coronavirus disease 2019 (COVID-19) stay-at-home order's unequal effects on trauma volume by insurance status in Southern California.

BACKGROUND: The rapid spread of coronavirus disease 2019 in the United States led to a variety of mandates intended to decrease population movement and "flatten the curve." However, there is evidence some are not able to stay-at-home due to certain disadvantages, thus remaining exposed to both coronavirus disease 2019 and trauma. We therefore sought to identify any unequal effects of the California stay-at-home orders between races and insurance statuses in a multicenter study utilizing trauma volume data. METHODS: A posthoc multicenter retrospective analysis of trauma patients presenting to 11 centers in Southern California between the dates of January 1, 2020, and June 30, 2020, and January 1, 2019, and June 30, 2019, was performed. The number of trauma patients of each race/insurance status was tabulated per day. We then calculated the changes in trauma volume related to stay-at-home orders for each race/insurance status and compared the magnitude of these changes using statistical resampling. RESULTS: Compared to baseline, there was a 40.1% drop in total trauma volume, which occurred 20 days after stay-at-home orders. During stay-at-home orders, the average daily trauma volume of patients with Medicaid increased by 13.7 ± 5.3%, whereas the volume of those with Medicare, private insurance, and no insurance decreased. The average daily trauma volume decreased for White, Black, Asian, and Latino patients with the volume of Black and Latino patients dropping to a similar degree compared to White patients. CONCLUSION: This retrospective multicenter study demonstrated that patients with Medicaid had a paradoxical increase in trauma volume during stay-at-home orders, suggesting that the most impoverished groups remain disproportionately exposed to trauma during a pandemic, further exacerbating existing health disparities.

Screen-Based Simulation for Training and Automated Assessment of Teamwork Skills: Comparing 2 Modes With Different Interactivity.

INTRODUCTION: The need for teamwork training is well documented; however, teaching these skills is challenging given the logistics of assembling individual team members together to train in person. We designed 2 modes of screen-based simulation for training teamwork skills to assess whether interactivity with nonplayer characters was necessary for in-game performance gains or for player satisfaction with the experience. METHODS: Mixed, randomized, repeated measures study with licensed healthcare providers block-stratified and randomized to evaluation-participant observes and evaluates the team player in 3 scenarios-and game play-participant is immersed as the leader in the same 3 scenarios. Teamwork construct scores (leadership, communication, situation monitoring, mutual support) from an ontology-based, Bayesian network assessment model were analyzed using mixed randomized repeated measures analyses of variance to compare performance, across scenarios and modes. Learning was measured by pretest and posttest quiz scores. User experience was evaluated using χ2 analyses. RESULTS: Among 166 recruited and randomized participants, 120 enrolled in the study and 109 had complete data for analysis. Mean composite teamwork Bayesian network scores improved for successive scenarios in both modes, with evaluation scores statistically higher than game play for every teamwork construct and scenario (r = 0.73, P = 0.000). Quiz scores improved from pretest to posttest (P = 0.004), but differences between modes were not significant. CONCLUSIONS: For training teamwork skills using screen-based simulation, interactivity of the player with the nonplayer characters is not necessary for in-game performance gains or for player satisfaction with the experience.

Use of Entrustable Professional Activities in the Assessment of Surgical Resident Competency.

Importance: Competency-based assessments of surgical resident performance require metrics of entrustable autonomy. Objectives: To designate entrustable professional activities (EPAs) in global performance and in specific operations, and to identify differences in perceived capability, autonomy, and expectations between surgical faculty and residents. Design, Setting, and Participants: This survey study was conducted from August 9, 2016, through August 24, 2016, in the Department of Surgery at the UCLA David Geffen School of Medicine. The survey instrument consisted of 5-point Likert scales for assessing perceptions of entrustability for 5 global and 5 operative EPAs. Faculty members were surveyed regarding resident capabilities and expected capabilities by postgraduate year. Residents were surveyed regarding their own capabilities, actual autonomy entrusted in the last EPA performed, and expected capabilities. Main Outcomes and Measures: Differences in mean ratings were assessed across 7 comparison domains. Results: Among 78 total faculty members, 31 (40%) participated in the survey. Among 49 residents, 39 (80%) participated in the survey. Residents generally rated their global EPA performance higher than the faculty did (mean, 3.7 vs 2.8; P < .01), but operative EPA performance ratings were equivalent (mean, 2.7 vs 2.4; P < .12). Faculty members perceived senior residents as underperforming expectations in operative EPAs. Most faculty members (80%) expected residents not to be independently capable of performing complex operations by graduation. Faculty members perceived residents in postgraduate years 4 and 5 to have greater operative capability than the level of autonomy entrusted to those residents (95% CI, 3.3-3.5 vs 1.9-2.2). Conclusions and Relevance: Global and operative EPAs are practical for developing competency-based curricula. Graduated autonomy should be granted to improve the operative experience for residents.

Comparative Analysis of Simulated versus Live Patient-Based FAST (Focused Assessment With Sonography for Trauma) Training.

OBJECTIVE: To investigate whether simulated patient (SP)-based training has comparable efficacy as live patient (LP)-based training in teaching Focused Abdominal Sonography for Trauma (FAST) knowledge and skill competencies to surgical residents. DESIGN: A randomized pretest/intervention/posttest controlled study design was employed to compare the participants' performance in written and practical examinations regarding FAST examination after SP-based versus LP-based training. SETTING: University-based general residency program at a single institution. PARTICIPANTS: A total of 29 general surgery residents of various training levels and sonographic experience were recruited by convenience sampling. RESULTS: There was no correlation between subjects' baseline training level or sonographic experience with either the posttest-pretest score difference or the percentage of subjects getting all 4 windows with adequate quality. There was no significant difference between the improvement in written posttest-pretest scores for SP and LP group, which were 33 ± 9.6 and 31 ± 6.8 (p = 0.40), respectively. With regard to performance-based learning efficacy, a statistically higher proportion of subjects were able to obtain all 4 windows with adequate quality among the LP than the SP group (6/8 vs 1/8, p = 0.01). CONCLUSION: SP- and LP-based FAST training for surgical residents were associated with similar knowledge-based competency acquisition, but residents receiving LP-based training were better at acquiring adequate FAST windows on live patients. Simulation training appeared to be a valid adjunct to LP practice but cannot replace LP training. Future investigations on how to improve simulation fidelity and its training efficacy for skill-based competencies are warranted.

Assessment of resident operative performance using a real-time mobile Web system: preparing for the milestone age.

OBJECTIVE: To satisfy trainees' operative competency requirements while improving feedback validity and timeliness using a mobile Web-based platform. DESIGN: The Southern Illinois University Operative Performance Rating Scale (OPRS) was embedded into a website formatted for mobile devices. From March 2013 to February 2014, faculty members were instructed to complete the OPRS form while providing verbal feedback to the operating resident at the conclusion of each procedure. Submitted data were compiled automatically within a secure Web-based spreadsheet. Conventional end-of-rotation performance (CERP) evaluations filed 2006 to 2013 and OPRS performance scores were compared by year of training using serial and independent-samples t tests. The mean CERP scores and OPRS overall resident operative performance scores were directly compared using a linear regression model. OPRS mobile site analytics were reviewed using a Web-based reporting program. SETTING: Large university-based general surgery residency program. PARTICIPANTS: General Surgery faculty used the mobile Web OPRS system to rate resident performance. Residents and the program director reviewed evaluations semiannually. RESULTS: Over the study period, 18 faculty members and 37 residents logged 176 operations using the mobile OPRS system. There were 334 total OPRS website visits. Median time to complete an evaluation was 45 minutes from the end of the operation, and faculty spent an average of 134 seconds on the site to enter 1 assessment. In the 38,506 CERP evaluations reviewed, mean performance scores showed a positive linear trend of 2% change per year of training (p = 0.001). OPRS overall resident operative performance scores showed a significant linear (p = 0.001), quadratic (p = 0.001), and cubic (p = 0.003) trend of change per year of clinical training, reflecting the resident operative experience in our training program. Differences between postgraduate year-1 and postgraduate year-5 overall performance scores were greater with the OPRS (mean = 0.96, CI: 0.55-1.38) than with CERP measures (mean = 0.37, CI: 0.34-0.41). Additionally, there were consistent increases in each of the OPRS subcategories. CONCLUSIONS: In contrast to CERPs, the OPRS fully satisfies the Accreditation Council for Graduate Medical Education and American Board of Surgery operative assessment requirements. The mobile Web platform provides a convenient interface, broad accessibility, automatic data compilation, and compatibility with common database and statistical software. Our mobile OPRS system encourages candid feedback dialog and generates a comprehensive review of individual and group-wide operative proficiency in real time.

Evaluation of hospital readmissions in surgical patients: do administrative data tell the real story?

IMPORTANCE: The Centers for Medicare & Medicaid Services has developed an all-cause readmission measure that uses administrative data to measure readmission rates and financially penalize hospitals with higher-than-expected readmission rates. OBJECTIVES: To examine the accuracy of administrative codes in determining the cause of readmission as determined by medical record review, to evaluate the readmission measure's ability to accurately identify a readmission as planned, and to document the frequency of readmissions for reasons clinically unrelated to the original hospital stay. DESIGN, SETTING, AND PARTICIPANTS: Retrospective review of all consecutive patients discharged from general surgery services at a tertiary care, university-affiliated teaching hospital during 8 consecutive quarters (quarter 4 [October through December] of 2009 through quarter 3 [July through September] of 2011). Clinical readmission diagnosis determined from direct medical record review was compared with the administrative diagnosis recorded in a claims database. The number of planned hospital readmissions defined by the readmission measure was compared with the number identified using clinical data. Readmissions unrelated to the original hospital stay were identified using clinical data. MAIN OUTCOMES AND MEASURES: Discordance rate between administrative and clinical diagnoses for all hospital readmissions, discrepancy between planned readmissions defined by the readmission measure and identified by clinical medical record review, and fraction of hospital readmissions unrelated to the original hospital stay. RESULTS: Of the 315 hospital readmissions, the readmission diagnosis listed in the administrative claims data differed from the clinical diagnosis in 97 readmissions (30.8%). The readmission measure identified 15 readmissions (4.8%) as planned, whereas clinical data identified 43 readmissions (13.7%) as planned. Unrelated readmissions comprised 70 of the 258 unplanned readmissions (27.1%). CONCLUSIONS AND RELEVANCE: Administrative billing data, as used by the readmission measure, do not reliably describe the reason for readmission. The readmission measure accounts for less than half of the planned readmissions and does not account for the nearly one-third of readmissions unrelated to the original hospital stay. Implementation of this readmission measure may result in unwarranted financial penalties for hospitals.

Does health care insurance affect outcomes after traumatic brain injury? Analysis of the National Trauma Databank.

Increasing evidence indicates insurance status plays a role in the outcome of trauma patients; however its role on outcomes after traumatic brain injury (TBI) remains unclear. A retrospective review was queried within the National Trauma Data Bank. Moderate to severe TBI insured patients were compared with their uninsured counterparts with respect to demographics, Injury Severity Score, Glasgow Coma Scale score, and outcome. Multivariate logistic regression analysis was used to determine independent risk factors for mortality. Of 52,344 moderate to severe TBI patients, 41,711 (79.7%) were insured. Compared with the uninsured, insured TBI patients were older (46.1 +/- 22.4 vs. 37.3 +/- 16.3 years, P < 0.0001), more severely injured (ISS > or =16: 78.4% vs. 74.4%, P < 0.0001), had longer intensive care unit length of stay (6.0 +/- 9.4 vs. 5.1 +/- 7.6, P < 0.0001) and had higher mortality (9.3% vs. 8.0%, P < 0.0001). However, when controlling for confounding variables, the presence of insurance had a significant protective effect on mortality (adjusted odds ratio 0.89; 95% confidence interval: 0.82-0.97, P = 0.007). This effect was most noticeable in patients with head abbreviated injury score = 5 (adjusted odds ratio 0.7; 95% confidence interval: 0.6-0.8, P < 0.0001), indicating insured severe TBI patients have improved outcomes compared with their uninsured counterparts. There is no clear explanation for this finding however the role of insurance in outcomes after trauma remains a topic for further investigation.