Opportunities and Applications of Educational Technologies in Surgical Education and Assessment.

BACKGROUND: Surgical education is challenged by continuously increasing clinical content, greater subspecialization, and public scrutiny of access to high quality surgical care. Since the last Blue Ribbon Committee on surgical education, novel technologies have been developed including artificial intelligence and telecommunication. OBJECTIVES AND METHODS: The goals of this Blue Ribbon Sub-Committee were to describe the latest technological advances and construct a framework for applying these technologies to improve the effectiveness and efficiency of surgical education and assessment. An additional goal was to identify implementation frameworks and strategies for centers with different resources and access. All sub-committee recommendations were included in a Delphi consensus process with the entire Blue Ribbon Committee (N=67). RESULTS: Our sub-committee found several new technologies and opportunities that are well poised to improve the effectiveness and efficiency of surgical education and assessment (see Tables 1-3). Our top recommendation was that a Multidisciplinary Surgical Educational Council be established to serve as an oversight body to develop consensus, facilitate implementation, and establish best practices for technology implementation and assessment. This recommendation achieved 93% consensus during the first round of the Delphi process. CONCLUSION: Advances in technology-based assessment, data analytics, and behavioral analysis now allow us to create personalized educational programs based on individual preferences and learning styles. If implemented properly, education technology has the promise of improving the quality and efficiency of surgical education and decreasing the demands on clinical faculty.

Society for Simulation in Healthcare Guidelines for Simulation Training.

BACKGROUND: Simulation has become a staple in the training of healthcare professionals with accumulating evidence on its effectiveness. However, guidelines for optimal methods of simulation training do not currently exist. METHODS: Systematic reviews of the literature on 16 identified key questions were conducted and expert panel consensus recommendations determined using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) methodology. OBJECTIVE: These evidence-based guidelines from the Society for Simulation in Healthcare intend to support healthcare professionals in decisions on the most effective methods for simulation training in healthcare. RESULTS: Twenty recommendations on 16 questions were determined using GRADE. Four expert recommendations were also provided. CONCLUSIONS: The first evidence-based guidelines for simulation training are provided to guide instructors and learners on the most effective use of simulation in healthcare.

Incubation with porcine urinary bladder matrix yields a late-stage wound transcriptome in endothelial cells and keratinocytes isolated from both diabetic and non-diabetic subjects.

Proper wound closure requires the functional coordination of endothelial cells (ECs) and keratinocytes. In the late stages of wound healing, keratinocytes become activated and ECs promote the maturation of nascent blood vessels. In diabetes mellitus, decreased keratinocyte activation and impaired angiogenic action of ECs delay wound healing. Porcine urinary bladder matrix (UBM) improves the rate of wound healing, but the effect of exposure to UBM under diabetic conditions remains unclear. We hypothesized that keratinocytes and ECs isolated from both diabetic and non-diabetic donors would exhibit a similar transcriptome representative of the later stages of wound healing following incubation with UBM. Human keratinocytes and dermal ECs isolated from non-diabetic and diabetic donors were incubated with and without UBM particulate. RNA-Seq analysis was performed to identify changes in the transcriptome of these cells associated with exposure to UBM. While diabetic and non-diabetic cells exhibited different transcriptomes, these differences were minimized following incubation with UBM. ECs exposed to UBM exhibited changes in the expression of transcripts suggesting an increase in the endothelial-mesenchymal transition (EndoMT) associated with vessel maturation. Keratinocytes incubated with UBM demonstrated an increase in markers of activation. Comparison of the whole transcriptomes with public datasets suggested increased EndoMT and keratinocyte activation following UBM exposure. Both cell types exhibited loss of pro-inflammatory cytokines and adhesion molecules. These data suggest that application of UBM may accelerate healing by promoting a transition to the later stages of wound healing. This healing phenotype is achieved in cells isolated from both diabetic and non-diabetic donors.

Better than the real thing? Success of a virtual platform for an established "Train the Trainer" course.

BACKGROUND: The Society of American Gastrointestinal and Endoscopic Surgeons (SAGES) uses the Laparoscopic colectomy Train the Trainer (Lapco TT) framework for standardization of instructor training for Hands-On surgical skills courses. The curriculum focuses on teaching structure, skills deconstruction, trainer intervention framework, and performance enhancing feedback. A halt in the in-person Lapco TT courses due to the Coronavirus Disease 2019 (COVID-19) pandemic necessitated creation of a virtual alternative. We investigated the effectiveness of this virtual course. METHODS: Adaptation of the in-person Lapco TT course to the virtual format retained the majority of content as well as the 4:6 instructor-to-participant ratio. The virtual platform and simulators chosen allowed maximal interactivity and ease of use. After participating in the day and one half course, participants completed an 8-item post-course survey using a 5-point Likert scale related to the training experience. In addition, they had the opportunity to provide answers to several open-ended questions regarding the course. For the survey, frequency counts provided an assessment of each item. For the open questions, qualitative analysis included determination of themes for each question. Frequency counts of each theme provided quantitative analysis. RESULTS: Thirty-six total participants completed a Lapco TT virtual course (six sessions of six participants). Of this number, 32 participants completed post-course surveys and questions. All the participants completing the survey would very likely or definitely (Likert scale 4, 5) recommend the course to a colleague and incorporate the teaching in their practice. The majority of participants completing open-ended questions felt the virtual course format was effective; half thought that post-course follow-up would be useful. Technical concerns were an issue using the virtual format. CONCLUSION: A virtual Lapco TT course is feasible and well received by participants. It presents a potentially more cost effective option to faculty development.

Comprehensive Literature Search to Identify Assessment Tools for Operating Room Nontechnical Skills to Determine Common Critical Components.

BACKGROUND: Effective use of nontechnical skills (NTS) contributes to the provision of safe, quality care in the fast-paced, dynamic setting of the operating room (OR). Inter-professional education of NTS to OR team members can improve performance. Such training requires the accurate measurement of NTS in order to identify gaps in their utilization by OR teams. Although several instruments for measuring OR NTS exist in the literature, each tool tends to define specific NTS differently. AIM: We aimed to determine commonalities in defined measurements among existing OR NTS tools. METHODS: We undertook a comprehensive literature review of assessment tools for OR NTS to determine the critical components common to these instruments. A PubMed search of the literature from May 2009 to May 2019 combined various combinations of keywords and Medical Subject Headings (MeSH) related to the following subjects: teamwork, teams, assessment, debriefing, surgery, operating room, nontechnical, communication. From this start, articles were selected describing specific instruments. Three reviewers then identified the common components measured among these assessment tools. Reviewers collated kin constructs within each instrument using frequency counts of similarly termed and conceptualized components. RESULTS: The initial PubMed search produced 119 articles of which 24 articles satisfied the inclusion criteria. Within these articles, 10 assessment tools evaluated OR NTS. Kin constructs were grouped into six NTS categories in the following decreasing frequency order: communication, situation awareness, teamwork, leadership, decision making, and task management/decision making (equal). CONCLUSION: NTS OR assessment tools in the literature have a variety of kin constructs related to the specific measured components within the instruments. Such kin constructs contain thematic cohesion across six primary NTS groupings with some variation in scale and scope. Future plans include using this information to develop an easy-to-use assessment tool to assist with debriefing in the clinical environment.

Improvement in student-led debriefing analysis after simulation-based team training using a revised teamwork assessment tool.

BACKGROUND: Team debriefing is an important teamwork development intervention for improving team outputs in healthcare. Debriefing is a key component of experiential team training teamwork development interventions such as simulation-based training. Improving the quality of debriefing of healthcare teams, therefore, has multiple benefits. We investigated whether the quality of student-led debriefing improved using a shortened guide. METHODS: Senior medical students, nurse anesthesia students, and senior undergraduate nursing students participated in student operating room team training at a health sciences center in the southeastern United States. Student teams participated in a dual-scenario simulation-based training session with immediate after-action debriefings after each scenario. In 2018, student teams conducted the second debriefing using as a guide the teamwork assessment scale, an 11-item, 3-subscale, 6-point Likert-type instrument. In 2019, they used a shortened, revised, 5-item version of the teamwork assessment scale, the quick teamwork assessment scale. Trained observers rated the quality of the student-led debriefings using the Objective Structured Assessment of Debriefing, an 8-item, 5-point instrument. The Wilcoxon-Mann-Whitney test was used to compare the teamwork assessment scale-guided and the quick teamwork assessment scale-guided mean item debriefing scores. RESULTS: Two observers rated 3 student-led team debriefings using the teamwork assessment scales as a guide in 2018, and 6 such debriefings happened using the quick teamwork assessment scale as a guide in 2019. For each debriefing, observer scores were averaged for each Objective Structured Assessment of Debriefing item; these mean scores were then averaged with other mean scores for each year. The use of the quick teamwork assessment scale resulted in a statistically significant higher mean score for the Analysis Objective Structured Assessment of Debriefing item compared with the use of the teamwork assessment scale (4.92 [standard deviation 0.20] versus 3.83 [standard deviation 0.76], P = .023). CONCLUSION: The use of a shortened teamwork assessment instrument as a debriefing guide for student teams in student operating room team training was more effective in analysis of actions than the original, longer tool. Next steps include determining the efficacy of the quick teamwork assessment scale in an actual clinical setting.

Brick in the wall? Linking quality of debriefing to participant learning in team training of interprofessional students.

Background: The evidence for the conventional wisdom that debriefing quality determines the effectiveness of learning in simulation-based training is lacking. We investigated whether the quality of debriefing in using simulation-based training in team training correlated with the degree of learning of participants. Methods: Forty-two teams of medical and undergraduate nursing students participated in simulation-based training sessions using a two-scenario format with after-action debriefing. Observers rated team performance with an 11-item Teamwork Assessment Scales (TAS) instrument (three subscales, team-based behaviours (5-items), shared mental model (3-items), adaptive communication and response (3-items)). Two independent, blinded raters evaluated video-recorded facilitator team prebriefs and debriefs using the Objective Structured Assessment of Debriefing (OSAD) 8-item tool. Descriptive statistics were calculated, t-test comparisons made and multiple linear regression and univariate analysis used to compare OSAD item scores and changes in TAS scores. Results: Statistically significant improvements in all three TAS subscales occurred from scenario 1 to 2. Seven faculty teams taught learners with all scores ≥3.0 (except two) for prebriefs and all scores ≥ 3.5 (except one) for debriefs (OSAD rating 1=done poorly to 5=done well). Linear regression analysis revealed a single statistically significant correlation between debrief engagement and adaptive communication and response score without significance on univariate analysis. Conclusions: Quality of debriefing does not seem to increase the degree of learning in interprofessional education using simulation-based training of prelicensure student teams. Such a finding may be due to the relatively high quality of the prebrief and debrief of the faculty teams involved in the training.

Modulation of inflammation in wounds of diabetic patients treated with porcine urinary bladder matrix.

Aim: To determine if porcine urinary bladder matrix (UBM) treatment is associated with modulation of wound inflammation in diabetic patients. Patients & methods: mRNA associated with M1 and M2 macrophages were measured in wounds of diabetic and nondiabetic patients pre- and post-treatment with UBM and an M1:M2 score was calculated. Results: Wound tissue from diabetic subjects exhibited elevated M1:M2 scores compared with nondiabetic patients, suggesting a greater pro-inflammatory state prior to treatment. Post-treatment, there was significantly greater reduction in the magnitude of the individual M1:M2 scores in the diabetic patients resulting in similar levels in both groups of patients. Conclusions: UBM may assist in diabetic wound healing by restoring an inflammatory state similar to that of nondiabetic patients.

Quality with quantity? Evaluating interprofessional faculty prebriefs and debriefs for simulation training using video.

BACKGROUND: High-fidelity simulation-based training is used increasingly for prelicensure student teams. Such sessions rely on faculty who are able to provide quality prebriefing and debriefing to foster learning among participants. We investigated how well faculty conducted prebriefing and debriefing as part of high-fidelity simulation-based training for interprofessional education. METHODS: Two trained observers independently rated 38 video-recorded sessions of combinations of 4 faculty conducting prebriefings and debriefings of prelicensure student teams after high-fidelity simulation-based training. Assessment was undertaken using the Objective Structured Assessment of Debriefing, an 8-item tool using a 5-point Likert scale (1 as minimum and 5 as maximum). Mean scores for each item were calculated. Inter-rater agreement was determined using Cohen's kappa. A one-way between-subjects analysis of variance with post-hoc Tukey's studentized range procedure was conducted to compare the effect of team facilitator grouping on the quality of team performance of each Objective Structured Assessment of Debriefing element during a prebriefing or a debriefing. Trend analyses of teams with 4 or more observations were performed using Kendall's Tau coefficient test and linear regression analyses to identify whether teams showed improvement through time. Statistical significance was set at P < .05. RESULTS: A total of 7 combinations of faculty conducted between 1 to 14 prebriefings or debriefings. In general, faculty combinations performed better during debriefings compared with prebriefings, with only 1 team having 1 mean item score <3.50. Statistically significant differences between faculty combinations in mean item scores was more pronounced during the prebriefings (2 of 3 Objective Structured Assessment of Debriefing items rated) than during debriefings (1 of 8 Objective Structured Assessment of Debriefing items rated). Effect sizes were strong for all differences. Linear regression analysis revealed a statistically significant change through time for the 3 rated prebriefing items and for 7 of the 8 rated debriefing items. CONCLUSION: Interprofessional faculty combinations in this study tended to have good quality prebriefings and debriefings. The quality of the prebriefings and debriefings can, however, be influenced by the composition of the facilitator teams, most prominently for prebriefings, and team performance does appear to change through time, especially during the debriefing. Future work will focus on whether the quality of prebriefings and debriefings influences learning by trainees.

Examining interprofessional learning perceptions among students in a simulation-based operating room team training experience.

High-fidelity simulation (HFS) operating room (OR) inter-professional team training improves healthcare students' team-based attitudes and behaviours. Such improvements can diminish tribalism among the professions in the OR by overcoming entrenched perceptions of team members. We investigated whether simulation-based interprofessional student OR team training impacts students differently based on their professional background. From 2010 to 2013, HFS OR interprofessional student team training sessions were conducted involving senior medical students, senior undergraduate nursing students, and nurse anaesthesia students. The training involved a two-scenario format, each followed by a structured debriefing focusing on team-based competencies. Before and after each session, students completed a 15-item teamwork competencies self-efficacy survey as well as, from 2012-2013, the Readiness for Interprofessional Learning Scale (RIPLS). At the end of each session, they also completed a 6-item rating scale assessing overall team function during the session. Mean scores were calculated for each student professional group, post/pre mean differences were determined, and student t-test and ANOVA analyses were employed to compare within and between-group differences, respectively. Response rates were over 80% for each scale used. Medical students and undergraduate nursing students had significant improvements in team-based attitudes post- to pre-session. Medical students and nurse anaesthesia students had significant improvements in RIPLS scores. Statistically significant improvements from post- to pre-session were seen overall for both team-based attitudes (effect size = 0.83) and RIPLS (effect size = 0.37). The difference between the team-based scores between professions was significant; RIPLS differences were not. No significant difference existed between professions related to overall teamwork scores. HFS OR team training of healthcare students has beneficial but variable benefits for each professional group.

eAssessment: development of an electronic version of the Objective Structured Assessment of Debriefing tool to streamline evaluation of video recorded debriefings.

Objective: The Objective Structured Assessment of Debriefing (OSAD) is an evidence-based, 8-item tool that uses a behaviorally anchored rating scale in paper-based form to evaluate the quality of debriefing in medical education. The objective of this project was twofold: 1) to create an easy-to-use electronic format of the OSAD (eOSAD) in order to streamline data entry; and 2) to pilot its use on videoed debriefings. Materials and Methods: The eOSAD was developed in collaboration with the LSU Health New Orleans Epidemiology Data Center using SurveyGizmo (Widgix Software, LLC, Boulder, CO, USA) software. The eOSAD was then piloted by 2 trained evaluators who rated 37 videos of faculty teams conducting pre-briefing and debriefing after a high-fidelity trauma simulation. Inter-rater reliability was assessed, and evaluators' qualitative feedback was obtained. Results: Inter-rater reliability was good [prebrief, intraclass correlation coefficient, ICC = 0.955 (95% CI, 0.912-0.977), P < .001; debrief, ICC = 0.853 (95% CI, 0.713-0.924), P < .001]. Qualitative feedback from evaluators found that the eOSAD was easy to complete, simple to read and add comments, and reliably stored data that were readily retrievable, enabling the smooth dissemination of information collected. Discussion: The eOSAD features a secure login, sharable internet access link for distant evaluators, and the immediate exporting of data into a secure database for future analysis. It provided convenience for end-users, produced reliable assessments among independent evaluators, and eliminated multiple sources of possible data corruption. Conclusion: The eOSAD tool format advances the post debriefing evaluation of videoed inter-professional team training in high-fidelity simulation.

Priorities Related to Improving Healthcare Safety Through Simulation.

STATEMENT: Improving healthcare safety is a worthwhile and important endeavor. Simulation-based activities can help with such a goal through research and training. In this manner, it can focus on education and training, assessment and metrics, process improvement, and culture change to help move forward both patient safety and quality of care.This article will address the following three main topics: (1) designing simulation-based activities to promote high reliability in healthcare, (2) developing simulation-based activities to foster resilience in healthcare systems, and (3) evaluating the impact of adverse events in healthcare and how simulation-based activities can be used to determine and potentially to prevent their cause. These topics will be treated sequentially, providing synopses of concepts and giving examples of research currently being undertaken. It will then highlight current priorities for simulation-based research in this domain by drawing from insights obtained and a targeted literature review.

The Second Society for Simulation in Healthcare Research Summit: Beyond our Boundaries.

STATEMENT: In this article, we report on the Second Society for Simulation in Healthcare Research Summit held in 2017. This meeting succeeded the First Research Summit from 2011 with the goal of advancing the scope of healthcare simulation research. During the one and a half day summit, some of the world's leading experts in simulation, healthcare, and simulation in healthcare convened to discuss ideas about what research goals would be most beneficial to the healthcare simulation community, and what could be done to achieve them. We describe the rationale for the meeting, the organization, the program, and the articles that emerged from the Summit, which are found in this supplemental issue of Simulation in Healthcare.

Using Simulation to Improve Systems-Based Practices.

BACKGROUND: Ensuring the safe, effective management of patients requires efficient processes of care within a smoothly operating system in which highly reliable teams of talented, skilled health care providers are able to use the vast array of high-technology resources and intensive care techniques available. Simulation can play a unique role in exploring and improving the complex perioperative system by proactively identifying latent safety threats and mitigating their damage to ensure that all those who work in this critical health care environment can provide optimal levels of patient care. METHODS: A panel of five experts from a wide range of institutions was brought together to discuss the added value of simulation-based training for improving systems-based aspects of the perioperative service line. Panelists shared the way in which simulation was demonstrated at their institutions. The themes discussed by each panel member were delineated into four avenues through which simulation-based techniques have been used. RESULTS: Simulation-based techniques are being used in (1) testing new clinical workspaces and facilities before they open to identify potential latent conditions; (2) practicing how to identify the deteriorating patient and escalate care in an effective manner; (3) performing prospective root cause analyses to address system weaknesses leading to sentinel events; and (4) evaluating the efficiency and effectiveness of the electronic health record in the perioperative setting. CONCLUSION: This focused review of simulation-based interventions to test and improve components of the perioperative microsystem, which includes literature that has emerged since the panel's presentation, highlights the broad-based utility of simulation-based technologies in health care.

Learning how to "teach one": A needs assessment of the state of faculty development within the Consortium of the American College of Surgeons Accredited Education Institutes.

BACKGROUND: Developing faculty competencies in curriculum development, teaching, and assessment using simulation is critical for the success of the Consortium of the American College of Surgeons Accredited Education Institutes program. The state of and needs for faculty development in the Accredited Education Institute community are unknown currently. The Faculty Development Committee of the Consortium of the Accredited Education Institutes conducted a survey of Accredited Education Institutes to ascertain what types of practices are used currently, with what frequency, and what needs are perceived for further programs and courses to guide the plan of action for the Faculty Development Committee. METHODS: The Faculty Development Committee created a 20-question survey with quantitative and qualitative items aimed at gathering data about practices of faculty development and needs within the Consortium of Accredited Education Institutes. The survey was sent to all 83 Accredited Education Institutes program leaders via Survey Monkey in January 2015 with 2 follow-up reminders. Quantitative data were compiled and analyzed using descriptive statistics, and qualitative data were interpreted for common themes. RESULTS: Fifty-four out of the 83 programs (65%) responded to the survey. Two-thirds of the programs had from 1 to 30 faculty teaching at their Accredited Education Institutes. More than three-quarters of the programs taught general surgery, emergency medicine, or obstetrics/gynecology. More than 60% of programs had some form of faculty development, but 91% reported a need to expand their offerings for faculty development with "extreme value" for debriefing skills (70%), assessment (47%), feedback (40%), and curriculum development (40%). Accredited Education Institutes felt that the Consortium could assist with faculty development through such activities as the provision of online resources, sharing of best practices, provision of a blueprint for development of a faculty curriculum and information related to available, credible master programs of faculty development and health professions education. CONCLUSION: Many Accredited Education Institutes programs are engaged in faculty development activities, but almost all see great needs in faculty development related to debriefing, assessment, and curricular development. These results should help to guide the action and decision-making of the Consortium Faculty Development Committee to improve teaching within the American College of Surgeons Accredited Education Institutes.

Introductions During Time-outs: Do Surgical Team Members Know One Another's Names?

BACKGROUND: Introductions are the first item of the time-out in the World Health Organization Surgical Safety Checklist (SSC). It has yet to be established that surgical teams use colleagues' names or consider the use of names important. A study was conducted to determine if using the SSC has a measurable impact on name retention and to assess if operating room (OR) personnel believe it is important to know the names of their colleagues or for their colleagues to know theirs. METHODS: All OR personnel were individually interviewed at the end of 25 surgical cases in which the SSC was used. They were asked (1) to name each OR participant, and (2) if they believed it is important to know the names of their team members and (3) for their team members to know their name. RESULTS: Of the 150 OR personnel interviewed, 147 (98%) named the surgery attending correctly. The surgery attending named only 44% of other OR staff (p <0.001). Only 62% of the OR staff correctly named the anesthesiology attending. The anesthesiology resident was the least well known but was able to name 82% of the others. The anesthesiology attending named his or her resident 100% of the time; the surgery attending correctly named his or her resident only 68% of the time (p = 0.002). CONCLUSION: This study suggests that OR personnel may consider introductions to be another bureaucratic hurdle instead of the safety check they were designed to be. It appears that this first step of the time-out is often being performed perfunctorily.

Team Training of Inter-Professional Students (TTIPS) for improving teamwork.

Objective: In surgery, dysfunctional teamwork is perpetuated by a 'silo' mentality modelled by students. Interprofessional education using high-fidelity simulation-based training (SBT) may counteract such modelling. We sought to determine whether SBT of interprofessional student teams (1) changes long-term teamwork attitudes and (2) is an effective form of team training. Design: A quasiexperimental, pre/postintervention comparison design was employed at an academic health sciences institution. High-fidelity simulation-based training of 42 interprofessional teams of third year surgery clerkship medical students and senior undergraduate nursing students was undertaken using a two-scenario format with immediate after action debriefing. Pre/postintervention TeamSTEPPS Teamwork Attitudes questionnaires (5 subscales, 30 items, Likert type) were given to the medical student and undergraduate nursing student classes. Pre/postsession Readiness for Inter-Professional Learning (RIPL; 19 items, Likert type) surveys and postscenario participant-rated and observer-rated Teamwork Assessment Scales (3 subscales, 11 items, Likert type) were given during each training session. Mean TeamSTEPPS Teamwork Attitudes Questionnaire, RIPL and Teamwork Assessment Scales scores were calculated; matched pre/postscore differences and trained versus non-trained TeamSTEPPS Teamwork Attitudes Questionnaire scores were compared using paired t-test or analysis of variance. Results: Both student groups had 10 significantly improved RIPL items as well as TeamSTEPPS Teamwork Attitudes Questionnaire (TTAQ) mutual support subscales. Medical students had a significantly improved TTAQ team structure subscale. Over a simulation-based training session, each observer-rated Teamwork Assessment Scales subscale and two self-rated Teamwork Assessment Scales subscales significantly improved. Trained students had significantly higher TTAQ team structure subscales than non-trained students. Conclusions: Interprofessional education using high-fidelity simulation-based training of students is effective at teaching teamwork, changing interprofessional attitudes and improving long-term teamwork attitudes.

Selection bias: Examining the feasibility, utility, and participant receptivity to incorporating simulation into the general surgery residency selection process.

BACKGROUND: Opportunities exist to revise the current residency selection process to capture desirable candidate competencies. We examined the extent to which components of the American College of Surgeons/Association for Surgical Education simulation-based medical student curriculum combined with a teamwork activity could be used as potential screening method. METHODS: Students participated in a workshop consisting of training/evaluation of knot tying, suturing, airway management, gowning/gloving, and teamwork. Surveys were given to medical students (MS) and faculty/resident/staff (FRS) to examine their opinions about the residency screening process, the most critical competencies to assess, and the effectiveness of each station for candidate evaluation. RESULTS: Communication (FRS, 4.86 ± .35; MS, 4.93 ± .26), leadership (FRS, 4.41 ± .80; MS, 4.5 ± .76), judgment (FRS, 4.62 ± .74; MS, 4.67 ± .62), professionalism (FRS, 4.64 ± .73; MS, 5.00 ± .00), integrity (FRS, 4.71 ± .78; MS, 4.87 ± .35), and grit/resilience (FRS, 4.71 ± .78; MS, 4.53 ± .74) were considered most valuable for candidate screening. The simulation-based curriculum for evaluation of residency candidates was rated lowest by both groups. Open response comments indicated positive perceptions of this process. CONCLUSIONS: Employing simulation to assess candidates may be most beneficial for examining nontechnical attributes. Future work should continue to explore this area.