Opportunities and Applications of Educational Technologies in Surgical Education and Assessment.

BACKGROUND: Surgical education is challenged by continuously increasing clinical content, greater subspecialization, and public scrutiny of access to high quality surgical care. Since the last Blue Ribbon Committee on surgical education, novel technologies have been developed including artificial intelligence and telecommunication. OBJECTIVES AND METHODS: The goals of this Blue Ribbon Sub-Committee were to describe the latest technological advances and construct a framework for applying these technologies to improve the effectiveness and efficiency of surgical education and assessment. An additional goal was to identify implementation frameworks and strategies for centers with different resources and access. All sub-committee recommendations were included in a Delphi consensus process with the entire Blue Ribbon Committee (N=67). RESULTS: Our sub-committee found several new technologies and opportunities that are well poised to improve the effectiveness and efficiency of surgical education and assessment (see Tables 1-3). Our top recommendation was that a Multidisciplinary Surgical Educational Council be established to serve as an oversight body to develop consensus, facilitate implementation, and establish best practices for technology implementation and assessment. This recommendation achieved 93% consensus during the first round of the Delphi process. CONCLUSION: Advances in technology-based assessment, data analytics, and behavioral analysis now allow us to create personalized educational programs based on individual preferences and learning styles. If implemented properly, education technology has the promise of improving the quality and efficiency of surgical education and decreasing the demands on clinical faculty.

Incubation with porcine urinary bladder matrix yields a late-stage wound transcriptome in endothelial cells and keratinocytes isolated from both diabetic and non-diabetic subjects.

Proper wound closure requires the functional coordination of endothelial cells (ECs) and keratinocytes. In the late stages of wound healing, keratinocytes become activated and ECs promote the maturation of nascent blood vessels. In diabetes mellitus, decreased keratinocyte activation and impaired angiogenic action of ECs delay wound healing. Porcine urinary bladder matrix (UBM) improves the rate of wound healing, but the effect of exposure to UBM under diabetic conditions remains unclear. We hypothesized that keratinocytes and ECs isolated from both diabetic and non-diabetic donors would exhibit a similar transcriptome representative of the later stages of wound healing following incubation with UBM. Human keratinocytes and dermal ECs isolated from non-diabetic and diabetic donors were incubated with and without UBM particulate. RNA-Seq analysis was performed to identify changes in the transcriptome of these cells associated with exposure to UBM. While diabetic and non-diabetic cells exhibited different transcriptomes, these differences were minimized following incubation with UBM. ECs exposed to UBM exhibited changes in the expression of transcripts suggesting an increase in the endothelial-mesenchymal transition (EndoMT) associated with vessel maturation. Keratinocytes incubated with UBM demonstrated an increase in markers of activation. Comparison of the whole transcriptomes with public datasets suggested increased EndoMT and keratinocyte activation following UBM exposure. Both cell types exhibited loss of pro-inflammatory cytokines and adhesion molecules. These data suggest that application of UBM may accelerate healing by promoting a transition to the later stages of wound healing. This healing phenotype is achieved in cells isolated from both diabetic and non-diabetic donors.

Better than the real thing? Success of a virtual platform for an established "Train the Trainer" course.

BACKGROUND: The Society of American Gastrointestinal and Endoscopic Surgeons (SAGES) uses the Laparoscopic colectomy Train the Trainer (Lapco TT) framework for standardization of instructor training for Hands-On surgical skills courses. The curriculum focuses on teaching structure, skills deconstruction, trainer intervention framework, and performance enhancing feedback. A halt in the in-person Lapco TT courses due to the Coronavirus Disease 2019 (COVID-19) pandemic necessitated creation of a virtual alternative. We investigated the effectiveness of this virtual course. METHODS: Adaptation of the in-person Lapco TT course to the virtual format retained the majority of content as well as the 4:6 instructor-to-participant ratio. The virtual platform and simulators chosen allowed maximal interactivity and ease of use. After participating in the day and one half course, participants completed an 8-item post-course survey using a 5-point Likert scale related to the training experience. In addition, they had the opportunity to provide answers to several open-ended questions regarding the course. For the survey, frequency counts provided an assessment of each item. For the open questions, qualitative analysis included determination of themes for each question. Frequency counts of each theme provided quantitative analysis. RESULTS: Thirty-six total participants completed a Lapco TT virtual course (six sessions of six participants). Of this number, 32 participants completed post-course surveys and questions. All the participants completing the survey would very likely or definitely (Likert scale 4, 5) recommend the course to a colleague and incorporate the teaching in their practice. The majority of participants completing open-ended questions felt the virtual course format was effective; half thought that post-course follow-up would be useful. Technical concerns were an issue using the virtual format. CONCLUSION: A virtual Lapco TT course is feasible and well received by participants. It presents a potentially more cost effective option to faculty development.

Examining interprofessional learning perceptions among students in a simulation-based operating room team training experience.

High-fidelity simulation (HFS) operating room (OR) inter-professional team training improves healthcare students' team-based attitudes and behaviours. Such improvements can diminish tribalism among the professions in the OR by overcoming entrenched perceptions of team members. We investigated whether simulation-based interprofessional student OR team training impacts students differently based on their professional background. From 2010 to 2013, HFS OR interprofessional student team training sessions were conducted involving senior medical students, senior undergraduate nursing students, and nurse anaesthesia students. The training involved a two-scenario format, each followed by a structured debriefing focusing on team-based competencies. Before and after each session, students completed a 15-item teamwork competencies self-efficacy survey as well as, from 2012-2013, the Readiness for Interprofessional Learning Scale (RIPLS). At the end of each session, they also completed a 6-item rating scale assessing overall team function during the session. Mean scores were calculated for each student professional group, post/pre mean differences were determined, and student t-test and ANOVA analyses were employed to compare within and between-group differences, respectively. Response rates were over 80% for each scale used. Medical students and undergraduate nursing students had significant improvements in team-based attitudes post- to pre-session. Medical students and nurse anaesthesia students had significant improvements in RIPLS scores. Statistically significant improvements from post- to pre-session were seen overall for both team-based attitudes (effect size = 0.83) and RIPLS (effect size = 0.37). The difference between the team-based scores between professions was significant; RIPLS differences were not. No significant difference existed between professions related to overall teamwork scores. HFS OR team training of healthcare students has beneficial but variable benefits for each professional group.

Introductions During Time-outs: Do Surgical Team Members Know One Another's Names?

BACKGROUND: Introductions are the first item of the time-out in the World Health Organization Surgical Safety Checklist (SSC). It has yet to be established that surgical teams use colleagues' names or consider the use of names important. A study was conducted to determine if using the SSC has a measurable impact on name retention and to assess if operating room (OR) personnel believe it is important to know the names of their colleagues or for their colleagues to know theirs. METHODS: All OR personnel were individually interviewed at the end of 25 surgical cases in which the SSC was used. They were asked (1) to name each OR participant, and (2) if they believed it is important to know the names of their team members and (3) for their team members to know their name. RESULTS: Of the 150 OR personnel interviewed, 147 (98%) named the surgery attending correctly. The surgery attending named only 44% of other OR staff (p <0.001). Only 62% of the OR staff correctly named the anesthesiology attending. The anesthesiology resident was the least well known but was able to name 82% of the others. The anesthesiology attending named his or her resident 100% of the time; the surgery attending correctly named his or her resident only 68% of the time (p = 0.002). CONCLUSION: This study suggests that OR personnel may consider introductions to be another bureaucratic hurdle instead of the safety check they were designed to be. It appears that this first step of the time-out is often being performed perfunctorily.

Using Simulation to Improve Systems-Based Practices.

BACKGROUND: Ensuring the safe, effective management of patients requires efficient processes of care within a smoothly operating system in which highly reliable teams of talented, skilled health care providers are able to use the vast array of high-technology resources and intensive care techniques available. Simulation can play a unique role in exploring and improving the complex perioperative system by proactively identifying latent safety threats and mitigating their damage to ensure that all those who work in this critical health care environment can provide optimal levels of patient care. METHODS: A panel of five experts from a wide range of institutions was brought together to discuss the added value of simulation-based training for improving systems-based aspects of the perioperative service line. Panelists shared the way in which simulation was demonstrated at their institutions. The themes discussed by each panel member were delineated into four avenues through which simulation-based techniques have been used. RESULTS: Simulation-based techniques are being used in (1) testing new clinical workspaces and facilities before they open to identify potential latent conditions; (2) practicing how to identify the deteriorating patient and escalate care in an effective manner; (3) performing prospective root cause analyses to address system weaknesses leading to sentinel events; and (4) evaluating the efficiency and effectiveness of the electronic health record in the perioperative setting. CONCLUSION: This focused review of simulation-based interventions to test and improve components of the perioperative microsystem, which includes literature that has emerged since the panel's presentation, highlights the broad-based utility of simulation-based technologies in health care.

Ongoing evolution of practice gaps in gastrointestinal and endoscopic surgery: 2014 report from the Society of American Gastrointestinal and Endoscopic Surgeons (SAGES) Continuing Education Committee.

BACKGROUND: In an effort to fulfill the charge to develop and maintain a comprehensive educational program to serve the members of the Society of American Gastrointestinal and Endoscopic Surgeons (SAGES), the SAGES Continuing Education Committee reports a summary of findings related to the evaluation of the 2014 SAGES annual meeting. METHODS: All attendees to the 2014 annual meeting had the opportunity to complete an immediate post-meeting questionnaire as part of their continuing medical education (CME) certification, and identify up to two learning themes, answer questions related to potential practice change items based on these learning themes, and complete a needs assessment for relevant learning topics for future meetings. In addition, participants in the postgraduate and hands-on courses were asked to complete questions about case volume and comfort level related to procedures/topics in those courses. All respondents to this initial survey were sent a 3-month follow-up questionnaire in which they were asked how successful they had been in the implementation of the targeted practice changes and what, if any, barriers were encountered. Descriptive statistical analysis of de-identified data was undertaken. SAGES University attendees respond to a post-test and post-activity evaluation. RESULTS: Response rates were 43 and 31 % for CME-eligible attendees/respondents for the immediate post-meeting and 3-month follow-up questionnaires, respectively. Top learning themes for respondents were foregut, hernia, bariatric, and colorectal. Improving minimally invasive surgical (MIS) technique and managing complications related to MIS procedures were top intended practice changes. Partial implementation was common with top barriers including lack of resources and lack of time. Desired topics for future meetings included management of complications, enhanced recovery after surgery, introduction of new procedures into clinical practice, and re-operative surgery. CONCLUSIONS: The SAGES 2014 annual meeting analysis provides insight into the educational needs among respondents, which is meaningful information for planning future meeting educational content.

Establishing technical performance norms for general surgery residents.

BACKGROUND: Surgery residents are required to achieve performance milestones to advance in their residency. Level-specific, technical performance norms that could be used as milestones, however, do not currently exist. Our aim was to develop level-specific, technical performance norms for general surgery residents on select simulated tasks across multiple institutions. STUDY DESIGN: An IRB-approved, prospective, multi-institutional collaborative study with voluntary participation of residents was undertaken at the start of the 2011-2012 academic year. General surgery residents (PGY I-V) from seven institutions were tested on three laparoscopic and five open simulated surgical tasks, and their performance was assessed based on task time and errors. Means and standard deviations of performance for each resident level were calculated and compared. Residents with performance 1 standard deviation below the mean were considered outliers. RESULTS: A total of 147 residents were evaluated. Mean resident age was 28 ± 3 years; 42 % were female; and they had attended 74 different medical schools. Senior residents (PGY III-V) had more clinical and simulator experience than junior residents (PGY I-II) (p < 0.001). Resident performance scores progressively increased in all tasks reaching a plateau at a lower PGY level for open tasks. Depending on the task, 0-18 % of residents were outliers. When surveyed, 66 % of residents agreed that national performance norms for residents should exist. CONCLUSIONS: Performance norms were established for select tasks in a representative sample of US surgery residents. Such performance norms allow a more informed assessment of resident skill through comparison to national data and enable the identification of outliers who may benefit from additional training.

Society for Simulation in Healthcare Guidelines for Simulation Training.

BACKGROUND: Simulation has become a staple in the training of healthcare professionals with accumulating evidence on its effectiveness. However, guidelines for optimal methods of simulation training do not currently exist. METHODS: Systematic reviews of the literature on 16 identified key questions were conducted and expert panel consensus recommendations determined using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) methodology. OBJECTIVE: These evidence-based guidelines from the Society for Simulation in Healthcare intend to support healthcare professionals in decisions on the most effective methods for simulation training in healthcare. RESULTS: Twenty recommendations on 16 questions were determined using GRADE. Four expert recommendations were also provided. CONCLUSIONS: The first evidence-based guidelines for simulation training are provided to guide instructors and learners on the most effective use of simulation in healthcare.

Evolution of practice gaps in gastrointestinal and endoscopic surgery: 2012 report from the Society of American Gastrointestinal and Endoscopic Surgeons (SAGES) Continuing Education Committee.

BACKGROUND: In an effort to fulfill its charge to develop and maintain a comprehensive educational program to serve the members of the Society of American Gastrointestinal and Endoscopic Surgeons (SAGES), the SAGES Continuing Education Committee (CEC) reports a summary of findings related to its evaluation of the 2012 SAGES annual meeting. METHODS: All attendees to the 2012 annual meeting had the opportunity to complete an immediate postmeeting questionnaire as part of their continuing medical education (CME) certification in which they identified up to two learning themes, answered questions related to potential practice change items that are based on those learning themes, and complete a needs assessment related to important learning topics for future meetings. In addition, participants in the postgraduate and hands-on courses were asked to complete questions about case volume and comfort levels related to procedures/topics in those courses. All respondents to this initial survey were sent a 3-month follow-up questionnaire in which they were asked how successfully they had implemented the intended practice changes and what, if any, barriers they encountered. Postgraduate and hands-on course participants completed case volume and comfort level questions. Descriptive statistical analysis of this deidentified data was undertaken. RESULTS: Response rates were 42% and 56% for CME-eligible attendees/respondents for the immediate postmeeting and 3-month follow-up questionnaires, respectively. Top learning themes for respondents were Bariatric, Hernia, Foregut, and Colorectal. Improving minimally invasive surgical (MIS) technique and managing complications related to MIS procedures were top intended practice changes. Partial implementation was common with top barriers including cost restrictions, lack of institutional support, and lack of time. CONCLUSIONS: The 2012 annual meeting analysis provides insight into educational needs among respondents and will help with planning content for future meetings.

The effect of simulation-based crew resource management training on measurable teamwork and communication among interprofessional teams caring for postoperative patients.

BACKGROUND: Many adverse events in health care are caused by teamwork and communication breakdown. This study was conducted to investigate the effect of a point-of-care simulation-based team training curriculum on measurable teamwork and communication skills in staff caring for postoperative patients. METHODS: Twelve facilities involving 334 perioperative surgical staff underwent simulation-based training. Pretest and posttest self-report data included the Self-Efficacy of Teamwork Competencies Scale. Observational data were captured with the Clinical Teamwork Scale. RESULTS: Teamwork scores (measured on a five-point Likert scale) improved for all eight survey questions by an average of 18% (3.7 to 4.4, p < .05). The observed communication rating (scale of 1 to 10) increased by 16% (5.6 to 6.4, p < .05). CONCLUSION: Simulation-based team training for staff caring for perioperative patients is associated with measurable improvements in teamwork and communication.

Comprehensive Literature Search to Identify Assessment Tools for Operating Room Nontechnical Skills to Determine Common Critical Components.

BACKGROUND: Effective use of nontechnical skills (NTS) contributes to the provision of safe, quality care in the fast-paced, dynamic setting of the operating room (OR). Inter-professional education of NTS to OR team members can improve performance. Such training requires the accurate measurement of NTS in order to identify gaps in their utilization by OR teams. Although several instruments for measuring OR NTS exist in the literature, each tool tends to define specific NTS differently. AIM: We aimed to determine commonalities in defined measurements among existing OR NTS tools. METHODS: We undertook a comprehensive literature review of assessment tools for OR NTS to determine the critical components common to these instruments. A PubMed search of the literature from May 2009 to May 2019 combined various combinations of keywords and Medical Subject Headings (MeSH) related to the following subjects: teamwork, teams, assessment, debriefing, surgery, operating room, nontechnical, communication. From this start, articles were selected describing specific instruments. Three reviewers then identified the common components measured among these assessment tools. Reviewers collated kin constructs within each instrument using frequency counts of similarly termed and conceptualized components. RESULTS: The initial PubMed search produced 119 articles of which 24 articles satisfied the inclusion criteria. Within these articles, 10 assessment tools evaluated OR NTS. Kin constructs were grouped into six NTS categories in the following decreasing frequency order: communication, situation awareness, teamwork, leadership, decision making, and task management/decision making (equal). CONCLUSION: NTS OR assessment tools in the literature have a variety of kin constructs related to the specific measured components within the instruments. Such kin constructs contain thematic cohesion across six primary NTS groupings with some variation in scale and scope. Future plans include using this information to develop an easy-to-use assessment tool to assist with debriefing in the clinical environment.

Brick in the wall? Linking quality of debriefing to participant learning in team training of interprofessional students.

Background: The evidence for the conventional wisdom that debriefing quality determines the effectiveness of learning in simulation-based training is lacking. We investigated whether the quality of debriefing in using simulation-based training in team training correlated with the degree of learning of participants. Methods: Forty-two teams of medical and undergraduate nursing students participated in simulation-based training sessions using a two-scenario format with after-action debriefing. Observers rated team performance with an 11-item Teamwork Assessment Scales (TAS) instrument (three subscales, team-based behaviours (5-items), shared mental model (3-items), adaptive communication and response (3-items)). Two independent, blinded raters evaluated video-recorded facilitator team prebriefs and debriefs using the Objective Structured Assessment of Debriefing (OSAD) 8-item tool. Descriptive statistics were calculated, t-test comparisons made and multiple linear regression and univariate analysis used to compare OSAD item scores and changes in TAS scores. Results: Statistically significant improvements in all three TAS subscales occurred from scenario 1 to 2. Seven faculty teams taught learners with all scores ≥3.0 (except two) for prebriefs and all scores ≥ 3.5 (except one) for debriefs (OSAD rating 1=done poorly to 5=done well). Linear regression analysis revealed a single statistically significant correlation between debrief engagement and adaptive communication and response score without significance on univariate analysis. Conclusions: Quality of debriefing does not seem to increase the degree of learning in interprofessional education using simulation-based training of prelicensure student teams. Such a finding may be due to the relatively high quality of the prebrief and debrief of the faculty teams involved in the training.

Improvement in student-led debriefing analysis after simulation-based team training using a revised teamwork assessment tool.

BACKGROUND: Team debriefing is an important teamwork development intervention for improving team outputs in healthcare. Debriefing is a key component of experiential team training teamwork development interventions such as simulation-based training. Improving the quality of debriefing of healthcare teams, therefore, has multiple benefits. We investigated whether the quality of student-led debriefing improved using a shortened guide. METHODS: Senior medical students, nurse anesthesia students, and senior undergraduate nursing students participated in student operating room team training at a health sciences center in the southeastern United States. Student teams participated in a dual-scenario simulation-based training session with immediate after-action debriefings after each scenario. In 2018, student teams conducted the second debriefing using as a guide the teamwork assessment scale, an 11-item, 3-subscale, 6-point Likert-type instrument. In 2019, they used a shortened, revised, 5-item version of the teamwork assessment scale, the quick teamwork assessment scale. Trained observers rated the quality of the student-led debriefings using the Objective Structured Assessment of Debriefing, an 8-item, 5-point instrument. The Wilcoxon-Mann-Whitney test was used to compare the teamwork assessment scale-guided and the quick teamwork assessment scale-guided mean item debriefing scores. RESULTS: Two observers rated 3 student-led team debriefings using the teamwork assessment scales as a guide in 2018, and 6 such debriefings happened using the quick teamwork assessment scale as a guide in 2019. For each debriefing, observer scores were averaged for each Objective Structured Assessment of Debriefing item; these mean scores were then averaged with other mean scores for each year. The use of the quick teamwork assessment scale resulted in a statistically significant higher mean score for the Analysis Objective Structured Assessment of Debriefing item compared with the use of the teamwork assessment scale (4.92 [standard deviation 0.20] versus 3.83 [standard deviation 0.76], P = .023). CONCLUSION: The use of a shortened teamwork assessment instrument as a debriefing guide for student teams in student operating room team training was more effective in analysis of actions than the original, longer tool. Next steps include determining the efficacy of the quick teamwork assessment scale in an actual clinical setting.

Improved operating room teamwork via SAFETY prep: a rural community hospital's experience.

BACKGROUND: Effective teamwork contributes to patient safety in the operating room (OR). For the busy rural surgeon, enhancing OR teamwork can be difficult. This manuscript describes results from the initial implementation of a preoperative briefing protocol at a rural community hospital. METHODS: From July 2006 to February 2007, teamwork among OR staff working with a single general surgeon at a rural hospital in Alaska was evaluated before and after introduction of a preoperative briefing protocol. After each case, participants completed a questionnaire applying a 6-point Likert-type scale targeting effectiveness of both the preoperative briefing and OR team interaction. Mean values were calculated from 20 cases before introduction of the preoperative briefing and from another 16 cases after its introduction. Statistical analysis of the difference between pre- and post-protocol team performance was conducted with Student's t test. Mean procedure times were calculated for matched cases pre- and post-intervention and were compared with Wilcoxon's exact test. RESULTS: Ten members of the OR staff, including the general surgeon, completed both pre- and post-protocol questionnaires. Four additional members of the OR staff completed only pre-protocol questionnaires, and three additional members of the OR staff completed only post-protocol questionnaires. After implementation of the preoperative briefing protocol, the mean score of overall preoperative briefing was 1.01 units higher than before (p < 0.0001), and overall OR team interaction was 0.50 units higher (p < 0.0001). The overall mean post-intervention procedure time was shorter than the overall mean pre-intervention procedure time (31 +/- 12 min versus 50 +/- 18 min) for four categories of matched cases. Because of the small sample size, statistical significance was not achieved (p = 0.057). CONCLUSIONS: Implementation of a preoperative briefing protocol improved overall preoperative briefing and OR team interaction in the study setting. These findings are encouraging for enhancing teamwork and patient safety through implementation of a systematic protocol.

Attitudinal changes resulting from repetitive training of operating room personnel using of high-fidelity simulation at the point of care.

We investigated the impact of repetitive training using high-fidelity simulation (HFS) at the point of care on the teamwork attitudes of operating room (OR) personnel. Members of the general surgical OR teams at an academic medical center participated in two half-day point-of-care HFS team training sessions. Module 1 targeted teamwork competencies; Module 2 included a preoperative briefing strategy. Modules were separated by 1 month. For each training, participants completed pre- and postsession questionnaires that included a 15-item self-efficacy tool targeting teamwork competencies using a 6-point Likert-type scale. Pre- and postsession mean scores were compared with a t test. Matched pre- and postsessions questionnaires were collected from 38 and 39 participants for Module 1 and Module 2, respectively. Mean item improvement from pre- to posttraining was 0.43 units (range, 0.23 to 0.69 units) for Module 1 and 0.42 units (range, 0.15 to 0.53 units) for Module 2. After Bonferroni adjustment, statistically significant improvement in scores from pre- to posttraining increased from four items after Module 1 to nine items after Module 2. Repetitive training of interdisciplinary OR teams through HFS at the point of care increases the effectiveness of promoting attitudinal change toward team-based competencies among participants.

Modulation of inflammation in wounds of diabetic patients treated with porcine urinary bladder matrix.

Aim: To determine if porcine urinary bladder matrix (UBM) treatment is associated with modulation of wound inflammation in diabetic patients. Patients & methods: mRNA associated with M1 and M2 macrophages were measured in wounds of diabetic and nondiabetic patients pre- and post-treatment with UBM and an M1:M2 score was calculated. Results: Wound tissue from diabetic subjects exhibited elevated M1:M2 scores compared with nondiabetic patients, suggesting a greater pro-inflammatory state prior to treatment. Post-treatment, there was significantly greater reduction in the magnitude of the individual M1:M2 scores in the diabetic patients resulting in similar levels in both groups of patients. Conclusions: UBM may assist in diabetic wound healing by restoring an inflammatory state similar to that of nondiabetic patients.

Quality with quantity? Evaluating interprofessional faculty prebriefs and debriefs for simulation training using video.

BACKGROUND: High-fidelity simulation-based training is used increasingly for prelicensure student teams. Such sessions rely on faculty who are able to provide quality prebriefing and debriefing to foster learning among participants. We investigated how well faculty conducted prebriefing and debriefing as part of high-fidelity simulation-based training for interprofessional education. METHODS: Two trained observers independently rated 38 video-recorded sessions of combinations of 4 faculty conducting prebriefings and debriefings of prelicensure student teams after high-fidelity simulation-based training. Assessment was undertaken using the Objective Structured Assessment of Debriefing, an 8-item tool using a 5-point Likert scale (1 as minimum and 5 as maximum). Mean scores for each item were calculated. Inter-rater agreement was determined using Cohen's kappa. A one-way between-subjects analysis of variance with post-hoc Tukey's studentized range procedure was conducted to compare the effect of team facilitator grouping on the quality of team performance of each Objective Structured Assessment of Debriefing element during a prebriefing or a debriefing. Trend analyses of teams with 4 or more observations were performed using Kendall's Tau coefficient test and linear regression analyses to identify whether teams showed improvement through time. Statistical significance was set at P < .05. RESULTS: A total of 7 combinations of faculty conducted between 1 to 14 prebriefings or debriefings. In general, faculty combinations performed better during debriefings compared with prebriefings, with only 1 team having 1 mean item score <3.50. Statistically significant differences between faculty combinations in mean item scores was more pronounced during the prebriefings (2 of 3 Objective Structured Assessment of Debriefing items rated) than during debriefings (1 of 8 Objective Structured Assessment of Debriefing items rated). Effect sizes were strong for all differences. Linear regression analysis revealed a statistically significant change through time for the 3 rated prebriefing items and for 7 of the 8 rated debriefing items. CONCLUSION: Interprofessional faculty combinations in this study tended to have good quality prebriefings and debriefings. The quality of the prebriefings and debriefings can, however, be influenced by the composition of the facilitator teams, most prominently for prebriefings, and team performance does appear to change through time, especially during the debriefing. Future work will focus on whether the quality of prebriefings and debriefings influences learning by trainees.

Implementation of a preoperative briefing protocol improves accuracy of teamwork assessment in the operating room.

This study examined the effect of implementing a new preoperative briefing protocol on self- and peer-assessments of individual operating room (OR) teamwork behaviors. From July 2006 to February 2007, OR teamwork performance at a rural community hospital was evaluated before and after training and implementation of the protocol. After each case, every member on the team completed a 360-degree type teamwork behavior evaluation containing both self- and peer-assessments using a six-point Likert type scale (1 = definitely no to 6 = definitely yes). Individual behavior change was measured using the mean scale score of pre and postprotocol assessments. Statistical analysis included t test for both pre/post and self/peer differences. Data were available for one general surgeon and nine OR staff (pre = 20 cases, post = 16 cases). The preprotocol self-assessment mean score was significantly higher than peer-assessment (5.63 vs 5.29, P < 0.0267). Pre and postprotocol peer assessment mean scores revealed a statistically significant gain in teamwork behaviors. No difference was observed in postassessment mean scores for self- and peer-assessments. Individuals overestimated their teamwork behaviors before protocol implementation. Using a preoperative protocol seems to improve OR staff teamwork behaviors and self-assessment accuracy. The use of a 360-degree assessment method targeting specific, observable behaviors may be useful in evaluating team-based interventions and enhancing teamwork effectiveness.

Priorities Related to Improving Healthcare Safety Through Simulation.

STATEMENT: Improving healthcare safety is a worthwhile and important endeavor. Simulation-based activities can help with such a goal through research and training. In this manner, it can focus on education and training, assessment and metrics, process improvement, and culture change to help move forward both patient safety and quality of care.This article will address the following three main topics: (1) designing simulation-based activities to promote high reliability in healthcare, (2) developing simulation-based activities to foster resilience in healthcare systems, and (3) evaluating the impact of adverse events in healthcare and how simulation-based activities can be used to determine and potentially to prevent their cause. These topics will be treated sequentially, providing synopses of concepts and giving examples of research currently being undertaken. It will then highlight current priorities for simulation-based research in this domain by drawing from insights obtained and a targeted literature review.