Evaluation of video review tools for assessing non-technical skills in emergency department resuscitation teams: a systematic review.

BACKGROUND AND IMPORTANCE: Use of video review in medicine is established in contexts such as surgery. Although not widely used in the emergency department (ED), some centres use it to evaluate non-technical skills (NTS) to support teaching and quality improvement. OBJECTIVE: There is no consensus on assessment of NTS using video review in the ED and the purpose of this review was to identify tools used in this context. DESIGN, SETTING AND PARTICIPANTS: Studies were identified using Embase, Medline, CINAHL and Google Scholar. Inclusion criterion for the review was NTS of resuscitation teams working within the ED were assessed using video review. A systematic search method was used, and results were synthesised after search criteria was checked by two independent reviewers. Authors settled on the same 9 studies eligible for inclusion. OUTCOME MEASURES AND ANALYSIS: Reliability and validity of tools identified for use in this context. Due to the heterogeneity of studies, no meta-analysis occurred. MAIN RESULTS: There are 9 studies included in the review. The review was registered with PROSPERO (Ref No: CRD42022306129). Four unique tools were identified - 6 studies used T-NOTECHS, 1 used TTCA-24, 1 used CALM and 1 used the Communication tool. T-NOTECHS is validated in the literature for use in this context. CONCLUSION: T-NOTECHS is the tool of choice for assessing ED teams in this context.

Team Assessment and Decision Making Is Associated With Outcomes: A Trauma Video Review Analysis.

BACKGROUND: Teamwork is a critical element of trauma resuscitation. Assessment tools such as T-NOTECHS (Trauma NOn-TECHnical Skills) exist, but correlation with patient outcomes is unclear. Using emergency department thoracotomy (EDT), we sought to describe T-NOTECHS scores during resuscitations. We hypothesized that patients undergoing EDT whose resuscitations had better scores would be more likely to have return of spontaneous circulation (ROSC). METHODS: Continuously recording video was used to review all captured EDTs over a 24-mo period. We used a modification of the validated T-NOTECHS instrument to measure five domains on a 3-point scale (1 = best, 2 = average, 3 = worst). A total T-NOTECHS score was calculated by one of three reviewers. The primary outcome was ROSC. ROSC was defined as an organized rhythm no longer requiring internal cardiac compressions. Associations between variables and ROSC were examined using univariate regression. RESULTS: Sixty-one EDTs were captured. Nineteen patients had ROSC (31%) and 42 (69%) did not. The median T-NOTECHS score for all resuscitations was 8 [IQR 6-10]. As demographic and injury data (age, gender, mechanism, signs of life) were not associated with ROSC in univariate analysis, they were not considered for inclusion in a multivariable regression model. The association between overall T-NOTECHS score and ROSC did not reach statistical significance, but examination of the individual components of the T-NOTECHS score demonstrated that, compared to resuscitations that had "average" (2) or "worst" (3) scores on "Assessment and Decision Making," resuscitations with a "best" score were 5 times more likely to lead to ROSC. CONCLUSIONS: Although the association between overall T-NOTECHS scores and ROSC did not reach statistical significance, better scores in the domain of assessment and decision making are associated with improved rates of ROSC in patients arriving in cardiac arrest who undergo EDT. LEVEL OF EVIDENCE: Level IV Therapeutic/Care Management.

Translatability and validation of non-technical skills scale for trauma (T-NOTECHS) for assessing simulated multi-professional trauma team resuscitations.

BACKGROUND: The 5-item non-technical skills scale for trauma (T-NOTECHS) with five response categories is developed to assess non-technical skills in trauma team resuscitations. This validated instrument assesses behavioral aspects in teamwork. Outcome instruments should undergo a robust adaptation process followed by psychometric validation to maintain their measurement properties when translated into different languages. The translatability of the T-NOTECHS into a non-Anglo-Saxon language has not been thus far unraveled. The authors aimed to assess whether the T-NOTECHS would be translatable into a non-Anglo-Saxon language and to investigate its psychometric properties for simulated multi-professional trauma team resuscitations. METHODS: The T-NOTECHS (scores: 1 = poor; 5 = excellent) was translated and cross-culturally adapted into Finnish. Data was derived from 61 real hospital trauma team resuscitation simulations with 193 multi-professional participants. Floor-ceiling effects, internal consistency, and inter-rater reliability were analyzed. An exploratory factor analysis was conducted to test construct validity. RESULTS: After pre-testing, minor changes were made to the Finnish translation of the T-NOTECHS. Mean scores of two raters were 3.76 and 4.01, respectively. The T-NOTECHS instrument showed no floor-effect either in single items or in the total score. The total score of the T-NOTECHS instrument showed a percentage of maximum scores of 1.6 and 4.9% by the Raters 1 and 2, respectively. Internal consistency (Cronbach's alpha) was 0.70 with inter-item correlation of 0.54. The intraclass correlation coefficient was 0.54 and coefficient of repeatability 1.53. The T-NOTECHS loaded on one factor. CONCLUSIONS: The T-NOTECHS translated well into a difficult non-Anglo-Saxon language. The rigorous adaptation process used here can be recommended in the translation of observational performance assessment instruments. The translated version demonstrated fair reliability and good construct validity for assessing team performance in simulated multi-professional trauma team resuscitations. The translated T-NOTECHS instrument can be used to assess the efficacy of simulated in-situ trauma team resuscitations allowing benchmarking and international collaboration.

Evaluating non-technical skills and mission essential competencies of pilots in military aviation environments.

To develop and validate a classification of non-technical skills (NTS) in military aviation, a study was conducted, using data from real operations of F16 aircraft formations. Phase 1 developed a NTS classification based on the literature review (e.g. NOTECHS) and a workshop with pilots. The Non-TEChnical-MILitary-Skills (NOTEMILS) scheme was tested in Phase 2 in a series of Principal Component Analysis with data from After-Action-Review sessions (i.e. 900 records from a wide range of operations). The NTS were found to make a good prediction of Mission Essential Components (R2 > 0.80) above the effect of experience. Phase 3 undertook a reliability analysis where three raters assessed the NOTEMILS scheme with good results (i.e. all rwg > 0.80). To look into the consistency of classifications, another test indicated that, at least, two out of three raters were in agreement in over 70% of the assessed flight segments. Practitioner Summary: A classification scheme of Non-Technical Skills (NTS) was developed and tested for reliability in military aviation operations. The NTS scheme is a valuable tool for assessing individual and team skills of F-16 pilots in combat. It is noteworthy that the tool had a good capability of predicting Mission Essential Competencies.

The development and measurement properties of the trauma NOn-TECHnical skills (T-NOTECHS) scale: A scoping review.

PURPOSE: Conduct a scoping review to critically appraise the development and summarize the evidence on the measurement properties of T-NOTECHS including sensibility, reliability, and validity. METHODS: A literature search was performed using Pubmed and Ovid databases. Studies that described the development process of T-NOTECHS and primary studies that presented evidence of reliability and validity were identified and included. Measurement properties of T-NOTECHS was assessed and summarized under the following: scale development, sensibility, reliability, and validity. RESULTS: The literature search yielded 245 articles with 24 studies meeting inclusion criteria. The T-NOTECHS was developed with an acceptable robust methodology. It has good sensibility with adequate content, face validity, and feasibility. It is a reliable measure of non-technical skills in the setting of trauma video review, which improves with expert raters or extensive training. The T-NOTECHS is a valid discriminative and evaluative instrument that measures non-technical skills of multidisciplinary trauma teams. CONCLUSIONS: T-NOTECHS provides reliable and valid measurements of non-technical skills of trauma teams, particularly when assessing trauma video review and non-technical skills training interventions by expert raters.

Non-technical skills in surgery during the COVID-19 pandemic: An observational study.

BACKGROUND: Non-technical skills are critical to surgical safety. We examined the impact of the COVID-19 pandemic on non-technical skills of operating room (OR) teams in Singapore. MATERIALS AND METHODS: Observers rated live operations using the Oxford NOTECHS system. Pre- and post-COVID observations were captured from November 2019 to January 2020 and from January 2021 to February 2021, respectively. Scores were compared using Schuirmann's Two One-Sided Test procedure. Multivariable linear regression was used to adjust for case mix. A 10% margin of equivalence was set a priori. RESULTS: Observers rated 159 cases: 75 pre-COVID and 84 post-COVID. There were significant differences between groups in surgical department and surgeon-reported case complexity (both P < 0.001). Total NOTECHS scores increased post-COVID on raw analysis (36.1 vs 38.0, P < 0.001) but remained within the margin of equivalence (90% CI 1.3 to 2.6, P < 0.001). Multivariable analysis demonstrated a similar increase within the margin of equivalence (2.0, 90% CI 1.3 to 2.7). Teamwork and cooperation scores increased by 1.0 post-COVID (90% CI 0.8 to 1.3); all other subcomponent scores were equivalent. CONCLUSION: Non-technical skills before and after the peak of the COVID-19 pandemic were equivalent but not equal. A small but statistically significant improvement post-COVID was driven by an increase in teamwork and cooperation skills. These findings may reflect an improvement in team cohesion, which has been observed in teams under duress in other settings such as the military. Future work should explore the effect of the pandemic on OR culture, team cohesion, and resilience.

Closed loop communication in the trauma bay: identifying opportunities for team performance improvement through a video review analysis.

OBJECTIVES: Communication among trauma team members in the trauma bay is vulnerable to errors, which may impact patient outcomes. We used the previously validated trauma-non-technical skills (T-NOTECHS) tool to identify communication gaps during patient management in the trauma bay and to inform development strategies to improve team performance. METHODS: Two reviewers independently assessed non-technical skills of team members through video footage at Sunnybrook Health Sciences Centre. Team performance was measured using T-NOTECHS across five domains using a five-point Likert scale (lower score indicating worse performance): (1) leadership; (2) cooperation and resource management; (3) communication and interaction; (4) assessment and decision making; (5) situation awareness/coping with stress. Secondary outcomes assessed the number of callouts, closed loop communications and parallel conversations. RESULTS: The study included 55 trauma activations. Injury severity score (ISS) was used as a measure of trauma severity. A case with an ISS score ≥ 16 was considered severe. ISS was ≥ 16 in 37% of cases. Communication and interaction scored significantly lower compared to all other domains (p < 0.0001). There were significantly more callouts and completed closed loop communications in more severe cases compared to less severe cases (p = 0.017 for both). Incomplete closed loop communications and parallel conversations were identified, irrespective of case severity. CONCLUSION: A lower communication score was identified using T-NOTECHS, attributed to incomplete closed loop communications and parallel conversations. Through video review of trauma team activations, opportunities for improvement in communication can be identified by the T-NOTECHS tool, as well as specifically identifying callouts and closed loop communication. This process may be useful for trauma programs as part of a quality improvement program on communication skills and team performance.

RéSUMé: OBJECTIFS : La communication entre les membres de l'équipe de traumatologie dans la salle de traumatologie est vulnérable aux erreurs, ce qui peut avoir un impact sur les résultats des patients. Nous avons utilisé l'outil de compétences non techniques en traumatologie (T-NOTECHS) précédemment validé pour identifier les lacunes en matière de communication pendant la prise en charge des patients dans la salle de traumatologie et pour informer les stratégies de développement visant à améliorer les performances de l'équipe. MéTHODES: Deux examinateurs ont évalué de manière indépendante les compétences non techniques des membres de l'équipe au moyen de séquences vidéo réalisées au Sunnybrook Health Sciences Centre. La performance de l'équipe a été mesurée à l'aide de la T-NOTECHS dans cinq domaines à l'aide d'une échelle de Likert à cinq points (un score plus bas indiquant une performance plus faible) : (1) leadership ; (2) coopération et gestion des ressources ; (3) communication et interaction ; (4) évaluation et prise de décision ; (5) conscience de la situation/ gestion du stress. Les résultats secondaires ont évalué le nombre d'appels, de communications en boucle fermée et de conversations parallèles. RéSULTATS: L'étude a porté sur 55 activations de traumatismes. Le score de gravité des blessures (ISS) a été utilisé comme mesure de la gravité du traumatisme. Un cas présentant un score ISS ≥ 16 était considéré comme grave. L'ISS était ≥ 16 dans 37 % des cas. La communication et l'interaction ont obtenu des scores significativement plus faibles par rapport à tous les autres domaines (p<0,0001). Il y avait significativement plus d'appels et de communications en boucle fermée terminées dans les cas plus graves que dans les cas moins graves (p = 0.017 pour les deux). Des communications incomplètes en boucle fermée et des conversations parallèles ont été identifiées, indépendamment de la gravité du cas. CONCLUSION: Un score de communication plus faible a été identifié en utilisant le T-NOTECHS, attribué à des communications incomplètes en boucle fermée et à des conversations parallèles. Grâce à l'examen vidéo des activations de l'équipe de traumatologie, les possibilités d'amélioration de la communication peuvent être identifiées par l'outil T-NOTECHS, ainsi que l'identification spécifique des appels et de la communication en boucle fermée. Ce processus peut être utile pour les programmes de traumatologie dans le cadre d'un programme d'amélioration de la qualité sur les compétences de communication et la performance de l'équipe.

Virtual non-technical skills assessment training is an effective, scalable approach for novice raters.

OBJECTIVES: The COVID-19 pandemic has forced a creative transition to virtual platforms due to physical distancing and travel restrictions. We designed and tested a highly scalable virtual training curriculum for novice raters using the Oxford NOTECHS non-technical skills rating system. DESIGN: A three-day training course comprising virtual didactics, virtually facilitated simulations, and independent live observations was implemented. NOTECHS scores were submitted for eleven standardized video simulations and four live operations. Intraclass correlation coefficients (ICCs) were calculated for total NOTECHS scores and subcomponent scores. Raters previously trained in-person with the same standardized videos served as a comparator group for equivalence testing. SETTING: All study activities were conducted in a large academic tertiary referral center in Singapore as part of an ongoing surgical safety initiative. PARTICIPANTS: Seven staff members underwent training (three virtually and four in-person).  None had prior surgical experience or non-technical skills assessment training. RESULTS: ICCs for total NOTECHS scores were 0.85 (95% CI, 0.73-0.98) for virtually trained raters and 0.83 for those trained in-person (95% CI, 0.68-0.99).  Scores were equivalent between groups within a 10% margin. CONCLUSIONS: Non-technical skills assessment can be reliably taught in a highly scalable virtual format. Virtual NOTECHS training is a valuable tool for educational and quality improvement initiatives during the COVID-19 pandemic and for centers that lack ready access to onsite non-technical skills training expertise.

Reliability of the assessment of non-technical skills by using video-recorded trauma resuscitations.

PURPOSE: Non-technical skills have gained attention, since enhancement of these skills is presumed to improve the process of trauma resuscitation. However, the reliability of assessing non-technical skills is underexposed, especially when using video analysis. Therefore, our primary aim was to assess the reliability of the Trauma Non-Technical Skills (T-NOTECHS) tool by video analysis. Secondarily, we investigated to what extent reliability increased when the T-NOTECHS was assessed by three assessors [average intra-class correlation (ICC)] instead of one (individual ICC). METHODS: As calculated by a pre-study power analysis, 18 videos were reviewed by three research assistants using the T-NOTECHS tool. Average and individual degree of agreement of the assessors was calculated using a two-way mixed model ICC. RESULTS: Average ICC was 'excellent' for the overall score and all five domains. Individual ICC was classified as 'excellent' for the overall score. Of the five domains, only one was classified as 'excellent', two as 'good' and two were even only 'fair'. CONCLUSIONS: Assessment of non-technical skills using the T-NOTECHS is reliable using video analysis and has an excellent reliability for the overall T-NOTECHS score. Assessment by three raters further improve the reliability, resulting in an excellent reliability for all individual domains.

Roll the Tape: Implementing and Harnessing the Power of Trauma Video Review.

Trauma video review (TVR) is a powerful technology with a rapidly expanding role in trauma performance improvement, education, and research. Video review is particularly well suited for evaluating elements not found in the medical record such as rapid changes in patient condition, medical decision making, resuscitation tempo, and team leadership. As such, TVR is an ideal tool for general surgery trainee education and as a means to evaluate multiple ACGME Core Competencies and entrustable professional activities. This article describes the development of a TVR program and the novel way in which we have integrated TVR into our resident trauma curriculum.

Training Novice Raters to Assess Nontechnical Skills of Operating Room Teams.

OBJECTIVE: To our knowledge, no curricula have been described for training novice, nonclinician raters of nontechnical skills in the operating room (OR). We aimed to report the reliability of Oxford Non-Technical Skills (NOTECHS) ratings provided by novice raters who underwent a scalable curriculum for learning to assess nontechnical skills of OR teams. DESIGN: In-person training course to apply the NOTECHS framework to assessing OR teams' nontechnical skill performance, led by 2 facilitators and involving 5 partial-day sessions of didactic presentations, video simulation, and live OR observation with postassessment debriefing. NOTECHS ratings were submitted after each of 11 video scenarios and 8 live operations for the total NOTECHS team rating (including surgical/anesthesiology/nursing subteams) and for each NOTECHS skill category-situation awareness, problem solving and decision making, teamwork and cooperation, leadership and management. Inter-rater reliability was determined by calculating the intraclass correlation coefficient (ICC, range 0-1). SETTING: Training for outcome measurement during a quality improvement initiative focused on surgical safety in 3 public hospitals in Singapore. Two trainings were conducted in May 2019 and January 2020. PARTICIPANTS: Ten novice raters who were existing hospital staff and had overall minimal OR experience and no prior experience with nontechnical skill assessment. RESULTS: ICC for the total NOTECHS team rating was 0.89 (95% confidence interval [CI], 0.87-0.91). ICCs for each NOTECHS category were as follows: situation awareness, 0.83 (95% CI, 0.78-0.88); problem solving and decision-making, 0.76 (95% CI, 0.70-0.83); teamwork and cooperation, 0.84 (95% CI, 0.79-0.88); leadership and management, 0.81 (95% CI, 0.75-0.86). CONCLUSIONS: This training curriculum for nontechnical skill assessments of OR teams was associated with high inter-rater reliability from novice raters with minimal collective OR experience. Using scalable training materials to produce reliable measurements of OR team performance, this nontechnical skills assessment curriculum may contribute to future QI projects aimed at improving surgical safety.

The NOTECHS+: A Short Scale Designed for Assessing the Non-technical Skills (and more) in the Aviation and the Emergency Personnel.

This research presents the development of a short scale named "NOTECHS+" to measure the Non-Technical Skills (i.e., NOTECHS: Cooperation, Leadership and Managerial skills, Decision-Making, and Situational Awareness), Resilience and Emotion Regulation, in a sector that comprises the aviation and the emergency personnel: the Helicopter Emergency Medical Service (HEMS). The design process of the scale was carried out starting from a review on the behavioral markers used to detect the NOTECHS. Moreover, 70 interviews with HEMS experts have been conducted with the aim of developing Resilience and Emotion Regulation items by considering the different professional profiles (e.g., pilots, nurses, physicians, etc.) which compose the HEMS. Through a pre-assessment procedure, a Q-Sort test was performed on a sample of students (n = 30) to test the logical principles, but also intelligibility and clarity, of the items developed. Once the instrument was defined, 211 participants from the HEMS sector were surveyed to test the theoretical model behind the NOTECHS+ instrument. First exploratory and then confirmatory analysis yielded results that suggested that the 18 items selected conform to a bi-factor model composed of three skill-dimensions: Social skills (i.e., Cooperation, and Leadership and Managerial skills), Cognitive skills (i.e., Decision-Making and Situational Awareness) and Emotional skills (i.e., Resilience and Emotional Regulation). Finally, the study ends with a discussion on the results obtained, including practical implications on assessment and training based on this novel instrument.

Translation and Psychometric Properties of the Persian Version of Oxford Non-technical Skills 2 System: Assessment of Surgical Teams' Non-technical Skills in Orthopedic Surgery Wards.

BACKGROUND: Non-technical skills are interpersonal and cognitive skills involved in safe performance and preventing adverse events during surgery. it is necessary to dominate the non-technical skills to ensure patient safety. This study has aimed to assess the validity and reliability of Oxford Non-technical skills 2 system (Oxford NOTECHS 2) in Iran and to evaluate surgical teams' non-technical skills in orthopedic surgery wards. METHODS: This cross-sectional study was conducted in Tehran, Iran during 2015. The level of evidence is III based on Canadian Task Force on the Periodic Health Examination. We followed the Beaton's guideline for Persian translation and cross-cultural adaptation of the checklist. In this study, 60 orthopedic surgical team members working in two selected public hospitals were selected by cluster random sampling method.Oxford NOTECHS 2 system which is consisted of four subscales including leadership and management, teamwork and collaboration, decision-makingand problem-solving, and situational awareness was used to collect the data. RESULTS: The overall mean score of non-technical skills was 69.52±6.64. The mean score for surgery, anesthesia, and nursing sub-teams were 24.98±3.71, 21.12±4.29, and 23.42±3.60, respectively. The teams' scores in total, leadership and management, teamwork and collaboration, problem solving and decision making, and situational awareness at the standard level were 74.70%, 76.95%, 73.75%, 66.87%, and 74.70% of maximum score, respectively. CONCLUSION: The validity and reliability of the Persian version of Oxford NOTECHS 2 scale in Iran was confirmed. The results of this study showed that surgical teams' non-technical skills were at a moderate level in orthopedic surgery wards. The minimum score of the surgical teams' non-technical skills belonged to anesthesia and maximum to surgery sub-team. Using the training programs and setup workshop is recommended to improve the surgical teams' non-technical skills, especially surgery-nursing sub-team.

Correlates of non-technical skills in surgery: a prospective study.

BACKGROUND: Communication and teamwork failures have frequently been identified as the root cause of adverse events and complications in surgery. Few studies have examined contextual factors that influence teams' non-technical skills (NTS) in surgery. The purpose of this prospective study was to identify and describe correlates of NTS. METHODS: We assessed NTS of teams and professional role at 2 hospitals using the revised 23-item Non-TECHnical Skills (NOTECHS) and its subscales (communication, situational awareness, team skills, leadership and decision-making). Over 6 months, 2 trained observers evaluated teams' NTS using a structured form. Interobserver agreement across hospitals ranged from 86% to 95%. Multiple regression models were developed to describe associations between operative time, team membership, miscommunications, interruptions, and total NOTECHS and subscale scores. RESULTS: We observed 161 surgical procedures across 8 teams. The total amount of explained variance in NOTECHS and its 5 subscales ranged from 14% (adjusted R2 0.12, p<0.001) to 24% (adjusted R2 0.22, p<0.001). In all models, inverse relationships between the total number of miscommunications and total number of interruptions and teams' NTS were observed. CONCLUSIONS: Miscommunications and interruptions impact on team NTS performance.

Curriculum Using the In-Situ Operating Room Setting.

OBJECTIVE: The American College of Surgeons/Association of Program Directors in Surgery is a comprehensive, simulation-based curriculum for General Surgery residents which exists in 3 phases. While phases 1 and 2 deal with core skills and advanced procedures respectively, phase 3 targets team-based skills. To date, the 3rd phase of this curriculum has not seen wide scale implementation. This is a pilot study to verify the feasibility of implementing the phase 3 curriculum in the in-situ setting. DESIGN: In our initial attempt to implement Phase 3 at our institution, we chose to perform the training in an in-situ setting within an operating room (OR) at our main hospital, despite our having a separate simulation center. By choosing the in-situ OR environment for this training we were able to minimize concerns regarding resident and faculty availability and able to successfully complete 8 separate sessions during the academic year. During 7 sessions, 2 separate scenarios were performed while a single scenario was performed in 1 session. This single session was excluded from analysis, leaving a total of 14 scenarios to evaluate. The unique scenarios included laparoscopic crisis, postoperative myocardial infarction, anaphylaxis, and postoperative hypotension. All sessions were audiovisually recorded. In order to evaluate the effect of the training, the videos were viewed by 3 independent reviewers and all surgery, anesthesia and nursing participants were rated using the NOTECHs II scale. Degree of inter-rater agreement was established. The difference between the first and second simulations on the same day was then assessed. In addition, participant opinions of the simulations were assessed through electronic surveys following the training. SETTING: Tertiary Care University Hospital. PARTICIPANTS: We performed a total of 8 sessions, for a total of 15 scenarios. Eight surgery residents at the postgraduate year 1 (PGY1)-PGY3 level, 16 anesthesia residents at the PGY3-PGY4 level, 16 nurses and 13 ancillary staff participated. RESULTS: From the first to the second scenario, the total team NOTECHs II score increased from 69.4 ± 1.4 to 77.3 ± 0.5 (p = 0.007). The NOTECHs II scores for each subteam also improved, from 24.2 ± 0.6 to 26.4 ± 0.5 (p = 0.007) for surgery residents, 23.7 ± 0.9 to 26.7 ± 0.4 (p = 0.03) for anesthesia, and 21.6 ± 0.3 to 24.3 ± 0.5 (p = 0.01) for nursing. The inter-rater reliability as measured by Kendall's coefficient of concordance was modest for the whole team score. Most of the participant responses were either favorable or strongly favorable. CONCLUSION: The in-situ OR environment is both a unique and effective setting to perform team-based training. Furthermore, training in the in-situ setting minimizes or removes many of the logistic issues involved in designing and implementing team-based training curricula for general surgery residency programs. However, we found that administrative and departmental (surgery, anesthesia, and nursing) "buy in" as well as protected faculty time for education were all necessary for in-situ training to be successful. NOTECHs II is an established scale for the evaluation of teams in this simulation setting and appears to be a valid tool based on the results of this study. However, further assessment of inter-rater reliability as well as improved training of evaluators are necessary to determine if inter-rater reliability can improve.

Role confusion and self-assessment in interprofessional trauma teams.

BACKGROUND: Trauma care requires coordinating an interprofessional team, with formative feedback on teamwork skills. We hypothesized nurses and surgeons have different perceptions regarding roles during resuscitation; that nurses' teamwork self-assessment differs from experts', and that video debriefing might improve accuracy of self-assessment. METHODS: Trauma nurses and surgeons were surveyed regarding resuscitation responsibilities. Subsequently, nurses joined interprofessional teams in simulated trauma resuscitations. After each resuscitation, nurses and teamwork experts independently scored teamwork (T-NOTECHS). After video debriefing, nurses repeated T-NOTECHS self-assessment. RESULTS: Nurses and surgeons assumed significantly more responsibility by their own profession for 71% of resuscitation tasks. Nurses' overall T-NOTECHS ratings were slightly higher than experts'. This was evident in all T-NOTECHS subdomains except "leadership," but despite statistical significance the difference was small and clinically irrelevant. Video debriefing did not improve the accuracy of self-assessment. CONCLUSIONS: Nurses and physicians demonstrated discordant perceptions of responsibilities. Nurses' self-assessment of teamwork was statistically, but not clinically significantly, higher than experts' in all domains except physician leadership.