Surgical Sabermetrics: A Scoping Review of Technology-enhanced Assessment of Nontechnical Skills in the Operating Room.

OBJECTIVE: To evaluate the current evidence for surgical sabermetrics: digital methods of assessing surgical nontechnical skills and investigate the implications for enhancing surgical performance. BACKGROUND: Surgeons need high-quality, objective, and timely feedback to optimize performance and patient safety. Digital tools to assess nontechnical skills have the potential to reduce human bias and aid scalability. However, we do not fully understand which of the myriad of digital metrics of performance assessment have efficacy for surgeons. METHODS: A systematic review was conducted by searching PubMed, EMBASE, CINAHL, and PSYCINFO databases following PRISMA-ScR guidelines. MeSH terms and keywords included "Assessment," "Surgeons," and "Technology". Eligible studies included a digital assessment of nontechnical skills for surgeons, residents, and/or medical students within an operative context. RESULTS: From 19,229 articles screened, 81 articles met the inclusion criteria. The studies varied in surgical specialties, settings, and outcome measurements. A total of 122 distinct objective, digital metrics were utilized. Studies digitally measured at least 1 category of surgical nontechnical skill using a single (n=54) or multiple objective measures (n=27). The majority of studies utilized simulation (n=48) over live operative settings (n=32). Surgical Sabermetrics has been demonstrated to be beneficial in measuring cognitive load (n=57), situation awareness (n=24), communication (n=3), teamwork (n=13), and leadership (n=2). No studies measured intraoperative decision-making. CONCLUSIONS: The literature detailing the intersection between surgical data science and operative nontechnical skills is diverse and growing rapidly. Surgical Sabermetrics may provide a promising modifiable technique to achieve desirable outcomes for both the surgeon and the patient. This study identifies a diverse array of measurements possible with sensor devices and highlights research gaps, including the need for objective assessment of decision-making. Future studies may advance the integration of physiological sensors to provide a holistic assessment of surgical performance.

Evaluating the Impact of Operative Team Familiarity on Cardiac Surgery Outcomes: A Retrospective Cohort Study of Medicare Beneficiaries.

OBJECTIVE: To associate surgeon-anesthesiologist team familiarity (TF) with cardiac surgery outcomes. BACKGROUND: TF, a measure of repeated team member collaborations, has been associated with improved operative efficiency; however, examination of its relationship to clinical outcomes has been limited. METHODS: This retrospective cohort study included Medicare beneficiaries undergoing coronary artery bypass grafting (CABG), surgical aortic valve replacement (SAVR), or both (CABG+SAVR) between January 1, 2017, and September 30, 2018. TF was defined as the number of shared procedures between the cardiac surgeon and anesthesiologist within 6 months of each operation. Primary outcomes were 30- and 90-day mortality, composite morbidity, and 30-day mortality or composite morbidity, assessed before and after risk adjustment using multivariable logistic regression. RESULTS: The cohort included 113,020 patients (84,397 CABG; 15,939 SAVR; 12,684 CABG+SAVR). Surgeon-anesthesiologist dyads in the highest [31631 patients, TF median (interquartile range)=8 (6, 11)] and lowest [44,307 patients, TF=0 (0, 1)] TF terciles were termed familiar and unfamiliar, respectively. The rates of observed outcomes were lower among familiar versus unfamiliar teams: 30-day mortality (2.8% vs 3.1%, P =0.001), 90-day mortality (4.2% vs 4.5%, P =0.023), composite morbidity (57.4% vs 60.6%, P <0.001), and 30-day mortality or composite morbidity (57.9% vs 61.1%, P <0.001). Familiar teams had lower overall risk-adjusted odds of 30-day mortality or composite morbidity [adjusted odds ratio (aOR) 0.894 (0.868, 0.922), P <0.001], and for SAVR significantly lower 30-day mortality [aOR 0.724 (0.547, 0.959), P =0.024], 90-day mortality [aOR 0.779 (0.620, 0.978), P =0.031], and 30-day mortality or composite morbidity [aOR 0.856 (0.791, 0.927), P <0.001]. CONCLUSIONS: Given its relationship with improved 30-day cardiac surgical outcomes, increasing TF should be considered among strategies to advance patient outcomes.

Non-technical skills training for Nigerian interprofessional surgical teams: a cross-sectional survey.

INTRODUCTION: Non-technical skills (NTS) including communication, teamwork, leadership, situational awareness, and decision making, are essential for enhancing surgical safety. Often perceived as tangential soft skills, NTS are many times not included in formal medical education curricula or continuing medical professional development. We aimed to explore exposure of interprofessional teams in North-Central Nigeria to NTS and ascertain perceived facilitators and barriers to interprofessional training in these skills to enhance surgical safety and inform design of a relevant contextualized curriculum. METHODS: Six health facilities characterised by high surgical volumes in Nigeria's North-Central geopolitical zone were purposively identified. Federal, state, and private university teaching hospitals, non-teaching public and private hospitals, and a not-for-profit health facility were included. A nineteen-item, web-based, cross-sectional survey was distributed to 71 surgical providers, operating room nurses, and anaesthesia providers by snowball sampling through interprofessional surgical team leads from August to November 2021. Data were analysed using Fisher's exact test, proportions, and constant comparative methods for free text responses. RESULTS: Respondents included 17 anaesthesia providers, 21 perioperative nurses, and 29 surgeons and surgical trainees, with a 95.7% survey completion rate. Over 96% had never heard of any NTS for surgery framework useful for variable resource contexts and only 8% had ever received any form of NTS training. Interprofessional teams identified communication and teamwork as the most deficient personal skills (38, 57%), and as the most needed for surgical team improvement (45, 67%). There was a very high demand for NTS training by all surgical team members (64, 96%). The main motivations for training were expectations of resultant improved patient safety and improved interprofessional team dynamics. Week-long, hybrid training courses (with combined in-person and online components) were the preferred format for delivery of NTS education. Factors that would facilitate attendance included a desire for patient safety and self-improvement, while barriers to attendance were conflicts of time, and training costs. CONCLUSIONS: Interprofessional surgical teams in the Nigerian context have a high degree of interest in NTS training, and believe it can improve team dynamics, personal performance, and ultimately patient safety. Implementation of NTS training programs should emphasize interprofessional communication and teamworking.

Crew Autonomy During Simulated Medical Event Management on Long Duration Space Exploration Missions.

OBJECTIVE: Our primary aim was to investigate crew performance during medical emergencies with and without ground-support from a flight surgeon located at mission control. BACKGROUND: There are gaps in knowledge regarding the potential for unanticipated in-flight medical events to affect crew health and capacity, and potentially compromise mission success. Additionally, ground support may be impaired or periodically absent during long duration missions. METHOD: We reviewed video recordings of 16 three-person flight crews each managing four unique medical events in a fully immersive spacecraft simulator. Crews were randomized to two conditions: with and without telemedical flight surgeon (FS) support. We assessed differences in technical performance, behavioral skills, and cognitive load between groups. RESULTS: Crews with FS support performed better clinically, were rated higher on technical skills, and completed more clinical tasks from the medical checklists than crews without FS support. Crews with FS support also had better behavioral/non-technical skills (information exchange) and reported significantly lower cognitive demand during the medical event scenarios on the NASA-TLX scale, particularly in mental demand and temporal demand. There was no significant difference between groups in time to treat or in objective measures of cognitive demand derived from heart rate variability and electroencephalography. CONCLUSION: Medical checklists are necessary but not sufficient to support high levels of autonomous crew performance in the absence of real-time flight surgeon support. APPLICATION: Potential applications of this research include developing ground-based and in-flight training countermeasures; informing policy regarding autonomous spaceflight, and design of autonomous clinical decision support systems.

Measuring and Improving Emotional Intelligence in Surgery: A Systematic Review.

OBJECTIVE: Evaluate how emotional intelligence (EI) has been measured among surgeons and to investigate interventions implemented for improving EI. SUMMARY BACKGROUND: EI has relevant applications in surgery given its alignment with nontechnical skills. In recent years, EI has been measured in a surgical context to evaluate its relationship with measures such as surgeon burnout and the surgeon-patient relationship. METHODS: A systematic review was conducted by searching MEDLINE, EMBASE, CINAHL, and PSYCINFO databases using Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. MeSH terms and keywords included "emotional intelligence," "surgery," and "surgeon." Eligible studies included an EI assessment of surgeons, surgical residents, and/or medical students within a surgical context. RESULTS: The initial search yielded 4627 articles. After duplicate removal, 4435 articles were screened by title and abstract and 49 articles proceeded to a full-text read. Three additional articles were found via hand search. A total of 37 articles were included. Studies varied in surgical specialties, settings, and outcome measurements. Most occurred in general surgery, residency programs, and utilized self-report surveys to estimate EI. Notably, EI improved in all studies utilizing an intervention. CONCLUSIONS: The literature entailing the intersection between EI and surgery is diverse but still limited. Generally, EI has been demonstrated to be beneficial in terms of overall well-being and job satisfaction while also protecting against burnout. EI skills may provide a promising modifiable target to achieve desirable outcomes for both the surgeon and the patient. Future studies may emphasize the relevance of EI in the context of surgical teamwork.

Surgeons' Coaching Techniques in the Surgical Coaching for Operative Performance Enhancement (SCOPE) Program.

OBJECTIVE: To evaluate coaching techniques used by practicing surgeons who underwent dedicated coach training in a peer surgical coaching program. BACKGROUND: Surgical coaching is a developing strategy for improving surgeons' intraoperative performance. How to cultivate effective coaching skills among practicing surgeons is uncertain. METHODS: Through the Surgical Coaching for Operative Performance Enhancement (SCOPE) program, 46 surgeons within 4 US academic medical centers were assigned 1:1 into coach/coachee pairs. All attended a 3-hour Surgical Coaching Workshop-developed using evidence from the fields of surgery and education-then received weekly reminders. We analyzed workshop evaluations and audio transcripts of postoperative debriefs between coach/coachee pairs, co-coding themes based on established principles of effective coaching: (i) self-identified goals, (ii) collaborative analysis, (iii) constructive feedback, and (iv) action planning. Coaching principles were cross-referenced with intraoperative performance topics: technical, nontechnical, and teaching skills. RESULTS: For the 8 postoperative debriefs analyzed, mean duration was 24.4 min (range 7-47 minutes). Overall, 326 coaching examples were identified, demonstrating application of all 4 core principles of coaching. Constructive feedback (17.6 examples per debrief) and collaborative analysis (16.3) were utilized more frequently than goal-setting (3.9) and action planning (3.0). Debriefs focused more often on nontechnical skills (60%) than technical skills (32%) or teaching-specific skills (8%). Among surgeons who completed the workshop evaluation (82% completion rate), 90% rated the Surgical Coaching Workshop "good" or "excellent." CONCLUSIONS: Short-course coach trainings can help practicing surgeons use effective coaching techniques to guide their peers' performance improvement in a way that aligns with surgical culture.

Objective Measurement of Learners' Cognitive Load During Simulation-Based Trauma Team Training: A Pilot Study.

INTRODUCTION: Literature has shown cognitive overload which can negatively impact learning and clinical performance in surgery. We investigated learners' cognitive load during simulation-based trauma team training using an objective digital biomarker. METHODS: A cross-sectional study was carried out in a simulation center where a 3-h simulation-based interprofessional trauma team training program was conducted. A session included three scenarios each followed by a debriefing session. One scenario involved multiple patients. Learners wore a heart rate sensor that detects interbeat intervals in real-time. Low-frequency/high-frequency (LF/HF) ratio was used as a validated proxy for cognitive load. Learners' LF/HF ratio was tracked through different phases of simulation. RESULTS: Ten subjects participated in 12 simulations. LF/HF ratios during scenario versus debriefing were compared for each simulation. These were 3.75 versus 2.40, P < 0.001 for scenario 1; 4.18 versus 2.77, P < 0.001 for scenario 2; and 4.79 versus 2.68, P < 0.001 for scenario 3. Compared to single-patient scenarios, multiple-patient scenarios posed a higher cognitive load, with LF/HF ratios of 3.88 and 4.79, P < 0.001, respectively. CONCLUSIONS: LF/HF ratio, a proxy for cognitive load, was increased during all three scenarios compared to debriefings and reached the highest levels in a multiple-patient scenario. Using heart rate variability as an objective marker of cognitive load is feasible and this metric is able to detect cognitive load fluctuations during different simulation phases and varying scenario difficulties.

Identifying Naturalistic Coaching Behavior Among Practicing Surgeons in the Operating Room.

OBJECTIVE: The aim of this study was to identify examples of naturalistic coaching behavior among practicing surgeons operating together by analyzing their intraoperative discussion. BACKGROUND: Opportunities to improve surgical performance are limited for practicing surgeons; surgical coaching is one strategy to address this need. To develop peer coaching programs that integrate with surgical culture, a better understanding is needed of how surgeons routinely discuss operative performance. METHODS: As part of a "co-surgery" quality improvement program, 20 faculty surgeons were randomized into 10 dyads who performed an operation together. Discourse analysis was conducted on transcribed intraoperative discussions. Themes were coded using an existing framework of surgical coaching principles (self-identified goals, collaborative analysis, constructive feedback, peer learning support) and surgical coaching content (technical skills, nontechnical skills). Coaching principles were cross-referenced with coaching content; c-coefficient measured the strength of association between pairs of themes. RESULTS: Overall, 44 unique coaching examples were identified in 10 operations. Of the 4 principles of surgical coaching, only self-identified goals and collaborative analysis were identified consistently. Self-identified goals were most associated with discussions regarding technical skills of "tissue exposure," "flow of operation," and "instrument handling" and the nontechnical skill "situation awareness." Collaborative analysis was most associated with discussions regarding technical skills of "respect for tissue" and "flow of operation" and nontechnical skills of "communication and teamwork." CONCLUSIONS: In naturalistic discussions between practicing surgeons in the operating room, numerous examples of unprompted coaching behavior were identified that target intraoperative performance. Prominent coaching gaps-constructive feedback and peer learning support-were also observed. Surgical coach trainings should address these gaps.

Dissecting Cardiac Surgery: A Video-based Recall Protocol to Elucidate Team Cognitive Processes in the Operating Room.

OBJECTIVE: The aim of this study was to elucidate the cognitive processes involved in surgical procedures from the perspective of different team roles (surgeon, anesthesiologist, and perfusionist) and provide a comprehensive compilation of intraoperative cognitive processes. SUMMARY BACKGROUND DATA: Nontechnical skills play a crucial role in surgical team performance and understanding the cognitive processes underlying the intraoperative phase of surgery is essential to improve patient safety in the operating room (OR). METHODS: A mixed-methods approach encompassing semistructured interviews with 9 subject-matter experts. A cognitive task analysis was built upon a hierarchical segmentation of coronary artery bypass grafting procedures and a cued-recall protocol using video vignettes was used. RESULTS: A total of 137 unique surgical cognitive processes were identified, including 33 decision points, 23 critical communications, 43 pitfalls, and 38 strategies. Self-report cognitive workload varied substantially, depending on team role and surgical step. A web-based dashboard was developed, providing an integrated visualization of team cognitive processes in the OR that allows readers to intuitively interact with the study findings. CONCLUSIONS: This study advances the current body of knowledge by making explicit relevant cognitive processes involved during the intraoperative phase of cardiac surgery from the perspective of multiple OR team members. By displaying the research findings in an interactive dashboard, we provide trainees with new knowledge in an innovative fashion that could be used to enhance learning outcomes. In addition, the approach used in the present study can be used to deeply understand the cognitive factors underlying surgical adverse events and errors in the OR.

Surgical Coaching for Operative Performance Enhancement (SCOPE): skill ratings and impact on surgeons' practice.

BACKGROUND: Evidence for surgical coaching has yet to demonstrate an impact on surgeons' practice. We evaluated a surgical coaching program by analyzing quantitative and qualitative data on surgeons' intraoperative performance. METHODS: In the 2018-2019 Surgical Coaching for Operative Performance Enhancement (SCOPE) program, 46 practicing surgeons in multiple specialties at four academic medical centers were recruited to complete three peer coaching sessions, each comprising preoperative goal-setting, intraoperative observation, and postoperative debriefing. Coach and coachee rated the coachee's performance using modified Objective Structured Assessment of Technical Skills (OSATS, range 1-5) and Non-Technical Skills for Surgeons (NOTSS, range 4-16). We used generalized estimating equations to evaluate trends in skill ratings over time, adjusting for case difficulty, clinical experience, and coaching role. Upon program completion, we analyzed semi-structured interviews with individual participants regarding the perceived impact of coaching on their practice. RESULTS: Eleven of 23 coachees (48%) completed three coaching sessions, three (13%) completed two sessions, and six (26%) completed one session. Adjusted mean OSATS ratings did not vary over three coaching sessions (4.39 vs 4.52 vs 4.44, respectively; P = 0.655). Adjusted mean total NOTSS ratings also did not vary over three coaching sessions (15.05 vs 15.50 vs 15.08, respectively; P = 0.529). Regarding patient care, participants self-reported improved teamwork skills, communication skills, and awareness in and outside the operating room. Participants acknowledged the potential for coaching to improve burnout due to reduced intraoperative stress and enhanced peer support but also the potential to worsen burnout by adding to chronic work overload. CONCLUSIONS: Surgeons reported high perceived impact of peer coaching on patient care and surgeon well-being, although changes in coachees' technical and non-technical skills were not detected over three coaching sessions. While quantitative skill measurement warrants further study, longitudinal peer surgical coaching should be considered a meaningful strategy for surgeons' professional development.

Analysis of Dynamic Changes in Cognitive Workload During Cardiac Surgery Perfusionists' Interactions With the Cardiopulmonary Bypass Pump.

OBJECTIVE: This novel preliminary study sought to capture dynamic changes in heart rate variability (HRV) as a proxy for cognitive workload among perfusionists while operating the cardiopulmonary bypass (CPB) pump during real-life cardiac surgery. BACKGROUND: Estimations of operators' cognitive workload states in naturalistic settings have been derived using noninvasive psychophysiological measures. Effective CPB pump operation by perfusionists is critical in maintaining the patient's homeostasis during open-heart surgery. Investigation into dynamic cognitive workload fluctuations, and their relationship with performance, is lacking in the literature. METHOD: HRV and self-reported cognitive workload were collected from three Board-certified cardiac perfusionists (N = 23 cases). Five HRV components were analyzed in consecutive nonoverlapping 1-min windows from skin incision through sternal closure. Cases were annotated according to predetermined phases: prebypass, three phases during bypass, and postbypass. Values from all 1min time windows within each phase were averaged. RESULTS: Cognitive workload was at its highest during the time between initiating bypass and clamping the aorta (preclamp phase during bypass), and decreased over the course of the bypass period. CONCLUSION: We identified dynamic, temporal fluctuations in HRV among perfusionists during cardiac surgery corresponding to subjective reports of cognitive workload. Not only does cognitive workload differ for perfusionists during bypass compared with pre- and postbypass phases, but differences in HRV were also detected within the three bypass phases. APPLICATION: These preliminary findings suggest the preclamp phase of CPB pump interaction corresponds to higher cognitive workload, which may point to an area warranting further exploration using passive measurement.

Nontechnical Skill Assessment of the Collective Surgical Team Using the Non-Technical Skills for Surgeons (NOTSS) System.

OBJECTIVE: To validate the Non-Technical Skills for Surgeons (NOTSS) system for assessment of the collective surgical teams' nontechnical skills after observing recordings of actual OR environment. BACKGROUND: The NOTSS system is a widely accepted tool to measure nontechnical skills of individual surgeons, and has mostly been used in the simulated setting. Surgical procedures are rarely performed by a single surgeon, but by a surgical team of attending surgeons, surgical assistants, and surgical trainees. Therefore, assessment of nontechnical skills may benefit from holistic assessment of the collective surgical teams. METHODS: Five trained participants assessed surgical team and attending surgeon using the NOTSS system after watching ten 20-minute long videos obtained from live OR. A set of reference ratings was provided by a multidisciplinary expert committee. We performed analyses to assess system sensitivity; examine inter-rater reliability of ratings; investigate concurrent construct validity; and assess feasibility and acceptability of using the NOTSS system to measure surgical team performance. RESULTS: There was adequate system sensitivity when comparing participants' and reference ratings. Inter-rater reliability among the participants' ratings was good except for decision-making category. The level of inter-rater reliability was similar when rating teams and attending surgeons. There was strong positive correlation between teams' and attending surgeons' NOTSS ratings at category [Pearson coefficient 0.86, 95% confidence interval (CI) 0.82-0.89] and element levels (0.83, 95% CI 0.80-0.85), demonstrating evidence of concurrent construct validity. The participants felt that the use of NOTSS system to measure teams' nontechnical skills was acceptable and feasible to a fair extent. CONCLUSION: The NOTSS system, although developed for assessment of individual surgeons, is a useful tool for observing and rating surgical teams.

Medical Event Management for Future Deep Space Exploration Missions to Mars.

BACKGROUND: Long-duration exploration missions (LDEMs), such as voyages to Mars, will present unique medical challenges for astronaut crews, including communication delays and the inability to return to Earth early. Medical events threaten crewmember lives and increase the risk of mission failure. Managing a range of potential medical events will require excellent technical and nontechnical skills (NTSs). We sought to identify medical events with potential for rescue, range them according to the potential impact on crew health and mission success during LDEMs, and develop a list of NTSs to train for management of in-flight medical events. MATERIALS AND METHODS: Twenty-eight subject matter experts with specializations in surgery, medicine, trauma, spaceflight operations, NTS training, simulation, human factors, and organizational psychology completed online surveys followed by a 2-d in-person workshop. They identified and rated medical events for survivability, mission impact, and impact of crewmember NTSs on outcomes in space. RESULTS: Sudden cardiac arrest, smoke inhalation, toxic exposure, seizure, and penetrating eye injury emerged as events with the highest potential mission impact, greatest potential for survival, and that required excellent NTS for successful management. Key NTS identified to target in training included information exchange, supporting behavior, communication delivery, and team leadership/followership. CONCLUSIONS: With a planned Mars mission on the horizon, training countermeasures need to be developed in the next 3-5 y. These results may inform policy, selection, medical system design, and training scenarios for astronauts to manage in-flight medical events on LDEMs. Findings may extend to surgical and medical care in any rural and remote location.

Episodes of strain experienced in the operating room: impact of the type of surgery, the profession and the phase of the operation.

BACKGROUND: Strain episodes, defined as phases of higher workload, stress or negative emotions, occur everyday in the operating room (OR). Accurate knowledge of when strain is most intense for the different OR team members is imperative for developing appropriate interventions. The primary goal of the study was to investigate temporal patterns of strain across surgical phases for different professionals working in the OR, for different types of operations. METHODS: We developed a guided recall method to assess the experience of strain from the perspective of operating room (OR) team members. The guided recall was completed by surgeons, residents, anesthesiologists, circulating nurses and scrub technicians immediately after 113 operations, performed in 5 departments of one hospital in North America. We also conducted interviews with 16 surgeons on strain moments during their specific operation types. Strain experiences were related to surgical phases and compared across different operation types separately for each profession in the OR. RESULTS: We analyzed 693 guided recalls. General linear modeling (GLM) showed that strain varied across the phases of the operations (defined as before incision, first third, middle third and last third) [quadratic (F = 47.85, p < 0.001) and cubic (F = 8.94, p = 0.003) effects]. Phases of operations varied across professional groups [linear (F = 4.14, p = 0.001) and quadratic (F = 14.28, p < 0.001) effects] and surgery types [only cubic effects (F = 4.92, p = 0.001)]. Overall strain was similar across surgery types (F = 1.27, p = 0.28). Surgeons reported generally more strain episodes during the first and second third of the operations; except in vascular operations, where no phase was associated with significantly higher strain levels, and emergency/trauma surgery, where strain episodes occurred primarily during the first third of the operation. Other professional groups showed different strain time patterns. CONCLUSIONS: Members of the OR teams experience strain differently across the phases of an operation. Thus, phases with high concentration requirements may highly vary across OR team members and no single phase of an operation can be defined as a "sterile cockpit" phase for all team members.

Surgery Task Load Index in Cardiac Surgery: Measuring Cognitive Load Among Teams.

Background. The most commonly used subjective assessment of perceived cognitive load, the NASA Task Load Index (TLX), has proven valuable in measuring individual load among general populations. The surgery task load index (SURG-TLX) was developed and validated to measure cognitive load specifically among individuals within a surgical team. Notably, the TLX lacks temporal sensitivity in its typical retrospective administration. Objective. This study sought to expand the utility of SURG-TLX by investigating individual measures of cognitive load over time during cardiac surgery, and the relationship between individual and team measures of cognitive load and proxies for surgical complexity. Materials & Methods. SURG-TLX was administered retrospectively in the operating room immediately following each case to approximate cognitive load before, during, and after cardiopulmonary bypass for cardiac surgery team members (surgeon, anesthesiologist, and perfusionist). Correlations were calculated to determine the relationship of individual and team measures of cognitive load over the entire procedure with bypass length and surgery length. Results. Results suggest that perceived cognitive load varies throughout the procedure such that cognitive load during bypass significantly differs compared to before or after bypass, across all 3 roles. While on bypass, results show that anesthesiologists experience significantly lower levels of perceived cognitive load than both surgeons and perfusionists. Correlational analyses reveal that perceived cognitive load of both the surgeon and the team had significant positive associations with bypass length and surgery length. Conclusion. Our findings support the utility of SURG-TLX in real cardiac cases as a measure of cognitive load over time, and on an individual and team-wide basis.

Identification of the Critical Nontechnical Skills for Surgeons Needed for High Performance in a Variable-resource Context (NOTSS-VRC).

OBJECTIVE: To identify the critical nontechnical skills (NTS) required for high performance in variable-resource contexts (VRC). BACKGROUND: As surgical training and capacity increase in low- and middle-income countries (LMICs), new strategies for improving surgical education and care in these settings are required. NTS are critical for high performance in surgery around the world. However, the essential NTS used by surgeons operating in LMICs to overcome the challenges specific to their contexts have never been described. METHOD: Using a constructivist grounded theory approach, 52 intraoperative team observations as well as 34 critical incident interviews with surgical providers (surgeons, anesthetists, and nurses) were performed at the 4 tertiary referral hospitals in Rwanda. Interview transcripts and field notes from observations were analyzed using line-by-line coding to identify emerging themes until thematic saturation was achieved. RESULTS: Four skill categories of situation awareness, decision-making, communication/teamwork, and leadership emerged. This provided the framework for a contextually informed skills taxonomy consisting of 12 skill elements with examples of specific behaviors indicative of high performance. While the main skill categories were consistent with those encountered in high-income countries, the specific behaviors associated with these skills often focused on overcoming the frequently encountered variability in resources, staff, systems support, and language in this context. CONCLUSION: This is the first description of the critical nontechnical skills, and associated example behaviors, used by surgeons in a VRC to overcome common challenges to safe and effective surgical patient care. Improvements in the NTS used by surgeons operating in VRCs have the potential to improve surgical care delivery worldwide.

Physiological synchronization and entropy as measures of team cognitive load.

The operating room (OR) is a high-risk and complex environment, where multiple specialized professionals work as a team to effectively care for patients in need of surgical interventions. Surgical tasks impose high cognitive demands on OR staff and cognitive overload may have deleterious effects on team performance and patient safety. The aim of the present study was to investigate the feasibility and describe a novel methodological approach to characterize dynamic changes in team cognitive load by measuring synchronization and entropy of heart rate variability parameters during real-life cardiac surgery. Cognitive load was measured by capturing interbeat intervals (IBI) from three team members (surgeon, anesthesiologist and perfusionist) using an unobtrusive wearable heart rate sensor and transmitted in real-time to a smartphone application. Clinical data and operating room audio/video recordings were also collected to provide behavioral and contextual information. We developed symbolic representations of the transient cognitive state of individual team members (Individual Cognitive State - ICS), and overall team (Team Cognitive State - TCS) by comparing IBI data from each team member with themselves and with others. The distribution of TCS symbols during surgery enabled us to display and analyze temporal states and dynamic changes of team cognitive load. Shannon's entropy was calculated to estimate the changing levels of team organization and to detect fluctuations resulting from a variety of cognitive demands and/or specific situations (e.g. medical error, emergency, flow disruptions). An illustrative example from a real cardiac surgery team shows how cognitive load patterns shifted rapidly after an actual near-miss medication event, leading the team to a more organized and synchronized state. The methodological approach described in this study provides a measurement technique for the assessment of team physiological synchronization, which can be applied to many other team-based environments. Future research should gather additional validity evidence to support the proposed methods for team cognitive load measurement.