Surgical Sabermetrics: A Scoping Review of Technology-enhanced Assessment of Nontechnical Skills in the Operating Room.

OBJECTIVE: To evaluate the current evidence for surgical sabermetrics: digital methods of assessing surgical nontechnical skills and investigate the implications for enhancing surgical performance. BACKGROUND: Surgeons need high-quality, objective, and timely feedback to optimize performance and patient safety. Digital tools to assess nontechnical skills have the potential to reduce human bias and aid scalability. However, we do not fully understand which of the myriad of digital metrics of performance assessment have efficacy for surgeons. METHODS: A systematic review was conducted by searching PubMed, EMBASE, CINAHL, and PSYCINFO databases following PRISMA-ScR guidelines. MeSH terms and keywords included "Assessment," "Surgeons," and "Technology". Eligible studies included a digital assessment of nontechnical skills for surgeons, residents, and/or medical students within an operative context. RESULTS: From 19,229 articles screened, 81 articles met the inclusion criteria. The studies varied in surgical specialties, settings, and outcome measurements. A total of 122 distinct objective, digital metrics were utilized. Studies digitally measured at least 1 category of surgical nontechnical skill using a single (n=54) or multiple objective measures (n=27). The majority of studies utilized simulation (n=48) over live operative settings (n=32). Surgical Sabermetrics has been demonstrated to be beneficial in measuring cognitive load (n=57), situation awareness (n=24), communication (n=3), teamwork (n=13), and leadership (n=2). No studies measured intraoperative decision-making. CONCLUSIONS: The literature detailing the intersection between surgical data science and operative nontechnical skills is diverse and growing rapidly. Surgical Sabermetrics may provide a promising modifiable technique to achieve desirable outcomes for both the surgeon and the patient. This study identifies a diverse array of measurements possible with sensor devices and highlights research gaps, including the need for objective assessment of decision-making. Future studies may advance the integration of physiological sensors to provide a holistic assessment of surgical performance.

Feasibility of Wearable Sensors to Assess Cognitive Load During Clinical Performance: Lessons Learned and Blueprint for Success.

INTRODUCTION: Cognitive load (CogL) is increasingly recognized as an important resource underlying operative performance. Current innovations in surgery aim to develop objective performance metrics via physiological monitoring from wearable digital sensors. Surgeons have access to consumer technology that could measure CogL but need guidance regarding device selection and implementation. To realize the benefits of surgical performance improvement these methods must be feasible, incorporating human factors usability and design principles. This paper aims to evaluate the feasibility of using wearable sensors to assess CogL, identify the benefits and challenges of implementing devices, and develop guidance for surgeons planning to implement wearable devices in their research or practice. METHODS: We examined the feasibility of wearable sensors from a series of empirical studies that measured aspects of clinical performance relating to CogL. Across four studies, 84 participants and five sensors were involved in the following clinical settings: (i) real intraoperative surgery; (ii) simulated laparoscopic surgery; and (iii) medical team performance outside the hospital. RESULTS: Wearable devices worn on the wrist and chest were found to be comfortable. After a learning curve, electrodermal activity data were easily and reliably collected. Devices using photoplethysmography to determine heart rate variability were significantly limited by movement artifact. There was variable success with electroencephalography devices regarding connectivity, comfort, and usability. CONCLUSIONS: It is feasible to use wearable sensors across various clinical settings, including surgery. There are some limitations, and their implementation is context and device dependent. To scale sensor use in clinical research, surgeons must embrace human factors principles to optimize wearability, usability, reliability, and data security.

An Open-Source, Interoperable Architecture for Generating Real-Time Surgical Team Cognitive Alerts from Heart-Rate Variability Monitoring.

Clinical alarm and decision support systems that lack clinical context may create non-actionable nuisance alarms that are not clinically relevant and can cause distractions during the most difficult moments of a surgery. We present a novel, interoperable, real-time system for adding contextual awareness to clinical systems by monitoring the heart-rate variability (HRV) of clinical team members. We designed an architecture for real-time capture, analysis, and presentation of HRV data from multiple clinicians and implemented this architecture as an application and device interfaces on the open-source OpenICE interoperability platform. In this work, we extend OpenICE with new capabilities to support the needs of the context-aware OR including a modularized data pipeline for simultaneously processing real-time electrocardiographic (ECG) waveforms from multiple clinicians to create estimates of their individual cognitive load. The system is built with standardized interfaces that allow for free interchange of software and hardware components including sensor devices, ECG filtering and beat detection algorithms, HRV metric calculations, and individual and team alerts based on changes in metrics. By integrating contextual cues and team member state into a unified process model, we believe future clinical applications will be able to emulate some of these behaviors to provide context-aware information to improve the safety and quality of surgical interventions.

Crew Autonomy During Simulated Medical Event Management on Long Duration Space Exploration Missions.

OBJECTIVE: Our primary aim was to investigate crew performance during medical emergencies with and without ground-support from a flight surgeon located at mission control. BACKGROUND: There are gaps in knowledge regarding the potential for unanticipated in-flight medical events to affect crew health and capacity, and potentially compromise mission success. Additionally, ground support may be impaired or periodically absent during long duration missions. METHOD: We reviewed video recordings of 16 three-person flight crews each managing four unique medical events in a fully immersive spacecraft simulator. Crews were randomized to two conditions: with and without telemedical flight surgeon (FS) support. We assessed differences in technical performance, behavioral skills, and cognitive load between groups. RESULTS: Crews with FS support performed better clinically, were rated higher on technical skills, and completed more clinical tasks from the medical checklists than crews without FS support. Crews with FS support also had better behavioral/non-technical skills (information exchange) and reported significantly lower cognitive demand during the medical event scenarios on the NASA-TLX scale, particularly in mental demand and temporal demand. There was no significant difference between groups in time to treat or in objective measures of cognitive demand derived from heart rate variability and electroencephalography. CONCLUSION: Medical checklists are necessary but not sufficient to support high levels of autonomous crew performance in the absence of real-time flight surgeon support. APPLICATION: Potential applications of this research include developing ground-based and in-flight training countermeasures; informing policy regarding autonomous spaceflight, and design of autonomous clinical decision support systems.

Drying, Physical, Nutritional and Bioactive Characteristics of Apple Peel Flour Subjected to Blanching and Ultrasound Pretreatments.

The aim of this work was to study the effect of blanching and ultrasound pretreatments on drying and quality characteristics of apple peel. Blanching was conducted in boiling water, ultrasound in a water bath, and drying in a batch tray dryer. The product obtained was ground into a flour, and assessed for color, water activity, proximate composition, sugars, and bioactive compounds. Results showed that effective moisture diffusivity increases with a decrease in product moisture content, being such dependence well described by a second order polynomial model. Average drying rate was higher and product moisture content was lower for blanched and sonicated flour, especially for the former. Such result suggests that blanching and ultrasound enhance water removal during drying of apple peel. Physical properties were significantly affected by pretreatments, being more intense red color and lower water activity obtained for sonicated flour. Nutritional and bioactive properties were also significantly affected by pretreatments, being lower sugar, higher protein, fiber, catechin and epicatechin content observed for blanched flour. Summarizing, blanching and ultrasound pretreatments improve drying of apple peel, both regarding process efficiency and product quality.

Measuring and Improving Emotional Intelligence in Surgery: A Systematic Review.

OBJECTIVE: Evaluate how emotional intelligence (EI) has been measured among surgeons and to investigate interventions implemented for improving EI. SUMMARY BACKGROUND: EI has relevant applications in surgery given its alignment with nontechnical skills. In recent years, EI has been measured in a surgical context to evaluate its relationship with measures such as surgeon burnout and the surgeon-patient relationship. METHODS: A systematic review was conducted by searching MEDLINE, EMBASE, CINAHL, and PSYCINFO databases using Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. MeSH terms and keywords included "emotional intelligence," "surgery," and "surgeon." Eligible studies included an EI assessment of surgeons, surgical residents, and/or medical students within a surgical context. RESULTS: The initial search yielded 4627 articles. After duplicate removal, 4435 articles were screened by title and abstract and 49 articles proceeded to a full-text read. Three additional articles were found via hand search. A total of 37 articles were included. Studies varied in surgical specialties, settings, and outcome measurements. Most occurred in general surgery, residency programs, and utilized self-report surveys to estimate EI. Notably, EI improved in all studies utilizing an intervention. CONCLUSIONS: The literature entailing the intersection between EI and surgery is diverse but still limited. Generally, EI has been demonstrated to be beneficial in terms of overall well-being and job satisfaction while also protecting against burnout. EI skills may provide a promising modifiable target to achieve desirable outcomes for both the surgeon and the patient. Future studies may emphasize the relevance of EI in the context of surgical teamwork.

Objective Measurement of Learners' Cognitive Load During Simulation-Based Trauma Team Training: A Pilot Study.

INTRODUCTION: Literature has shown cognitive overload which can negatively impact learning and clinical performance in surgery. We investigated learners' cognitive load during simulation-based trauma team training using an objective digital biomarker. METHODS: A cross-sectional study was carried out in a simulation center where a 3-h simulation-based interprofessional trauma team training program was conducted. A session included three scenarios each followed by a debriefing session. One scenario involved multiple patients. Learners wore a heart rate sensor that detects interbeat intervals in real-time. Low-frequency/high-frequency (LF/HF) ratio was used as a validated proxy for cognitive load. Learners' LF/HF ratio was tracked through different phases of simulation. RESULTS: Ten subjects participated in 12 simulations. LF/HF ratios during scenario versus debriefing were compared for each simulation. These were 3.75 versus 2.40, P < 0.001 for scenario 1; 4.18 versus 2.77, P < 0.001 for scenario 2; and 4.79 versus 2.68, P < 0.001 for scenario 3. Compared to single-patient scenarios, multiple-patient scenarios posed a higher cognitive load, with LF/HF ratios of 3.88 and 4.79, P < 0.001, respectively. CONCLUSIONS: LF/HF ratio, a proxy for cognitive load, was increased during all three scenarios compared to debriefings and reached the highest levels in a multiple-patient scenario. Using heart rate variability as an objective marker of cognitive load is feasible and this metric is able to detect cognitive load fluctuations during different simulation phases and varying scenario difficulties.

Maintaining health professional education during war: A scoping review.

PURPOSE: War negatively impacts health professional education when health care is needed most. The aims of this scoping review are to describe the scope of barriers and targeted interventions to maintaining health professional education during war and summarise the research. METHODS: We conducted a scoping review between 20 June 2018 and 2 August 2018. The search was restricted to English publications including peer-reviewed publications without date ranges involving war and health professional education (medical school, residency training and nursing school), with interventions described to maintain educational activities. Two independent reviewers completed inclusion determinations and data abstraction. Thematic coding was performed using an inductive approach allowing dominant themes to emerge. The frequency of barrier and intervention themes and illustrative quotes were extracted. Articles were divided into modern/postmodern categories to permit temporal and historical analysis of thematic differences. RESULTS: Screening identified 3271 articles, with 56 studies meeting inclusion criteria. Publication dates ranged from 1914-2018 with 17 unique wars involving 17 countries. The studies concerned medical students (61.4%), residents (28.6%) and nursing students (10%). Half involved the modern era and half the postmodern era. Thematic coding identified five categories of barriers and targeted interventions in maintaining health professions education during war: curriculum, personnel, wellness, resources, and oversight, with most involving curriculum and personnel. The distribution of themes among various health professional trainees was similar. The frequency and specifics changed temporally reflecting innovations in medical education and war, with increased focus on oversight and personnel during the modern era and greater emphasis on wellness, curriculum, and resources during the postmodern era. CONCLUSIONS: There are overarching categories of barriers and targeted interventions in maintaining health professional education during war which evolve over time. These may serve as a useful framework to strategically support future research and policy efforts.

Dissecting Cardiac Surgery: A Video-based Recall Protocol to Elucidate Team Cognitive Processes in the Operating Room.

OBJECTIVE: The aim of this study was to elucidate the cognitive processes involved in surgical procedures from the perspective of different team roles (surgeon, anesthesiologist, and perfusionist) and provide a comprehensive compilation of intraoperative cognitive processes. SUMMARY BACKGROUND DATA: Nontechnical skills play a crucial role in surgical team performance and understanding the cognitive processes underlying the intraoperative phase of surgery is essential to improve patient safety in the operating room (OR). METHODS: A mixed-methods approach encompassing semistructured interviews with 9 subject-matter experts. A cognitive task analysis was built upon a hierarchical segmentation of coronary artery bypass grafting procedures and a cued-recall protocol using video vignettes was used. RESULTS: A total of 137 unique surgical cognitive processes were identified, including 33 decision points, 23 critical communications, 43 pitfalls, and 38 strategies. Self-report cognitive workload varied substantially, depending on team role and surgical step. A web-based dashboard was developed, providing an integrated visualization of team cognitive processes in the OR that allows readers to intuitively interact with the study findings. CONCLUSIONS: This study advances the current body of knowledge by making explicit relevant cognitive processes involved during the intraoperative phase of cardiac surgery from the perspective of multiple OR team members. By displaying the research findings in an interactive dashboard, we provide trainees with new knowledge in an innovative fashion that could be used to enhance learning outcomes. In addition, the approach used in the present study can be used to deeply understand the cognitive factors underlying surgical adverse events and errors in the OR.

We Asked the Experts: The WHO Surgical Safety Checklist and the COVID-19 Pandemic: Recommendations for Content and Implementation Adaptations.

BACKGROUND: As surgical systems are forced to adapt and respond to new challenges, so should the patient safety tools within those systems. We sought to determine how the WHO SSC might best be adapted during the COVID-19 pandemic. METHODS: 18 Panelists from five continents and multiple clinical specialties participated in a three-round modified Delphi technique to identify potential recommendations, assess agreement with proposed recommendations and address items not meeting consensus. RESULTS: From an initial 29 recommendations identified in the first round, 12 were identified for inclusion in the second round. After discussion of recommendations without consensus for inclusion or exclusion, four additional recommendations were added for an eventual 16 recommendations. Nine of these recommendations were related to checklist content, while seven recommendations were related to implementation. CONCLUSIONS: This multinational panel has identified 16 recommendations for sites looking to use the surgical safety checklist during the COVID-19 pandemic. These recommendations provide an example of how the SSC can adapt to meet urgent and emerging needs of surgical systems by targeting important processes and encouraging critical discussions.

Analysis of Dynamic Changes in Cognitive Workload During Cardiac Surgery Perfusionists' Interactions With the Cardiopulmonary Bypass Pump.

OBJECTIVE: This novel preliminary study sought to capture dynamic changes in heart rate variability (HRV) as a proxy for cognitive workload among perfusionists while operating the cardiopulmonary bypass (CPB) pump during real-life cardiac surgery. BACKGROUND: Estimations of operators' cognitive workload states in naturalistic settings have been derived using noninvasive psychophysiological measures. Effective CPB pump operation by perfusionists is critical in maintaining the patient's homeostasis during open-heart surgery. Investigation into dynamic cognitive workload fluctuations, and their relationship with performance, is lacking in the literature. METHOD: HRV and self-reported cognitive workload were collected from three Board-certified cardiac perfusionists (N = 23 cases). Five HRV components were analyzed in consecutive nonoverlapping 1-min windows from skin incision through sternal closure. Cases were annotated according to predetermined phases: prebypass, three phases during bypass, and postbypass. Values from all 1min time windows within each phase were averaged. RESULTS: Cognitive workload was at its highest during the time between initiating bypass and clamping the aorta (preclamp phase during bypass), and decreased over the course of the bypass period. CONCLUSION: We identified dynamic, temporal fluctuations in HRV among perfusionists during cardiac surgery corresponding to subjective reports of cognitive workload. Not only does cognitive workload differ for perfusionists during bypass compared with pre- and postbypass phases, but differences in HRV were also detected within the three bypass phases. APPLICATION: These preliminary findings suggest the preclamp phase of CPB pump interaction corresponds to higher cognitive workload, which may point to an area warranting further exploration using passive measurement.

Medical Event Management for Future Deep Space Exploration Missions to Mars.

BACKGROUND: Long-duration exploration missions (LDEMs), such as voyages to Mars, will present unique medical challenges for astronaut crews, including communication delays and the inability to return to Earth early. Medical events threaten crewmember lives and increase the risk of mission failure. Managing a range of potential medical events will require excellent technical and nontechnical skills (NTSs). We sought to identify medical events with potential for rescue, range them according to the potential impact on crew health and mission success during LDEMs, and develop a list of NTSs to train for management of in-flight medical events. MATERIALS AND METHODS: Twenty-eight subject matter experts with specializations in surgery, medicine, trauma, spaceflight operations, NTS training, simulation, human factors, and organizational psychology completed online surveys followed by a 2-d in-person workshop. They identified and rated medical events for survivability, mission impact, and impact of crewmember NTSs on outcomes in space. RESULTS: Sudden cardiac arrest, smoke inhalation, toxic exposure, seizure, and penetrating eye injury emerged as events with the highest potential mission impact, greatest potential for survival, and that required excellent NTS for successful management. Key NTS identified to target in training included information exchange, supporting behavior, communication delivery, and team leadership/followership. CONCLUSIONS: With a planned Mars mission on the horizon, training countermeasures need to be developed in the next 3-5 y. These results may inform policy, selection, medical system design, and training scenarios for astronauts to manage in-flight medical events on LDEMs. Findings may extend to surgical and medical care in any rural and remote location.

Sensors for Continuous Monitoring of Surgeon's Cognitive Workload in the Cardiac Operating Room.

Monitoring healthcare providers' cognitive workload during surgical procedures can provide insight into the dynamic changes of mental states that may affect patient clinical outcomes. The role of cognitive factors influencing both technical and non-technical skill are increasingly being recognized, especially as the opportunities to unobtrusively collect accurate and sensitive data are improving. Applying sensors to capture these data in a complex real-world setting such as the cardiac surgery operating room, however, is accompanied by myriad social, physical, and procedural constraints. The goal of this study was to investigate the feasibility of overcoming logistical barriers in order to effectively collect multi-modal psychophysiological inputs via heart rate (HR) and near-infrared spectroscopy (NIRS) acquisition in the real-world setting of the operating room. The surgeon was outfitted with HR and NIRS sensors during aortic valve surgery, and validation analysis was performed to detect the influence of intra-operative events on cardiovascular and prefrontal cortex changes. Signals collected were significantly correlated and noted intra-operative events and subjective self-reports coincided with observable correlations among cardiovascular and cerebral activity across surgical phases. The primary novelty and contribution of this work is in demonstrating the feasibility of collecting continuous sensor data from a surgical team member in a real-world setting.

The growing impact of older patients in the emergency department: a 5-year retrospective analysis in Brazil.

BACKGROUND: The average age of the global population is rising at an increasing rate. There is a disproportional increase in Emergency Department (ED) visits by older people worldwide. In the Brazilian health system, complex and severely ill patients and those requiring specialized urgent procedures are referred to tertiary level care. As far as we know, no other study in Latin America has analyzed the impact of demographic changes in tertiary ED attendance. AIM: To describe the sociodemographic characteristics and outcomes of tertiary Brazilian ED users. METHODS: Design: Observational cross-sectional analytic study. SETTING: Emergency Department, tertiary university hospital, São Paulo, Brazil. PARTICIPANTS: patients aged 18 years or older attending a tertiary ED (2009-2013). The primary outcomes were hospitalization and mortality; the secondary outcome was ICU admission. Age was categorized as 'young adults' (18-39y), 'adults' (40-59y), 'young-older adults' (60-79y), and 'old-older adults' (80-109y). Other variables included sex, reason for attendance, time of ED visit, mode of presentation, type of hospitalization, main procedure, length of hospital stay (LOS) and length of ICU stay (ICU-LOS). We calculated descriptive statistics, built generalized linear mixed models for each outcome and estimated Odds Ratios (95% CI) for the independent categorical variables. The significance level was 5% with Bonferroni correction. RESULTS: Older age-groups represented 26.6% of 333,028 ED visits, 40.7% of admissions, 42.7% of ICU admissions and 58% of all deaths. Old-older patients accounted for 5.1% of ED visits, 9.5% of admissions and 10.1% of ICU admissions. Hospitalization, ICU admission and mortality rates increased with older age in both sexes. LOS and ICU-LOS were similar across age-groups. The proportions of visits and admissions attributed to young adults decreased annually, while those of people aged 60 or over increased. The ORs for hospitalization, ICU admission and mortality associated with the old-older group were 3.49 (95% CI = 3.15-3.87), 1.27 (1.15-1.39) and 5.93 (5.29-6.66) respectively, with young adults as the reference. CONCLUSIONS: In tertiary ED, age is an important risk factor for hospitalization and mortality, but not for ICU admission. Old-older people are at the greatest risk and demand further subgroup stratification.

Surgery Task Load Index in Cardiac Surgery: Measuring Cognitive Load Among Teams.

Background. The most commonly used subjective assessment of perceived cognitive load, the NASA Task Load Index (TLX), has proven valuable in measuring individual load among general populations. The surgery task load index (SURG-TLX) was developed and validated to measure cognitive load specifically among individuals within a surgical team. Notably, the TLX lacks temporal sensitivity in its typical retrospective administration. Objective. This study sought to expand the utility of SURG-TLX by investigating individual measures of cognitive load over time during cardiac surgery, and the relationship between individual and team measures of cognitive load and proxies for surgical complexity. Materials & Methods. SURG-TLX was administered retrospectively in the operating room immediately following each case to approximate cognitive load before, during, and after cardiopulmonary bypass for cardiac surgery team members (surgeon, anesthesiologist, and perfusionist). Correlations were calculated to determine the relationship of individual and team measures of cognitive load over the entire procedure with bypass length and surgery length. Results. Results suggest that perceived cognitive load varies throughout the procedure such that cognitive load during bypass significantly differs compared to before or after bypass, across all 3 roles. While on bypass, results show that anesthesiologists experience significantly lower levels of perceived cognitive load than both surgeons and perfusionists. Correlational analyses reveal that perceived cognitive load of both the surgeon and the team had significant positive associations with bypass length and surgery length. Conclusion. Our findings support the utility of SURG-TLX in real cardiac cases as a measure of cognitive load over time, and on an individual and team-wide basis.

Physiological synchronization and entropy as measures of team cognitive load.

The operating room (OR) is a high-risk and complex environment, where multiple specialized professionals work as a team to effectively care for patients in need of surgical interventions. Surgical tasks impose high cognitive demands on OR staff and cognitive overload may have deleterious effects on team performance and patient safety. The aim of the present study was to investigate the feasibility and describe a novel methodological approach to characterize dynamic changes in team cognitive load by measuring synchronization and entropy of heart rate variability parameters during real-life cardiac surgery. Cognitive load was measured by capturing interbeat intervals (IBI) from three team members (surgeon, anesthesiologist and perfusionist) using an unobtrusive wearable heart rate sensor and transmitted in real-time to a smartphone application. Clinical data and operating room audio/video recordings were also collected to provide behavioral and contextual information. We developed symbolic representations of the transient cognitive state of individual team members (Individual Cognitive State - ICS), and overall team (Team Cognitive State - TCS) by comparing IBI data from each team member with themselves and with others. The distribution of TCS symbols during surgery enabled us to display and analyze temporal states and dynamic changes of team cognitive load. Shannon's entropy was calculated to estimate the changing levels of team organization and to detect fluctuations resulting from a variety of cognitive demands and/or specific situations (e.g. medical error, emergency, flow disruptions). An illustrative example from a real cardiac surgery team shows how cognitive load patterns shifted rapidly after an actual near-miss medication event, leading the team to a more organized and synchronized state. The methodological approach described in this study provides a measurement technique for the assessment of team physiological synchronization, which can be applied to many other team-based environments. Future research should gather additional validity evidence to support the proposed methods for team cognitive load measurement.

Criterion validity and inter-rater reliability of a palliative care screening tool for patients admitted to an emergency department intensive care unit.

OBJECTIVE: The use of palliative care (PC) screening criteria to trigger PC consultations may optimize the utilization of PC services, improve patient comfort, and reduce invasive and futile end-of-life care. The aim of the present study was to assess the criterion validity and inter-rater reliability of a PC screening tool for patients admitted to an emergency department intensive care unit (ED-ICU). METHOD: Observational retrospective study evaluating PC screening criteria based on the presence of advanced diagnosis and the use of two "surprise questions" (traditional and modified). Patients were classified at ED-ICU admission in four categories according to the proposed algorithm.ResultA total of 510 patients were included in the analysis. From these, 337 (66.1%) were category 1, 0 (0.0%) category 2, 63 (12.4%) category 3, and 110 (21.6%) category 4. Severity of illness (Simplified Acute Physiology Score III score and mechanical ventilation), mortality (ED-ICU and intrahospital), and PC-related measures (order for a PC consultation, time between admission and PC consultation, and transfer to a PC bed) were significantly different across groups, more evidently between categories 4 and 1. Category 3 patients presented similar outcomes to patients in category 1 for severity of illness and mortality. However, category 3 patients had a PC consultation ordered more frequently than did category 1 patients. The screening criteria were assessed by two independent raters (n = 100), and a substantial interrater reliability was found, with 80% of agreement and a kappa coefficient of 0.75 (95% confidence interval = 0.62, 0.88).Significance of resultsThis study is the first step toward the implementation of a PC screening tool in the ED-ICU. The tool was able to discriminate three groups of patients within a spectrum of increasing severity of illness, risk of death, and PC needs, presenting substantial inter-rater reliability. Future research should investigate the implementation of these screening criteria into routine practice of an ED-ICU.

Acute stress in residents during emergency care: a study of personal and situational factors.

Providing care for simulated emergency patients may induce considerable acute stress in physicians. However, the acute stress provoked in a real-life emergency room (ER) is not well known. Our aim was to assess acute stress responses in residents during real emergency care and investigate the related personal and situational factors. A cross-sectional observational study was carried out at an emergency department of a tertiary teaching hospital. All second-year internal medicine residents were invited to voluntarily participate in this study. Acute stress markers were assessed at baseline (T1), before residents started their ER shift, and immediately after an emergency situation (T2), using heart rate, systolic, and diastolic blood pressure, salivary α-amylase activity, salivary interleukin-1 ß, and the State-Trait Anxiety Inventory (STAI-s and STAI-t). Twenty-four residents were assessed during 40 emergency situations. All stress markers presented a statistically significant increase between T1 and T2. IL-1 ß presented the highest percent increase (141.0%, p < .001), followed by AA (99.0%, p = .002), HR (81.0%, p < .001), DBP (8.0%, p < .001), and SBP (3.0%, p < .001). In the multivariable analysis, time of residency had a negative correlation with HR during the emergency (adjusted R-square = .168; F = 8.69; p = .006), SBP response (adjusted R-square = .210; F = 6.19; p = .005) and DBP response (adjusted R-square = .293; F = 9.09; p = .001). Trait anxiety (STAI-t) was positively correlated with STAI-s (adjusted R-square = .326; F = 19.9; p < .001), and number of procedures performed during emergency care had a positive association with HR response (adjusted R-square = .241; F = 5.02; p = .005). In the present study, emergency care provoked substantial acute stress in residents. Resident experience, trait anxiety, and number of emergency procedures were independently associated with acute stress response.

Development of an algorithm to aid triage decisions for intensive care unit admission: a clinical vignette and retrospective cohort study.

BACKGROUND: Intensive care unit (ICU) admission triage is performed routinely and is often based solely on clinical judgment, which could mask biases. A computerized algorithm to aid ICU triage decisions was developed to classify patients into the Society of Critical Care Medicine's prioritization system. In this study, we sought to evaluate the reliability and validity of this algorithm. METHODS: Nine senior physicians evaluated forty clinical vignettes based on real patients. The reference standard was defined as the priorities ascribed by two investigators with full access to patients' records. Agreement of algorithm-based priorities with the reference standard and with intuitive priorities provided by the physicians were evaluated. Correlations between algorithm prioritization and physicians' judgment of the appropriateness of ICU admissions in scarcity and nonscarcity settings were also evaluated. Validity was further assessed by retrospectively applying this algorithm to 603 patients with requests for ICU admission for association with clinical outcomes. RESULTS: Agreement between algorithm-based priorities and the reference standard was substantial, with a median κ of 0.72 (interquartile range [IQR] 0.52-0.77). Algorithm-based priorities demonstrated higher interrater reliability (overall κ 0.61, 95% confidence interval [CI] 0.57-0.65; median percentage agreement 0.64, IQR 0.59-0.70) than physicians' intuitive prioritization (overall κ 0.51, 95% CI 0.47-0.55; median percentage agreement 0.49, IQR 0.44-0.56) (p = 0.001). Algorithm-based priorities were also associated with physicians' judgment of appropriateness of ICU admission (priorities 1, 2, 3, and 4 vignettes would be admitted to the last ICU bed in 83.7%, 61.2%, 45.2%, and 16.8% of the scenarios, respectively; p < 0.001) and with actual ICU admission, palliative care consultation, and hospital mortality in the retrospective cohort. CONCLUSIONS: This ICU admission triage algorithm demonstrated good reliability and validity. However, more studies are needed to evaluate a difference in benefit of ICU admission justifying the admission of one priority stratum over the others.