SECUre: a multicentre survey of the safety of emergency care in UK emergency departments.

INTRODUCTION: According to safety theory, frontline staff are often best informed to identify problems that threaten safety in their workplace. Surveying emergency department (ED) staff is a straightforward method for investigating risks, identifying solutions and evaluating interventions. This study's aim was to validate an ED safety questionnaire specifically for use in the UK and provide an overview of safety culture and risks. METHODS: An ED safety questionnaire developed in the USA was modified then validated using 33 RCEM (Royal College of Emergency Medicine) patient safety leads (calculating content validity index). The resulting 39 multiple-choice questionnaire was used in a multicentre survey. 110 participants were randomly selected from each site. A minimum 40% response rate per site reduced non-response bias. Cronbach's alpha was calculated across five categories as an estimate of reliability. Simple descriptive statistics were used to identify risks or good practice. χ2 test compared individual sites' results with national results to highlight outlier questions (ie, the department's strengths and weaknesses). χ2 was also used to identify significant differences between responses from nurses and doctors. RESULTS: 1060 participants were recruited across 18 sites. Cronbach's alpha was adequate (0.65 to 0.8). Analysis highlighted risks posed by interruptions, negative effects of targets, deficient mental healthcare (especially compared with critical care) and ED crowding. The study also revealed encouraging safety culture, such as effective doctor-nurse communication, and identified sites that were positive outliers overall or for specific questions. Comparing doctors and nurses' responses suggests additional support is needed for nursing staff. CONCLUSIONS: This study provides the first step towards assessing ED safety culture and describing risks in the UK. Identifying outlier sites provides opportunities to learn from excellence. Repeat application of the survey will enable monitoring of safety interventions on a local and national level.

The Extended Supervised Learning Event (ESLE): Assessing Nontechnical Skills in Emergency Medicine Trainees in the Workplace.

STUDY OBJECTIVE: The contribution of emergency medicine clinicians' nontechnical skills in providing safe, high-quality care in the emergency department (ED) is well known. In 2015, the UK Royal College of Emergency Medicine introduced explicit validated descriptors of nontechnical skills needed to function effectively in the ED. A new nontechnical skills assessment tool that provided a score for 12 domains of nontechnical skills and detailed narrative feedback, the Extended Supervised Learning Event (ESLE), was introduced and was mandated as part of the Royal College of Emergency Medicine assessment schedule. We aim to evaluate the psychometric reliability of the ESLE in its first year of use. METHODS: ESLEs were mandated for all UK emergency medicine trainees in the final 4 years of a 6-year national training program from August 2015. The completed assessments were uploaded to the Royal College of Emergency Medicine e-portfolio. All assessments recorded in the Royal College of Emergency Medicine e-portfolio database between August 2015 and August 2016 were anonymized and analyzed for psychometric reliability, using generalizability theory. Decision analysis was used to model the effect of altering the number of episodes and assessors on reliability. RESULTS: A total of 1,390 ESLEs were analyzed. The majority (62%) of the variation in nontechnical skills scores was attributable to the trainee's ability. The circumstances of the event (eg, case complexity, workload) accounted for 21% and the stringency or leniency of assessors the remaining 16%. Decision analysis suggests that 3 ESLEs by 2 or more assessors, as currently recommended in the Royal College of Emergency Medicine curriculum, provide an assessment with a reliability coefficient of 0.8. CONCLUSION: Board-certified-equivalent emergency medicine supervisors are able to provide reliable assessments of emergency medicine trainees' nontechnical skills in the workplace by using the ESLE.

An Emergency Medicine Research Priority Setting Partnership to establish the top 10 research priorities in emergency medicine.

Defining research priorities in a specialty as broad as emergency medicine is a significant challenge. In order to fund and complete the most important research projects, it is imperative that we identify topics that are important to all clinicians, society and to our patients. We have undertaken a priority setting partnership to establish the most important questions facing emergency medicine. The top 10 questions reached through a consensus process are discussed.

A multicentre observational study to evaluate a new tool to assess emergency physicians' non-technical skills.

OBJECTIVE: To evaluate a new tool to assess emergency physicians' non-technical skills. METHODS: This was a multicentre observational study using data collected at four emergency departments in England. A proportion of observations used paired observers to obtain data for inter-rater reliability. Data were also collected for test-retest reliability, observability of skills, mean ratings and dispersion of ratings for each skill, as well as a comparison of skill level between hospitals. Qualitative data described the range of non-technical skills exhibited by trainees and identified sources of rater error. RESULTS: 96 assessments of 43 senior trainees were completed. At a scale level, intra-class coefficients were 0.575, 0.532 and 0.419 and using mean scores were 0.824, 0.702 and 0.519. Spearman's ρ for calculating test-retest reliability was 0.70 using mean scores. All skills were observed more than 60% of the time. The skill Maintenance of Standards received the lowest mean rating (4.8 on a nine-point scale) and the highest mean was calculated for Team Building (6.0). Two skills, Supervision & Feedback and Situational Awareness-Gathering Information, had significantly different distributions of ratings across the four hospitals (p<0.04 and 0.007, respectively), and this appeared to be related to the leadership roles of trainees. CONCLUSION: This study shows the performance of the assessment tool is acceptable and provides valuable information to structure the assessment and training of non-technical skills, especially in relation to leadership. The framework of skills may be used to identify areas for development in individual trainees, as well as guide other patient safety interventions.

Identifying nontechnical skills associated with safety in the emergency department: a scoping review of the literature.

STUDY OBJECTIVE: Understanding the nontechnical skills specifically applicable to the emergency department (ED) is essential to facilitate training and more broadly consider interventions to reduce error. The aim of this scoping review is to first identify and then explore in depth the nontechnical skills linked to safety in the ED. METHODS: The review was conducted in 2 stages. In stage 1, online databases were searched for published empirical studies linking nontechnical skills to safety and performance in the ED. Articles were analyzed to identify key ED nontechnical skills. In stage 2, these key skills were used to generate additional key words, which enabled a second search of the literature to be undertaken and expand on the evidence available for review. RESULTS: In stage 1, 11 articles were retrieved for data analysis and 9 core emergency medicine nontechnical skills were identified. These were communicating, managing workload, anticipating, situational awareness, supervising and providing feedback, leadership, maintaining standards, using assertiveness, and decisionmaking. In stage 2, a secondary search, using these 9 skills and related terms, uncovered a further 21 relevant articles. Therefore, 32 articles were used to describe the main nontechnical skills linked to safety in the ED. CONCLUSION: This article highlights the challenges of reviewing a topic for which the terms are not clearly defined in the literature. A novel methodological approach is described that provides a structured and transparent process for reviewing the literature in emerging areas of interest. A series of literature reviews focusing on individual nontechnical skills will provide a clearer understanding of how the skills identified contribute to safety in the ED.

Development and validation of a tool to assess emergency physicians' nontechnical skills.

STUDY OBJECTIVE: Nontechnical skills are "the cognitive, social and personal resource skills that complement technical skills, and contribute to safe and efficient task performance." Our research team developed and evaluated the task of developing and validating a behavioral marker system for the observational assessment of emergency physicians' nontechnical skills. METHODS: The development of the tool was divided into 3 phases and used triangulation of data from a number of sources. During phase 1, a provisional assessment tool was developed according to published literature and curricula. Phase 2 used analysis of staff interviews and field observations to determine whether the skill list contained any significant omissions. These studies were also used to identify behavioral markers linked to nontechnical skills in the context of the emergency department (ED) and establish whether skills included in the tool were observable. Phase 3 involved evaluating the content validity index of exemplar behaviors, using a survey of experts. RESULTS: A behavioral marker system was developed that comprised 12 emergency medicine-specific nontechnical skills, grouped into 4 categories. Content validity was assessed with a survey of 148 emergency medicine staff, and 75% of items achieved the recommended content validity index greater than 0.75. Data from the survey enabled further refinement of the behavioral markers to produce a final version of the tool. CONCLUSION: Although further evaluative studies are needed, this behavioral marker system provides a structured approach to the assessment and training of nontechnical skills in the ED.

Teams under pressure in the emergency department: an interview study.

OBJECTIVE: To identify key stressors for emergency department (ED) staff, investigate positive and negative behaviours associated with working under pressure and consider interventions that may improve how the ED team functions. METHODS: This was a qualitative study involving semistructured interviews. Data were collected from staff working in the ED of a London teaching hospital. A purposive sampling method was employed to recruit staff from a variety of grades and included both doctors and nurses. RESULTS: 22 staff members took part in the study. The most frequently mentioned stressors included the '4-hour' target, excess workload, staff shortages and lack of teamwork, both within the ED and with inpatient staff. Leadership and teamwork were found to be mediating factors between objective stress (eg, workload and staffing) and the subjective experience. Participants described the impact of high pressure on communication practices, departmental overview and the management of staff and patients. The study also revealed high levels of misunderstanding between senior and junior staff. Suggested interventions related to leadership and teamwork training, advertising staff breaks, efforts to help staff remain calm under pressure and addressing team motivation. CONCLUSIONS: This study highlights the variety of stressors that ED staff are subject to and considers a number of cost-efficient interventions. Medical education needs to expand to include training in leadership and other 'non-technical' skills in addition to traditional clinical skills.