Trainee anaesthetist self-assessment using an entrustment scale in workplace-based assessment.

The role of self-assessment in workplace-based assessment remains contested. However, anaesthesia trainees need to learn to judge the quality of their own work. Entrustment scales have facilitated a shared understanding of performance standards among supervisors by aligning assessment ratings with everyday clinical supervisory decisions. We hypothesised that if the entrustment scale similarly helped trainees in their self-assessment, there would be substantial agreement between supervisor and trainee ratings. We collected separate mini-clinical evaluation exercises forms from 113 anaesthesia trainee-supervisor pairs from three hospitals in Australia and New Zealand. We calculated the agreement between trainee and supervisor ratings using Pearson and intraclass correlation coefficients. We also tested for associations with demographic variables and examined narrative comments for factors influencing rating. We found ratings agreed in 32% of cases, with 66% of trainee ratings within one point of the supervisor rating on a nine-point scale. The correlation between trainee and supervisor ratings was 0.71, and the degree of agreement measured by the intraclass correlation coefficient was 0.67. With higher supervisor ratings, trainee ratings better correlated with supervisor ratings. We found no strong association with demographic variables. Possible explanations of divergent ratings included one party being unaware of a vital aspect of the performance and different interpretations of the prospective nature of the scale. The substantial concordance between trainee and supervisor ratings supports the contention that the entrustment scale helped produce a shared understanding of the desired performance standard. Discussion between trainees and supervisors on the reasoning underlying their respective judgements would provide further opportunities to enhance this shared understanding.

Evaluation of indicators of acute emotional states in dogs.

A complete assessment of animal welfare requires not just an understanding of negative emotional states, such as fear and anxiety, but also of positive states, such as calmness and happiness. However, few studies have identified accurate and reliable indicators of positive emotional states in dogs. This study aimed to identify parameters that may serve as indicators of short-term emotional states in dogs. Using a cross-over design, 60 dogs living at a research facility were exposed to six different 10-min scenarios expected to elicit responses varying in emotional valence and arousal. A range of behavioural and physiological parameters were collected and their relationship to anticipated emotional valence and arousal was analysed using linear and logistic mixed models. Cortisol, adrenocorticotropic hormone, heart rate variability, panting, whining, and body shake all demonstrated significant differences based on arousal levels, but only within negative valence scenarios. Scores from a qualitative behavioural assessment (QBA) were associated with both emotional valence and arousal and were considered the best indicator of positive valence. Activity, ear temperature, and sitting were associated with positive high arousal, although this may have been influenced by differing levels of movement induced during these scenarios. Meanwhile, heart rate, secretory immunoglobulin A, standing and lying all showed similar changes associated with arousal for both positive and negative valence scenarios. This study provides a critical first step towards identifying evidence-based indicators of short-term emotional states in dogs, while highlighting considerations that should be made when employing these parameters, including the influence of coder bias, food provision, exercise, and external temperature. Overall, it is recommended future dog emotion and welfare research use a combination of parameters including indicators of both emotional valence and arousal.

Teamwork matters: team situation awareness to build high-performing healthcare teams, a narrative review.

Healthcare today is the prerogative of teams rather than of individuals. In acute care domains such as anaesthesia, intensive care, and emergency medicine, the work is complex and fast-paced, and the team members are diverse and interdependent. Three decades of research into the behaviours of high-performing teams provides us with clear guidance on team training, demonstrating positive effects on patient safety and staff wellbeing. Here we consider team performance through the lens of situation awareness. Maintaining situation awareness is an absolute requirement for safe and effective patient management. Situation awareness is a dynamic process of perceiving cues in the environment, understanding what they mean, and predicting how the situation may evolve. In the context of acute clinical care, situation awareness can be improved if the whole team actively contributes to monitoring the environment, processing information, and planning next steps. In this narrative review, we explore the concept of situation awareness at the level of the team, the conditions required to maintain team situation awareness, and the relationship between team situation awareness, shared mental models, and team performance. Our ultimate goal is to help clinicians create the conditions required for high-functioning teams, and ultimately improve the safety of clinical care.

Psychological Safety and Hierarchy in Operating Room Debriefing: Reflexive Thematic Analysis.

INTRODUCTION: Debriefing is a team discussion in a constructive, supportive environment. Barriers exist to consistent, effective team debriefing in the clinical setting, especially in operating theaters. The purpose of this study was to gain insights from frontline workers on how to set up an effective debriefing policy for our operating room. METHODS: This was a qualitative study in which we interviewed operating room workers in a tertiary children's hospital. Interviews were audio-recorded, transcribed, and coded. Data were analysed using the reflexive thematic analysis technique within a critical realism paradigm. RESULTS: Interviews were analysed from 40 operating room staff: 14 nurses, seven anesthetic technicians, seven anaesthetists, and 12 surgeons; 25 (65%) were female. The three key themes were (1) "commitment to learning"-healthcare workers are committed to teamwork and quality improvement; (2) "it is a safe space"-psychological safety is a prerequisite for, and is enhanced by, debriefing; and (3) "natural leader"-the value of leadership, but also constructs around leadership that maintain hierarchies. CONCLUSIONS: Psychological safety is both a prerequisite for and a product of debriefing. Leadership, if viewed as a collective responsibility, could help break down power structures. Given the results of this study and evidence in the literature, it is likely that routine debriefing, if well done, will improve psychological safety, facilitate team learning, reduce errors, and improve patient safety.

Reflecting on insight and insights into reflection: a systematic review of insight and reflection in post graduate medical education.

BACKGROUND: Clinicians recognize insight as important for safe independent medical practice. Clinical education literature focuses on self-reflection. The aim of this review is to describe how clinical educators conceptualize reflection and ask is it analogous to how clinicians conceptualize insight? METHODS: Using PRISMA guidelines, a systematic review of the literature around insight and reflection in postgraduate medical education was undertaken. A thematic analysis of the concepts of insight and reflection was performed. RESULTS: A total of 75 reports were included in the analysis. The literature focussed predominantly on reflection with little discussion of insight. Three main themes were generated: episodic reflection; cyclic reflection; reflection as a state. Reflection as a state seemed to be the professional quality most often aspired to but was less well defined in terms of educational interventions. When more than one model was described, it was often with a reflective state being the ideal that episodic or cyclic reflection may approximate. It is not clear that it is possible to progress up the hierarchy. CONCLUSION: We present a novel description of a hierarchy from discrete episodes of reflection, to cyclic processes that involve reflection, through to a state in which the practitioner is reflective. There is no unified understanding of how an individual ascends this hierarchy, or a cohesive description of what insight is for an independent medical practitioner. This review highlights the need for research into how practicing clinicians conceptualize and characterize insight in their training and practice.

Evolution of the feedback conversation in anaesthesia education: a narrative review.

Over the past century, education has been a core component for improving patient safety. The initial focus was developing a curriculum and an assessment process. In recent decades, the value of work-based learning has come to the fore. Learning from work, or experiential learning, requires reflection, which is critically dependent on external feedback. Conceptions of feedback have moved from a transactional information transfer from the supervisor to the trainee to a learner-centred and collaborative process occurring in a complex socio-cultural environment. In this narrative review we describe the evolution of the feedback conversation, provide a model synthesising the core concepts of feedback, and offer some guidance for the development of effective feedback in anaesthesia education.

Anaesthesia and patient safety in the socio-technical operating theatre: a narrative review spanning a century.

We review the development of technology in anaesthesia over the course of the past century, from the invention of the Boyle apparatus to the modern anaesthetic workstation with artificial intelligence assistance. We define the operating theatre as a socio-technical system, being necessarily comprised of human and technological parts, the ongoing development of which has led to a reduction in mortality during anaesthesia by an order of four magnitudes over a century. The remarkable technological advances in anaesthesia have been accompanied by important paradigm shifts in the approach to patient safety, and we describe the inter-relationship between technology and the human work environment in the development of such paradigm shifts, including the systems approach and organisational resilience. A better understanding of emerging technological advances and their effects on patient safety will allow anaesthesia to continue to be a leader in both patient safety and in the design of equipment and workspaces.

Emotions and team communication in the operating room: a scoping review.

Training in healthcare team communication has largely focused on strategies to improve information transfer with less focus on interpersonal dynamics and emotional aspects of communication. The Operating Room (OR) may be one of the most emotionally charged hospital environments, and is one requiring excellent team communications. We aimed to identify literature reporting on the emotional aspects of OR team communication. Our research questions were: what are the triggers in the environment that provoke an emotional response affecting communication, and what are the emotional responses to communication between OR team members; and how do these emotional aspects of communication affect the function of the OR team? We undertook a Scoping Review of literature across relevant databases following published guidelines, and narrative synthesis of the identified studies. From the 10 included studies we identified three themes: (1) Emotional experiences in the OR and their contributors; (2) Effects of emotional experiences on team communication; and (3) Solutions to manage the emotional experiences in the OR. Theme 1 sub-themes were: (1) Range of emotions experienced in the OR; (2) Hierarchical culture and (3) Leadership expectations as contributors to negative emotions. The OR is an emotionally charged environment. The hierarchical culture can inhibit staff from speaking up, and failure of leaders to meet team expectations, e.g., through appropriate and timely communication, may cause frustration and stress. The consequences of emotions include poor team dynamics, ineffective communication and potential negative impact on patient care. Few studies described strategies to manage emotions in the OR. The studies reviewed describe an environment where emotions can run high, affecting interpersonal communications, team function and patient care. The few identified studies relevant to our research questions demonstrate a need to better understand the emotional aspects of OR team communication and the effectiveness of interventions to improve these.

The Effect of Transportation on Puppy Welfare from Commercial Breeding Kennels to a Distributor.

Many puppies from commercial breeding kennels (CBKs) are transported by ground from their kennels of origin to a distributor. This experience may elicit fear and stress during a sensitive developmental period, which may in turn negatively impact the puppies' short- and long-term welfare. This study aimed to measure short-term effects of transportation on puppy welfare metrics. Eight-week-old puppies (n = 383) from 12 CBKs were tested at their kennels (pre-trans) and ~48 h after arriving at a distributor (post-trans). At each location, puppies underwent an isolation test, a stranger-approach test, and a physical health assessment. Behavioral responses to testing were scored from videos. Fecal glucocorticoid metabolites (FGM), fecal secretory immunoglobulin A (sIgA), and presence of intestinal parasites were also analyzed. Linear mixed-effects models identified decreased exploration (p < 0.001), and increased locomotion (p < 0.001) and escape attempts (p = 0.001) during the post-trans isolation test. Increased affiliative behavior (p < 0.001), FGM (p < 0.001) and sIgA (p = 0.014) were also observed post-trans. Findings support good physical health both pre- and post-trans, while behavioral and physiological changes suggest increased puppy distress post-trans. Higher post-transport affiliative behavior may indicate that puppies sought social support as a coping strategy after experiencing transport-related distress. Future studies should explore the efficacy of transportation-related interventions to mitigate puppy distress.

Dam (Canis familiaris) Welfare throughout the Peri-Parturient Period in Commercial Breeding Kennels.

Poor dam welfare throughout the peri-parturient period can also negatively affect that of their offspring. This study aimed to identify changes in physical, physiological, and behavioral metrics indicative of dam welfare throughout the peri-parturient period. Dams (n = 74) from eight U.S. Midwest commercial breeding (CB) kennels were tested at 6 and 1 week prepartum, and 4 and 8 weeks postpartum. At each time point dams underwent a stranger approach test, physical health assessment, hair collection for hair cortisol concentration (HCC) and fecal collection for fecal glucocorticoid metabolites (FGM), fecal secretory immunoglobulin A (sIgA) and parasite detection. Linear mixed-effects models indicated dams exhibited more affiliative behaviors towards the stranger at 4 weeks postpartum than 6 weeks prepartum (p = 0.03), increased HCC from 4-weeks to 8 weeks postpartum (p = 0.02), and increased FGM from 1 week prepartum to 8 weeks postpartum (p = 0.04). At each respective time point, the percentage of dams with intestinal parasites was 11%, 4%, 23%, and 15%. Most changes are likely due to increased energy requirements and hormonal variations. However, deviations from expected changes may have resulted from changes in environment and/ or management, which should be explored in future studies.

Perioperative leaders' experience of COVID-19 in Aotearoa: a qualitative interview study.

AIMS: Once it became apparent that COVID-19 would reach Aotearoa New Zealand, perioperative services responded urgently to contain viral spread, keep staff safe and maintain patient care. We aimed to understand how perioperative leaders around the country responded to the pandemic, their experiences, reflections and the lessons learnt. Our goal is to inform future pandemic responses. METHODS: We undertook a qualitative study with thematic analysis of semi-structured interviews. We recruited perioperative leads involved in the COVID-19 response using snowball sampling, following initial contact with anaesthetic and surgical department heads. RESULTS: We interviewed 33 perioperative leads from 16 of the country's 20 district health boards, with representation across hospitals of different sizes and the professional groups working in operating theatres. Four main themes were identified from data. These were: "no one source of truth," with prolific, constantly changing information, limited initial support from hospital senior executives, and siloed approaches and tensions between departments and professional groups; resourcing challenges attributed to limited baseline preparedness and increased workload; deficiencies in PPE and physical facilities; staff stress and anxiety, and the impact this had on workforce capacity; ongoing preparedness for future waves; and reflections on "lessons learnt". These lessons focused strongly on communication, caring for staff, collaboration, downtime to enable preparation, and a need for external, potentially national co-ordination and resources to facilitate planning. CONCLUSIONS: Perioperative leaders' experiences and reflections of COVID-19 paint a picture of limited prior preparation or planning for a pandemic, requiring an immediate pivot from routine care to emergency response. In an environment of uncertainty, information overload and staff stress hospital leaders worked to obtain resources, maintain staff safety and engagement, develop new systems and in some cases, create new facilities. Sharing the experiences and lessons learned about communication and collaboration, policy development and staff training may go some way to facilitate a smoother implementation of a pandemic response the next time around.

Desire paths for workplace assessment in postgraduate anaesthesia training: analysing informal processes to inform assessment redesign.

BACKGROUND: In postgraduate specialist training, workplace assessments are expected to provide the information required for decisions on trainee progression. Research suggests that meeting this expectation can be difficult in practice, which has led to the development of informal processes, or 'shadow systems' of assessment. Rather than rejecting these informal approaches to workplace assessment, we propose borrowing from sociology the concept of 'desire paths' to legitimise and strengthen these well-trodden approaches. We asked what information about trainees is currently used or desired by those charged with making decisions on trainee progression, and how is it obtained? METHODS: We undertook a qualitative study with thematic analysis of semi-structured interviews of supervisors of training across Australia and New Zealand. RESULTS: From 21 interviews, we identified four interrelated themes, the first being the local context of training sites. The other three themes represent dilemmas in the desire for authentic and representative information about the trainee: 1) how the process of gathering and documenting information can filter, transform, or limit the original message; 2) deciding when possible trainee deviation from performance norms warrants a closer look; and 3) how transparent vs covert information gathering affects the information supervisors will provide, and how control over assessment is distributed between trainee and supervisor. CONCLUSION: From these themes, we propose a set of design principles for future workplace assessment. Understanding the reasons desire paths exist can inform future assessment redesign, and may address the current disjunct between the formal workplace assessment system and what happens in practice.

Latent Safety Threats and Countermeasures in the Operating Theater: A National In Situ Simulation-Based Observational Study.

INTRODUCTION: In situ simulation provides a valuable opportunity to identify latent safety threats (LSTs) in real clinical environments. Using a national simulation program, we explored latent safety threats (LSTs) identified during in situ multidisciplinary simulation-based training in operating theaters in hospitals across New Zealand. METHOD: Surgical simulations lasting between 15 and 45 minutes each were run as part of a team training course delivered in 21 hospitals in New Zealand. After surgical in situ simulations, instructors used a template to record identified LSTs in a postcourse report. We analyzed these reports using the contributory factors framework from the London Protocol to categorize LSTs. RESULTS: Of 103 postcourse reports across 21 hospitals, 77 contained LSTs ranging across all factors in the London Protocol. Common threats included staff knowledge and skills in emergencies, team factors, factors related to task or technology, and work environment threats. Team factors were also commonly reported as protecting against adverse events, in particular, creating a shared mental model. Examples of actions taken to address threats included replacing or repairing faulty equipment, clarifying emergency processes, correcting written information, and staff training for clinical emergencies. CONCLUSIONS: The pervasiveness of LSTs suggests that our results have widespread relevance to surgical departments throughout New Zealand and elsewhere and that collective solutions would be valuable. In situ simulation is an effective mechanism both for identifying threats to patient safety and to prompt initiatives for improvement, supporting the use of in situ simulation in the quality improvement cycle in healthcare.

Hospital accreditation processes in Saudi Arabia: a thematic analysis of hospital staff experiences.

BACKGROUND: Hospital accreditation by an international organisation can play an important role in health quality and safety. However, little is known about how managers and front-line employees experience and perceive the effects of accreditation. Their views could inform quality improvement processes and procedures. OBJECTIVE: To explore perceptions of employees at the managerial level on the Joint Commission International (JCI) accreditation process and its impact on quality of patient care in Saudi Arabian JCI-accredited hospitals. METHODS: We undertook a qualitative study using semi-structured interviews to explore the perspectives of senior staff from three accredited public hospitals in Saudi Arabia. Interviews were transcribed prior to thematic analysis. RESULTS: Twenty managers participated in the interviews. The following inter-related themes emerged concerning the JCI accreditation process and its impact on quality of patient care: drivers for the change; the plan for the change; the process of the change; maintaining changes post-accreditation and patients' issues. Participants were positive in their accounts of: drivers for the change; planning for the change needed to achieve accreditation and managing patients' issues. However, participants reported less favourably on: the process of the change; and maintaining changes post-accreditation. CONCLUSION: The planning stage was perceived as the easiest component of JCI accreditation. Implementing and maintaining changes post-accreditation that demonstrably promote patient safety and quality of care was perceived as more difficult. When planning for accreditation, institutions need to incorporate strategies to ensure that improvements to care continue beyond the accreditation period.

How Trainees Come to Trust Supervisors in Workplace-Based Assessment: A Grounded Theory Study.

PURPOSE: In competency-based medical education, workplace-based assessment provides trainees with an opportunity for guidance and supervisors the opportunity to judge the trainees' clinical practice. Learning from assessment is enhanced when trainees reveal their thinking and are open to critique, which requires trust in the assessor. If supervisors knew more about how trainees come to trust them in workplace-based assessment, they could better engender trainee trust and improve trainees' learning experience. METHOD: From August 2018 to September 2019, semistructured interviews were conducted with 17 postgraduate anesthesia trainees across Australia and New Zealand. The transcripts were analyzed using constructivist grounded theory methods sensitized by a sociocultural view of learning informed by Wenger's communities of practice theory. RESULTS: Participants described a continuum from a necessary initial trust to an experience-informed dynamic trust. Trainees assumed initial trust in supervisors based on accreditation, reputation, and a perceived obligation of trustworthiness inherent in the supervisor's role. With experience and time, trainees' trust evolved based on supervisor actions. Deeper levels of trainee trust arose in response to perceived supervisor investment and allowed trainees to devote more emotional and cognitive resources to patient care and learning rather than impression management. Across the continuum from initial trust to experience-informed trust, trainees made rapid trust judgments that were not preceded by conscious deliberation; instead, they represented a learned "feel for the game." CONCLUSIONS: While other factors are involved, our results indicate that the trainee behavior observed in workplace-based assessment is a product of supervisor invitation. Supervisor trustworthiness and investment in trainee development invite trainees to work and present in authentic ways in workplace-based assessment. This authentic engagement, where learners "show themselves" to supervisors and take risks, creates assessment for learning.

Trust, power and learning in workplace-based assessment: The trainee perspective.

For trainees to participate meaningfully in workplace-based assessment (WBA), they must have trust in their assessor. However, the trainee's dependent position complicates such trust. Understanding how power and trust influence WBAs may help us make them more effective learning opportunities. We conducted semi-structured interviews with 17 postgraduate anaesthesia trainees across Australia and New Zealand. Sensitised by notions of power, we used constructivist grounded theory methodology to examine trainees' experiences with trusting their supervisors in WBAs. In our trainee accounts, we found that supervisors held significant power to mediate access to learning opportunities and influence trainee progress in training. All episodes where supervisors could observe trainees, from simply working together to formal WBAs, were seen to generate assessment information with potential consequences. In response, trainees actively acquiesced to a deferential role, which helped them access desirable expertise and minimise the risk of reputational harm. Trainees granted trust based on how they anticipated a supervisor would use the power inherent in their role. Trainees learned to ration exposure of their authentic practice to supervisors in proportion to their trust in them. Trainees were more trusting and open to learning when supervisors used their power for the trainee's benefit and avoided WBAs with supervisors they perceived as less trustworthy. If assessment for learning is to flourish, then the trainee-supervisor power dynamic must evolve. Enhancing supervisor behaviour through reflection and professional development to better reward trainee trust would invite more trainee participation in assessment for learning. Modifying the assessment system design to nudge the power balance towards the trainee may also help. Modifications could include designated formative and summative assessments or empowering trainees to select which assessments count towards progress decisions. Attending to power and trust in WBA may stimulate progress towards the previously aspirational goal of assessment for learning in the workplace.

Impact of SARS-CoV-2 infection and implementation of infection prevention and control (IPC) measures on inpatient psychiatric units.

Psychiatric inpatients are at high risk of acquiring and transmitting communicable diseases such as SARS-CoV-2 (COVID-19). Via chart review, the authors examined a cohort of COVID-positive psychiatric inpatients admitted between March and June of 2020, early in the pandemic, to Valleywise Health Medical Center (VMHC), in Arizona, USA. The goal was to assess the ways in which the virus itself as well as infection prevention and control (IPC) measures affected psychiatric inpatients. Variables examined included demographics, psychiatric diagnoses, COVID-19 symptoms, medical comorbidities, and length of stay. Behavioral health faciltiies encountered significant challenges in blalancing the need for a therapeutic milieu and compliance with IPC measures. During the study period, 39 patients and 15 staff members contracted COVID. All but one COVID-positive staff member provided direct patient care. During the study period, VMHC behavioral health facilities were largely successful in identifying and quarantining COVID-positive patients. The hospital's IPC policies/procedures were constantly updated to incorporate new guidelines and address emerging knowledge about the virus, which may have lowered transmission rates and mitigated potential complications. To preserve quallity and safety of psychiatric care, the therapeutic milieu was altered, which may have adversely affected patient care and/or lengthened hospital stay.

Key dimensions of innovations in workplace-based assessment for postgraduate medical education: a scoping review.

BACKGROUND: Specialist training bodies continue to devise innovative methods of gathering information on trainee workplace performance to meet the requirements of competency-based medical education. We reviewed recent innovations in workplace-based assessment (WBA) tools to identify strengths, weaknesses, and trade-offs inherent in their design and use. METHODS: In this scoping review, using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines, we systematically searched databases between 2009 and 2019 for WBA tools with novel characteristics not typically seen in traditional WBAs. These included innovations in rating scales, ways of collecting information, technological innovations, ways of triggering WBAs, and approaches to compiling and using information. RESULTS: We identified 30 innovative WBA tools whose characteristics could be categorised into seven dimensions: frequency of assessment, granularity (unit of performance assessed), coverage of the curriculum, rating method, initiation of the WBA, information use, and incentives. These dimensions had multiple interdependencies and trade-offs, often balancing generating assessment data with available resources. Philosophical stance on assessment also influenced WBA choice, for example prioritising trainee-centred learning (i.e. initiation of WBA and transparency of assessment data), perceptions of assessment and feedback as burdensome or beneficial, and holistic vs reductionist views on assessment of performance. CONCLUSIONS: Our synthesis of the literature on innovative WBAs provides a framework for categorising tool characteristics across seven dimensions, systematically teasing apart the considerations in design and use of workplace assessments. It also draws attention to the trade-offs inherent in tool design and selection, and enables a more deliberate consideration of the tool characteristics most appropriate to the local context.

Communication and team function affect patient outcomes in anaesthesia: getting the message across.

A study in this edition of the Journal has added to data showing that failures in communication in the operating room contribute to patient harm. These data support the view that multidisciplinary teamwork and communication training should be part of the continuous professional development of all members of the perioperative team. Achieving change will require efforts to win the hearts and minds of all concerned, but these data also support an expectation that engagement in initiatives and techniques to enhance communication and teamwork should not be optional.