Attending Surgeons Demonstrate Greater Correlations of Skill Assessment and Anticipation of Adverse Events Than Residents During Laparoscopic Cholecystectomy.

BACKGROUND: Surgical training includes the development of technical and nontechnical skills. While technical skills are more easily quantified, nontechnical skills such as situation awareness (SA) are more difficult to measure and quantify. This study investigated the relationships between different SA elements and expertise. METHODS: Twenty attending and resident surgeons rated their anticipation of an impending adverse event while watching 20 videos of laparoscopic cholecystectomies with and without adverse events. After watching each video, they assessed surgeon skills and self-assessed their anticipation ratings. All participants answered a general confidence questionnaire before and after the study. RESULTS: Videos with adverse events led to significantly higher anticipation of adverse events (P < 0.001), lower surgeon skill rating (P < 0.001), and higher self-assessment in their anticipation ratings (P < 0.001) across both participant groups. General confidence was significantly lower for residents than that for attending surgeons (P < 0.001). Compared with the residents, attendings exhibited stronger and more stable correlations between measurements of SA. When viewing videos with adverse events, attendings showed significantly higher correlation between anticipation of an impending adverse event and skill assessment of the surgeon (P = 0.005). CONCLUSIONS: This study investigated how different elements of SA and their relationships were influenced by experience. The results indicated that attendings had stronger and more stable correlations between SA elements than residents, demonstrating how measurement correlations could be meaningful and sensitive indicators of expertise and autonomy readiness.

Human factors/ergonomics work system analysis of patient work: state of the science and future directions.

PURPOSE: To demonstrate the use and value of the Human Factors/Ergonomics-based Systems Engineering Initiative for Patient Safety (SEIPS) family of work system models for studying and improving patient work. DATA SOURCES: We conducted a review of the published empirical literature applying the SEIPS family of work system models for patient work. STUDY SELECTION: Included studies had to apply one of the SEIPS family of work system models to study patient work; be published in a peer-reviewed journal in English and include analysis of data. We identified 16 articles that met our inclusion criteria. DATA EXTRACTION: For each study, we extracted settings and situations in which models were applied; research design; study methods; model(s) used; type and number of study participants; study objective(s); whether the study included an intervention; specific aspects of the model used; knowledge generated about patient work and benefits of using the models. RESULTS OF DATA SYNTHESIS: Our analysis revealed that a majority of studies were conducted in the United States, used qualitative or mixed methods and employed a variety of data collection techniques to study adult patient populations with chronic illness and their informal caregivers and healthcare providers performing patient work in the home and clinical setting. The studies resulted in a variety of useful products, demonstrating several benefits of using the models. CONCLUSION: Our review has demonstrated the value of using the SEIPS family of work systems models to study and improve patient and family contributions to health-related work.

Eye tracking in surgical education: gaze-based dynamic area of interest can discriminate adverse events and expertise.

BACKGROUND: Eye-gaze metrics derived from areas of interest (AOIs) have been suggested to be effective for surgical skill assessment. However, prior research is mostly based on static images and simulated tasks that may not translate to complex and dynamic surgical scenes. Therefore, eye-gaze metrics must advance to account for changes in the location of important information during a surgical procedure. METHODS: We developed a dynamic AOI generation technique based on eye gaze collected from an expert viewing surgery videos. This AOI updated as the gaze of the expert moved with changes in the surgical scene. This technique was evaluated through an experiment recruiting a total of 20 attendings and residents to view 10 videos associated with and another 10 without adverse events. RESULTS: Dwell time percentage (i.e., gaze duration) inside the AOI differentiated video type (U = 13508.5, p < 0.001) between videos with the presence (Mdn = 16.75) versus absence (Mdn = 19.95) of adverse events. This metric also differentiated participant group (U = 14029.5, p < 0.001) between attendings (Mdn = 15.45) and residents (Mdn = 19.80). This indicates that our dynamic AOIs reflecting the expert eye gaze was able to differentiate expertise, and the presence of unexpected adverse events. CONCLUSION: This dynamic AOI generation technique produced dynamic AOIs for deriving eye-gaze metrics that were sensitive to expertise level and event characteristics.

A proactive learning approach toward building adaptive capacity during COVID-19: A radiology case study.

The COVID-19 pandemic has challenged organizations to adapt under uncertainty and time pressure, with no pre-existing protocols or guidelines available. For organizations to learn to adapt effectively, there is a need to understand the perspectives of the frontline workforce involved in everyday operations. This study implemented a survey-tool to elicit narratives of successful adaptation based on the lived experiences frontline radiology staff at a large multispecialty pediatric hospital. Fifty-eight members of the radiology frontline staff responded to the tool between July and October of 2020. Qualitative analysis of the free-text data revealed five categories of themes that underpinned adaptive capacity of the radiology department during the pandemic: information flow, attitudes and initiative, new and adjusted workflows, availability and utilization of resources, and collaboration and teamwork. Enablers of adaptive capacity included timely and clear communication about procedures and policies from the leadership to frontline staff, and revised workflows with flexible work arrangements, such as remote patient screening. Responses to multiple choice questions in the tool helped identify the main categories of challenges faced by staff, factors that enabled successful adaptation, and resources used. The study demonstrates the use of a survey-tool to proactively identify frontline adaptations. The paper also reports a system-wide intervention resulting directly from a discovery enabled by the findings based on the use of RETIPS in the radiology department. In general, the tool could be used in concert with existing learning mechanisms, such as safety event reporting systems, to inform leadership-level decisions to support adaptive capacity.

A human factors and ergonomics approach to conceptualizing care work among caregivers of people with dementia.

Society relies upon informal (family, friend) caregivers to provide much of the care to the estimated 43.8 million individuals living with Alzheimer's disease and related dementias globally. Caregivers rarely receive sufficient training, resources, or support to meet the demands associated with dementia care, which is often associated with increased risk of suboptimal outcomes. Human factors and ergonomics (HFE) can address the call for new approaches to better understand caregiving and support caregiver performance through systematic attention to and design of systems that support the work of caregivers- their care work. Thus, our objective was to perform a work system analysis of care work. We conducted a qualitative study using a Critical Incident Technique interviewing approach and Grounded Dimensional Analysis analytic procedures. Our findings introduce a new conceptual framework for understanding the care work system of dementia caregivers and suggest that care work is influenced by interactions among distinct caregiver goals, the task demands of the care needs of the person with dementia, daily life needs of the caregiver and family, and contextual factors that shape caregivers' perceptions surrounding care. The initial work system model produced by this study provides a foundation from which future work can further elucidate the care work system, determine how the care work system intersects and coordinates with other work systems such as the patient work system, and design systems that address caregivers' individual caregiving context.

A process-based approach to exploring the information behavior of informal caregivers of people living with dementia.

INTRODUCTION AND PURPOSE: Informal caregivers of persons living with dementia have significant unmet information needs that, if met, would better equip them to provide effective care. Despite the existence of health information technologies, websites, resources, and organizations dedicated to dementia caregiving, caregivers continue to report unmet information needs. Caregivers' continued unmet information needs suggest a misalignment between information products, and caregivers' information behavior-how caregivers generate, acquire, manage, use, communicate, and seek information. Researchers have developed conceptual models for understanding caregivers' information behavior, but these models are limited in that they are task-oriented, and they assume that caregivers' information needs will be met if they engage in information behavior. To address these limitations, the present study sought to explore caregivers' information behavior as a sociotechnical-systems-based process. METHODS: We conduced semi-structured interviews with 30 self-identified caregivers to explore their daily experience of caregiving activities, including their information behavior. We applied a process-based conceptual framework that takes into account inputs, processes, outputs, and feedback mechanisms within a sociotechnical system to guide analysis. The process of interest was caregivers' information behavior as modeled by the information-seeking and communication model (ISCM). We conducted a deductive content analysis guided by the components of the ISCM. We then used team-based affinity diagramming to collapse and categorize the ISCM components into inputs, processes, outputs, and feedback. RESULTS: We developed a conceptual model to depict caregivers' information behavior as a sociotechnical-systems-based process of inputs, processes, and outputs that feedback into the system. The conceptual model consisted of three inputs (i.e., information users, information providers, and information products), three information seeking and communication processes (i.e., information access, information interaction, and information assessment and processing), two outputs (i.e., utility and credibility), and feedback. DISCUSSION AND CONCLUSION: Building on and addressing the gaps in previous information behavior models, our conceptual framework advances the previous task-level understandings of caregivers' information behavior into a comprehensive feedback-driven, process-level perspective consisting of context-based inputs, information seeking and communication processes, outputs, and feedback. A sociotechnical-systems-based understanding of caregivers' information behavior allows for misalignments between information providers and products, and caregivers' information behavior not only to be illuminated, but systematically addressed.

Physiologic Monitor Alarm Burden and Nurses' Subjective Workload in a Children's Hospital.

BACKGROUND AND OBJECTIVES: Physiologic monitor alarms occur at high rates in children's hospitals; ≤1% are actionable. The burden of alarms has implications for patient safety and is challenging to measure directly. Nurse workload, measured by using a version of the National Aeronautics and Space Administration Task Load Index (NASA-TLX) validated among nurses, is a useful indicator of work burden that has been associated with patient outcomes. A recent study revealed that 5-point increases in the NASA-TLX score were associated with a 22% increased risk in missed nursing care. Our objective was to measure the relationship between alarm count and nurse workload by using the NASA-TLX. METHODS: We conducted a repeated cross-sectional study of pediatric nurses in a tertiary care children's hospital to measure the association between NASA-TLX workload evaluations (using the nurse-validated scale) and alarm count in the 2 hours preceding NASA-TLX administration. Using a multivariable mixed-effects regression accounting for nurse-level clustering, we modeled the adjusted association of alarm count with workload. RESULTS: The NASA-TLX score was assessed in 26 nurses during 394 nursing shifts over a 2-month period. In adjusted regression models, experiencing >40 alarms in the preceding 2 hours was associated with a 5.5 point increase (95% confidence interval 5.2 to 5.7; P < .001) in subjective workload. CONCLUSION: Alarm count in the preceding 2 hours is associated with a significant increase in subjective nurse workload that exceeds the threshold associated with increased risk of missed nursing care and potential patient harm.

Conceptualizing caregiving activities for persons with dementia (PwD) through a patient work lens.

Informal caregivers are an integral part of care delivery for persons with dementia (PwD). Informal caregivers take part in a wide range of care activities both individually and collaboratively with other caregivers. Caregiving often involves high demands in the face of limited resources, which can lead to stress, burden, and burnout. To support caregivers, we need to conceptualize caregiving activities they perform, and the networks and roles through which they perform work. We performed a directed content analysis on interview data from twenty caregivers and applied a human factors approach to characterize informal caregiving work. Our results revealed 1) nuances in caregiving roles, 2) differences in caregiving networks, and 3) 13 categories of caregiving activities characterized by time commitments; physical, cognitive and socio-behavioral demands; and varying network dependencies. These findings can be applied in future studies to evaluate the needs of caregiving networks and how to better support them.

Improving the Intraoperative Educational Experience: Understanding the Role of Confidence in the Resident-Attending Relationship.

OBJECTIVE: With recent changes to graduate medical education, the balance between resident autonomy and need for supervision impacts the educational and training experience of residents. The objective of this study was to understand the relationship between the confidence of attendings and residents and their different perspectives of perceived educational experience and autonomy in the operating room (OR). We hypothesized that the attending's confidence in the resident would be an important factor in improving the educational experience and resident's autonomy in the OR. DESIGN: Self-reported confidence-rating and operative experience surveys were administered to teams of post-graduate year (PGY 1) through PGY 5 surgical residents and attendings in two temporal sets (Early: Sept-Dec 2015, n = 20; Late: Jan-Apr 2016, n = 22). A second "end-of-year" survey was distributed to residents (n = 9, 37.5% response) and attendings (n = 10, 35% response) asking questions regarding their educational experience and operative experience during the past year. SETTING: Large rural teaching hospital. PARTICIPANTS: Nineteen general surgery residents (PGY 1 - 5) and 14 general surgery attendings. RESULTS: Resident perception of confidence differs from junior to senior residents, and that there was discordance between resident's confidence and skill as perceived by attendings, particularly in senior residents. Results also showed that attending's confidence in residents was positively correlated with attending's perceived educational experience in the OR. Residents and attendings both indicated attending's confidence in residents as an important factor in increasing resident autonomy in the OR, thus the attending's confidence in residents could have a positive impact on resident autonomy and educational experience in the OR. CONCLUSIONS: We have demonstrated a relationship between self-confidence for residents and improved confidence from attendings in residents' capabilities. Based on these findings, we would propose identifying methods to expand resident's awareness of surgical situations and develop attending's confidence in residents.