Multiple outcome interactions in healthcare systems: a participatory outcome mapping approach.

Outcomes, which are the result state or condition from a process or intervention, are essential elements of healthcare system design and an important indicator of performance. They are included in well-known system analysis frameworks such as the Systems Engineering Initiative for Patient Safety (SEIPS) and Cognitive Work Analysis (CWA). However, fewer practical approaches exist for understanding and communicating interactions among healthcare outcomes. This study applies a novel mapping method as a practical approach to collect, aggregate and visualise interrelations among multiple healthcare outcomes. Graphic facilitation mapping sessions with eleven healthcare providers and ten patients with chronic conditions were conducted. Participants created outcome interrelationship maps following a six-step process. Two outcome-based network visualisations were synthesised using network analysis. This outcome-based approach advances how we frame healthcare systems, focussing on accommodating multiple stakeholders' visions, understanding interrelations, and defining trade-offs. This practical approach may complement frameworks such as SEIPS and CWA. Practitioner summary: The presented outcome-based mapping approach can facilitate the understanding of outcomes as part of the interrelated healthcare system. The approach allows the discussion and integration of different stakeholders' outcome priorities to identify critical elements and better inform the development or adaptation of healthcare systems. Abbreviations: SEIPS: engineering initiative for patient safety; CWA: cognitive work analysis; HFE: human factors and ergonomics; AH: abstraction hierarchy; POTS: postural orthostatic tachycardia syndrome; DRM: design research methodology; FA2: forceAtlas2; HbA1c: glycated haemoglobin; NHS: National Health Service; UK: United Kingdom.

Adopting systems models for multiple incident analysis: utility and usability.

BACKGROUND: This study aims to present two system models widely used in Human Factors and Ergonomics (HF/E) and evaluate whether the models are adoptable to England's national patient safety team in improving the exploration and understanding of multiple incident reports of an active patient safety issue and the development of the remedial actions for a potential National Patient Safety Alert. The existing process of examining multiple incidents is based on inductive thematic analysis and forming the remedial actions is based on barrier analysis of intelligence on potential solutions. However, no formal systems models evaluated in this study have been used. METHODS: AcciMap and Systems Engineering Initiative for Patient Safety (SEIPS) were selected, applied and evaluated to the analysis of two different sets of patient safety incidents: (i) incidents concerning ingestion of superabsorbent polymer granules and (ii) incidents concerning the interruption in use of High Nasal Flow Oxygen. The first set was analysed by the first author and the utility and usability were reflected. The second set was analysed collectively by a purposeful sample of patient safety team members, who create the National Patient Safety Alerts from incident-level data and information. All of them attended a 30-min video-based training and a 1.5 h case-based online workshop. Post-workshop individual interviews were conducted to evaluate their perceived utility and usability of each model. RESULTS: The patient safety team showed overwhelming support for the utility of the system models as a 'framework' that provides a systematic, structured way of looking at an issue and examining the causes, whilst also sharing concerns regarding their usability. AcciMap was viewed useful particularly in providing a visual comprehensive overview of the issue but considered chaotic by some participants due to many arrows between factors. SEIPS was perceived easier to understand due to the familiarity of the structure (Donbedian's model), but the non-hierarchical format of SEIPS was considered less useful. CONCLUSIONS: The participants of the study agreed with the high level of utility of both models for their unique strengths, but shared some concern for the usability of them in terms of complexity and further training/coaching time would be required to adopt these models in their daily practices. It is recommended that the gap between HF/E practitioners and patient safety practitioners can be narrowed by strengthening education, and coaching and mentoring relationships between the two groups, led by the increasing number of healthcare practitioners who embrace their membership to HF/E practice.

Healthcare workers' perspectives on participatory system dynamics modelling and simulation: designing safe and efficient hospital pharmacy dispensing systems together.

With increasingly complex safety-critical systems like healthcare being developed and managed, there is a need for a tool that permits decision-makers to better understand the complexity, test various strategies and guide effective changes. System Dynamics (SD) modelling is an effective approach that can aid strategic decision-making in healthcare systems but has been underutilised partly due to the challenge of engaging healthcare stakeholders in the modelling process. This paper, therefore, investigates the applicability of a participatory SD approach based on healthcare workers' perspectives on ease of use (usability) and usefulness (utility). The study developed an interactive simulation dashboard platform which facilitated participatory simulation for exploring various hospital pharmacy staffing level arrangements and their impacts on interruptions, fatigue, workload, rework, productivity and safety. The findings reveal that participatory SD approach can enhance team learning by converging on a shared mental model, aid decision-making and identifying trade-offs. The implications of these findings are discussed as well as experience and lessons learned on modelling facilitation. Practitioner Summary: This paper reports the perspectives of healthcare workers, who were engaged with a participatory system dynamics modelling and simulation process for hospital pharmacy staffing level management. Evaluative feedback revealed that the participatory SD approach can be a valuable tool for participatory ergonomics by helping the participants gain a deeper understanding of the complex dynamic interactions between workload, rework, safety and efficiency. Abbreviations: SD: system dynamics; ETTO: efficiency-thoroughness trade-off.

A participatory systems approach to design for safer integrated medicine management.

It is recognised that whole systems approaches are required in the design and development of complex health care services. Application of a systems approach benefits from the involvement of key stakeholders. However, participation in the context of community based health care is particularly challenging due to busy and geographically distributed stakeholders. This study used action research to investigate what processes and methods were needed to successfully employ a participatory systems approach. Three participatory workshops planned and facilitated by method experts were held with 30 representative stakeholders. Various methods were used with them and evaluated through an audit of workshop outputs and a qualitative questionnaire. Findings on the method application and participation are presented and methodological challenges are discussed with reference to further research. Practitioner Summary: This study provides practical insights on how to apply a participatory systems approach to complex health care service design. Various template-based methods for systems thinking and risk-based thinking were efficiently and effectively applied with stakeholders.

Articulating current service development practices: a qualitative analysis of eleven mental health projects.

BACKGROUND: The utilisation of good design practices in the development of complex health services is essential to improving quality. Healthcare organisations, however, are often seriously out of step with modern design thinking and practice. As a starting point to encourage the uptake of good design practices, it is important to understand the context of their intended use. This study aims to do that by articulating current health service development practices. METHODS: Eleven service development projects carried out in a large mental health service were investigated through in-depth interviews with six operation managers. The critical decision method in conjunction with diagrammatic elicitation was used to capture descriptions of these projects. Stage-gate design models were then formed to visually articulate, classify and characterise different service development practices. RESULTS: Projects were grouped into three categories according to design process patterns: new service introduction and service integration; service improvement; service closure. Three common design stages: problem exploration, idea generation and solution evaluation - were then compared across the design process patterns. Consistent across projects were a top-down, policy-driven approach to exploration, underexploited idea generation and implementation-based evaluation. CONCLUSIONS: This study provides insight into where and how good design practices can contribute to the improvement of current service development practices. Specifically, the following suggestions for future service development practices are made: genuine user needs analysis for exploration; divergent thinking and innovative culture for idea generation; and fail-safe evaluation prior to implementation. Better training for managers through partnership working with design experts and researchers could be beneficial.

Individual Factors Influencing the Public's Perceptions About the Importance of COVID-19 Immunity Certificates in the United Kingdom: Cross-sectional Web-based Questionnaire Survey.

BACKGROUND: Understanding how perceptions around immunity certificates are influenced by individual characteristics is important to inform evidence-based policy making and implementation strategies for services around immunity and vaccine certification. OBJECTIVE: This study aimed to assess what were the main individual factors influencing people's perception of the importance of using COVID-19 immunity certificates, including health beliefs about COVID-19, vaccination views, sociodemographics, and lifestyle factors. METHODS: A cross-sectional web-based survey with a nationally representative sample in the United Kingdom was conducted on August 3, 2021. Responses were collected and analyzed from 534 participants, aged 18 years and older, who were residents of the United Kingdom. The primary outcome measure (dependent variable) was the participants' perceived importance of using immunity certificates, computed as an index of 6 items. The following individual drivers were used as the independent variables: (1) personal beliefs about COVID-19 (using constructs adapted from the Health Belief Model), (2) personal views on vaccination, (3) willingness to share immunity status with service providers, and (4) variables related to respondents' lifestyle and sociodemographic characteristics. RESULTS: The perceived importance of immunity certificates was higher among respondents who felt that contracting COVID-19 would have a severe negative impact on their health (ß=0.2564; P<.001) and felt safer if vaccinated (ß=0.1552; P<.001). The prospect of future economic recovery positively influenced the perceived importance of immunity certificates. Respondents who were employed or self-employed (ß=-0.2412; P=.001) or experienced an increase in income after the COVID-19 pandemic (ß=-0.1287; P=.002) perceived the use of immunity certificates as less important compared to those who were unemployed or had retired or those who had experienced a reduction in their income during the pandemic. CONCLUSIONS: The findings of our survey suggest that more vulnerable members in our society (those unemployed or retired and those who believe that COVID-19 would have a severe impact on their health) and people who experienced a reduction in income during the pandemic perceived the severity of not using immunity certificates in their daily life as higher.

Why 'one size fits all' is not enough when designing COVID-19 immunity certificates for domestic use: a UK-wide cross-sectional online survey.

OBJECTIVES: The present study explored public's willingness to use COVID-19 immunity certificates across six different domestic scenarios. DESIGN: Cross-sectional online survey. SETTING: UK representative survey conducted on 3 August 2021. PARTICIPANTS: 534 UK residents over 18 years old. INTERVENTIONS: Participants replied to the same set of questions. PRIMARY AND SECONDARY OUTCOME MEASURES: The primary outcome measure was willingness to use immunity certificates across three different domestic settings: (1) visiting the general practitioner (GP) for a non-urgent health issue; (2) dining in a restaurant and (3) attending a performance in a theatre. For each setting two options, one prioritising convenience (option A) and the other privacy (option B), were offered. Our secondary outcome measures were computed indices from items adapted from the Health Belief Model; attitudes towards sharing immunity status with service providers; prior to COVID-19 lifestyle. In addition, we recorded data about respondents' sociodemographic characteristics. RESULTS: Respondents were more willing to use immunity certificates that prioritised convenience (92%), rather than privacy (76%), when visiting their GP . However, privacy was more favourable in the other two settings (dining in a restaurant (84%) and going to a theatre (83%)) compared with convenience (38% and 39% respectively). Personal beliefs about COVID-19 and immunity certificates were associated with variations in willingness to use these across all scenarios. No variations were observed across sociodemographics and lifestyle. CONCLUSIONS: The findings of this survey suggest that there is not one-size-fits-all solution for designing immunity certificates. Immunity certificates are complex sociotechnical systems, any attempt to implement these for domestic use should be tailored to different settings and user needs. The design of certification services requires a more evidence-based approach and further research is needed to understand how different settings, design elements (like convenience or privacy) and personal beliefs about the pandemic should inform their design.

Systems modelling approaches to the design of safe healthcare delivery: ease of use and usefulness perceived by healthcare workers.

The UK health service, which had been diagnosed to be seriously out of step with good design practice, has been recommended to obtain knowledge of design and risk management practice from other safety-critical industries. While these other industries have benefited from a broad range of systems modelling approaches, healthcare remains a long way behind. In order to investigate the healthcare-specific applicability of systems modelling approaches, this study identified 10 distinct methods through meta-model analysis. Healthcare workers' perception on 'ease of use' and 'usefulness' was then evaluated. The characterisation of the systems modelling methods showed that each method had particular capabilities to describe specific aspects of a complex system. However, the healthcare workers found that some of the methods, although potentially very useful, would be difficult to understand, particularly without prior experience. This study provides valuable insights into a better use of the systems modelling methods in healthcare. STATEMENT OF RELEVANCE: The findings in this study provide insights into how to make a better use of various systems modelling approaches to the design and risk management of healthcare delivery systems, which have been a growing research interest among ergonomists and human factor professionals.

Health care process modelling: which method when?

OBJECTIVE: The role of process modelling has been widely recognized for effective quality improvement. However, application in health care is somewhat limited since the health care community lacks knowledge about a broad range of methods and their applicability to health care. Therefore, the objectives of this paper are to present a summary description of a limited number of distinct modelling methods and evaluate how health care workers perceive them. METHODS: Various process modelling methods from several different disciplines were reviewed and characterized. Case studies in three different health care scenarios were carried out to model those processes and evaluate how health care workers perceive the usability and utility of the process models. RESULTS: Eight distinct modelling methods were identified and characterized by what the modelling elements in each explicitly represents. Flowcharts, which had been most extensively used by the participants, were most favoured in terms of their usability and utility. However, some alternative methods, although having been used by a much smaller number of participants, were considered to be helpful, specifically in understanding certain aspects of complex processes, e.g. communication diagrams for understanding interactions, swim lane activity diagrams for roles and responsibilities and state transition diagrams for a patient-centred perspective. DISCUSSION: We believe that it is important to make the various process modelling methods more easily accessible to health care by providing clear guidelines or computer-based tool support for health care-specific process modelling. These supports can assist health care workers to apply initially unfamiliar, but eventually more effective modelling methods.

A hybrid human and organisational analysis method for railway accidents based on STAMP-HFACS and human information processing.

Safety is a constant priority for the railway industry and there are numerous hazards in and around the rail system which may result in damage to train and environment, human injury and fatalities. Low levels of human and organisational performance have been shown to be a prime cause of railway accidents and a number of accident models and methods have been developed in order to probe deeper into the role played by organisational factors in accident causation. The Systems-Theoretical Accident Modelling and Processes (STAMP) method for example, represents a promising systematic and systemic way of examining sociotechnical systems such as the railway. Another method, the Human Factors Analysis and Classification System (HFACS), based upon Reason's model of human error in an organisational context, has also proved popular as a human factors accident analysis framework. However, human factors elements are still somewhat limited and under-specified and these managerial and social issues within an organisation are simply regarded as sources of failure in the control constraints of STAMP. HFACS likewise, categorises accident data rather than analysing it in more depth. In this context, a hybrid human and organisational analysis method based on HFACS-STAMP (HFACS-STAMP method for railway accidents, HS-RAs) is proposed to identify and analyse human and organisational factors involved in railway accidents. Using the categories of human errors derived from HFACS and the structured systematic analysis process of STAMP, the HS-RAs method provides a mechanism by which active failures can promulgate across organisations and give a systemic analysis of human error in accidents. Combined with human information processing, the HS-RAs method gives a detailed causal analysis of human errors from receiving information to implement control actions. At last, the HS-RAs method is demonstrated using a case study of the 2011 Yong-Wen railway collision. A number of prominent accident causes of human factors are revealed and necessary countermeasures are proposed to avoid the recurrence of similar accidents. The HFACS-STAMP hybrid method has several advantages and can contribute to railway safety by providing a detailed analysis of the role of human error in railway accidents.

Why are we misdiagnosing urinary tract infection in older patients? A qualitative inquiry and roadmap for staff behaviour change in the emergency department.

PURPOSE: The aim of this study was to identify the psychological and behavioural factors influencing clinicians managing older people with possible UTI in urgent care settings, and to develop an improvement roadmap. METHODS: Michie's behaviour change wheel and COM-B (Capability, Opportunity, Motivation, Behaviour Change) models were used as the theoretical basis for this study. Semi-structured interviews were undertaken with 21 purposively selected medical and nursing staff in a large urban emergency department in the East Midlands, United Kingdom. Analysis was informed by the framework approach. A participatory design approach was used to develop an improvement roadmap. RESULTS: Key themes emerging from the semi-structured interviews included lack of knowledge on the role of urine dipstick testing, bias towards older people, automatic testing, time and resource constraints, pressures from peers and patients, and fear of the legal consequences of inaction. A thematic networks map indicated complex interactions between psychological and behavioural factors. Among more than 50 different intervention ideas identified by the workshop participants, two interventions were prioritised for implementation: i) controlling the use of dip stick urine tests; ii) providing individualised feedback to staff regarding the outcomes of patients diagnosed and treated for UTI. CONCLUSIONS: Psychological and behavioural factors play a significant role in the misdiagnosis of UTI in older people. Systematic approaches incorporating these factors might improve patient outcomes. Future studies should focus on implementation and evaluating their effectiveness and sustainability.

A systemic analysis of South Korea Sewol ferry accident - Striking a balance between learning and accountability.

The South Korea Sewol ferry accident in April 2014 claimed the lives of over 300 passengers and led to criminal charges of 399 personnel concerned including imprisonment of 154 of them as of Oct 2014. Blame and punishment culture can be prevalent in a more hierarchical society like South Korea as shown in the aftermath of this disaster. This study aims to analyse the South Korea ferry accident using Rasmussen's risk management framework and the associated AcciMap technique and to propose recommendations drawn from an AcciMap-based focus group with systems safety experts. The data for the accident analysis were collected mainly from an interim investigation report by the Board of Audit and Inspection of Korea and major South Korean and foreign newspapers. The analysis showed that the accident was attributed to many contributing factors arising from front-line operators, management, regulators and government. It also showed how the multiple factors including economic, social and political pressures and individual workload contributed to the accident and how they affected each other. This AcciMap was presented to 27 safety researchers and experts at 'the legacy of Jens Rasmussen' symposium adjunct to ODAM2014. Their recommendations were captured through a focus group. The four main recommendations include forgive (no blame and punishment on individuals), analyse (socio-technical system-based), learn (from why things do not go wrong) and change (bottom-up safety culture and safety system management). The findings offer important insights into how this type of accident should be understood, analysed and the subsequent response.