The Chartered Institute of Ergonomics and Human Factors at 75: perspectives on contemporary challenges and future directions for Ergonomics and Human Factors.

As the UK's Chartered Institute of Ergonomics and Human Factors (CIEHF) celebrates its 75th anniversary, it is worth reflecting on our discipline's contribution, current state, and critical future endeavours. We present the perspectives of 18 EHF professionals who were asked to respond to five questions regarding the impact of EHF, contemporary challenges, and future directions. Co-authors were in agreement that EHF's impact has been only limited to date and that critical issues require resolution, such as increasing the number of suitably qualified practitioners, resolving the research-practice gap, and increasing awareness of EHF and its benefits. Frequently discussed future directions include advanced emerging technologies such as artificial intelligence, the development of new EHF methods, and enhancing the quality and reach of education and training. The majority felt there will be a need for EHF in 75 years; however, many noted that our methods will need to adapt to meet new needs.Practitioner statement: This article provides the perspectives of 18 Ergonomics and Human Factors (EHF) professionals on the impact of EHF, contemporary challenges and critical future directions, and changes that are necessary to ensure EHF remains relevant in future. As such, it provides important guidance on future EHF research and practice.

Testing the reliability of accident analysis methods: a comparison of AcciMap, STAMP-CAST and AcciNet.

Accident analysis methods are used to model the multifactorial cause of adverse incidents. Methods such as AcciMap, STAMP-CAST and recently AcciNet, are systemic approaches that support the identification of safety interventions across sociotechnical system levels. Despite their growing popularity, little is known about how reliable systems-based methods are when used to describe, model and classify contributory factors and relationships. Here, we conducted an intra-rater and inter-rater reliability assessment of AcciMap, STAMP-CAST and AcciNet using the Signal Detection Theory (SDT) paradigm. A total of 180 hours' worth of analyses across 360 comparisons were performed by 30 expert analysts. Findings revealed that all three methods produced a weak to moderate positive correlation coefficient, however the inter-rater reliability of STAMP-CAST was significantly higher compared to AcciMap and AcciNet. No statistically significant or practically meaningful differences were found between methods in the overall intra-rater reliability analyses. Implications and future research directions are discussed.

Practitioners who undertake accident analysis within their organisations should consider the use of STAMP-CAST due to the significantly higher inter-rater reliability findings obtained in this study compared to AcciMap and AcciNet, particularly if they tend to work alone and/or part of relatively small teams.

Analysing dynamic work systems using DynEAST: a demonstration of concept.

The capability of current Ergonomics methods to capture dynamism is limited, stifling our understanding of work-as-done, distributed situational awareness and organisational drift. This paper provides a demonstration of concept of DynEAST; an extension of the EAST framework underpinned by principles from Dynamic Network Analysis, to capture elements of dynamism within work systems. The DynEAST concept is applied to a railway maintenance case study. Case study findings demonstrate how DynEAST outputs can be used to advance our understanding of the aforementioned phenomena and better equip practitioners for current and future Ergonomics challenges.Practitioner summary: This paper introduces the DynEAST method. DynEAST enables HF/E practitioners to model and analyse dynamic features of complex work systems. The development of DynEAST is timely due to the concurrent proliferation of increasingly complex sociotechnical systems and stagnation of HF/E methods development; particularly those able to model systemic dynamism. Abbreviations: DynEAST: dynamic event analysis of systemic teamwork; EAST: dynamic event analysis of systemic teamwork; HF/E: human factors and ergonomics; HF: human factors; DNA: dynamic network analysis; HTA: hierarchal task analysis; CWA: cognitive work analysis; CAST: causal analysis based on system theory; STAMP: system theoretic accident model and processes; FRAM: functional resonance analysis method; SNA: social network analysis; DSA: distributed situational awareness; PPO: possession protection officer; PO: protection officer; RTS: railway track signals; LPA: local possession authority; SMEs: subject matter experts.

Towards a unified model of accident causation: refining and validating the systems thinking safety tenets.

The systems thinking tenets were developed based on a synthesis of contemporary accident causation theory, models and approaches and encapsulate 15 features of complex systems that interact to create both safety and adverse events. Whilst initial testing provided supportive evidence, the tenets have not yet been subject to formal validation. This article presents the findings from a three-round Delphi study undertaken to refine and validate the tenets and assess their suitability for inclusion in a unified model of accident causation. Participants with expertise in accident causation and systems thinking provided feedback on the tenets and associated definitions until an acceptable level of consensus was achieved. The results reduced the original 15 tenets to 14 and 10 were identified as important to include in unified model of accident causation. The refined systems thinking tenets are presented along with future research directions designed to facilitate their use in safety practice.Practitioner summary: This article presents a refined and validated set of systems thinking tenets which describe features of complex systems that interact to create adverse events. The tenets can be used by practitioners to proactively identify safety leading indicators and contributory factors during adverse event analysis.

Testing the reliability and validity of risk assessment methods in Human Factors and Ergonomics.

There is growing interest in the use of systems-based risk assessment methods in Human Factors and Ergonomics (HFE). The purpose of this study was to test the intra-rater reliability and criterion-referenced concurrent validity of three systems-based risk assessment approaches: (i) the Systems-Theoretic Process Analysis (STPA) method; (ii) the Event Analysis of Systemic Teamwork Broken Links (EAST-BL) method; and, (iii) the Network Hazard Analysis and Risk Management System (Net-HARMS) method. Reliability and validity measures were obtained using the Signal Detection Theory (SDT) paradigm. Whilst STPA identified the highest number of risks, the findings indicate a weak to moderate level of reliability and validity for STPA, EAST-BL and Net-HARMS. There were no statistically significant differences between the methods across analyses. The results suggest that there is merit to the continued use of systems-based risk assessment methods following a series of methodological extensions that aim to enhance the reliability and validity of future applications. Practitioner summary The three risk assessment methods produced weak to moderate levels of stability and accuracy regarding their capability to predict risks. There is a pressing need to further test the reliability and validity of safety methods in Human Factors and Ergonomics.

Festschrift in honour of Professor Neville Stanton: A lone crusader in a world of driving simulators.

The automotive future has always pointed to a world of intelligent co-pilots and robot cars, but perhaps no more so than Knight Rider. In this 1980's television series the fictional Knight Industries Two Thousand (KITT) was a supercomputer on wheels with 1000 megabytes of memory. The protagonist was Michael Knight, a young loner on a crusade to champion the cause of the innocent and the helpless. This was a shadowy flight into the trials and tribulations of different levels of automation, re-claiming control when automation failed, and a wilful, chatty computer co-driver. An amusing metaphor, perhaps, for the research impact made by Neville Stanton in the field of vehicle automation. Without question - to paraphrase the Knight Rider outro - "one man can make a difference". This festschrift in Neville's honour tells the story of how.

State of science: evolving perspectives on 'human error'.

This paper reviews the key perspectives on human error and analyses the core theories and methods developed and applied over the last 60 years. These theories and methods have sought to improve our understanding of what human error is, and how and why it occurs, to facilitate the prediction of errors and use these insights to support safer work and societal systems. Yet, while this area of Ergonomics and Human Factors (EHF) has been influential and long-standing, the benefits of the 'human error approach' to understanding accidents and optimising system performance have been questioned. This state of science review analyses the construct of human error within EHF. It then discusses the key conceptual difficulties the construct faces in an era of systems EHF. Finally, a way forward is proposed to prompt further discussion within the EHF community. Practitioner statement This state-of-science review discusses the evolution of perspectives on human error as well as trends in the theories and methods applied to understand, prevent and mitigate error. It concludes that, although a useful contribution has been made, we must move beyond a focus on an individual error to systems failure to understand and optimise whole systems.

The Binary-Based Model (BBM) for Improved Human Factors Method Selection.

OBJECTIVE: This paper presents the Binary-Based Model (BBM), a new approach to Human Factors (HF) method selection. The BBM helps practitioners select the most appropriate HF methodology in relation to the complexity within the target system. BACKGROUND: There are over 200 HF methods available to the practitioner and little guidance to help choose between them. METHOD: The BBM defines a HF "problem space" comprising three complexity attributes. HF problems can be rated against these attributes and located in the "problem space." In addition, a similar HF "approach space" in which 66 predictive methods are rated according to their ability to confront those attributes is defined. These spaces are combined into a "utility space" in which problems and methods coexist. In the utility space, the match between HF problems and methods can be formally assessed. RESULTS: The method space is split into octants to establish broad groupings of methods distributed throughout the space. About 77% of the methods reside in Octant 1 which corresponds to problems with low levels of complexity. This demonstrates that most HF methods are suited to problems in low-complexity systems. CONCLUSION: The location of 77% of the rated methods in Octant 1 indicates that HF practitioners are underserved with methods for analysis of HF problems exhibiting high complexity. APPLICATION: The BBM can be used by multidisciplinary teams to select the most appropriate HF methodology for the problem under analysis. All the materials and analysis are placed in the public domain for modification and consensus building by the wider HF community.

Complexity theory in accident causation: using AcciMap to identify the systems thinking tenets in 11 catastrophes.

The quest to explain and understand the cause of accidents is both ever-present and ongoing amongst the safety science community. In an attempt to advance the theory and science of accident causation, researchers have recently formalised a set of '15 systems thinking tenets' that cover the conditions and characteristics of work systems that are believed to contribute to the cause of accidents. The purpose of this study was to attempt to identify the systems thinking tenets across a range of different systems and accidents using the Accident Mapping (AcciMap) method. The findings suggest that the tenets can be attributed to play a role in accident causation, however as a result of this process, the capability of AcciMap has been brought into question. Implications and directions for future research are described. Practitioner Summary: This study is an extension of previous work that suggested there was a need to test for the 'systems thinking tenets of accident causation' in a multi-incident dataset. We used AcciMap to evaluate whether it has the capability to support ongoing accident analysis activities in ergonomics research.

Systems thinking-based risk assessment methods applied to sports performance: A comparison of STPA, EAST-BL, and Net-HARMS in the context of elite women's road cycling.

There is increasing interest in applying systems Human Factors and Ergonomics (HFE) methods in sport. Risk assessment (RA) methods can be used identify risks which may impact the performance of individual athletes, teams, and overall sports systems; however, they have not yet been tested in sport. This study sets out to apply and compare three systems thinking-based RA methods in the context of elite sports performance and report on the frequency and types of the risks identified. The Systems-Theoretic Process Analysis (STPA) method, the Event Analysis of Systemic Teamwork Broken Links (EAST-BL) method, and the Networked Hazard Analysis and Risk Management System (Net-HARMS) method were applied to elite women's road cycling to identify all the credible risks that could degrade optimal team performance. The findings demonstrate that all three methods appear to provide useful results in a context other than safety, and that multiple risks threatening the performance of the cycling team were identified. Whilst the frequency and types of risks differed across the methods applied, there are additional theoretical, methodological, and practical implications to be considered prior to the selection and use of systems thinking-based RA approaches. Recommendations and directions for future HFE and sports science research are discussed.

Interaction-centred design: an end user evaluation of road intersection concepts developed using the cognitive work analysis design toolkit (CWA-DT).

Crashes at intersections represent an important road safety problem. Interactions between different road user types, such as between vehicles and vulnerable road users, are a particular concern. It has been suggested driver-centric road design plays a role in crashes. A multi-road user evaluation of three novel intersection designs is described. The designs were generated using the Cognitive Work Analysis Design Toolkit, underpinned by sociotechnical systems theory. The desktop evaluation involved drivers, motorcyclists, cyclists and pedestrians rating the design concepts against alignment with design goals, sociotechnical systems theory and usability, and providing feedback on the positive and negative aspects. Two concepts received more positive ratings and feedback in comparison to a concept that provided more user autonomy. The evaluation results also highlight clear differences in needs across road user groups. The design and evaluation process demonstrates how sociotechnical systems values and principles can be applied in the design of public spaces. Practitioner Summary: This study involved a participatory evaluation of novel road intersection designs, based on sociotechnical systems theory. The results identified important differences in needs and preferences across road user groups and demonstrate the value of sociotechnical systems theory and user participation in road transport design and evaluation processes. Abbreviations: CWA-DT: cognitive work analysis design toolkit; WDA: work domain analysis; SUS: system usability scale.

Radical systems thinking and the future role of computational modelling in ergonomics: an exploration of agent-based modelling.

We are teetering on the precipice of the imminent Fourth Industrial Revolution. In this new age, systems are set to become more densely intraconnected and interconnected, and massive sociotechnical systems exhibiting unprecedented levels of complexity will increasingly take hold. At the dawning of this new age, the Ergonomics discipline must reflect on its preparedness for tackling problems in these novel systems. This paper engages in this reflection by putting forth a critical commentary on the implication of these changes on the discipline and discusses the utility of our current methods in this new paradigm. A resulting Radical Systems Thinking in Ergonomics Manifesto is put forward - a set of mandates to guide practitioners and researchers in the development of new methods capable of coping with these imminent challenges. From the manifesto are derived a series of capability requirements for future computational modelling approaches in Ergonomics. Practitioner summary: The goal of this paper was to inspire the Ergonomics community to pursue further applications involving computational modelling approaches such as Agent-Based Modelling. It presents a manifesto for the future of the discipline, and from this the capabilities that future computational modelling approaches need to possess. Abbreviations: 1IR: first industrial revolution; 2IR: second industrial revolution; 3IR: third industrial revolution; 4IR: fourth industrial revolution; ABM: agent based model; AI: artificial intelligence; AoF: allocation of function; CPA: cyber physical attack; CPS: cyber-physical system; CWA: cognitive work analysis; DDoS: distributed denial of service; EAST: event analysis of systemic teamwork; FRAM; functional resonance analysis method; HCI: human-computer interaction; HERA: human error and recovery assessment; HET: human error template; HMC: human-machine cooperation; IoT: internet of things; RSTEM: radical systems thinking in ergonomics manifesto; SAI: situated artificial intelligence; STAMP: systems theoretic accident model and processes; TRACEr: technique for the retrospective and predictive analysis of cognitive errors in air traffic control.

Walking the talk: Comparing pedestrian 'activity as imagined' with 'activity as done'.

The safety of vulnerable road users, including pedestrians, is an important issue worldwide. In line with the shift towards systems thinking in transport safety, the aim of this study was to compare the normal performance of pedestrians as they navigate the road system with that imagined by road system managers to gain insights into how safety management can be improved for this vulnerable road user group. The Event Analysis of Systemic Teamwork framework was used to compare pedestrian activity 'as imagined' and 'as done' at signalised road intersections and railway level crossings. Data regarding 'activity as imagined' was derived from documentation review, and data on 'activity as done' was derived from a semi-naturalistic study of ten participants. It is concluded that in both environments pedestrians exhibited more diversity and variability than anticipated by system managers. Insights for improving the design of the road environment for pedestrians are provided. Further, it is argued that wider changes to the processes used in the design and management of road systems are needed.

A practical review of energy saving technology for ageing populations.

Fuel poverty is a critical issue for a globally ageing population. Longer heating/cooling requirements combine with declining incomes to create a problem in need of urgent attention. One solution is to deploy technology to help elderly users feel informed about their energy use, and empowered to take steps to make it more cost effective and efficient. This study subjects a broad cross section of energy monitoring and home automation products to a formal ergonomic analysis. A high level task analysis was used to guide a product walk through, and a toolkit approach was used thereafter to drive out further insights. The findings reveal a number of serious usability issues which prevent these products from successfully accessing an important target demographic and associated energy saving and fuel poverty outcomes. Design principles and examples are distilled from the research to enable practitioners to translate the underlying research into high quality design-engineering solutions.

Co-designing the next generation of home energy management systems with lead-users.

Home energy management systems are widely promoted as essential components of future low carbon economies. It is argued in this paper that assumptions surrounding their deployment, and the methods used to design them, emerge from discredited models of people and energy. This offers an explanation for why their field trial performance is so inconsistent. A first of a kind field trial is reported. Three eco communities took part in a comprehensive participatory design exercise as lead users. The challenge was to help users synchronise their energy use behaviours with the availability of locally generated renewable energy sources. To meet this aim, a set of highly novel Home Energy Management interfaces were co-designed and tested. Not only were the designs radically different to the norm, but they also yielded sustained user engagement over a six-month follow-up period. It is argued that user-centred design holds the key to unlocking the energy saving potential of new domestic technologies, and this study represents a bold step in that direction.

Quantum ergonomics: shifting the paradigm of the systems agenda.

A paradigm is an accepted world view. If we do not continually question our paradigm then wider trends and movements will overtake the discipline leaving it ill adapted to future challenges. This Special Issue is an opportunity to keep systems thinking at the forefront of ergonomics theory and practice. Systems thinking prompts us to ask whether ergonomics, as a discipline, has been too timid? Too preoccupied with the resolution of immediate problems with industrial-age methods when, approaching fast, are developments which could render these operating assumptions an irrelevance. Practical case studies are presented to show how abstract systems problems can be tackled head-on to deliver highly innovative and cost-effective insights. The strategic direction of the discipline foregrounds high-quality systems problems. These are something the discipline is well able to respond to provided that the appropriate operating paradigms are selected. Practitioner Summary: High-quality systems problems are the future of the discipline. How do we convert obtuse sounding systems concepts into practical interventions? In this paper, the essence of systems thinking is distilled and practical case studies used to demonstrate the benefits of this new paradigm.

Fitting methods to paradigms: are ergonomics methods fit for systems thinking?

The issues being tackled within ergonomics problem spaces are shifting. Although existing paradigms appear relevant for modern day systems, it is worth questioning whether our methods are. This paper asks whether the complexities of systems thinking, a currently ubiquitous ergonomics paradigm, are outpacing the capabilities of our methodological toolkit. This is achieved through examining the contemporary ergonomics problem space and the extent to which ergonomics methods can meet the challenges posed. Specifically, five key areas within the ergonomics paradigm of systems thinking are focused on: normal performance as a cause of accidents, accident prediction, system migration, systems concepts and ergonomics in design. The methods available for pursuing each line of inquiry are discussed, along with their ability to respond to key requirements. In doing so, a series of new methodological requirements and capabilities are identified. It is argued that further methodological development is required to provide researchers and practitioners with appropriate tools to explore both contemporary and future problems. Practitioner Summary: Ergonomics methods are the cornerstone of our discipline. This paper examines whether our current methodological toolkit is fit for purpose given the changing nature of ergonomics problems. The findings provide key research and practice requirements for methodological development.

Using the decision ladder to understand road user decision making at actively controlled rail level crossings.

Rail level crossings (RLXs) represent a key strategic risk for railways worldwide. Despite enforcement and engineering countermeasures, user behaviour at RLXs can often confound expectations and erode safety. Research in this area is limited by a relative absence of insights into actual decision making processes and a focus on only a subset of road user types. One-hundred and sixty-six road users (drivers, motorcyclists, cyclists and pedestrians) completed a diary entry for each of 457 naturalistic encounters with RLXs when a train was approaching. The final eligible sample comprised 94 participants and 248 encounters at actively controlled crossings where a violation of the active warnings was possible. The diary incorporated Critical Decision Method probe questions, which enabled user responses to be mapped onto Rasmussen's decision ladder. Twelve percent of crossing events were non-compliant. The underlying decision making was compared to compliant events and a reference decision model to reveal important differences in the structure and type of decision making within and between road user groups. The findings show that engineering countermeasures intended to improve decision making (e.g. flashing lights), may have the opposite effect for some users because the system permits a high level of flexibility for circumvention. Non-motorised users were more likely to access information outside of the warning signals because of their ability to achieve greater proximity to the train tracks and the train itself. The major conundrum in resolving these issues is whether to restrict the amount of time and information available to users so that it cannot be used for circumventing the system or provide more information to help users make safe decisions.