Where do we intervene to optimize sports systems? Leverage Points the way.

Sport and sports research are inherently complex systems. This appears to be somewhat at odds with the current research paradigm in sport in which interventions are aimed are fixing or solving singular broken components within the system. In any complex system, such as sport, there are places where we can intervene to change behaviour and, ideally, system outcomes. Meadows influential work describes 12 different points with which to intervene in complex systems (termed "Leverage Points"), which are ordered from shallow to deeper based on their potential effectiveness to influence transformational change. Whether research in sport is aimed at shallow or deeper Leverage Points is unknown. This study aimed to assess highly impactful research in sports science, sports nutrition/metabolism, sports medicine, sport and exercise psychology, sports management, motor control, sports biomechanics and sports policy/law through a Leverage Points lens. The 10 most highly cited original-research manuscripts from each journal representing these fields were analysed for the Leverage Point with which the intervention described in the manuscript was focused. The results indicate that highly impactful research in sports science, sports nutrition/metabolism, sports biomechanics and sports medicine is predominantly focused at the shallow end of the Leverage Points hierarchy. Conversely, the interventions drawn from journals representing sports management and sports policy/law were focused on the deeper end. Other journals analysed had a mixed profile. Explanations for these findings include the dual practitioner/academic needing to "think fast" to solve immediate questions in sports science/medicine/nutrition, limited engagement with "working slow" systems and method experts and differences in incremental vs. non-incremental research strategies.

Applying a systems thinking lens to anti-doping: A systematic review identifying the contributory factors to doping in sport.

The use of performance enhancing substances and methods (known as "doping") in sport is an intractable issue, with current anti-doping strategies predominantly focused on the personal responsibility and strict liability of individual athletes. This is despite an emerging understanding that athletes exist as part of a broader complex sports system that includes governance, policymakers, media, sponsors, clubs, team members, and athlete support staff, to name a few. As such, there is a need to examine the broader systemic factors that influence doping in sport. The aim of this systematic review was to identify and synthesise the factors contributing to doping and doping behaviours, attitudes, and beliefs and the extent to which this knowledge extends beyond the athlete to consider broader sports systems. The review followed PRISMA guidelines with risk of bias and study quality assessed by the Mixed Methods Appraisal Tool, and identified contributory factors synthesised and mapped onto a systems thinking-based framework. Overall, the included studies were determined to be of high quality. Support personnel, the coach, and the coach-athlete relationship represent key influences on the athletes' decisions to dope. From the evidence presented, doping is an emergent property of sport systems and represents a complex systemic problem that will require whole-of-system interventions. The implications for this and the focus of future research are discussed.

Testing the reliability of accident analysis methods: a comparison of AcciMap, STAMP-CAST and AcciNet.

Accident analysis methods are used to model the multifactorial cause of adverse incidents. Methods such as AcciMap, STAMP-CAST and recently AcciNet, are systemic approaches that support the identification of safety interventions across sociotechnical system levels. Despite their growing popularity, little is known about how reliable systems-based methods are when used to describe, model and classify contributory factors and relationships. Here, we conducted an intra-rater and inter-rater reliability assessment of AcciMap, STAMP-CAST and AcciNet using the Signal Detection Theory (SDT) paradigm. A total of 180 hours' worth of analyses across 360 comparisons were performed by 30 expert analysts. Findings revealed that all three methods produced a weak to moderate positive correlation coefficient, however the inter-rater reliability of STAMP-CAST was significantly higher compared to AcciMap and AcciNet. No statistically significant or practically meaningful differences were found between methods in the overall intra-rater reliability analyses. Implications and future research directions are discussed.

Practitioners who undertake accident analysis within their organisations should consider the use of STAMP-CAST due to the significantly higher inter-rater reliability findings obtained in this study compared to AcciMap and AcciNet, particularly if they tend to work alone and/or part of relatively small teams.

Tomorrow's demons: a scoping review of the risks associated with emerging technologies.

Society faces a growing set of risks from advanced emerging technologies. While there has been discussion on some of these risks, a comprehensive overview does not exist, and it is not clear what methods are suited to identify future risks. This scoping review aimed to synthesise current knowledge regarding the risks associated with emerging technologies. The findings show that a diverse set of technologies and risks have been considered, with ten risk themes identified: risks to human health and wellbeing, sub-standard technology risks, legal and ethical risks, privacy and security risks, socioeconomic impacts, ecological and environmental risks, malicious use risks, geopolitical risks, technological unemployment risks, and existential threats. It is concluded that there is a need to expand the focus of prospective risk assessments to consider the organisational, sociotechnical and societal systems in which emerging technologies will be deployed. The development of a future technology risks classification scheme is also recommended. PRACTITIONER STATEMENT: This scoping review provides practitioners with a comprehensive overview of the risks associated with future advanced technologies. This will support the proactive development of suitable controls, with the findings also signposting ergonomics methods that can be used to support future risk assessments.

The effect of information integration on team communication in a simulated submarine control room task.

Submarine control rooms are characterised by dedicated individual roles for information types (e.g. Sonar operator processes sound energy), with individuals verbally reporting the information that they receive to other team members to help resolve uncertainty in the operational environment (low information integration). We compared this work design with one that ensured critical information was more readily available to all team members (high information integration). We used the Event Analysis of Systemic Teamwork (EAST) method to analyse task, information, and social networks for novice teams operating within a simulated submarine control room under low versus high information integration. Integration impacted team member centrality (importance relative to other operators) and the nature of information shared. Team members with greater centrality reported higher workload. Higher integration across consoles altered how team members interacted and their relative status, the information shared, and how workload was distributed. However, overall network structures remained intact.

Wider integration (distribution) of information within teams in a simulated submarine control room altered the content of the information shared between team members and the centrality and workload of team members. Practitioners must consider how to integrate information in sociotechnical systems such that information traditionally held by specialist positions can be distributed within teams to benefit team performance and other outcomes.

The Chartered Institute of Ergonomics and Human Factors at 75: perspectives on contemporary challenges and future directions for Ergonomics and Human Factors.

As the UK's Chartered Institute of Ergonomics and Human Factors (CIEHF) celebrates its 75th anniversary, it is worth reflecting on our discipline's contribution, current state, and critical future endeavours. We present the perspectives of 18 EHF professionals who were asked to respond to five questions regarding the impact of EHF, contemporary challenges, and future directions. Co-authors were in agreement that EHF's impact has been only limited to date and that critical issues require resolution, such as increasing the number of suitably qualified practitioners, resolving the research-practice gap, and increasing awareness of EHF and its benefits. Frequently discussed future directions include advanced emerging technologies such as artificial intelligence, the development of new EHF methods, and enhancing the quality and reach of education and training. The majority felt there will be a need for EHF in 75 years; however, many noted that our methods will need to adapt to meet new needs.Practitioner statement: This article provides the perspectives of 18 Ergonomics and Human Factors (EHF) professionals on the impact of EHF, contemporary challenges and critical future directions, and changes that are necessary to ensure EHF remains relevant in future. As such, it provides important guidance on future EHF research and practice.

Towards a unified model of accident causation: refining and validating the systems thinking safety tenets.

The systems thinking tenets were developed based on a synthesis of contemporary accident causation theory, models and approaches and encapsulate 15 features of complex systems that interact to create both safety and adverse events. Whilst initial testing provided supportive evidence, the tenets have not yet been subject to formal validation. This article presents the findings from a three-round Delphi study undertaken to refine and validate the tenets and assess their suitability for inclusion in a unified model of accident causation. Participants with expertise in accident causation and systems thinking provided feedback on the tenets and associated definitions until an acceptable level of consensus was achieved. The results reduced the original 15 tenets to 14 and 10 were identified as important to include in unified model of accident causation. The refined systems thinking tenets are presented along with future research directions designed to facilitate their use in safety practice.Practitioner summary: This article presents a refined and validated set of systems thinking tenets which describe features of complex systems that interact to create adverse events. The tenets can be used by practitioners to proactively identify safety leading indicators and contributory factors during adverse event analysis.

Using systems thinking-based risk assessment methods to assess hazardous manual tasks: a comparison of Net-HARMS, EAST-BL, FRAM and STPA.

Formal risk assessment is a component of safety management relating to hazardous manual tasks (HMT). Systems thinking approaches are currently gaining interest for supporting safety management. Existing HMT risk assessment methods have been found to be limited in their ability to identify risks across the whole work system; however, systems thinking-based risk assessment (STBRA) methods were not designed for the HMT context and have not been tested in this area. The aim of this study was to compare the performance of four state-of-the-art STBRA methods: Net-HARMS, EAST-BL, FRAM and STPA to determine which would be most useful for identifying HMT risks. Each method was independently applied by one of four analysts to assess the risks associated with a hypothetical HMT system. The outcomes were assessed for alignment with a benchmark analysis. Using signal detection theory (SDT), overall STPA was found to be the best performing method having the highest hit rate, second lowest false alarm rate and highest Matthews Correlation Coefficient of the four methods.Practitioner summary: A comparison of four systems thinking risk assessment methods found that STPA had the highest level of agreement with the benchmark analysis and is the most suitable for practitioners to use to identify the risks associated with HMT systems.

A systems thinking approach to understanding youth active recreation.

BACKGROUND: Active recreation contributes to child and adolescent physical activity, however, factors affecting uptake are poorly understood at the systems level. The aims of this study were: (1) to use systems analysis methods to understand youth active recreation in Victoria, Australia, (ii) identify potential system leverage points to enhance active recreation, and (iii) explore stakeholder views of systems analysis methods for informing practice and policy decision-making. METHODS: Phase 1: Umbrella review of systematic reviews (2013-2018), synthesising evidence for correlates, determinants and intervention evidence for promoting active recreation. Phase 2: Development of three systems models (ActorMap and two ActivMaps), depicting active recreation actors/organisations, correlates, determinants and intervention evidence. Phase 3: Development of causal loop diagrams (CLDs) and identification of leverage points based on the Action Scales Model. Phase 4: Model feedback via stakeholder interviews (n = 23; 16 organisations). RESULTS: From the literature, 93 correlates and determinants, and 49 intervention strategies were associated with child and adolescent active recreation; the majority located at a social or individual level. Ten potential system leverage points were identified in the CLDs, which differed for pre-schoolers versus children and adolescents. Only time outdoors (an event leverage point) emerged for all age groups. Changes to the built and natural environment (i.e., land use planning, urban design) as a complete domain was a key structural leverage point for influencing active recreation in children and adolescents. Subject matter experts and stakeholder interviews identified 125 actors operating across seven hierarchical active recreation system levels in Victoria. Stakeholder interviews identified 12 areas for future consideration and recommendations for practice/policy influence. CONCLUSIONS: Our findings underscore the need for dynamic models of system behaviour in active recreation, and to capture stakeholder influence as more than a transactional role in evidence generation and use. Effective responses to youth inactivity require a network of interventions that target specific leverage points across the system. Our models illustrate areas that may have the greatest system-level impact, such as changes to the built and natural environment, and they provide a tool for policy, appraisal, advocacy, and decision-making within and outside of government.

Incident reporting in the outdoors: a systems-based analysis of injury, illness, and psychosocial incidents in led outdoor activities in Australia.

Incident reporting systems are a fundamental component of safety management, however, most systems used in practice are not aligned with contemporary accident causation models. This article presents an analysis of a National Incident Dataset (NID) for adverse incidents occurring in the Australian Led Outdoor Activity (LOA) sector. The aim was to investigate the adverse Injury, Illness, and Psychosocial incidents reported to the NID. In total, 1657 injuries, 532 illnesses, and 146 psychosocial incidents were analysed from 357,691 program participation days. The findings show that the rate of incidents per 1000 program participant days in LOAs was 4.6 for injury, 1.5 for illness, and 0.04 for psychosocial incidents, and incident severity was predominately minor. The analysis of systemic contributory factors demonstrates that incidents in LOA are systemic in nature, with multiple levels of the LOA system identified as contributing to adverse incidents. For example, contributory factors were identified across local government (facilities), schools (communication), parents (communication), LOA management (policies and procedures), people involved in the incidents (mental and physical condition), and the environment (terrain) and equipment (clothing). This study presents an assessment of the current state of safety in the Australian LOA sector and demonstrates the utility of applying systems ergonomics methods in practice. Practitioner summary: This article presents an analysis of 1657 injury, 532 illness, and 146 psychosocial incidents occurring in the Australian Led Outdoor Activity (LOA) sector, using a systems ergonomics method. The findings demonstrate the incident charactersitics and how decisions and actions from across the system contribute to adverse incidents in LOAs.

Using cognitive work analysis to identify competencies for human factors and ergonomics practitioners.

While several competency frameworks have been proposed for Human Factors and Ergonomics (HFE) practitioners, these are not commonly based on structured analyses. The aim of this research was to develop a sociotechnical systems model of the HFE practitioner role in Australia and identify the competencies required to fulfil the role. Study One applied the Work Domain Analysis phase of cognitive work analysis (CWA) to model the HFE practitioner role. Model refinement was undertaken with seven subject matter experts. In Study Two, the model was used to elicit the competencies (knowledge, skills, abilities, other characteristics) required for successful performance, via a survey of 28 HFE practitioners. Most competencies related to skills (i.e. communication skills) and knowledge (i.e. domain knowledge). Gaps in competencies were also identified, linked to a lack of HFE education pathways in Australia. The findings have practical utility for designing HFE practitioner roles and educational programs. Practitioner summary: Cognitive work analysis provided a structured analysis of the role of the Human Factors and Ergonomics (HFE) practitioner and to support the identification of competencies. The results suggest that HFE practitioners are generalists rather than specialists and have implications for the job design and education of HFE practitioners. Abbreviations: BCPE: board of certification in professional ergonomics; CIEHF: chartered institute of ergonomics and human factors; CWA: cognitive work analysis; HFE: human factors and ergonomics; HFESA: human factors and ergonomics society of Australia; IEA: International Ergonomics Association; KSAO: knowledge, skills, abilities and other characteristics; O*NET: occupation information network; SME: subject matter expert; SRK: skills, rules, knowledge; UK: United Kingdom; USA: United States of America; WDA: work domain analysis.

Testing the reliability and validity of risk assessment methods in Human Factors and Ergonomics.

There is growing interest in the use of systems-based risk assessment methods in Human Factors and Ergonomics (HFE). The purpose of this study was to test the intra-rater reliability and criterion-referenced concurrent validity of three systems-based risk assessment approaches: (i) the Systems-Theoretic Process Analysis (STPA) method; (ii) the Event Analysis of Systemic Teamwork Broken Links (EAST-BL) method; and, (iii) the Network Hazard Analysis and Risk Management System (Net-HARMS) method. Reliability and validity measures were obtained using the Signal Detection Theory (SDT) paradigm. Whilst STPA identified the highest number of risks, the findings indicate a weak to moderate level of reliability and validity for STPA, EAST-BL and Net-HARMS. There were no statistically significant differences between the methods across analyses. The results suggest that there is merit to the continued use of systems-based risk assessment methods following a series of methodological extensions that aim to enhance the reliability and validity of future applications. Practitioner summary The three risk assessment methods produced weak to moderate levels of stability and accuracy regarding their capability to predict risks. There is a pressing need to further test the reliability and validity of safety methods in Human Factors and Ergonomics.

State of science: models and methods for understanding and enhancing teams and teamwork in complex sociotechnical systems.

This state of the science review brings together the disparate literature of effective strategies for enhancing and accelerating team performance. The review evaluates and synthesises models and proposes recommended avenues for future research. The two major models of the Input-Mediator-Output-Input (IMOI) framework and the Big Five dimensions of teamwork were reviewed and both will need significant development for application to future teams comprising non-human agents. Research suggests that a multi-method approach is appropriate for team measurements, such as the integration of methods from self-report, observer ratings, event-based measurement and automated recordings. Simulations are recommended as the most effective team-based training interventions. The impact of new technology and autonomous agents is discussed with respect to the changing nature of teamwork. In particular, whether existing teamwork models and measures are suitable to support the design, operation and evaluation of human-nonhuman teams of the future. Practitioner summary: This review recommends a multi-method approach to the measurement and evaluation of teamwork. Team models will need to be adapted to describe interaction with non-human agents, which is what the future is most likely to hold. The most effective team training interventions use simulation-based approaches.

Applying a systems thinking lens to injury causation in the outdoors: Evidence collected during 3 years of the Understanding and Preventing Led Outdoor Accidents Data System.

INTRODUCTION: This article presents a detailed systems analysis of injury incidents from 35 Australian led outdoor activity organisations between 2014 to 2017. METHOD: Injury incident reports were collected using a specific led outdoor activity incident reporting system known as UPLOADS (Understanding and Preventing Led Outdoor Accidents Data System). RESULTS: In total, 1367 people sustained injuries from across 20 different activities, with an injury rate of 1.9 injured people per 1000 participants over the three-year period. A total of 2234 contributory factors from multiple levels of the led outdoor activity system were identified from the incident reports, and 361 relationships were identified between contributory factors. DISCUSSION: This systems analysis of injury incidents demonstrates that it is not only factors within the immediate context of the incident (Participants, Environment, Equipment) but factors from across multiple systemic levels that contributes to injury incidents (Schools, Parents, Activity centre management). Prevention efforts should focus on addressing the whole network of contributing factors and not only the prominent factors at the lower system levels within the immediate context of the injury incident occurrences.

The impact of power on health care team performance and patient safety: a review of the literature.

Communication failure within health care teams is a major cause of patient harm across health care settings. Factors which contribute to communication failure include actual or perceived 'power'. Whilst a great deal of ergonomics research has focussed on teamwork in health care, the role of power in relation to measurable patient safety and performance outcomes remains relatively unknown. This article presents the findings from a review of the literature on power within multidisciplinary health care team settings. Following a systematic literature search, nineteen studies were evaluated in terms of research design, methods and analyses across the included studies. The main impacts resulting from power imbalances include negative effects on team collaboration, decision-making, communication and overall performance. Wider patient safety research, and more specifically the ergonomics discipline, is encouraged to address the complex interplay between power and teamwork in the health care sector.Practitioner Statement: We conducted a review of studies focussed on the influence of power on teamwork in health care. The findings show that power can have negative impacts on collaboration, decision-making, communication, and team performance. We conclude that power represents an important area for ergonomics, both in health care and other settings.Abbreviations: CRM: crew resource management; TEM: threat and error management; SNA: social network analysis; EAST: event analysis of systemic teamwork.

State of science: evolving perspectives on 'human error'.

This paper reviews the key perspectives on human error and analyses the core theories and methods developed and applied over the last 60 years. These theories and methods have sought to improve our understanding of what human error is, and how and why it occurs, to facilitate the prediction of errors and use these insights to support safer work and societal systems. Yet, while this area of Ergonomics and Human Factors (EHF) has been influential and long-standing, the benefits of the 'human error approach' to understanding accidents and optimising system performance have been questioned. This state of science review analyses the construct of human error within EHF. It then discusses the key conceptual difficulties the construct faces in an era of systems EHF. Finally, a way forward is proposed to prompt further discussion within the EHF community. Practitioner statement This state-of-science review discusses the evolution of perspectives on human error as well as trends in the theories and methods applied to understand, prevent and mitigate error. It concludes that, although a useful contribution has been made, we must move beyond a focus on an individual error to systems failure to understand and optimise whole systems.

Complexity theory in accident causation: using AcciMap to identify the systems thinking tenets in 11 catastrophes.

The quest to explain and understand the cause of accidents is both ever-present and ongoing amongst the safety science community. In an attempt to advance the theory and science of accident causation, researchers have recently formalised a set of '15 systems thinking tenets' that cover the conditions and characteristics of work systems that are believed to contribute to the cause of accidents. The purpose of this study was to attempt to identify the systems thinking tenets across a range of different systems and accidents using the Accident Mapping (AcciMap) method. The findings suggest that the tenets can be attributed to play a role in accident causation, however as a result of this process, the capability of AcciMap has been brought into question. Implications and directions for future research are described. Practitioner Summary: This study is an extension of previous work that suggested there was a need to test for the 'systems thinking tenets of accident causation' in a multi-incident dataset. We used AcciMap to evaluate whether it has the capability to support ongoing accident analysis activities in ergonomics research.

A systems thinking perspective on the barriers to treatment access for people with eating disorders.

Treatment access remains low for people with eating disorders. In addressing the complexity inherent in this challenge, this article introduces systems thinking and argues that it could provide new insights. Systems thinking views behavior as an emergent property of a system and considers the relationships between technical, organizational, and social components. Several methods used in safety science incorporate this thinking. For example, AcciMap draws focus to the influence of decisions and actions made across hierarchical levels of a system, including those by government, regulatory bodies, management, services, and individuals. By examining the findings of the existing literature on barriers to eating disorder treatment access according to these levels, it is evident that most identified barriers relate to individuals and that further research is needed to consider the influence of high-level stakeholders. Research using systems thinking should consider the causal networks of influence from government, regulatory, and organizational decisions and actions through to outcomes for clinicians and individuals. The understanding of how barriers operate within specific healthcare systems also warrants investigation. Systems thinking is yet to be formally applied in the area of eating disorders and thus represents an opportunity to inform the development and implementation of more effective, system wide interventions.

Defining the attributes for specific playing positions in football match-play: A complex systems approach.

INTRODUCTION: Talent identification and development programmes that retain and develop athletes are integral to the sporting success of National Governing Bodies in football. Currently, player attributes are studied in isolation without considering the complexity of interacting components of football performance. The current study applied a systems analysis framework to describe, in a structured and systematic way, the attributes for specific playing positions in football match-play. Methods: Eight high-level football coaches were interviewed. Models of the interacting attributes were developed for each position using Work Domain Analysis (WDA). Results: Six WDA models detail the attributes associated with each playing position. The models identified purposes of playing positions (restrict opposition actions, organise and coordinate, building up of offence, goal scoring and stretch opposition), performance-related measures and the functions required to achieve the playing position purposes (game play, psychological functions, time and space and player actions). Critically, the relationships between the purposes, measures, functions, processes, and objects are described in the models. DISCUSSION: The WDA models describe the interacting attributes of different playing positions in football match-play. The findings demonstrate football performance is complex, consisting of multiple interacting and dynamic components. Implications to support coaches in talent identification and development are discussed.

The perils of perfect performance; considering the effects of introducing autonomous vehicles on rates of car vs cyclist conflict.

How humans will adapt and respond to the introduction of autonomous vehicles (AVs) is uncertain. This study used an agent-based model to explore how AVs, human-operated vehicles, and cyclists might interact based on the introduction of flawlessly performing AVs. Under two separate experimental conditions, results of experiment 1 showed that, despite no conflicts occurring between cyclists and AVs, modelled conflicts among human-operated cars and cyclists increased with the introduction of AVs due to cyclists' adjusted expectations of the behaviour and capability of human-operated and autonomous cars. Similarly, when human-operated cars were replaced with AVs over time in experiment 2, cyclist conflict rates did not follow a linear reduction consistent with the replacement rate but decreased more slowly in the early stages of replacement before 50% substitution. It is concluded that, although flawlessly performing AVs might reduce total conflicts, the introduction of AVs into a transport system where humans adjust to the behaviour and risk presented by AVs could create new sources of error that offset some of AVs assumed safety benefits. Practitioner summary: Ergonomics is an applied science that studies interactions between humans and other elements of a system, including non-human agents. Agent-Based Modelling (ABM) provides an approach for exploring dynamic and emergent interactions between agents. In this article, we demonstrate ABM through an analysis of how cyclists and pedestrians might interact with Autonomous Vehicles (AVs) in future road transport systems. Abbreviations: ABM: agent-based model; AV: autonomous vehicle; ODD; overview, design concepts and details; RW: rescorla-wagner.