Designing human-AI systems for complex settings: ideas from distributed, joint, and self-organising perspectives of sociotechnical systems and cognitive work analysis.

Real-world events like the COVID-19 pandemic and wildfires in Australia, Europe, and America remind us that the demands of complex operational settings are met by multiple, distributed teams interwoven with a large array of artefacts and networked technologies, including automation. Yet, current models of human-automation interaction, including those intended for human-machine teaming or collaboration, tend to be dyadic in nature, assuming individual humans interacting with individual machines. Given the opportunities and challenges of emerging artificial intelligence (AI) technologies, and the growing interest of many organisations in utilising these technologies in complex operations, we suggest turning to contemporary perspectives of sociotechnical systems for a way forward. We show how ideas of distributed cognition, joint cognitive systems, and self-organisation lead to specific concepts for designing human-AI systems, and propose that design frameworks informed by contemporary views of complex work performance are needed. We discuss cognitive work analysis as an example.

Emerging developments in AI will pose challenges for the design of human-machine systems. Contemporary perspectives of sociotechnical systems, namely distributed cognition, joint cognitive systems, and self-organisation, have design implications that are unaccommodated by traditional methods. Cognitive work analysis may provide a way forward.Abbreviation: AI: Artificial intelligence.

Development of Rasmussen's risk management framework for analysing multi-level sociotechnical influences in the design of envisioned work systems.

Besides radically altering work, advances in automation and intelligent technologies have the potential to bring significant societal transformation. These transitional periods require an approach to analysis and design that goes beyond human-machine interaction in the workplace to consider the wider sociotechnical needs of envisioned work systems. The Sociotechnical Influences Space, an analytical tool motivated by Rasmussen's risk management model, promotes a holistic approach to the design of future systems, attending to societal needs and challenges, while still recognising the bottom-up push from emerging technologies. A study explores the concept and practical potential of the tool when applied to the analysis of a large-scale, 'real-world' problem, specifically the societal, governmental, regulatory, organisational, human, and technological factors of significance in mixed human-artificial agent workforces. Further research is needed to establish the feasibility of the tool in a range of application domains, the details of the method, and the value of the tool in design. Practitioner summary: Emerging automation and intelligent technologies are not only transforming workplaces, but may be harbingers of major societal change. A new analytical tool, the Sociotechnical Influences Space, is proposed to support organisations in taking a holistic approach to the incorporation of advanced technologies into workplaces and function allocation in mixed human-artificial agent teams.

Designing for Adaptation in Workers' Individual Behaviors and Collective Structures With Cognitive Work Analysis: Case Study of the Diagram of Work Organization Possibilities.

OBJECTIVE: We demonstrate that the diagram of work organization possibilities, a recent addition to cognitive work analysis, can be used to develop designs that promote adaptation in the workplace. BACKGROUND: Workers in sociotechnical systems adapt not just their individual behaviors but also their collective structures in dealing with instability, uncertainty, and unpredictability in their tasks. However, conventional design approaches are limited in supporting adaptations in both workers' behaviors and structures, especially during unforeseen situations. The work organization possibilities diagram has the potential to meet these requirements, but its value for design has not been established. METHOD: We present a case study of a future system for maritime surveillance that provides an analytical demonstration of the utility of the diagram for design and empirical validation of the impact, uniqueness, and feasibility of this approach in an industrial setting. RESULTS: This application results in a team design that is integrated with the career and training progression pathway of the crew in a way that maximizes the system's behavioral and structural possibilities for adaptation. Further, the approach has impact on practice, makes a distinct contribution to design relative to other techniques, and is implemented feasibly in an industrial setting. CONCLUSION: The work organization possibilities diagram can contribute to the development of an integrated system design that supports actors' possibilities for behavioral and structural adaptation in a unified fashion. APPLICATION: This research provides a basis for designing interfaces, teams, training, and automation that preserve a system's inherent capacity for adaptation.

Cognitive work analysis: An influential legacy extending beyond human factors and engineering.

Jens Rasmussen's multifaceted legacy includes cognitive work analysis (CWA), a framework for the analysis, design, and evaluation of complex sociotechnical systems. After considering the framework's origins, this paper reviews its progress, predictably covering experimental research on ecological interface design, case studies of the application of CWA to human factors and engineering problems in industry, and methods and modelling tools for CWA. Emphasis is placed, however, on studying the nexus between some of the recent results obtained with CWA and the original field studies of human problem-solving that motivated the framework's development. Of particular interest is a case study of the use of CWA for military doctrine development, a problem commonly regarded as lying outside the fields of human factors and engineering. It is concluded that the value of CWA, even for such diverse problems, is likely to result from its conceptual grounding in empirical observations of patterns of human reasoning in complex systems.

Integrated System Design: Promoting the Capacity of Sociotechnical Systems for Adaptation through Extensions of Cognitive Work Analysis.

This paper proposes an approach for integrated system design, which has the intent of facilitating high levels of effectiveness in sociotechnical systems by promoting their capacity for adaptation. Building on earlier ideas and empirical observations, this approach recognizes that to create adaptive systems it is necessary to integrate the design of all of the system elements, including the interfaces, teams, training, and automation, such that workers are supported in adapting their behavior as well as their structure, or organization, in a coherent manner. Current approaches for work analysis and design are limited in regard to this fundamental objective, especially in cases when workers are confronted with unforeseen events. A suitable starting point is offered by cognitive work analysis (CWA), but while this framework can support actors in adapting their behavior, it does not necessarily accommodate adaptations in their structure. Moreover, associated design approaches generally focus on individual system elements, and those that consider multiple elements appear limited in their ability to facilitate integration, especially in the manner intended here. The proposed approach puts forward the set of possibilities for work organization in a system as the central mechanism for binding the design of its various elements, so that actors can adapt their structure as well as their behavior-in a unified fashion-to handle both familiar and novel conditions. Accordingly, this paper demonstrates how the set of possibilities for work organization in a system may be demarcated independently of the situation, through extensions of CWA, and how it may be utilized in design. This lynchpin, conceptualized in the form of a diagram of work organization possibilities (WOP), is important for preserving a system's inherent capacity for adaptation. Future research should focus on validating these concepts and establishing the feasibility of implementing them in industrial contexts.

Designing teams for first-of-a-kind, complex systems using the initial phases of cognitive work analysis: case study.

We present a technique for team design based on cognitive work analysis (CWA). We first develop a rationale for this technique by discussing the limitations of conventional approaches for team design in light of the special characteristics of first-of-a-kind, complex systems. We then introduce the CWA-based technique for team design and provide a case study of how we used this technique to design a team for a first-of-a-kind, complex military system during the early stages of its development. In addition to illustrating the CWA-based technique by example, the case study allows us to evaluate the technique. This case study demonstrates that the CWA-based technique for team design is both feasible and useful, although empirical validation of the technique is still necessary. Applications of this work include the design of teams for first-of-a-kind, complex systems in military, medical, and industrial domains.