Understanding Is Key: An Analysis of Factors Pertaining to Trust in a Real-World Automation System.

OBJECTIVE: This paper aims to explore the role of factors pertaining to trust in real-world automation systems through the application of observational methods in a case study from the railway sector. BACKGROUND: Trust in automation is widely acknowledged as an important mediator of automation use, but the majority of the research on automation trust is based on laboratory work. In contrast, this work explored trust in a real-world setting. METHOD: Experienced rail operators in four signaling centers were observed for 90 min, and their activities were coded into five mutually exclusive categories. Their observed activities were analyzed in relation to their reported trust levels, collected via a questionnaire. RESULTS: The results showed clear differences in activity, even when circumstances on the workstations were very similar, and significant differences in some trust dimensions were found between groups exhibiting different levels of intervention and time not involved with signaling. CONCLUSION: Although the empirical, lab-based studies in the literature have consistently found that reliability and competence of the automation are the most important aspects of trust development, understanding of the automation emerged as the strongest dimension in this study. The implications are that development and maintenance of trust in real-world, safety-critical automation systems may be distinct from artificial laboratory automation. APPLICATION: The findings have important implications for emerging automation concepts in diverse industries including highly automated vehicles and Internet of things.

Physiological Parameter Response to Variation of Mental Workload.

OBJECTIVE: To examine the relationship between experienced mental workload and physiological response by noninvasive monitoring of physiological parameters. BACKGROUND: Previous studies have examined how individual physiological measures respond to changes in mental demand and subjective reports of workload. This study explores the response of multiple physiological parameters and quantifies their added value when estimating the level of demand. METHOD: The study presented was conducted in laboratory conditions and required participants to perform a visual-motor task that imposed varying levels of demand. The data collected consisted of physiological measurements (heart interbeat intervals, breathing rate, pupil diameter, facial thermography), subjective ratings of workload (Instantaneous Self-Assessment Workload Scale [ISA] and NASA-Task Load Index), and the performance. RESULTS: Facial thermography and pupil diameter were demonstrated to be good candidates for noninvasive workload measurements: For seven out of 10 participants, pupil diameter showed a strong correlation ( R values between .61 and .79 at a significance value of .01) with mean ISA normalized values. Facial thermography measures added on average 47.7% to the amount of variability in task performance explained by a regression model. As with the ISA ratings, the relationship between the physiological measures and performance showed strong interparticipant differences, with some individuals demonstrating a much stronger relationship between workload and performance measures than others. CONCLUSION: The results presented in this paper demonstrate that physiological and pupil diameter can be used for noninvasive real-time measurement of workload. APPLICATION: The methods presented in this article, with current technological capabilities, are better suited for workplaces where the person is seated, offering the possibility of being applied to pilots and air traffic controllers.

The dichotomy of the application of a systems approach in UK healthcare the challenges and priorities for implementation.

There is increasing demand for a systems approach within national healthcare guidelines to provide a systematic and sustainable framework for improvements in patient safety. Supported by this is the growing body of evidence within Human Factors/Ergonomics (HFE) healthcare literature for the inclusion of this approach in health service design, provision and evaluation. This paper considers the current interpretation of this within UK healthcare systems and the dichotomy which exists in the challenge to implement a systems approach. Three case studies, from primary and secondary care, present a systems approach, offering a novel perspective of primary care and blood sampling. These provide practical illustrations of how HFE methods have been used in collaboration with healthcare staff to understand the system for the purpose of professional education, design and safety of clinical activities. The paper concludes with the challenge for implementation and proposes five roles for systems HFE to support patient safety. Practitioner Summary: healthcare is classified as a complex and dynamic system within this paper and as such HFE system methods are presented as desirable to understand the system, to develop HFE tools, to deliver education and integrate HFE within healthcare systems.

The field becomes the laboratory? The impact of the contextual digital footprint on the discipline of E/HF.

The increasing prevalence of affordable digital sensors, ubiquitous networking and computation puts us at what is only the start of a new era in terms of the volume, coverage and granularity of data that we can access about individuals and workplaces. This paper examines the consequences of harnessing this data deluge for the practice of E/HF. Focusing on what we term the 'contextual digital footprint', the trail of data we produce through interactions with many different digital systems over the course of even a single day, we describe three example scenarios (drawn from health care, distributed work and transportation) and examine how access to data directly drawn in considerable volume from the field will potentially change our application of design and evaluation methods. We conclude with a discussion of issues relevant to ethical and professional practice within this new environment including the increased challenges of respecting anonymity, working with n = all data-sets and the central role of ergonomists in promulgating positive uses of data while retaining a systems-based humanistic approach to work design. Practitioner summary: The paper envisions the impact of new and emerging sources of data about people and workplaces upon future practice in E/HF. We identify practical consequences for ergonomics practice, highlight new areas of professional competence likely to be required and flag both the risks and benefits of adopting a more data-driven approach.

PRO: confronting resistance to rule-based medicine is essential to improving outcomes.

The past 20 years have seen two great changes in the practice of medicine: the widespread adoption of evidence-based medicine, and the increasing challenge of managing complex multimorbid patients. Both these developments have resulted in clinical rules and protocols becoming ever more abundant and increasingly critical to delivering safe and effective patient care. These evidence-based clinical rules perform at least as well as expert opinion, and the increasing volume and quality of available clinical data suggests their performance could continue to improve. This article considers why clinicians deviate from effective rules, highlighting key issues such as the persisting culture of heroism, institutional inertia, deference to authority and personal heuristics. We argue that better rules can be created, and that clinical improvements will follow if there is a 'common knowledge' of these rules. Furthermore, we argue that there is a ceiling to the effectiveness of any rule, even one as simple as ensuring hand hygiene, unless individuals are held accountable for transgressions.

The attribution of success when using navigation aids.

Attitudes towards geographic information technology is a seldom explored research area that can be explained with reference to established theories of attribution. This article reports on a study of how the attribution of success and failure in pedestrian navigation varies with level of automation, degree of success and locus of control. A total of 113 participants took part in a survey exploring reflections on personal experiences and vignettes describing fictional navigation experiences. A complex relationship was discovered in which success tends to be attributed to skill and failure to the navigation aid when participants describe their own experiences. A reversed pattern of results was found when discussing the navigation of others. It was also found that navigation success and failure are associated with personal skill to a greater extent when using paper maps, as compared with web-based routing engines or satellite navigation systems. PRACTITIONER SUMMARY: This article explores the influences on the attribution of success and failure when using navigation aids. A survey was performed exploring interpretations of navigation experiences. Level of success, self or other as navigator and type of navigation aid used are all found to influence the attribution of outcomes to internal or external factors.

A framework to support human factors of automation in railway intelligent infrastructure.

Technological and organisational advances have increased the potential for remote access and proactive monitoring of the infrastructure in various domains and sectors - water and sewage, oil and gas and transport. Intelligent Infrastructure (II) is an architecture that potentially enables the generation of timely and relevant information about the state of any type of infrastructure asset, providing a basis for reliable decision-making. This paper reports an exploratory study to understand the concepts and human factors associated with II in the railway, largely drawing from structured interviews with key industry decision-makers and attachment to pilot projects. Outputs from the study include a data-processing framework defining the key human factors at different levels of the data structure within a railway II system and a system-level representation. The framework and other study findings will form a basis for human factors contributions to systems design elements such as information interfaces and role specifications.

Promoting equality, diversity and inclusion in research and funding: reflections from a digital manufacturing research network.

BACKGROUND: Equal, diverse, and inclusive teams lead to higher productivity, creativity, and greater problem-solving ability resulting in more impactful research. However, there is a gap between equality, diversity, and inclusion (EDI) research and practices to create an inclusive research culture. Research networks are vital to the research ecosystem, creating valuable opportunities for researchers to develop their partnerships with both academics and industrialists, progress their careers, and enable new areas of scientific discovery. A feature of a network is the provision of funding to support feasibility studies - an opportunity to develop new concepts or ideas, as well as to 'fail fast' in a supportive environment. The work of networks can address inequalities through equitable allocation of funding and proactive consideration of inclusion in all of their activities. METHODS: This study proposes a strategy to embed EDI within research network activities and funding review processes. This paper evaluates 21 planned mitigations introduced to address known inequalities within research events and how funding is awarded. EDI data were collected from researchers engaging in a digital manufacturing network activities and funding calls to measure the impact of the proposed method. RESULTS: Quantitative analysis indicates that the network's approach was successful in creating a more ethnically diverse network, engaging with early career researchers, and supporting researchers with care responsibilities. However, more work is required to create a gender balance across the network activities and ensure the representation of academics who declare a disability. Preliminary findings suggest the network's anonymous funding review process has helped address inequalities in funding award rates for women and those with care responsibilities, more data are required to validate these observations and understand the impact of different interventions individually and in combination. CONCLUSIONS: In summary, this study offers compelling evidence regarding the efficacy of a research network's approach in advancing EDI within research and funding. The network hopes that these findings will inform broader efforts to promote EDI in research and funding and that researchers, funders, and other stakeholders will be encouraged to adopt evidence-based strategies for advancing this important goal.

The psychosocial impact of home use medical devices on the lives of older people: a qualitative study.

BACKGROUND: Increased life expectancy and the accompanying prevalence of chronic conditions have led to the focus and delivery of health care migrating from the hospital and into people's homes. While previous studies have investigated the integration of particular types of medical devices into the home, it was our intention to describe how medical devices are integrated into the lives of older people. METHODS: Adopting a qualitative study design, 12 older people, who used medical devices in the home, took part in in-depth, semi structured interviews. In 7 of the interviews participants and their partners were interviewed together. These interviews were recorded, transcribed and analysed thematically. RESULTS: Two themes were constructed that describe how medical devices that are used in the home present certain challenges to older people and their partners in how the device is adopted and the personal adaptations that they are required to make. The first theme of 'self-esteem' highlighted the psychological impact on users. The second theme of 'the social device' illustrated the social impact of these devices on the user and the people around them. CONCLUSIONS: We found that these devices had both a positive and negative psychosocial impact on users' lives. An improved understanding of these psychological and social issues may assist both designers of medical devices and the professionals who issue them to better facilitate the integration of medical devices into the homes and lives of older people.

Development of design principles for automated systems in transport control.

This article reports the results of a qualitative study investigating attitudes towards and opinions of an advanced automation system currently used in UK rail signalling. In-depth interviews were held with 10 users, key issues associated with automation were identified and the automation's impact on the signalling task investigated. The interview data highlighted the importance of the signallers' understanding of the automation and their (in)ability to predict its outputs. The interviews also covered the methods used by signallers to interact with and control the automation, and the perceived effects on their workload. The results indicate that despite a generally low level of understanding and ability to predict the actions of the automation system, signallers have developed largely successful coping mechanisms that enable them to use the technology effectively. These findings, along with parallel work identifying desirable attributes of automation from the literature in the area, were used to develop 12 principles of automation which can be used to help design new systems which better facilitate cooperative working. PRACTITIONER SUMMARY: The work reported in this article was completed with the active involvement of operational rail staff who regularly use automated systems in rail signalling. The outcomes are currently being used to inform decisions on the extent and type of automation and user interfaces in future generations of rail control systems.

Understanding factors that influence unintentional insider threat: a framework to counteract unintentional risks.

The exploitation of so-called insiders is increasingly recognised as a common vector for cyberattacks. Emerging work in this area has considered the phenomenon from various perspectives including the technological, the psychological and the sociotechnical. We extend this work by specifically examining unintentional forms of insider threat and report the outcomes of a series of detailed Critical Decision Method (CDM) led interviews with those who have experienced various forms of unwitting cybersecurity breaches. We also articulate factors likely to contribute firmly in the context of everyday work-as-done. CDM's probing questions were used to elicit expert knowledge around how decision making occurred prior, during and post an unintentional cyber breach whilst participants were engaged in the delivery of cognitive tasks. Through the application of grounded theory to data, emerging results included themes of decision making, task factors, accidents and organisational factors. These results are utilised to inform an Epidemiological Triangle to represent the dynamic relationship between three vectors of exploit, user and the work environment that can in turn affect the resilience of cyber defences. We conclude by presenting a simple framework, which for the purposes of this work is a set of recommendations applicable in specific scenarios to reduce negative impact for understanding unintentional insider threats. We also suggest practical means to counteract such threats rooted in the lived experience of those who have fallen prey to them.

A head mounted augmented reality design practice for maintenance assembly: Toward meeting perceptual and cognitive needs of AR users.

Head Mounted Display (HMD) based Augmented Reality (AR) is being increasingly used in manufacturing and maintenance. However, limited research has been done to understand user interaction with AR interfaces, which may lead to poor usability, risk of occupational hazards, and low acceptance of AR systems. This paper uses a theoretically-driven approach to interaction design to investigate the impact of different AR modalities in terms of information mode (i.e. video vs. 3D animation) and interaction modality (i.e. hand-gesture vs. voice command) on user performance, workload, eye gaze behaviours, and usability during a maintenance assembly task. The results show that different information modes have distinct impacts compared to paper-based maintenance, in particular, 3D animation led to a 14% improvement over the video instructions in task completion time. Moreover, insights from eye gaze behaviours such as number of fixations and transition between Areas of Interest (AOIs) revealed the differences in attention switching and task comprehension difficulty with the choice of AR modalities. While, subjective user perceptions highlight some ergonomic issues such as misguidance and overreliance, which must be considered and addressed from the joint cognitive systems' (JCSs) perspective and in line with the predictions derived from the Multiple Resources Model.

The impact of map orientation and generalisation on congestion decisions: a comparison of schematic-egocentric and topographic-allocentric maps.

Map information for drivers is usually presented in an allocentric-topographic form (as with printed maps) or in an egocentric-schematic form (as with road signs). The advent of new variable message boards on UK motorways raises the possibility of presenting road maps to reflect congestion ahead. Should these maps be allocentric-topographic or egocentric-schematic? This was assessed in an eye tracking study, with participants viewing maps of a motorway network in order to identify whether any congestion was relevant to their intended route. The schematic-egocentric maps were responded to most accurately with shorter fixation durations suggesting easier processing. In particular, the driver's entrance and intended exit from the map were attended to more in the allocentric maps. Individual differences in mental rotation ability also seem to contribute to poor performance on allocentric maps. The results favour schematic-egocentric maps for roadside congestion information, but also provide theoretical insights into map-rotation and individual differences. Statement of Relevance: This study informs designers and policy makers about optimum representations of traffic congestion on roadside variable message signs and, furthermore, demonstrates that individual differences contribute to problems with processing certain sign types. Schematic-egocentric representations of a motorway network produced the best results, as noted in behavioural and eye movement measures.

The importance of usability in product choice: a mobile phone case study.

Usability has become established as an important aspect of product design. This paper describes an investigation that was carried out to identify the importance of usability in product choice related to other product attributes. Interviews were initially carried out to identify possible attributes that contribute to product choice. Experiments were then undertaken using the methods of active information search, structured preference elicitation, ranking and interviews in order to find out what attributes were important to people when choosing an example product - mobile phones. It was found that usability is indeed important in product choice but perhaps not as much as users themselves believe. Other attributes that were found to be more important were features, aesthetics and cost. The process of product choice was found to be complex and it may be the case that people have come to expect usability in their products. Further research is needed to understand more fully the changing role of usability in product choice and to further improve the quality of the user-product relationship.

Young adults' attitudes to sharing whole-genome sequencing information: a university-based survey.

BACKGROUND: Genomic services are increasingly accessible to young adults starting their independent lives with responsibility for their self-care, yet their attitudes to sharing genomic information remain under-researched. This study explored attitudes of university-based 18-25 year-olds towards sharing personal whole-genome sequencing (WGS) information with relatives. METHODS: We surveyed 112 young adults. Hypotheses were tested regarding the relationships between their preferences for sharing personal WGS information with relatives and factors including their gender, previous genetics-specific education, general educational attainment level and current study in a science, technology, engineering, maths or medicine (STEMM) field. RESULTS: Most participants were positive about both their intention to share their WGS results with their parents and siblings, and their desire to know their relatives' results. Being female and having a university-level genetics education were consistently positively correlated with intention to share one's results with parents and with siblings as well as the desire to know relatives' results. Additionally, females who had undertaken a genetics course at university had significantly greater intentions and desires than females who had not. Lower general educational attainment was related to a lower intention to share with siblings. Participants who were in a STEMM field had a greater desire to know their relatives' results. CONCLUSIONS: Participants' gender and prior genetics education were consistently related to their intentions to share WGS results with relatives and their desire to know relatives' results. Educational attainment was found to be positively correlated with intention to share with siblings. Being in a STEMM field was related to participants' desire to know their relatives' results. These findings indicate that gender and genetics education are particularly important influencers on young adults' stated sharing preferences. More research is required to examine the dependent variables studied to further understand their influence on attitudes to sharing WGS results. These findings are particularly interesting for information provision and support before genomic sequencing and post-results to improve the outcomes for individuals and their relatives.

An interview analysis of coordination behaviours in Out-of-Hours secondary care.

This paper seeks to elicit and structure the factors that shape the execution and, in particular, the coordination of work in Out of Hours care. Evenings and weekends in UK hospitals are managed by specific Out of Hours (OoH) care arrangements, and associated technology. Managing care within the constraints of staff availability and demands is a key concern for both patient care and staff wellbeing, yet has received little attention from healthcare human factors. A study of sixteen clinical staff used Critical Decision Method to understand how work is coordinated and the constraints and criteria that are applied by the roles managing OoH care. The analysis identified ten types of coordination decision that, in turn, underpinned three types of adaptive behaviour - pre-emption, information augmentation and self-organisation - that were crucial for the effective performance in OoH care. These behaviours explain how OoH staff manage the task demands placed on them, individually and as a team.

The Impact of an Electronic Patient Bedside Observation and Handover System on Clinical Practice: Mixed-Methods Evaluation.

BACKGROUND: Patient safety literature has long reported the need for early recognition of deteriorating patients. Early warning scores (EWSs) are commonly implemented as "track and trigger," or rapid response systems for monitoring and early recognition of acute patient deterioration. This study presents a human factors evaluation of a hospital-wide transformation in practice, engendered by the deployment of an innovative electronic observations (eObs) and handover system. This technology enables real-time information processing at the patient's bedside, improves visibility of patient data, and streamlines communication within clinical teams. OBJECTIVE: The aim of this study was to identify improvement and deterioration in workplace efficiency and quality of care resulting from the large-scale imposition of new technology. METHODS: A total of 85 hours of direct structured observations of clinical staff were carried out before and after deployment. We conducted 40 interviews with a range of clinicians. A longitudinal analysis of critical care audit and electronically recorded patient safety incident reports was conducted. The study was undertaken in a large secondary-care facility in the United Kingdom. RESULTS: Roll-out of eObs was associated with approximately 10% reduction in total unplanned admissions to critical care units from eObs-equipped wards. Over time, staff appropriated the technology as a tool for communication, workload management, and improving awareness of team capacity. A negative factor was perceived as lack of engagement with the system by senior clinicians. Doctors spent less time in the office (68.7% to 25.6%). More time was spent at the nurses' station (6.6% to 41.7%). Patient contact time was more than doubled (2.9% to 7.3%). CONCLUSIONS: Since deployment, clinicians have more time for patient care because of reduced time spent inputting and accessing data. The formation of a specialist clinical team to lead the roll-out was universally lauded as the reason for success. Staff valued the technology as a tool for managing workload and identified improved situational awareness as a key benefit. For future technology deployments, the staff requested more training preroll-out, in addition to engagement and support from senior clinicians.

Natural locomotion based on a reduced set of inertial sensors: Decoupling body and head directions indoors.

Inertial sensors offer the potential for integration into wireless virtual reality systems that allow the users to walk freely through virtual environments. However, owing to drift errors, inertial sensors cannot accurately estimate head and body orientations in the long run, and when walking indoors, this error cannot be corrected by magnetometers, due to the magnetic field distortion created by ferromagnetic materials present in buildings. This paper proposes a technique, called EHBD (Equalization of Head and Body Directions), to address this problem using two head- and shoulder-located magnetometers. Due to their proximity, their distortions are assumed to be similar and the magnetometer measurements are used to detect when the user is looking straight forward. Then, the system corrects the discrepancies between the estimated directions of the head and the shoulder, which are provided by gyroscopes and consequently are affected by drift errors. An experiment is conducted to evaluate the performance of this technique in two tasks (navigation and navigation plus exploration) and using two different locomotion techniques: (1) gaze-directed mode (GD) in which the walking direction is forced to be the same as the head direction, and (2) decoupled direction mode (DD) in which the walking direction can be different from the viewing direction. The obtained results show that both locomotion modes show similar matching of the target path during the navigation task, while DD's path matches the target path more closely than GD in the navigation plus exploration task. These results validate the EHBD technique especially when allowing different walking and viewing directions in the navigation plus exploration tasks, as expected. While the proposed method does not reach the accuracy of optical tracking (ideal case), it is an acceptable and satisfactory solution for users and is much more compact, portable and economical.

An observation tool to study air traffic control and flightdeck collaboration.

The complex systems of the flightdeck (FD) and the Air Traffic Control Centre (ATC) are characterised by numerous concurrently operating and interacting communication channels between people and between people and machines/computer systems. This paper describes work in support of investigating the impact of changes to technologies and responsibilities within this system with respect to human factors. It focuses primarily on the introduction of datalink (text-based communication rather than traditional radio communication) and the move towards freeflight (pilot-mediated air traffic control). Air traffic management investigations have outlined these specific changes as strategies to enable further increases in the volume of air traffic. A systems approach was taken and field studies were conducted. Small numbers of domain experts such as air traffic controllers (ATCOs) were involved in the field-based observations of how people interact with systems and each other. This paper summarises the overall research approach taken and then specifically reports on the field-based observations including the justification, development, and findings of the observation tool used. The observation tool examined information propagation through the air traffic control-flightdeck (ATC-FD) system, and resulted in models of possible information trajectories through the system.

Flightdeck and air traffic control collaboration evaluation (FACE): evaluating aviation communication in the laboratory and field.

The challenge to anticipate the human factors impact of introducing new technologies into a safety critical environment can be addressed in a number of ways. This paper presents a research programme that utilised both laboratory- and field-based assessments to examine the way in which datalink and freeflight may affect the communication and collaboration between pilots, air traffic controllers, and other actors and artefacts in the flightdeck-air traffic control (ATC) joint cognitive system. An overview of the results from these studies is presented, and guidance is provided as to the likely situations in which this new technology is most likely to be successfully applied. In addition, the methodological approach of combining results from field and laboratory data is discussed.