Advanced workstations and collaborative robots: exploiting eye-tracking and cardiac activity indices to unveil senior workers' mental workload in assembly tasks.

Introduction: As a result of Industry 5.0's technological advancements, collaborative robots (cobots) have emerged as pivotal enablers for refining manufacturing processes while re-focusing on humans. However, the successful integration of these cutting-edge tools hinges on a better understanding of human factors when interacting with such new technologies, eventually fostering workers' trust and acceptance and promoting low-fatigue work. This study thus delves into the intricate dynamics of human-cobot interactions by adopting a human-centric view. Methods: With this intent, we targeted senior workers, who often contend with diminishing work capabilities, and we explored the nexus between various human factors and task outcomes during a joint assembly operation with a cobot on an ergonomic workstation. Exploiting a dual-task manipulation to increase the task demand, we measured performance, subjective perceptions, eye-tracking indices and cardiac activity during the task. Firstly, we provided an overview of the senior workers' perceptions regarding their shared work with the cobot, by measuring technology acceptance, perceived wellbeing, work experience, and the estimated social impact of this technology in the industrial sector. Secondly, we asked whether the considered human factors varied significantly under dual-tasking, thus responding to a higher mental load while working alongside the cobot. Finally, we explored the predictive power of the collected measurements over the number of errors committed at the work task and the participants' perceived workload. Results: The present findings demonstrated how senior workers exhibited strong acceptance and positive experiences with our advanced workstation and the cobot, even under higher mental strain. Besides, their task performance suffered increased errors and duration during dual-tasking, while the eye behavior partially reflected the increased mental demand. Some interesting outcomes were also gained about the predictive power of some of the collected indices over the number of errors committed at the assembly task, even though the same did not apply to predicting perceived workload levels. Discussion: Overall, the paper discusses possible applications of these results in the 5.0 manufacturing sector, emphasizing the importance of adopting a holistic human-centered approach to understand the human-cobot complex better.

Smart Co-housing for People With Disabilities: A Preliminary Assessment of Caregivers' Interaction With the DOMHO System.

Millions of people with motor and cognitive disabilities face hardships in daily life due to the limited accessibility and inclusiveness of living spaces which limit their autonomy and independence. The DOMHO project deals with these fundamental issues by leveraging an innovative solution: a smart co-housing apartment. Besides, the project aims at exploiting the well know effects of co-housing on individuals' health and well-being in combination with ambient assisted living technologies. The present study focused on the interaction of caregivers with the control application of an integrated smart system. Participants performed different tasks, fill out a questionnaire, and were interviewed. Performance and usability of the user interface, trust in technology, privacy, and attitudes towards home automation were explored. A series of guidelines for domotic technology control interfaces design was identified, and a high level of trust in these advanced tools was shown. Caregivers considered smart technologies as a work aid and a means for enhancing autonomy and life quality for users with disabilities.

Sharing the Space With the "Victim" Can Increase Help Rates. A Study With Virtual Reality.

A typical protocol for the psychological study of helping behavior features two core roles: a help seeker suffering from some personal or situational emergency (often called "victim") and a potential helper. The setting of these studies is such that the victim and the helper often share the same space. We wondered whether this spatial arrangement might affect the help rate. Thus, we designed a simple study with virtual reality in which space sharing could be manipulated. The participant plays the role of a potential helper; the victim is a humanoid located inside the virtual building. When the request for help is issued, the participant can be either in the same spatial region as the victim (the virtual building) or outside it. The effect of space was tested in two kinds of emergencies: a mere request for help and a request for help during a fire. The analysis shows that, in both kinds of emergencies, the participants were more likely to help the victim when sharing the space with it. This study suggests controlling the spatial arrangement when investigating helping behavior. It also illustrates the expediency of virtual reality to further investigate the role of space on pro-social behavior during emergencies.

Facing with Collaborative Robots: The Subjective Experience in Senior and Younger Workers.

In the past few years, collaborative robots (i.e., cobots) have been largely adopted within industrial manufacturing. Although robots can support companies and workers in carrying out complex activities and improving productivity, human factors related to cobot operators have not yet been thoroughly investigated. The present study aims to understand the subjective experience of younger and senior workers interacting with an industrial collaborative robot. Results show that workers' acceptance of cobots is high, regardless of age and control modality used. Interesting differences between seniors and younger adults emerged in the evaluations of user experience, usability, and perceived workload of participants and are detailed and commented in the last part of the work.

Investigating the Accessibility of Voice Assistants With Impaired Users: Mixed Methods Study.

BACKGROUND: Voice assistants allow users to control appliances and functions of a smart home by simply uttering a few words. Such systems hold the potential to significantly help users with motor and cognitive disabilities who currently depend on their caregiver even for basic needs (eg, opening a door). The research on voice assistants is mainly dedicated to able-bodied users, and studies evaluating the accessibility of such systems are still sparse and fail to account for the participants' actual motor, linguistic, and cognitive abilities. OBJECTIVE: The aim of this work is to investigate whether cognitive and/or linguistic functions could predict user performance in operating an off-the-shelf voice assistant (Google Home). METHODS: A group of users with disabilities (n=16) was invited to a living laboratory and asked to interact with the system. Besides collecting data on their performance and experience with the system, their cognitive and linguistic skills were assessed using standardized inventories. The identification of predictors (cognitive and/or linguistic) capable of accounting for an efficient interaction with the voice assistant was investigated by performing multiple linear regression models. The best model was identified by adopting a selection strategy based on the Akaike information criterion (AIC). RESULTS: For users with disabilities, the effectiveness of interacting with a voice assistant is predicted by the Mini-Mental State Examination (MMSE) and the Robertson Dysarthria Profile (specifically, the ability to repeat sentences), as the best model shows (AIC=130.11). CONCLUSIONS: Users with motor, linguistic, and cognitive impairments can effectively interact with voice assistants, given specific levels of residual cognitive and linguistic skills. More specifically, our paper advances practical indicators to predict the level of accessibility of speech-based interactive systems. Finally, accessibility design guidelines are introduced based on the performance results observed in users with disabilities.

Integrating neurophysiologic relevance feedback in intent modeling for information retrieval.

The use of implicit relevance feedback from neurophysiology could deliver effortless information retrieval. However, both computing neurophysiologic responses and retrieving documents are characterized by uncertainty because of noisy signals and incomplete or inconsistent representations of the data. We present the first-of-its-kind, fully integrated information retrieval system that makes use of online implicit relevance feedback generated from brain activity as measured through electroencephalography (EEG), and eye movements. The findings of the evaluation experiment (N = 16) show that we are able to compute online neurophysiology-based relevance feedback with performance significantly better than chance in complex data domains and realistic search tasks. We contribute by demonstrating how to integrate in interactive intent modeling this inherently noisy implicit relevance feedback combined with scarce explicit feedback. Although experimental measures of task performance did not allow us to demonstrate how the classification outcomes translated into search task performance, the experiment proved that our approach is able to generate relevance feedback from brain signals and eye movements in a realistic scenario, thus providing promising implications for future work in neuroadaptive information retrieval (IR).

The relationship between attention allocation and cheating.

Little is known about the relationship between attention allocation and dishonesty. The goal of the present work was to address this issue using the eyetracking methodology. We developed a novel task in which participants could honestly report seeing a particular card and lose money, or they could falsely report not seeing the card and not lose money. When participants cheated, they allocated less attention (i.e., shorter fixation durations and fewer fixations) to the card than when they behaved honestly. Our results suggest that when dishonesty pays, shifting attention away from undesirable information can serve as a self-deception strategy that allows individuals to serve their self-interests while maintaining a positive self-concept.

Object-substitution masking modulates spatial attention deployment and the encoding of information in visual short-term memory: insights from occipito-parietal ERP components.

If object-substitution masking (OSM) arises from mask representations replacing target representations, OSM should impede the formation of representations in visual short-term memory (VSTM). We utilized event-related potentials to examine the effect of OSM on target processing. An N2pc was observed on trials with delayed-offset masks, indicating that focused attention was directed to the target. The sustained posterior contralateral negativity (SPCN), an index of VSTM storage, was observed in delayed-offset trials only on trials with correct responses. This supports the hypothesis that inaccurate performance on delayed-offset trials arises from a failure to encode the target in VSTM. On co-termination trials, accuracy was high and neither the N2pc nor SPCN was observed. This indicates that, in the absence of masking, the task was accomplished by maintaining a diffuse attentional state that enabled the joint encoding of the potential target items.

A hemodynamic correlate of lateralized visual short-term memories.

Neuroimaging studies attempting to isolate the neural substrate of visual short-term memory in humans have concentrated on the behavior of neurons populating the posterior part of the parietal cortex as a possible source of visual short-term memory capacity limits. Using a standard change-detection task, fMRI studies have shown that maintenance of bilaterally encoded objects elicited bilateral increases of hemodynamic activation in the intra-parietal and intra-occipital sulci (IPS-IOS) proportional to the number of objects retained in visual short-term memory. We used a spatially cued variant of the change-detection task to record hemodynamic responses to unilaterally encoded objects using functional near-infrared spectroscopy (fNIRS). Electrophysiological studies that employed this task have shown that maintenance of unilaterally encoded objects elicited posterior unilateral (contralateral) increase in event-related negativity proportional to the number of objects retained in visual short-term memory. We therefore examined whether contralateral increases in oxy-hemoglobin concentration correlated with the number of retained objects. Contrary to the idea that bilateral increases in BOLD responses and unilateral increases in event-related negativity may be different reflections of the same underlying neural/functional processing, memory-related increases in oxy-hemoglobin concentration were found bilaterally even when objects had to be encoded unilaterally. The present findings suggest that EEG and fMRI/fNIRS techniques reveal distinct neural signatures of the mechanisms supporting visual short-term memory.

Reevaluating encoding-capacity limitations as a cause of the attentional blink.

A number of researchers have emphasized the role of distractors intervening between successive targets as the primary determinant of the attentional blink (AB) phenomenon. They argued that the AB is abolished when 3 or more targets are displayed as temporally contiguous items in rapidly presented serial sequences. In 3 experiments, the authors embedded 1-, 2-, or 3-digit targets among letter distractors in rapidly presented visual sequences. Across the experiments, both the number of targets and the lag between them were manipulated, producing different proportion of trials in which 3 temporally contiguous targets were presented in the test session. Evidence of an AB affecting the targets that followed the first target in these sequences was found in each experiment when the probability of a given target report was conditionalized on a correct response to the preceding targets, thus reinforcing the notion that some form of capacity limitation in the encoding of targets plays a central role in the elicitation and modulation of the AB effect.

Short-term consolidation of individual identities leads to Lag-1 sparing.

A rapid serial visual presentation (RSVP) technique was used to investigate the role of the nature of processing carried out on targets in the Lag-1 sparing phenomenon. Lag-1 sparing refers to a higher accuracy in the task associated with the 2nd target when the 2 targets are immediately successive in the RSVP stream relative to when there are 1 or 2 intervening items between the targets. In 5 experiments, 0, 1, or 2 digits were embedded with equal probability in RSVP streams of letter distractors. In 4 of the experiments, subjects identified the digits in some blocks of trials, and they counted the number of presented digits in other blocks. In a 5th experiment, the counting task was replaced with a digit-sum task. The most interesting results were those from trials with 2 digits. Lag-1 sparing was always evident when the task involved the explicit identification of the digits. In addition, Lag-1 sparing was evident when subjects were required to sum 2 digits or to count digits of a prespecified parity subclass (e.g., count only even digits). In striking contrast, Lag-1 sparing was absent when subjects were required to count the digits independent of their parity subclass. These results suggest that the occurrence of Lag-1 sparing depends on the type of mental representation that must be generated on the basis of target information.