Optimizing Human-Robot Teaming Performance through Q-Learning-Based Task Load Adjustment and Physiological Data Analysis.

The transition to Industry 4.0 and 5.0 underscores the need for integrating humans into manufacturing processes, shifting the focus towards customization and personalization rather than traditional mass production. However, human performance during task execution may vary. To ensure high human-robot teaming (HRT) performance, it is crucial to predict performance without negatively affecting task execution. Therefore, to predict performance indirectly, significant factors affecting human performance, such as engagement and task load (i.e., amount of cognitive, physical, and/or sensory resources required to perform a particular task), must be considered. Hence, we propose a framework to predict and maximize the HRT performance. For the prediction of task performance during the development phase, our methodology employs features extracted from physiological data as inputs. The labels for these predictions-categorized as accurate performance or inaccurate performance due to high/low task load-are meticulously crafted using a combination of the NASA TLX questionnaire, records of human performance in quality control tasks, and the application of Q-Learning to derive task-specific weights for the task load indices. This structured approach enables the deployment of our model to exclusively rely on physiological data for predicting performance, thereby achieving an accuracy rate of 95.45% in forecasting HRT performance. To maintain optimized HRT performance, this study further introduces a method of dynamically adjusting the robot's speed in the case of low performance. This strategic adjustment is designed to effectively balance the task load, thereby enhancing the efficiency of human-robot collaboration.

Adaptive Lifting Index (aLI) for Real-Time Instrumental Biomechanical Risk Assessment: Concepts, Mathematics, and First Experimental Results.

When performing lifting tasks at work, the Lifting Index (LI) is widely used to prevent work-related low-back disorders, but it presents criticalities pertaining to measurement accuracy and precision. Wearable sensor networks, such as sensorized insoles and inertial measurement units, could improve biomechanical risk assessment by enabling the computation of an adaptive LI (aLI) that changes over time in relation to the actual method of carrying out lifting. This study aims to illustrate the concepts and mathematics underlying aLI computation and compare aLI calculations in real-time using wearable sensors and force platforms with the LI estimated with the standard method used by ergonomists and occupational health and safety technicians. To reach this aim, 10 participants performed six lifting tasks under two risk conditions. The results show us that the aLI value rapidly converges towards the reference value in all tasks, suggesting a promising use of adaptive algorithms and instrumental tools for biomechanical risk assessment.

Optimizing Rare Disease Gait Classification through Data Balancing and Generative AI: Insights from Hereditary Cerebellar Ataxia.

The interpretability of gait analysis studies in people with rare diseases, such as those with primary hereditary cerebellar ataxia (pwCA), is frequently limited by the small sample sizes and unbalanced datasets. The purpose of this study was to assess the effectiveness of data balancing and generative artificial intelligence (AI) algorithms in generating synthetic data reflecting the actual gait abnormalities of pwCA. Gait data of 30 pwCA (age: 51.6 ± 12.2 years; 13 females, 17 males) and 100 healthy subjects (age: 57.1 ± 10.4; 60 females, 40 males) were collected at the lumbar level with an inertial measurement unit. Subsampling, oversampling, synthetic minority oversampling, generative adversarial networks, and conditional tabular generative adversarial networks (ctGAN) were applied to generate datasets to be input to a random forest classifier. Consistency and explainability metrics were also calculated to assess the coherence of the generated dataset with known gait abnormalities of pwCA. ctGAN significantly improved the classification performance compared with the original dataset and traditional data augmentation methods. ctGAN are effective methods for balancing tabular datasets from populations with rare diseases, owing to their ability to improve diagnostic models with consistent explainability.

An Intuitive Formulation of the Human Arm Active Endpoint Stiffness.

In this work, we propose an intuitive and real-time model of the human arm active endpoint stiffness. In our model, the symmetric and positive-definite stiffness matrix is constructed through the eigendecomposition Kc=VDVT, where V is an orthonormal matrix whose columns are the normalized eigenvectors of Kc, and D is a diagonal matrix whose entries are the eigenvalues of Kc. In this formulation, we propose to construct V and D directly by exploiting the geometric information from a reduced human arm skeleton structure in 3D and from the assumption that human arm muscles work synergistically when co-contracted. Through the perturbation experiments across multiple subjects under different arm configurations and muscle activation states, we identified the model parameters and examined the modeling accuracy. In comparison to our previous models for predicting human active arm endpoint stiffness, the new model offers significant advantages such as fast identification and personalization due to its principled simplicity. The proposed model is suitable for applications such as teleoperation, human-robot interaction and collaboration, and human ergonomic assessments, where a personalizable and real-time human kinodynamic model is a crucial requirement.

An Online Method to Detect and Locate an External Load on the Human Body with Applications in Ergonomics Assessment.

In this work, we propose an online method to detect and approximately locate an external load induced on the body of a person interacting with the environment. The method is based on a torque equilibrium condition on the human sagittal plane, which takes into account a reduced-complexity model of the whole-body centre of pressure (CoP) along with the measured one, and the vertical component of the ground reaction forces (vGRFs). The latter is combined with a statistical analysis approach to improve the localisation accuracy, (which is subject to uncertainties) to the extent of the industrial applications we target. The proposed technique eliminates the assumption of known contact position of an external load on the human limbs, allowing a more flexible online body-state tracking. The accuracy of the proposed method is first evaluated via a simulation study in which various contact points on different body postures are considered. Next, experiments on human subjects with three different contact locations applied to the human body are presented, revealing the validity of the proposed methodology. Lastly, its benefit in the estimation of human dynamic states is demonstrated. These results add another layer to the online human ergonomics assessment framework developed in our laboratory, extending it to more realistic and varying interaction conditions.

The Sensor-Based Biomechanical Risk Assessment at the Base of the Need for Revising of Standards for Human Ergonomics.

Due to the epochal changes introduced by "Industry 4.0", it is getting harder to apply the varying approaches for biomechanical risk assessment of manual handling tasks used to prevent work-related musculoskeletal disorders (WMDs) considered within the International Standards for ergonomics. In fact, the innovative human-robot collaboration (HRC) systems are widening the number of work motor tasks that cannot be assessed. On the other hand, new sensor-based tools for biomechanical risk assessment could be used for both quantitative "direct instrumental evaluations" and "rating of standard methods", allowing certain improvements over traditional methods. In this light, this Letter aims at detecting the need for revising the standards for human ergonomics and biomechanical risk assessment by analyzing the WMDs prevalence and incidence; additionally, the strengths and weaknesses of traditional methods listed within the International Standards for manual handling activities and the next challenges needed for their revision are considered. As a representative example, the discussion is referred to the lifting of heavy loads where the revision should include the use of sensor-based tools for biomechanical risk assessment during lifting performed with the use of exoskeletons, by more than one person (team lifting) and when the traditional methods cannot be applied. The wearability of sensing and feedback sensors in addition to human augmentation technologies allows for increasing workers' awareness about possible risks and enhance the effectiveness and safety during the execution of in many manual handling activities.

Optimal configurations for stiffness and compliance in human & robot arms.

Research in neurophysiology has shown that humans are able to adapt the mechanical stiffness at the hand in order to resist disturbances. This has served as inspiration for optimising stiffness in robot arms during manipulation tasks. Endpoint stiffness is modelled in Cartesian space, as though the hand were in independent rigid body. But an arm is a series of rigid bodies connected by articulated joints. The contribution of the joints and arm configuration to the endpoint stiffness has not yet been quantified. In this paper we use mathematical optimisation to find conditions for maximum stiffness and compliance with respect to an externally applied force. By doing so, we can retroactively explain observations made about humans using these mathematically optimal conditions. We then show how this optimisation can be applied to robotic task planning and control. Experiments on a humanoid robot show similar arm posture to that observed in humans. This suggests there is an underlying physical principle by which humans optimise stiffness. We can use this to derive natural control methods for robots.

Kinematic and dynamic data from a robotic assembly of aeronautical threaded fasteners.

Industrial screwing is one of several industry branches' most common manufacturing processes. Good quality and structured data from these operations have increased demand with the popularization of data-driven techniques for manufacturing automation. The dataset presented in this paper comprises screwing experiments with aeronautical nuts performed by an industrial robot Kuka KR-16 in a lab setting. The data comprises force, torque, linear and angular displacements, and velocities in time-series format. The dataset contains three different experiment results: mounted, jammed, and not mounted, which can be used as labels for classification techniques.

Ergonomic human-robot collaboration in industry: A review.

In the current industrial context, the importance of assessing and improving workers' health conditions is widely recognised. Both physical and psycho-social factors contribute to jeopardising the underlying comfort and well-being, boosting the occurrence of diseases and injuries, and affecting their quality of life. Human-robot interaction and collaboration frameworks stand out among the possible solutions to prevent and mitigate workplace risk factors. The increasingly advanced control strategies and planning schemes featured by collaborative robots have the potential to foster fruitful and efficient coordination during the execution of hybrid tasks, by meeting their human counterparts' needs and limits. To this end, a thorough and comprehensive evaluation of an individual's ergonomics, i.e. direct effect of workload on the human psycho-physical state, must be taken into account. In this review article, we provide an overview of the existing ergonomics assessment tools as well as the available monitoring technologies to drive and adapt a collaborative robot's behaviour. Preliminary attempts of ergonomic human-robot collaboration frameworks are presented next, discussing state-of-the-art limitations and challenges. Future trends and promising themes are finally highlighted, aiming to promote safety, health, and equality in worldwide workplaces.

A Directional Vibrotactile Feedback Interface for Ergonomic Postural Adjustment.

The objective of this paper is to develop and evaluate a directional vibrotactile feedback interface as a guidance tool for postural adjustments during work. In contrast to the existing active and wearable systems such as exoskeletons, we aim to create a lightweight and intuitive interface, capable of guiding its wearers towards more ergonomic and healthy working conditions. To achieve this, a vibrotactile device called ErgoTac is employed to develop three different feedback modalities that are able to provide a directional guidance at the body segments towards a desired pose. In addition, an evaluation is made to find the most suitable, comfortable, and intuitive feedback modality for the user. Therefore, these modalities are first compared experimentally on fifteen subjects wearing eight ErgoTac devices to achieve targeted arm and torso configurations. The most effective directional feedback modality is then evaluated on five subjects in a set of experiments in which an ergonomic optimisation module provides the optimised body posture while performing heavy lifting or forceful exertion tasks. The results yield strong evidence on the usefulness and the intuitiveness of one of the developed modalities in providing guidance towards ergonomic working conditions, by minimising the effect of an external load on body joints. We believe that the integration of such low-cost devices in workplaces can help address the well-known and complex problem of work-related musculoskeletal disorders.

A Supernumerary Soft Robotic Limb for Reducing Hand-Arm Vibration Syndromes Risks.

The most common causes of the risk of work-related musculoskeletal disorders (WMSD) have been identified as joint overloading, bad postures, and vibrations. In the last two decades, various solutions ranging from human-robot collaborative systems to robotic exoskeletons have been proposed to mitigate them. More recently, a new approach has been proposed with a high potential in this direction: the supernumerary robotic limbs SRLs are additional robotic body parts (e.g., fingers, legs, and arms) that can be worn by the workers, augmenting their natural ability and reducing the risks of injuries. These systems are generally proposed in the literature for their potentiality of augmenting the user's ability, but here we would like to explore this kind of technology as a new generation of (personal) protective equipment. A supernumerary robotic upper limb, for example, allows for indirectly interacting with hazardous objects like chemical products or vibrating tools. In particular, in this work, we present a supernumerary robotic limbs system to reduce the vibration transmitted along the arms and minimize the load on the upper limb joints. For this purpose, an off-the-shelf wearable gravity compensation system is integrated with a soft robotic hand and a custom damping wrist, designed starting from theoretical considerations on a mass-spring-damper model. The real efficacy of the system was experimentally tested within a simulated industrial work environment, where seven subjects performed a drilling task on two different materials. Experimental analysis was conducted according to the ISO-5349. Results showed a reduction from 40 to 60% of vibration transmission with respect to the traditional hand drilling using the presented SRL system without compromising the time performance.

A Novel Soft Robotic Supernumerary Hand for Severely Affected Stroke Patients.

Upper limb functions are severely affected in 23% of the chronic stroke patients, compromising their life quality. To re-enable hand use, providing a degree of functionality and motivating against learned non-use, we propose a robotic supernumerary limb, the SoftHand X (SHX), consisting of a robotic hand, a gravity support system, and different sensors to detect the patient's intent for controlling the robotic hand. In this paper, this novel compensational approach is introduced and experimentally evaluated in stroke patients, assessing its efficacy, usability and safety. Ten patients were asked to perform tasks of a modified Action Research Arm Test with the SHX, by using three input methods. The mARAT scores rated the potentiality of the system. Usability was evaluated with the System Usability Scale, while spasticity before and after use was measured by the modified Ashworth Scale (mAS). Nine patients, not able to perform any tasks without external support, completed the whole experimental procedure using the proposed system with a median score greater than 12/30. Among the three input methods tested, the usability of one was rated as "good" while the other two were rated as "ok". Seven patients exhibited a reduction of the mAS. All nine patients stated that they would use the system frequently. Results obtained suggest that the SHX has the potential to partially compensate severely impaired hand function in stroke patients.

Design and Validation of a Modular One-To-Many Actuator for a Soft Wearable Exosuit.

The size, weight, and power consumption of soft wearable robots rapidly scale with their number of active degrees of freedom. While various underactuation strategies have been proposed, most of them impose hard constrains on the kinetics and kinematics of the device. Here we propose a paradigm to independently control multiple degrees of freedom using a set of modular components, all tapping power from a single motor. Each module consists of three electromagnetic clutches, controlled to convert a constant unidirectional motion in an arbitrary output trajectory. We detail the design and functioning principle of each module and propose an approach to control the velocity and position of its output. The device is characterized in free space and under loading conditions. Finally, we test the performance of the proposed actuation scheme to drive a soft exosuit for the elbow joint, comparing it with the performance obtained using a traditional DC motor and an unpowered-exosuit condition. The exosuit powered by our novel scheme reduces the biological torque required to move by an average of 46.2%, compared to the unpowered condition, but negatively affects movement smoothness. When compared to a DC motor, using the our paradigm slightly deteriorates performance. Despite the technical limitations of the current design, the method proposed in this paper is a promising way to design more portable wearable robots.

A Bio-inspired Grasp Stiffness Control for Robotic Hands.

This work presents a bio-inspired grasp stiffness control for robotic hands based on the concepts of Common Mode Stiffness (CMS) and Configuration Dependent Stiffness (CDS). Using an ellipsoid representation of the desired grasp stiffness, the algorithm focuses on achieving its geometrical features. Based on preliminary knowledge of the fingers workspace, the method starts by exploring the possible hand poses that maintain the grasp contacts on the object. This outputs a first selection of feasible grasp configurations providing the base for the CDS control. Then, an optimization is performed to find the minimum joint stiffness (CMS control) that would stabilize these grasps. This joint stiffness can be increased afterwards depending on the task requirements. The algorithm finally chooses among all the found stable configurations the one that results in a better approximation of the desired grasp stiffness geometry (CDS). The proposed method results in a reduction of the control complexity, needing to independently regulate the joint positions, but requiring only one input to produce the desired joint stiffness. Moreover, the usage of the fingers pose to attain the desired grasp stiffness results in a more energy-efficient configuration than only relying on the joint stiffness (i.e., joint torques) modifications. The control strategy is evaluated using the fully actuated Allegro Hand while grasping a wide variety of objects. Different desired grasp stiffness profiles are selected to exemplify several stiffness geometries.

A Human-Robot Co-Manipulation Approach Based on Human Sensorimotor Information.

This paper aims to improve the interaction and coordination between the human and the robot in cooperative execution of complex, powerful, and dynamic tasks. We propose a novel approach that integrates online information about the human motor function and manipulability properties into the hybrid controller of the assistive robot. Through this human-in-the-loop framework, the robot can adapt to the human motor behavior and provide the appropriate assistive response in different phases of the cooperative task. We experimentally evaluate the proposed approach in two human-robot co-manipulation tasks that require specific complementary behavior from the two agents. Results suggest that the proposed technique, which relies on a minimum degree of task-level pre-programming, can achieve an enhanced physical human-robot interaction performance and deliver appropriate level of assistance to the human operator.

A real-time and reduced-complexity approach to the detection and monitoring of static joint overloading in humans.

This paper proposes a novel technique for the real-time estimation of the joint torques variations in humans while performing heavy manipulation tasks. To achieve this, the method is based on the deviations of the Centre of Pressure (CoP) and Ground Reaction Force (GRF) in the presence of interaction forces. The CoP and GRF variations are calculated from the difference between the estimated values (assuming no interaction forces) using a pre-identified statically equivalent serial chain (SESC) and the measured ones (with the effect of interaction forces) using an external device. The calculated variation vectors and the measured joint angles of the human body are then used for the estimation of the overloading joint torques in real-time. We evaluated the efficacy of the proposed method both in simulations and experiments, in various poses of the human and interaction force profiles.

Soft brain-machine interfaces for assistive robotics: A novel control approach.

Robotic systems offer the possibility of improving the life quality of people with severe motor disabilities, enhancing the individual's degree of independence and interaction with the external environment. In this direction, the operator's residual functions must be exploited for the control of the robot movements and the underlying dynamic interaction through intuitive and effective human-robot interfaces. Towards this end, this work aims at exploring the potential of a novel Soft Brain-Machine Interface (BMI), suitable for dynamic execution of remote manipulation tasks for a wide range of patients. The interface is composed of an eye-tracking system, for an intuitive and reliable control of a robotic arm system's trajectories, and a Brain-Computer Interface (BCI) unit, for the control of the robot Cartesian stiffness, which determines the interaction forces between the robot and environment. The latter control is achieved by estimating in real-time a unidimensional index from user's electroencephalographic (EEG) signals, which provides the probability of a neutral or active state. This estimated state is then translated into a stiffness value for the robotic arm, allowing a reliable modulation of the robot's impedance. A preliminary evaluation of this hybrid interface concept provided evidence on the effective execution of tasks with dynamic uncertainties, demonstrating the great potential of this control method in BMI applications for self-service and clinical care.

Exploring teleimpedance and tactile feedback for intuitive control of the Pisa/IIT SoftHand.

This paper proposes a teleimpedance controller with tactile feedback for more intuitive control of the Pisa/IIT SoftHand. With the aim to realize a robust, efficient and low-cost hand prosthesis design, the SoftHand is developed based on the motor control principle of synergies, through which the immense complexity of the hand is simplified into distinct motor patterns. Due to the built-in flexibility of the hand joints, as the SoftHand grasps, it follows a synergistic path while allowing grasping of objects of various shapes using only a single motor. The DC motor of the hand incorporates a novel teleimpedance control in which the user's postural and stiffness synergy references are tracked in real-time. In addition, for intuitive control of the hand, two tactile interfaces are developed. The first interface (mechanotactile) exploits a disturbance observer which estimates the interaction forces in contact with the grasped object. Estimated interaction forces are then converted and applied to the upper arm of the user via a custom made pressure cuff. The second interface employs vibrotactile feedback based on surface irregularities and acceleration signals and is used to provide the user with information about the surface properties of the object as well as detection of object slippage while grasping. Grasp robustness and intuitiveness of hand control were evaluated in two sets of experiments. Results suggest that incorporating the aforementioned haptic feedback strategies, together with user-driven compliance of the hand, facilitate execution of safe and stable grasps, while suggesting that a low-cost, robust hand employing hardware-based synergies might be a good alternative to traditional myoelectric prostheses.

Proceedings of the first workshop on Peripheral Machine Interfaces: going beyond traditional surface electromyography.

One of the hottest topics in rehabilitation robotics is that of proper control of prosthetic devices. Despite decades of research, the state of the art is dramatically behind the expectations. To shed light on this issue, in June, 2013 the first international workshop on Present and future of non-invasive peripheral nervous system (PNS)-Machine Interfaces (MI; PMI) was convened, hosted by the International Conference on Rehabilitation Robotics. The keyword PMI has been selected to denote human-machine interfaces targeted at the limb-deficient, mainly upper-limb amputees, dealing with signals gathered from the PNS in a non-invasive way, that is, from the surface of the residuum. The workshop was intended to provide an overview of the state of the art and future perspectives of such interfaces; this paper represents is a collection of opinions expressed by each and every researcher/group involved in it.