Utilising redundancy in musculoskeletal systems for adaptive stiffness and muscle failure compensation: a model-free inverse statics approach.

Vertebrates possess a biomechanical structure with redundant muscles, enabling adaptability in uncertain and complex environments. Harnessing this inspiration, musculoskeletal systems offer advantages like variable stiffness and resilience to actuator failure and fatigue. Despite their potential, the complex structure presents modelling challenges that are difficult to explicitly formulate and control. This difficulty arises from the need for comprehensive knowledge of the musculoskeletal system, including details such as muscle arrangement, and fully accessible muscle and joint states. Whilst existing model-free methods do not need explicit formulations, they also underutilise the benefits of muscle redundancy. Consequently, they necessitate retraining in the event of muscle failure and require manual tuning of parameters to control joint stiffness limiting their applications under unknown payloads. Presented here is a model-free local inverse statics controller for musculoskeletal systems, employing a feedforward neural network trained on motor babbling data. Experiments with a musculoskeletal leg model showcase the controller's adaptability to complex structures, including mono and bi-articulate muscles. The controller can compensate for changes such as weight variations, muscle failures, and environmental interactions, retaining reasonable accuracy without the need for any additional retraining.

Coordinating upper limbs for octave playing on the piano via neuro-musculoskeletal modeling.

Understanding the coordination of multiple biomechanical degrees of freedom in biological organisms is crucial for unraveling the neurophysiological control of sophisticated motor tasks. This study focuses on the cooperative behavior of upper-limb motor movements in the context of octave playing on the piano. While the vertebrate locomotor system has been extensively investigated, the coherence and precision timing of rhythmic movements in the upper-limb system remain incompletely understood. Inspired by the spinal cord neuronal circuits (central pattern generator, CPG), a computational neuro-musculoskeletal model is proposed to explore the coordination of upper-limb motor movements during octave playing across varying tempos and volumes. The proposed model incorporates a CPG-based nervous system, a physiologically-informed mechanical body, and a piano environment to mimic human joint coordination and expressiveness. The model integrates neural rhythm generation, spinal reflex circuits, and biomechanical muscle dynamics while considering piano playing quality and energy expenditure. Based on real-world human subject experiments, the model has been refined to study tempo transitions and volume control during piano playing. This computational approach offers insights into the neurophysiological basis of upper-limb motor coordination in piano playing and its relation to expressive features.

Heterogeneity is a key factor describing the initial outbreak of COVID-19.

Assessing the transmission potential of emerging infectious diseases, such as COVID-19, is crucial for implementing prompt and effective intervention policies. The basic reproduction number is widely used to measure the severity of the early stages of disease outbreaks. The basic reproduction number of standard ordinary differential equation models is computed for homogeneous contact patterns; however, realistic contact patterns are far from homogeneous, specifically during the early stages of disease transmission. Heterogeneity of contact patterns can lead to superspreading events that show a significantly high level of heterogeneity in generating secondary infections. This is primarily due to the large variance in the contact patterns of complex human behaviours. Hence, in this work, we investigate the impacts of heterogeneity in contact patterns on the basic reproduction number by developing two distinct model frameworks: 1) an SEIR-Erlang ordinary differential equation model and 2) an SEIR stochastic agent-based model. Furthermore, we estimated the transmission probability of both models in the context of COVID-19 in South Korea. Our results highlighted the importance of heterogeneity in contact patterns and indicated that there should be more information than one quantity (the basic reproduction number as the mean quantity), such as a degree-specific basic reproduction number in the distributional sense when the contact pattern is highly heterogeneous.

Data-driven method for damage localization on soft robotic grippers based on motion dynamics.

Damage detection is one of the critical challenges in operating soft robots in an industrial setting. In repetitive tasks, even a small cut or fatigue can propagate to large damage ceasing the complete operation process. Although research has shown that damage detection can be performed through an embedded sensor network, this approach leads to complicated sensorized systems with additional wiring and equipment, made using complex fabrication processes and often compromising the flexibility of the soft robotic body. Alternatively, in this paper, we proposed a non-invasive approach for damage detection and localization on soft grippers. The essential idea is to track changes in non-linear dynamics of a gripper due to possible damage, where minor changes in material and morphology lead to large differences in the force and torque feedback over time. To test this concept, we developed a classification model based on a bidirectional long short-time memory (biLSTM) network that discovers patterns of dynamics changes in force and torque signals measured at the mounting point. To evaluate this model, we employed a two-fingered Fin Ray gripper and collected data for 43 damage configurations. The experimental results show nearly perfect damage detection accuracy and 97% of its localization. We have also tested the effect of the gripper orientation and the length of time-series data. By shaking the gripper with an optimal roll angle, the localization accuracy can exceed 95% and increase further with additional gripper orientations. The results also show that two periods of the gripper oscillation, i.e., roughly 50 data points, are enough to achieve a reasonable level of damage localization.

State-transfer modeling collective behavior of multi-ball Bernoulli system based on local interaction forces.

Collective behavior observed in nature has been actively employed in swarm robotics. In order to better respond to external cues, the agents in such systems organize themselves in an ordered structure based on simple local rules. The central assumption, in swarm robotics, is that all agents in the system collaborate to fulfill a common goal. In nature, however, many multi-agent systems exhibit a more complex collective behavior involving a certain level of competition. One representative example of complex collective behavior is a multi-ball Bernoulli-ball system. In this paper, by extracting local force among the Bernoulli balls, we approximated the state-transfer model mapping interaction forces to observed behaviors. The results show that the collective Bernoulli-ball system spent 41% of its time on competitive behaviors, in which up to 84% of the interaction state is unorganized. The rest 59% of the time is spent on collaborative behavior. We believe that the novel proposed model opens new avenues in swarm robotics research.

Reach Space Analysis of Baseline Differential Extrinsic Plasticity Control.

The neuroplasticity rule Differential Extrinsic Plasticity (DEP) has been studied in the context of goal-free simulated agents, producing realistic-looking, environmentally-aware behaviors, but no successful control mechanism has yet been implemented for intentional behavior. The goal of this paper is to determine if "short-circuited DEP," a simpler, open-loop variant can generate desired trajectories in a robot arm. DEP dynamics, both transient and limit cycles are poorly understood. Experiments were performed to elucidate these dynamics and test the ability of a robot to leverage these dynamics for target reaching and circular motions.

Mastication-Enhanced Taste-Based Classification of Multi-Ingredient Dishes for Robotic Cooking.

Chefs frequently rely on their taste to assess the content and flavor of dishes during cooking. While tasting the food, the mastication process also provides continuous feedback by exposing the taste receptors to food at various stages of chewing. Since different ingredients of the dish undergo specific changes during chewing, the mastication helps to understand the food content. The current methods of electronic tasting, on the contrary, always use a single taste snapshot of a homogenized sample. We propose a robotic setup that uses the mixing to imitate mastication and tastes the dish at two different mastication phases. Each tasting is done using a conductance probe measuring conductance at multiple, spatially distributed points. This data is used to classify 9 varieties of scrambled eggs with tomatoes. We test four different tasting methods and analyze the resulting classification performance, showing a significant improvement over tasting homogenized samples. The experimental results show that tasting at two states of mechanical processing of the food increased classification F1 score to 0.93 in comparison to the traditional tasting of a homogenized sample resulting in F1 score of 0.55. We attribute this performance increase to the fact that different dishes are affected differently by the mixing process, and have different spatial distributions of the salinity. It helps the robot to distinguish between dishes of the same average salinity, but different content of ingredients. This work demonstrates that mastication plays an important role in robotic tasting and implementing it can improve the tasting ability of robotic chefs.

Visually Guided Acquisition of Contact Dynamics and Case Study in Data-Driven Haptic Texture Modeling.

Data-driven modeling of human hand contact dynamics starts with a tedious process of data collection. The data of contact dynamics consist of an input describing an applied action and response stimuli from the environment. The quality and stability of the model mainly depend on how well data points cover the model space. Thus, in order to build a reliable data-driven model, a user usually collects data dozens of times. In this article, we aim to build an interactive system that assists a user in data collection. We develop an online segmentation framework that partitions a multivariate streaming signal. Real-time segmentation allows for tracking the process of how the model space is being populated. We applied the proposed framework for a haptic texture modeling use-case. In order to guide a user in data collection, we designed a user interface mapping applied input to alternative visual modalities based on the theory of direct perception. A combination of the segmentation framework and user interface implements a human-in-loop system, where the user interface assigns the target combination of input variables and the user tries to acquire them. Experimental results show that the proposed data collection schema considerably increases the approximation quality of the model, whereas the proposed user interface considerably reduces mental workload experienced during data collection.

Towards Universal Haptic Library: Library-Based Haptic Texture Assignment Using Image Texture and Perceptual Space.

In this paper, we focused on building a universal haptic texture models library and automatic assignment of haptic texture models to any given surface from the library based on image features. It is shown that a relationship exists between perceived haptic texture and its image features, and this relationship is effectively used for automatic haptic texture model assignment. An image feature space and a perceptual haptic texture space are defined, and the correlation between the two spaces is found. A haptic texture library was built, using 84 real life textured surfaces, by training a multi-class support vector machine with radial basis function kernel. The perceptual space was classified into perceptually similar clusters using K-means. Haptic texture models were assigned to new surfaces in a two step process; classification into a perceptually similar group using the trained multi-class support vector machine, and finding a unique match from within the group using binarized statistical image features. The system was evaluated using 21 new real life texture surfaces and an accuracy of 71.4 percent was achieved in assigning haptic models to these surfaces.

Data-Driven Modeling and Rendering of Force Responses from Elastic Tool Deformation.

This article presents a new data-driven model design for rendering force responses from elastic tool deformation. The new design incorporates a six-dimensional input describing the initial position of the contact, as well as the state of the tool deformation. The input-output relationship of the model was represented by a radial basis functions network, which was optimized based on training data collected from real tool-surface contact. Since the input space of the model is represented in the local coordinate system of a tool, the model is independent of recording and rendering devices and can be easily deployed to an existing simulator. The model also supports complex interactions, such as self and multi-contact collisions. In order to assess the proposed data-driven model, we built a custom data acquisition setup and developed a proof-of-concept rendering simulator. The simulator was evaluated through numerical and psychophysical experiments with four different real tools. The numerical evaluation demonstrated the perceptual soundness of the proposed model, meanwhile the user study revealed the force feedback of the proposed simulator to be realistic.