Design, Fabrication, and Characterization of a Novel Optical Six-Axis Distributed Force and Displacement Tactile Sensor for Dexterous Robotic Manipulation.

Real-time multi-axis distributed tactile sensing is a critical capability if robots are to perform stable gripping and dexterous manipulation, as it provides crucial information about the sensor-object interface. In this paper, we present an optical-based six-axis tactile sensor designed in a fingertip shape for robotic dexterous manipulation. The distributed sensor can precisely estimate the local XYZ force and displacement at ten distinct locations and provide the global XYZ force and torque measurements. Its compact size, comparable to that of a human thumb, and minimal thickness allow seamless integration onto existing robotic fingers, eliminating the need for complex modifications to the gripper. The proposed sensor design uses a simple, low-cost fabrication method. Moreover, the optical transduction approach uses light angle and intensity sensing to infer force and displacement from deformations of the individual sensing units that form the overall sensor, providing distributed six-axis sensing. The local force precision at each sensing unit in the X, Y, and Z axes is 20.89 mN, 19.19 mN, and 43.22 mN, respectively, over a local force range of approximately ±1.5 N in X and Y and 0 to -2 N in Z. The local displacement precision in the X, Y, and Z axes is 56.70 µm, 50.18 µm, and 13.83 µm, respectively, over a local displacement range of ±2 mm in the XY directions and 0 to -1.5 mm in Z (i.e., compression). Additionally, the sensor can measure global torques, Tx, Ty, and Tz, with a precision of of 1.90 N-mm, 1.54 N-mm, and 1.26 N-mm, respectively. The fabricated design is showcased by integrating it with an OnRobot RG2 gripper and illustrating real-time measurements during in simple demonstration task, which generated changing global forces and torques.

Optimal use of limb mechanics distributes control during bimanual tasks.

Bimanual tasks involve the coordination of both arms, which often offers redundancy in the ways a task can be completed. The distribution of control across limbs is often considered from the perspective of handedness. In this context, although there are differences across dominant and nondominant arms during reaching control ( Sainburg 2002 ), previous studies have shown that the brain tends to favor the dominant arm when performing bimanual tasks ( Salimpour and Shadmehr 2014 ). However, biomechanical factors known to influence planning and control in unimanual tasks may also generate limb asymmetries in force generation, but their influence on bimanual control has remained unexplored. We investigated this issue in a series of experiments in which participants were instructed to generate a 20-N force with both arms, with or without perturbation of the target force during the trial. We modeled the task in the framework of optimal feedback control of a two-link model with six human-like muscles groups. The biomechanical model predicted a differential contribution of each arm dependent on the orientation of the target force and joint configuration that was quantitatively matched by the participants' behavior, regardless of handedness. Responses to visual perturbations were strongly influenced by the perturbation direction, such that online corrections also reflected an optimal use of limb biomechanics. These results show that the nervous system takes biomechanical constraints into account when optimizing the distribution of forces generated across limbs during both movement planning and feedback control of a bimanual task. NEW & NOTEWORTHY Here, we studied a bimanual force production task to examine the effects of biomechanical constraints on the distribution of control across limbs. Our findings show that the central nervous system optimizes the distribution of force across the two arms according to the joint configuration of the upper limbs. We further show that the underlying mechanisms influence both movement planning and online corrective responses to sudden changes in the target force.

Open-Source Instrumented Object to Study Dexterous Object Manipulation.

Humans use tactile feedback to perform skillful manipulation. When tactile sensory feedback is unavailable, for instance, if the fingers are anesthetized, dexterity is severely impaired. Imaging the deformation of the finger pad skin when in contact with a transparent plate provides information about the tactile feedback received by the central nervous system. Indeed, skin deformations are transduced into neural signals by the mechanoreceptors of the finger pad skin. Understanding how this feedback is used for active object manipulation would improve our understanding of human dexterity. In this paper, we present a new device for imaging the skin of the finger pad of one finger during manipulation performed with a precision grip. The device's mass (300 g) makes it easy to use during unconstrained dexterous manipulation. Using this device, we reproduced the experiment performed in Delhaye et al. (2021) We extracted the strains aligned with the object's movement, i.e., the vertical strains in the ulnar and radial parts of the fingerpad, to see how correlated they were with the grip force (GF) adaptation. Interestingly, parts of our results differed from those in Delhaye et al. (2021) due to weight and inertia differences between the devices, with average GF across participants differing significantly. Our results highlight a large variability in the behavior of the skin across participants, with generally low correlations between strain and GF adjustments, suggesting that skin deformations are not the primary driver of GF adaptation in this manipulation scenario.

Different Control Strategies Drive Interlimb Differences in Performance and Adaptation during Reaching Movements in Novel Dynamics.

Humans exhibit lateralization such that most individuals typically show a preference for using one arm over the other for a range of movement tasks. The computational aspects of movement control leading to these differences in skill are not yet understood. It has been hypothesized that the dominant and nondominant arms differ in terms of the use of predictive or impedance control mechanisms. However, previous studies present confounding factors that prevented clear conclusions: either the performances were compared across two different groups, or in a design in which asymmetrical transfer between limbs could take place. To address these concerns, we studied a reach adaptation task during which healthy volunteers performed movements with their right and left arms in random order. We performed two experiments. Experiment 1 (18 participants) focused on adaptation to the presence of a perturbing force field (FF) and experiment 2 (12 participants) focused on rapid adaptations in feedback responses. The randomization of the left and right arm led to simultaneous adaptation, allowing us to study lateralization in single individuals with symmetrical and minimal transfer between limbs. This design revealed that participants could adapt control of both arms, with both arms showing similar performance levels. The nondominant arm initially presented a slightly worst performance but reached similar levels of performance in late trials. We also observed that the nondominant arm showed a different control strategy compatible with robust control when adapting to the force field perturbation. EMG data showed that these differences in control were not caused by differences in co-contraction across the arms. Thus, instead of assuming differences in predictive or reactive control schemes, our data show that in the context of optimal control, both arms can adapt, and that the nondominant arm uses a more robust, model-free strategy likely to compensate for less accurate internal representations of movement dynamics.

Biomechanics of the finger pad in response to torsion.

Surface skin deformation of the finger pad during partial slippage at finger-object interfaces elicits firing of the tactile sensory afferents. A torque around the contact normal is often present during object manipulation, which can cause partial rotational slippage. Until now, studies of surface skin deformation have used stimuli sliding rectilinearly and tangentially to the skin. Here, we study surface skin dynamics under pure torsion of the right index finger of seven adult participants (four males). A custom robotic platform stimulated the finger pad with a flat clean glass surface, controlling the normal forces and rotation speeds applied while monitoring the contact interface using optical imaging. We tested normal forces between 0.5 N and 10 N at a fixed angular velocity of 20° s-1 and angular velocities between 5° s-1 and 100° s-1 at a fixed normal force of 2 N. We observe the characteristic pattern by which partial slips develop, starting at the periphery of the contact and propagating towards its centre, and the resulting surface strains. The 20-fold range of normal forces and angular velocities used highlights the effect of those parameters on the resulting torque and skin strains. Increasing normal force increases the contact area, the generated torque, strains and the twist angle required to reach full slip. On the other hand, increasing angular velocity causes more loss of contact at the periphery and higher strain rates (although it has no impact on resulting strains after the full rotation). We also discuss the surprisingly large inter-individual variability in skin biomechanics, notably observed in the twist angle the stimulus needs to rotate before reaching full slip.

Robot-assisted line bisection in patients with Complex Regional Pain Syndrome.

Complex Regional Pain Syndrome (CRPS) is characterized by pain, motor and inflammatory symptoms usually affecting one limb. Cognitive difficulties have been reported to affect patients' ability to represent, perceive and use their affected limb. It is debated whether these difficulties result from deficits in controlling goal-directed movements in space or from a learned strategy to protect the affected limb. In order to dissociate the two hypotheses, patients with upper-limb CRPS were asked to move with their unaffected hand towards visual targets projected at different positions on a horizontal semi-reflexive mirror. By means of a robotic handle placed below the screen, they were asked to move a cursor, to reach and cross lines at their estimated midpoint. In some of the stimulation series, the affected hand was placed below the mirror so that some lines appeared projected onto that hand. Vision of the hands and the robotic handle was preserved or prevented by opening or closing a shutter below the mirror. Lines were displayed on the mirror according to which part of the body was affected (ispi- vs. contralateral) and the actual position of the affected hand (inside vs. outside the workspace). Comparatively to control participants, CRPS patients generally biased their estimation by bisecting the lines towards their left side, irrelative of which part of the body was affected and the position of the affected hand, both in ipsi- and contralateral space, with only a few exceptions. Our results are in line with previous studies having described a visuospatial deficit in CRPS patients and discard the explanation of observed symptoms in terms of learned nonuse strategies, as only the unaffected hand was used to perform the task. It is suggested that CRPS patients can display difficulties to perform tasks requesting visuo-motor coordination, reflecting the complex cortical reorganization occurring in CRPS.