Exploring crossmodal correspondences for future research in human movement augmentation.

"Crossmodal correspondences" are the consistent mappings between perceptual dimensions or stimuli from different sensory domains, which have been widely observed in the general population and investigated by experimental psychologists in recent years. At the same time, the emerging field of human movement augmentation (i.e., the enhancement of an individual's motor abilities by means of artificial devices) has been struggling with the question of how to relay supplementary information concerning the state of the artificial device and its interaction with the environment to the user, which may help the latter to control the device more effectively. To date, this challenge has not been explicitly addressed by capitalizing on our emerging knowledge concerning crossmodal correspondences, despite these being tightly related to multisensory integration. In this perspective paper, we introduce some of the latest research findings on the crossmodal correspondences and their potential role in human augmentation. We then consider three ways in which the former might impact the latter, and the feasibility of this process. First, crossmodal correspondences, given the documented effect on attentional processing, might facilitate the integration of device status information (e.g., concerning position) coming from different sensory modalities (e.g., haptic and visual), thus increasing their usefulness for motor control and embodiment. Second, by capitalizing on their widespread and seemingly spontaneous nature, crossmodal correspondences might be exploited to reduce the cognitive burden caused by additional sensory inputs and the time required for the human brain to adapt the representation of the body to the presence of the artificial device. Third, to accomplish the first two points, the benefits of crossmodal correspondences should be maintained even after sensory substitution, a strategy commonly used when implementing supplementary feedback.

Comparing end-effector position and joint angle feedback for online robotic limb tracking.

Somatosensation greatly increases the ability to control our natural body. This suggests that supplementing vision with haptic sensory feedback would also be helpful when a user aims at controlling a robotic arm proficiently. However, whether the position of the robot and its continuous update should be coded in a extrinsic or intrinsic reference frame is not known. Here we compared two different supplementary feedback contents concerning the status of a robotic limb in 2-DoFs configuration: one encoding the Cartesian coordinates of the end-effector of the robotic arm (i.e., Task-space feedback) and another and encoding the robot joints angles (i.e., Joint-space feedback). Feedback was delivered to blindfolded participants through vibrotactile stimulation applied on participants' leg. After a 1.5-hour training with both feedbacks, participants were significantly more accurate with Task compared to Joint-space feedback, as shown by lower position and aiming errors, albeit not faster (i.e., similar onset delay). However, learning index during training was significantly higher in Joint space feedback compared to Task-space feedback. These results suggest that Task-space feedback is probably more intuitive and more suited for activities which require short training sessions, while Joint space feedback showed potential for long-term improvement. We speculate that the latter, despite performing worse in the present work, might be ultimately more suited for applications requiring long training, such as the control of supernumerary robotic limbs for surgical robotics, heavy industrial manufacturing, or more generally, in the context of human movement augmentation.

Reduced connectivity of primary auditory and motor cortices during exposure to auditory white noise.

Auditory white noise (WN) is widely used in daily life for inducing sleep, and in neuroscience to mask unwanted environmental noise and cues. However, WN was recently reported to influence corticospinal excitability and behavioral performance. Here, we expand previous preliminary findings on the influence of WN exposure on cortical functioning, and we hypothesize that it may modulate cortical connectivity. We tested our hypothesis by performing magnetoencephalography in 20 healthy subjects. WN reduces cortical connectivity of the primary auditory and motor regions with very distant cortical areas, showing a right lateralized connectivity reduction for primary motor cortex. The present results, together with previous finding concerning WN impact on corticospinal excitability and behavioral performance, further support the role of WN as a modulator of cortical function. This suggest avoiding its unrestricted use as a masking tool, while purposely designed and controlled WN application could be exploited to harness brain function and to treat neuropsychiatric conditions.

Stimulation with acoustic white noise enhances motor excitability and sensorimotor integration.

Auditory white noise (WN) is widely used in neuroscience to mask unwanted environmental noise and cues, e.g. TMS clicks. However, to date there is no research on the influence of WN on corticospinal excitability and potentially associated sensorimotor integration itself. Here we tested the hypothesis, if WN induces M1 excitability changes and improves sensorimotor performance. M1 excitability (spTMS, SICI, ICF, I/O curve) and sensorimotor reaction-time performance were quantified before, during and after WN stimulation in a set of experiments performed in a cohort of 61 healthy subjects. WN enhanced M1 corticospinal excitability, not just during exposure, but also during silence periods intermingled with WN, and up to several minutes after the end of exposure. Two independent behavioural experiments highlighted that WN improved multimodal sensorimotor performance. The enduring excitability modulation combined with the effects on behaviour suggest that WN might induce neural plasticity. WN is thus a relevant modulator of corticospinal function; its neurobiological effects should not be neglected and could in fact be exploited in research applications.