Visual delay affects force scaling and weight perception during object lifting in virtual reality.

Lifting an object requires precise scaling of fingertip forces based on a prediction of object weight. At object contact, a series of tactile and visual events arise that need to be rapidly processed online to fine-tune the planned motor commands for lifting the object. The brain mechanisms underlying multisensory integration serially at transient sensorimotor events, a general feature of actions requiring hand-object interactions, are not yet understood. In this study we tested the relative weighting between haptic and visual signals when they are integrated online into the motor command. We used a new virtual reality setup to desynchronize visual feedback from haptics, which allowed us to probe the relative contribution of haptics and vision in driving participants' movements when they grasped virtual objects simulated by two force-feedback robots. We found that visual delay changed the profile of fingertip force generation and led participants to perceive objects as heavier than when lifts were performed without visual delay. We further modeled the effect of vision on motor output by manipulating the extent to which delayed visual events could bias the force profile, which allowed us to determine the specific weighting the brain assigns to haptics and vision. Our results show for the first time how visuo-haptic integration is processed at discrete sensorimotor events for controlling object-lifting dynamics and further highlight the organization of multisensory signals online for controlling action and perception. NEW & NOTEWORTHY Dexterous hand movements require rapid integration of information from different senses, in particular touch and vision, at different key time points as movement unfolds. The relative weighting between vision and haptics for object manipulation is unknown. We used object lifting in virtual reality to desynchronize visual and haptic feedback and find out their relative weightings. Our findings shed light on how rapid multisensory integration is processed over a series of discrete sensorimotor control points.

Loss of sensory attenuation in patients with functional (psychogenic) movement disorders.

Functional movement disorders require attention to manifest yet patients report the abnormal movement to be out of their control. In this study we explore the phenomenon of sensory attenuation, a measure of the sense of agency for movement, in this group of patients by using a force matching task. Fourteen patients and 14 healthy control subjects were presented with forces varying from 1 to 3 N on the index finger of their left hand. Participants were required to match these forces; either by pressing directly on their own finger or by operating a robot that pressed on their finger. As expected, we found that healthy control subjects consistently overestimated the force required when pressing directly on their own finger than when operating a robot. However, patients did not, indicating a significant loss of sensory attenuation in this group of patients. These data are important because they demonstrate that a fundamental component of normal voluntary movement is impaired in patients with functional movement disorders. The loss of sensory attenuation has been correlated with the loss of sense of agency, and may help to explain why patients report that they do not experience the abnormal movement as voluntary.

Opposing roles of sensory and parietal cortices in awareness in a bistable motion illusion.

Motion-induced blindness (MIB) is a bistable visual phenomenon in which stationary disks surrounded by a moving pattern intermittently disappear from the viewer's awareness. We explored the cortical network that subserves the MIB phenomenon by targeting its constituent parts with disruptive transcranial magnetic stimulation (TMS), in the form of continuous theta burst stimulation (cTBS). Previous neuroimaging and TMS studies have implicated the right posterior parietal cortex (rPPC) in perceptual transitions such as binocular rivalry, while the visual area V5/MT has been suggested to play a key role in MIB. In this study, we found that cTBS applied to the rPPC lengthened the duration of disappearance in MIB, while cTBS applied to V5/MT shortened the duration of disappearance and decreased the frequency of disappearance in MIB. These results demonstrate a causal role for both the rPPC and V5/MT in MIB, and suggest that the rPPC is involved in shifting resources between competing functional areas, while V5/MT processing initiates and maintains MIB.

Contribution of human melanopsin retinal ganglion cells to steady-state pupil responses.

The recent discovery of melanopsin-containing retinal ganglion cells (mRGCs) has led to a fundamental reassessment of non-image forming processing, such as circadian photoentrainment and the pupillary light reflex. In the conventional view of retinal physiology, rods and cones were assumed to be the only photoreceptors in the eye and were, therefore, considered responsible for non-image processing. However, signals from mRGCs contribute to this non-image forming processing along with cone-mediated luminance signals; although both signals contribute, it is unclear how these signals are summed. We designed and built a novel multi-primary stimulation system to stimulate mRGCs independently of other photoreceptors using a silent-substitution technique within a bright steady background. The system allows direct measurements of pupillary functions for mRGCs and cones. We observed a significant change in steady-state pupil diameter when we varied the excitation of mRGC alone, with no change in luminance and colour. Furthermore, the change in pupil diameter induced by mRGCs was larger than that induced by a variation in luminance alone: that is, for a bright steady background, the mRGC signals contribute to the pupillary pathway by a factor of three times more than the L- and M-cone signals.

Two distinct cone-opponent processes in the L+M luminance pathway.

We measured phase shifts between Long-wavelength cone (L-cone) and Middle-wavelength cone (M-cone) signals as well as sensitivity in the luminance pathway either following a cone-silent substitution of colored background or on a steady colored background. In background substitution, the phase shifts between L- and M-cone signals varied only slightly depending on the substituted color, whereas marked elevation of the threshold following the substitution of colored background was found. In contrast, the phase shifts, as well as threshold, varied largely, depending on the background color in the steady background. These facts suggest that suppression by the cone-opponent process for background color substitution is different from the one for a steady colored background.