Motion and binocular disparity processing: Two sides of two different coins.

From a mathematical point of view, extracting motion and disparity signals from a binocular visual stream requires very similar operations, applied over time for motion and across eyes for disparity. This similarity is reflected in the theories that have been proposed to describe the neural mechanisms used by the brain to extract these signals. At the behavioral level there are, however, several differences in how humans react to these stimuli, which presumably reflect differences in how these signals are processed by the brain. Here we highlight three such differences: the degree to which different axes of motion/disparity are treated isotropically, the importance of reference signals, and the rules that underlie the combination of 1D signals to extract 2D signals.

Terminator disparity contributes to stereo matching for eye movements and perception.

In the context of motion detection, the endings (or terminators) of 1-D features can be detected as 2-D features, affecting the perceived direction of motion of the 1-D features (the barber-pole illusion) and the direction of tracking eye movements. In the realm of binocular disparity processing, an equivalent role for the disparity of terminators has not been established. Here we explore the stereo analogy of the barber-pole stimulus, applying disparity to a 1-D noise stimulus seen through an elongated, zero-disparity, aperture. We found that, in human subjects, these stimuli induce robust short-latency reflexive vergence eye movements, initially in the direction orthogonal to the 1-D features, but shortly thereafter in the direction predicted by the disparity of the terminators. In addition, these same stimuli induce vivid depth percepts, which can only be attributed to the disparity of line terminators. When the 1-D noise patterns are given opposite contrast in the two eyes (anticorrelation), both components of the vergence response reverse sign. Finally, terminators drive vergence even when the aperture is defined by a texture (as opposed to a contrast) boundary. These findings prove that terminators contribute to stereo matching, and constrain the type of neuronal mechanisms that might be responsible for the detection of terminator disparity.

Temporal evolution of pattern disparity processing in humans.

Stereo matching, i.e., the matching by the visual system of corresponding parts of the images seen by the two eyes, is inherently a 2D problem. To gain insights into how this operation is carried out by the visual system, we measured, in human subjects, the reflexive vergence eye movements elicited by the sudden presentation of stereo plaids. We found compelling evidence that the 2D pattern disparity is computed by combining disparities first extracted within orientation selective channels. This neural computation takes 10-15 ms, and is carried out even when subjects perceive not a single plaid but rather two gratings in different depth planes (transparency). However, we found that 1D disparities are not always effectively combined: when spatial frequency and contrast of the gratings are sufficiently different pattern disparity is not computed, a result that cannot be simply attributed to the transparency of such stimuli. Based on our results, we propose that a narrow-band implementation of the IOC (Intersection of Constraints) rule (Fennema and Thompson, 1979; Adelson and Movshon, 1982), preceded by cross-orientation suppression, underlies the extraction of pattern disparity.

Role of cerebellum in motion perception and vestibulo-ocular reflex-similarities and disparities.

Vestibular velocity storage enhances the efficacy of the angular vestibulo-ocular reflex (VOR) during relatively low-frequency head rotations. This function is modulated by GABA-mediated inhibitory cerebellar projections. Velocity storage also exists in perceptual pathway and has similar functional principles as VOR. However, it is not known whether the neural substrate for perception and VOR overlap. We propose two possibilities. First, there is the same velocity storage for both VOR and perception; second, there are nonoverlapping neural networks: one might be involved in perception and the other for the VOR. We investigated these possibilities by measuring VOR and perceptual responses in healthy human subjects during whole-body, constant-velocity rotation steps about all three dimensions (yaw, pitch, and roll) before and after 10 mg of 4-aminopyridine (4-AP). 4-AP, a selective blocker of inward rectifier potassium conductance, can lead to increased synchronization and precision of Purkinje neuron discharge and possibly enhance the GABAergic action. Hence 4-AP could reduce the decay time constant of the perceived angular velocity and VOR. We found that 4-AP reduced the decay time constant, but the amount of reduction in the two processes, perception and VOR, was not the same, suggesting the possibility of nonoverlapping or partially overlapping neural substrates for VOR and perception. We also noted that, unlike the VOR, the perceived angular velocity gradually built up and plateau prior to decay. Hence, the perception pathway may have additional mechanism that changes the dynamics of perceived angular velocity beyond the velocity storage. 4-AP had no effects on the duration of build-up of perceived angular velocity, suggesting that the higher order processing of perception, beyond the velocity storage, might not occur under the influence of mechanism that could be influenced by 4-AP.