Binocular receptive-field construction in the primary visual cortex.

ON and OFF thalamic afferents from the two eyes converge in the primary visual cortex to form binocular receptive fields. The receptive fields need to be diverse to sample our visual world but also similar across eyes to achieve binocular fusion. It is currently unknown how the cortex balances these competing needs between receptive-field diversity and similarity. Our results demonstrate that receptive fields in the cat visual cortex are binocularly matched with exquisite precision for retinotopy, orientation/direction preference, orientation/direction selectivity, response latency, and ON-OFF polarity/structure. Specifically, the average binocular mismatches in retinotopy and ON-OFF structure are tightly restricted to 1/20 and 1/5 of the average receptive-field size but are still large enough to generate all types of binocular disparity tuning. Based on these results, we conclude that cortical receptive fields are binocularly matched with the high precision needed to facilitate binocular fusion while allowing restricted mismatches to process visual depth.

The role of pattern coherence in interocular grouping during binocular rivalry: Insights from individual differences.

Interocular grouping during binocular rivalry occurs when two images presented to each eye combine into a coherent pattern. The experience of interocular grouping is thought to be influenced by both eye-of-origin, which involves excitatory lateral connections among monocular neurons, and pattern coherence, which results from top-down intervention from higher visual areas. However, it remains unclear which factor plays a more significant role in the interocularly-grouped percepts during binocular rivalry. The current study employed an individual difference approach to investigate whether grouping dynamics are mainly determined by eye-of-origin or pattern coherence. We found that participants who perceived interocularly-driven coherent percepts for a longer duration also tended to experience longer periods of monocularly-driven coherent percepts. In contrast, participants who experienced non-coherent piecemeal percepts for an extended duration in conventional rivalry also had longer duration of non-coherent percepts in the interocular coherence setting. This individual differences in experiencing interocular grouping suggest that pattern coherence exerts a stronger influence on grouping dynamics during binocular rivalry compared to eye-of-origin factors.

Temporal mechanisms in frontoparallel stereomotion revealed by individual differences analysis.

Masking experiments, using vertical and horizontal sinusoidal depth corrugations, have suggested the existence of more than two spatial-frequency disparity mechanisms. This result was confirmed through an individual differences approach. Here, using factor analytic techniques, we want to investigate the existence of independent temporal mechanisms in frontoparallel stereoscopic (cyclopean) motion. To construct stereomotion, we used sinusoidal depth corrugations obtained with dynamic random-dot stereograms. Thus, no luminance motion was present monocularly. We measured disparity thresholds for drifting vertical (up-down) and horizontal (left-right) sinusoidal corrugations of 0.4 cyc/deg at 0.25, 0.5, 1, 2, 4, 6, and 8 Hz. In total, we tested 34 participants. Results showed a small orientation anisotropy with lower thresholds for horizontal corrugations. Disparity thresholds as a function of temporal frequency were almost constant from 0.25 up to 1 Hz, and then they increased monotonically. Principal component analysis uncovered two significant factors for vertical and two for horizontal corrugations. Varimax rotation showed that one factor loaded from 0.25 to 1-2 Hz and a second factor from 2 to 4 to 8 Hz. Direct Oblimin rotation indicated a moderate intercorrelation of both factors. Our results suggest the possible existence of two somewhat interdependent temporal mechanisms involved in frontoparallel stereomotion.

Mean orientation discrimination based on proximal stimuli.

Ensemble perception refers to the ability to accurately and rapidly perceive summary statistical representations of specific features from a group of similar objects. However, the specific type of representation involved in this perception within a three-dimensional (3-D) environment remains unclear. In the context of perspective viewing with stereopsis, distal stimuli can be projected onto the retina as different forms of proximal stimuli based on their distances, despite sharing similar properties, such as object size and spatial frequency. This study aimed to investigate the effects of distal and proximal stimuli on the perception of summary statistical information related to orientation. In our experiment, we presented multiple Gabor patches in a stereoscopic environment, allowing us to measure the discrimination threshold of the mean orientation. The object size and spatial frequency were fixed for all patches regardless of depth. However, the physical angular size and absolute spatial frequency covaried with the depth. The results revealed the threshold elevation with depth expansion, especially when the patches formed two clusters at near and far distances, leading to large variations in their retinotopic representations. This finding indicates a minor contribution of similarity of the distal stimuli. Subsequent experiments demonstrated that the variability in physical angular size of the patches significantly influenced the threshold elevation in contrast to that of binocular disparity and absolute spatial frequency. These findings highlight the critical role of physical angular size variability in perceiving mean orientations within the 3-D space.

Double fusion, a depth perception mechanism in Panum's limiting case.

The origin of depth in Panum's limiting case is unclear at present, so we investigated the depth perception mechanism using a triangle type of Panum's stimulus with a slant effect and clear criterion. Experiment 1 explored whether participants can correctly perceive fixation and nonfixation features using the fixation point and quick representation of stimuli, then examined whether participants' depth judgments supported double fusion or single fusion. The results of Experiment 1 showed that participants could correctly perceive the depth of fixation and nonfixation features. That is, it supported double fusion. In Experiment 2, we examined whether the depth perceived by observers comes from depth contrast. The results of Experiment 2 showed that the depth of the two features perceived after binocular fusion did not originate from the depth contrast. The findings suggest that the depth perception mechanism of Panum's limiting case is more likely to be double fusion.

Parallax attention stereo matching network based on the improved group-wise correlation stereo network.

Recent stereo matching methods, especially end-to-end deep stereo matching networks, have achieved remarkable performance in the fields of autonomous driving and depth sensing. However, state-of-the-art stereo algorithms, even with the deep neural network framework, still have difficulties at finding correct correspondences in near-range regions and object edge cues. To reinforce the precision of disparity prediction, in the present study, we propose a parallax attention stereo matching algorithm based on the improved group-wise correlation stereo network to learn the disparity content from a stereo correspondence, and it supports end-to-end predictions of both disparity map and edge map. Particular, we advocate for a parallax attention module in three-dimensional (disparity, height and width) level, which structure ensures high-precision estimation by improving feature expression in near-range regions. This is critical for computer vision tasks and can be utilized in several existing models to enhance their performance. Moreover, in order to making full use of the edge information learned by two-dimensional feature extraction network, we propose a novel edge detection branch and multi-featured integration cost volume. It is demonstrated that based on our model, edge detection project is conducive to improve the accuracy of disparity estimation. Our method achieves better results than previous works on both Scene Flow and KITTI datasets.

A Joint Lateral Motion-Stereo Constraint.

Purpose: We developed a stereo task that is based on a motion direction discrimination to examine the role that depth can play in disambiguating motion direction. Methods: In this study, we quantified normal adults' static and dynamic (i.e., laterally moving) stereoscopic performance using a psychophysical task, where we dichoptically presented randomly arranged, limited lifetime Gabor elements at two depth planes (one plane was at the fixation plane and the other at an uncrossed disparity relative to the fixation plane). Each plane contained half of the elements. For the dynamic condition, all elements were vertically oriented and moved to the left in one plane and to the right in another plane; for the static condition, the elements were horizontally oriented in one plane and vertically oriented in another plane. Results: For the range of motion speed that we measured (from 0.17°/s to 5.33°/s), we observed clear speed tuning of the stereo sensitivity (P = 3.0 × 10-5). The shape of this tuning did not significantly change with different spatial frequencies. We also found a significant difference in stereo sensitivity between stereopsis with static and laterally moving stimuli (speed = 0.67°/s; P = 0.004). Such difference was not evident when we matched the task between the static and moving stimuli. Conclusions: We report that lateral motion modulates human global depth perception. This motion/stereo constraint is related to motion velocity not stimulus temporal frequency. We speculate that the processing of motion-based stereopsis of the kind reported here occurs in dorsal extrastriate cortex.

Detection of binocular chromatic fusion limit for opposite colors.

When the input colors of the left and right eyes are different from one another, binocular rivalry may occur. According to Hering theory, opponent colors would have the most significant tendency for rivalry. However, binocular color fusion still occurs under the condition that each eye's opponent chromatic responses do not exceed a specific chromatic fusion limit (CFL). This paper detects the binocular chromatic fusion limit for opposite colors within a conventional 3D display color gamut. We conducted a psychophysical experiment to quantitatively measure the binocular chromatic fusion limit on four opposite color directions in the CIELAB color space. Due to color inconsistency between eyes may affect the binocular color fusion, the experiment was divided into two sessions by swapping stimulation colors of left and right eyes. There were 5 subjects and they each experienced 320 trials. By analyzing the results, we used ellipses to quantify the chromatic fusion limits for opposing colors. The average semi-major axis of the ellipses is 27.55 Δ E a b∗, and the average semi-minor axis is 16.98 Δ E a b∗. We observed that the chromatic fusion limit varies with the opposite color direction: the CFL on RedBlue-GreenYellow direction is greater than that on Red-Green direction, the latter being greater than that on Yellow-Blue direction and the CFL on RedYellow-GreenBlue direction is smallest. Furthermore, we suggested that the chromatic fusion limit is independent of the distribution of cells, and there is no significant change in the fusion ellipse boundaries after swapping left and right eye colors.

Binocular treatment for amblyopia: A meta-analysis of randomized clinical trials.

BACKGROUND: To date, there is still no consensus regarding the effect of binocular treatment for amblyopia. The purpose of this systematic review and meta-analysis was to summarize the available evidence to determine whether binocular treatment is more effective than patching in children with amblyopia. METHODS: Four electronic databases (PubMed, Scopus, Web of Science, and Cochrane Central Register of Controlled Trials) were searched for studies that compared binocular treatment and patching in children with amblyopia. The outcome measures were visual acuity and stereopsis. Pooled effects sizes were calculated with a random-effect model. The standardized difference in means (SDM) with 95% confidence intervals (CI) was calculated. Sensitivity analysis and assessment of publication bias were performed. RESULTS: Five randomized clinical trials were included. No significant difference in visual acuity between patients treated with binocular treatment and patching was observed (SDM = -0.12; 95% CI: -0.45-0.20; P = 0.464). No significant difference in stereopsis between patients treated with binocular treatment and patching was observed (SDM = -0.07; 95% CI: -0.61-0.48; P = 0.809). For both variables, the between-study heterogeneity was high (respectively, I2 = 61% and I2 = 57%). CONCLUSIONS: This meta-analysis found no convincing evidence supporting the efficacy of binocular treatment as an alternative to conventional patching. Therefore, the binocular treatment cannot fully replace traditional treatment but, to date, it can be considered a valid complementary therapy in peculiar cases. Further studies are required to determine whether more engaging therapies and new treatment protocols are more effective.

Binocular fusion enhances the efficiency of spot-the-difference gameplay.

Spot-the-difference, the popular childhood game and a prototypical change blindness task, involves identification of differences in local features of two otherwise identical scenes using an eye scanning and matching strategy. Through binocular fusion of the companion scenes, the game becomes a visual search task, wherein players can simply scan the cyclopean percept for local features that may distinctly stand-out due to binocular rivalry/lustre. Here, we had a total of 100 visually normal adult (18-28 years of age) volunteers play this game in the traditional non-fusion mode and after cross-fusion of the companion images using a hand-held mirror stereoscope. The results demonstrate that the fusion mode significantly speeds up gameplay and reduces errors, relative to the non-fusion mode, for a range of target sizes, contrasts, and chromaticity tested (all, p<0.001). Amongst the three types of local feature differences available in these images (polarity difference, presence/absence of a local feature difference and shape difference in a local feature difference), features containing polarity difference was identified as first in ~60-70% of instances in both modes of gameplay (p<0.01), with this proportion being larger in the fusion than in the non-fusion mode. The binocular fusion advantage is lost when the lustre cue is purposefully weakened through alterations in target luminance polarity. The spot-the-difference game may thus be cheated using binocular fusion and the differences readily identified through a vivid experience of binocular rivalry/lustre.

Disparity in Context: Understanding how monocular image content interacts with disparity processing in human visual cortex.

Horizontal disparities between the two eyes' retinal images are the primary cue for depth. Commonly used random ot tereograms (RDS) intentionally camouflage the disparity cue, breaking the correlations between monocular image structure and the depth map that are present in natural images. Because of the nonlinear nature of visual processing, it is unlikely that simple computational rules derived from RDS will be sufficient to explain binocular vision in natural environments. In order to understand the interplay between natural scene structure and disparity encoding, we used a depth-image-based-rendering technique and a library of natural 3D stereo pairs to synthesize two novel stereogram types in which monocular scene content was manipulated independent of scene depth information. The half-images of the novel stereograms comprised either random-dots or scrambled natural scenes, each with the same depth maps as the corresponding natural scene stereograms. Using these stereograms in a simultaneous Event-Related Potential and behavioral discrimination task, we identified multiple disparity-contingent encoding stages between 100 ~ 500 msec. The first disparity sensitive evoked potential was observed at ~100 msec after an earlier evoked potential (between ~50-100 msec) that was sensitive to the structure of the monocular half-images but blind to disparity. Starting at ~150 msec, disparity responses were stereogram-specific and predictive of perceptual depth. Complex features associated with natural scene content are thus at least partially coded prior to disparity information, but these features and possibly others associated with natural scene content interact with disparity information only after an intermediate, 2D scene-independent disparity processing stage.

Visual cortex cTBS increases mixed percept duration while a-tDCS has no effect on binocular rivalry.

Neuromodulation of the primary visual cortex using anodal transcranial direct current stimulation (a-tDCS) can alter visual perception and enhance neuroplasticity. However, the mechanisms that underpin these effects are currently unknown. When applied to the motor cortex, a-tDCS reduces the concentration of the inhibitory neurotransmitter gamma aminobutyric acid (GABA), an effect that has been linked to increased neuroplasticity. The aim of this study was to assess whether a-tDCS also reduces GABA-mediated inhibition when applied to the human visual cortex. Changes in visual cortex inhibition were measured using the mixed percept duration in binocular rivalry. Binocular rivalry mixed percept duration has recently been advocated as a direct and sensitive measure of visual cortex inhibition whereby GABA agonists decrease mixed percept durations and agonists of the excitatory neurotransmitter acetylcholine (ACH) increase them. Our hypothesis was that visual cortex a-tDCS would increase mixed percept duration by reducing GABA-mediated inhibition and increasing cortical excitation. In addition, we measured the effect of continuous theta-burst transcranial magnetic stimulation (cTBS) of the visual cortex on binocular rivalry dynamics. When applied to the motor or visual cortex, cTBS increases GABA concentration and we therefore hypothesized that visual cortex cTBS would decrease the mixed percept duration. Binocular rivalry dynamics were recorded before and after active and sham a-tDCS (N = 15) or cTBS (N = 15). Contrary to our hypotheses, a-tDCS had no effect, whereas cTBS increased mixed percepts during rivalry. These results suggest that the neurochemical mechanisms of a-tDCS may differ between the motor and visual cortices.

Specialized contributions of mid-tier stages of dorsal and ventral pathways to stereoscopic processing in macaque.

The division of labor between the dorsal and ventral visual pathways has been well studied, but not often with direct comparison at the single-neuron resolution with matched stimuli. Here we directly compared how single neurons in MT and V4, mid-tier areas of the two pathways, process binocular disparity, a powerful cue for 3D perception and actions. We found that MT neurons transmitted disparity signals more quickly and robustly, whereas V4 or its upstream neurons transformed the signals into sophisticated representations more prominently. Therefore, signaling speed and robustness were traded for transformation between the dorsal and ventral pathways. The key factor in this tradeoff was disparity-tuning shape: V4 neurons had more even-symmetric tuning than MT neurons. Moreover, the tuning symmetry predicted the degree of signal transformation across neurons similarly within each area, implying a general role of tuning symmetry in the stereoscopic processing by the two pathways.

Exploitation of image statistics with sparse coding in the case of stereo vision.

The sparse coding algorithm has served as a model for early processing in mammalian vision. It has been assumed that the brain uses sparse coding to exploit statistical properties of the sensory stream. We hypothesize that sparse coding discovers patterns from the data set, which can be used to estimate a set of stimulus parameters by simple readout. In this study, we chose a model of stereo vision to test our hypothesis. We used the Locally Competitive Algorithm (LCA), followed by a naïve Bayes classifier, to infer stereo disparity. From the results we report three observations. First, disparity inference was successful with this naturalistic processing pipeline. Second, an expanded, highly redundant representation is required to robustly identify the input patterns. Third, the inference error can be predicted from the number of active coefficients in the LCA representation. We conclude that sparse coding can generate a suitable general representation for subsequent inference tasks.

The relationship between reflex eye realignment and the percept of single vision in young children.

Effective binocular vision is dependent on both motor and perceptual function. Young children undergo development of both components while interacting with their dynamic three-dimensional environment. When this development fails, eye misalignment and double vision may result. We compared the range of image disparities over which young children display reflex motor realignment of their eyes with the range over which they report a single versus double percept. In response to step changes in the disparity of a 2.2° wide stimulus, 5-year-olds generated an adult-like reflex vergence velocity tuning function peaking at 2° of disparity, with a mean latency of 210 ms. On average, they reported double vision for stimulus disparities of 3° and larger, compared to 1° in adult reports. Three-year-olds also generated reflex vergence tuning functions peaking at approximately 2° of disparity, but their percepts could not be assessed. These data suggest that, by age 5, reflex eye realignment responses and percepts driven by these brief stimuli are tightly coordinated in space and time to permit robust binocular function around the point of fixation. Importantly, the plastic neural processes maintaining this tight coordination during growth control the stability of visual information driving learning during childhood.

Conflict defined by global gestalt can modulate binocular rivalry suppression.

Binocular rivalry suppression is thought to necessarily require local interocular conflict: the presence of incompatible image elements, such as orthogonal contours, in retinally corresponding regions of two monocular displays. Whether suppression can also be driven by conflict at the level of spatially nonlocal surface or object representations is unclear. Here, we kept local contour conflict constant while varying global conflict, defined by the gestalt formed by the two monocular displays. Specifically, each eye was presented with a grid of image elements (crosses or plusses), placed such that the two eyes' individual grid elements did not directly overlap but the grids as a whole did. In a "shared motion" condition, all elements moved in unison, inviting a gestalt made up of all elements across both eyes; in a "different motions" condition, the elements' trajectories differed between eyes, inviting a gestalt of two overlapping surfaces, each associated with one eye. Perceptual disappearances of image elements occurred more readily in the different motions condition, an observation that could not be explained by any between-condition differences in local contour conflict. In a second experiment, we furthermore established that, whereas perceptual disappearances in the shared motion condition tended to involve a single element at a time, in the different motions condition, multiple elements belonging to the same gestalt often disappeared together. These findings indicate that, even though binocular rivalry may critically rely on inhibition due to locally incompatible image elements, this inhibition also depends on the global gestalt to which these elements contribute.

Perceptual enhancement of suprathreshold luminance modulation in stereoscopic patterns.

Previous studies have shown that the binocular summation of luminance contrast signals depends on the parameters involved in stereopsis when the luminance contrast is at the detection threshold. However, less attention has been paid to the perception of luminance modulation in stereoscopic patterns at suprathreshold contrast. To address this issue, we determined the contrast of stereoscopic patterns at the perceptual match to a standard contrast as a function of binocular disparity. The matched contrast was close to the standard contrast at 0 degrees disparity, but decreased as disparity deviated from 0 degrees, suggesting that sufficient disparity perceptually enhances luminance contrast. The reduction of matched contrast was more evident for uncrossed disparities than for crossed disparities, which almost disappeared when the contrast was near the threshold and also occurred when vertical disparity was introduced. We argue that the perceptual enhancement of the luminance contrast is due to the weaker interocular suppression for stimuli with large disparities.

Disparity Sensitivity and Binocular Integration in Mouse Visual Cortex Areas.

Binocular disparity, the difference between the two eyes' images, is a powerful cue to generate the 3D depth percept known as stereopsis. In primates, binocular disparity is processed in multiple areas of the visual cortex, with distinct contributions of higher areas to specific aspects of depth perception. Mice, too, can perceive stereoscopic depth, and neurons in primary visual cortex (V1) and higher-order, lateromedial (LM) and rostrolateral (RL) areas were found to be sensitive to binocular disparity. A detailed characterization of disparity tuning across mouse visual areas is lacking, however, and acquiring such data might help clarifying the role of higher areas for disparity processing and establishing putative functional correspondences to primate areas. We used two-photon calcium imaging in female mice to characterize the disparity tuning properties of neurons in visual areas V1, LM, and RL in response to dichoptically presented binocular gratings, as well as random dot correlograms (RDC). In all three areas, many neurons were tuned to disparity, showing strong response facilitation or suppression at optimal or null disparity, respectively, even in neurons classified as monocular by conventional ocular dominance (OD) measurements. Neurons in higher areas exhibited broader and more asymmetric disparity tuning curves compared with V1, as observed in primate visual cortex. Finally, we probed neurons' sensitivity to true stereo correspondence by comparing responses to correlated RDC (cRDC) and anticorrelated RDC (aRDC). Area LM, akin to primate ventral visual stream areas, showed higher selectivity for correlated stimuli and reduced anticorrelated responses, indicating higher-level disparity processing in LM compared with V1 and RL.SIGNIFICANCE STATEMENT A major cue for inferring 3D depth is disparity between the two eyes' images. Investigating how binocular disparity is processed in the mouse visual system will not only help delineating the role of mouse higher areas for visual processing, but also shed light on how the mammalian brain computes stereopsis. We found that binocular integration is a prominent feature of mouse visual cortex, as many neurons are selectively and strongly modulated by binocular disparity. Comparison of responses to correlated and anticorrelated random dot correlograms (RDC) revealed that lateromedial area (LM) is more selective to correlated stimuli, while less sensitive to anticorrelated stimuli compared with primary visual cortex (V1) and rostrolateral area (RL), suggesting higher-level disparity processing in LM, resembling primate ventral visual stream areas.

Optokinetic stimulation induces vertical vergence, possibly through a non-visual pathway.

Vertical vergence is generally associated with one of three mechanisms: vestibular activation during a head tilt, induced by vertical visual disparity, or as a by-product of ocular torsion. However, vertical vergence can also be induced by seemingly unrelated visual conditions, such as optokinetic rotations. This study aims to investigate the effect of vision on this latter form of vertical vergence. Eight subjects (4m/4f) viewed a visual scene in head erect position in two different viewing conditions (monocular and binocular). The scene, containing white lines angled at 45° against a black background, was projected at an eye-screen distance of 2 m, and rotated 28° at an acceleration of 56°/s2. Eye movements were recorded using a Chronos Eye-Tracker, and eye occlusions were carried out by placing an infrared-translucent cover in front of the left eye during monocular viewing. Results revealed vergence amplitudes during binocular viewing to be significantly lower than those seen for monocular conditions (p = 0.003), while torsion remained unaffected. This indicates that vertical vergence to optokinetic stimulation, though visually induced, is visually suppressed during binocular viewing. Considering that vertical vergence is generally viewed as a vestibular signal, the findings may reflect a visually induced activation of a vestibular pathway.

Natural statistics of depth edges modulate perceptual stability.

Binocular fusion relies on matching points in the two eyes that correspond to the same physical feature in the world; however, not all world features are binocularly visible. Near depth edges, some regions of a scene are often visible to only one eye (so-called half occlusions). Accurate detection of these monocularly visible regions is likely to be important for stable visual perception. If monocular regions are not detected as such, the visual system may attempt to binocularly fuse non-corresponding points, which can result in unstable percepts. We investigated the hypothesis that the visual system capitalizes on statistical regularities associated with depth edges in natural scenes to aid binocular fusion and facilitate perceptual stability. By sampling from a large set of stereoscopic natural images with co-registered distance information, we found evidence that monocularly visible regions near depth edges primarily result from background occlusions. Accordingly, monocular regions tended to be more visually similar to the adjacent binocularly visible background region than to the adjacent binocularly visible foreground. Consistent with our hypothesis, perceptual experiments showed that perception tended to be more stable when the image properties of the depth edge were statistically more likely given the probability of occurrence in natural scenes (i.e., when monocular regions were more visually similar to the binocular background). The generality of these results was supported by a parametric study with simulated environments. Exploiting regularities in natural environments may allow the visual system to facilitate fusion and perceptual stability when both binocular and monocular regions are visible.