Linear filtering precedes nonlinear processing in early vision.

BACKGROUND: Nonlinearities play a significant role in early visual processing. They are central to the perception of spatial contrast variations, multiplicative transparencies and texture boundaries. This article concerns the stage of processing at which nonlinearities first become significant. RESULTS: Subjects were adapted to a high contrast sinusoidal grating followed by a brief presentation of a contrast modulated test (plaid) pattern. Thresholds for the detection of the contrast modulation (the beat) were measured. Results show that threshold elevation is greatest when the orientation and spatial frequency of the adapting grating are close to the principal Fourier frequency (the carrier) of the test pattern. Adaptation to sinewave-gratings near the frequency of the contrast modulation has relatively little effect. The data also show that the processing of contrast is frequency selective, with a peak tuning frequency near 0.4 cycles per degree. CONCLUSIONS: The data are consistent with a model in which the contrast beats are processed in a frequency-specific manner, after an initial stage of frequency-specific and orientation-specific linear filtering.

Disparity-defined objects moving in depth do not elicit three-dimensional shape constancy.

Observers generally fail to recover three-dimensional shape accurately from binocular disparity. Typically, depth is overestimated at near distances and underestimated at far distances [Johnston, E. B. (1991). Systematic distortions of shape from stereopsis. Vision Research, 31, 1351-1360]. A simple prediction from this is that disparity-defined objects should appear to expand in depth when moving towards the observer, and compress in depth when moving away. However, additional information is provided when an object moves from which 3D Euclidean shape can be recovered, be this through the addition of structure from motion information [Richards, W. (1985). Structure from stereo and motion. Journal of the Optical Society of America A, 2, 343-349], or the use of non-generic strategies [Todd, J. T., & Norman, J. F. (2003). The visual perception of 3-D shape from multiple cues: Are observers capable of perceiving metric structure? Perception and Psychophysics, 65, 31-47]. Here, we investigated shape constancy for objects moving in depth. We found that to be perceived as constant in shape, objects needed to contract in depth when moving toward the observer, and expand in depth when moving away, countering the effects of incorrect distance scaling (Johnston, 1991). This is a striking example of the failure of shape constancy, but one that is predicted if observers neither accurately estimate object distance in order to recover Euclidean shape, nor are able to base their responses on a simpler processing strategy.

Linear and nonlinear transparencies in binocular vision.

When the product of a vertical square-wave grating (contrast envelope) and a horizontal sinusoidal grating (carrier) are viewed binocularly with different disparity cues they can be perceived transparently at different depths. We found, however, that the transparency was asymmetric; it only occurred when the envelope was perceived to be the overlaying surface. When the same two signals were added, the percept of transparency was symmetrical; either signal could be seen in front of or behind the other at different depths. Differences between these multiplicative and additive signal combinations were examined in two experiments. In one, we measured disparity thresholds for transparency as a function of the spatial frequency of the envelope. In the other, we measured disparity discrimination thresholds. In both experiments the thresholds for the multiplicative condition, unlike the additive condition, showed distinct minima at low envelope frequencies. The different sensitivity curves found for multiplicative and additive signal combinations suggest that different processes mediated the disparity signal. The data are consistent with a two-channel model of binocular matching, with multiple depth cues represented at single retinal locations.

Cue combination in the motion correspondence problem.

Image motion is a primary source of visual information about the world. However, before this information can be used the visual system must determine the spatio-temporal displacements of the features in the dynamic retinal image, which originate from objects moving in space. This is known as the motion correspondence problem. We investigated whether cross-cue matching constraints contribute to the solution of this problem, which would be consistent with physiological reports that many directionally selective cells in the visual cortex also respond to additional visual cues. We measured the maximum displacement limit (Dmax) for two-frame apparent motion sequences. Dmax increases as the number of elements in such sequences decreases. However, in our displays the total number of elements was kept constant while the number of a subset of elements, defined by a difference in contrast polarity, binocular disparity or colour, was varied. Dmax increased as the number of elements distinguished by a particular cue was decreased. Dmax was affected by contrast polarity for all observers, but only some observers were influenced by binocular disparity and others by colour information. These results demonstrate that the human visual system exploits local, cross-cue matching constraints in the solution of the motion correspondence problem.

Plaid slant and inclination thresholds can be predicted from components.

We investigated whether stereoscopic slant and inclination thresholds for surfaces defined by two component plaids could be predicted from the interocular differences in their individual component gratings. Thresholds were measured for binocular images defined by single sinusoidal gratings and two component plaids. In both cases thresholds showed a marked dependence on component orientation. For absolute component orientations greater than 45 deg we found that inclination thresholds were smaller than slant thresholds. However, for absolute component orientations less than 45 deg, we found a reversal: slant thresholds were smaller than inclination thresholds. We considered three models that might account for these data. One assumed that thresholds stemmed from interocular position differences of corresponding image points. The other two assumed a combination of position, orientation and/or spatial-frequency differences. The best fits were obtained from those models that explicitly represented orientation differences. From the model combining orientation and spatial-frequency differences, we estimated the relative cue sensitivity to be 1.7:1, respectively. For plaids, we found that thresholds obtained from the individual components could be used to predict thresholds for plaids, even though an additional disparity cue from the contrast beat was available.

Global motion processing is not tuned for binocular disparity.

An important goal of the visual system is the segmentation of image features into objects and their backgrounds. A primary cue for this is motion: when a region shares the same pattern of motion it is segregated from its surround. Three experiments were carried out to investigate whether the segmentation of image features on the basis of motion information is facilitated by the addition of binocular disparity. Coherence thresholds were measured for the discrimination of the global direction of motion of random dot kinematograms (RDKs) in which the relative disparity of the signal and noise dots was manipulated. When the signal dots were embedded in a three dimensional cloud of noise dots, coherence thresholds were similar to those measured when signal and noise dots were both presented with zero disparity. However, when the signal dots were separated from the noise dots in depth, global motion processing was strongly facilitated. These results were considered in terms of two models, one in which global motion is processed by disparity tuned mechanisms, the other in which the discrimination of the direction of motion is mediated by an attention-based system. It was concluded that global motion processing is not tuned for binocular disparity and that the facilitation of the discrimination of direction provided by binocular disparity in certain circumstances reflects the rôle of an attention-based system.

Stereopsis from contrast envelopes.

We report two experiments concerning the site of the principal nonlinearity in second-order stereopsis. The first exploits the asymmetry in perceiving transparency with second-order stimuli found by Langley et al. (1998) (Proceedings of the Royal Society of London B, 265, 1837-1845) i.e. the product of a positive-valued contrast envelope and a mean-zero carrier grating can be seen transparently only when the disparities are consistent with the envelope appearing in front of the carrier. We measured the energy at the envelope frequencies that must be added in order to negate this asymmetry. We report that this amplitude can be predicted from the envelope sidebands and not from the magnitude of compressive pre-cortical nonlinearities measured by other researchers. In the second experiment, contrast threshold elevations were measured for the discrimination of envelope disparities following adaptation to sinusoidal gratings. It is reported that perception of the envelope's depth was affected most when the adapting grating was similar (in orientation and frequency) to the carrier, rather than to the contrast envelope. These results suggest that the principal nonlinearity in second-order stereopsis is cortical, occurring after orientation- and frequency-selective linear filtering.

Contextual effects on perceived three-dimensional shape.

Binocular disparity is a powerful cue for the perception of depth. The accuracy with which observers can judge depth from disparity can, however, be very poor. This has been attributed to difficulties associated with the scaling of disparity to take account of distance (Johnston, 1991). We test potential strategies that could be used to improve this scaling. Using the depth-to-width ratio task introduced by Bradshaw, Parton, and Eagle (1998), observers adjusted a depth interval to match the vertical distance between two points. The first experiment examined the effect of placing additional visual stimuli between the observer and the target. Despite the potential of these stimuli to provide reliable distance information, the accuracy of depth settings did not change. The second experiment demonstrated that the degree of binocular correlation present in natural images provides useful distance information, and investigated whether this is used by observers in scaling disparity. To do this, we measured whether varying the magnitude of relative disparity presented in the surround of the target affected depth settings. No such effect was observed. We conclude that the effect of information presented in the surrounding context on settings of depth is limited to those situations in which it provides direct information about the distance to the target.

Does binocular disparity facilitate the detection of transparent motion?

Recent physiological studies have established that cortical cells that are tuned for the direction of motion may also exhibit tuning for binocular disparity. This tuning does not appear to provide any advantage in discriminating the direction of global motion in random-dot kinematograms. Here we investigated the possibility that this tuning may be important in the perception of transparent motion. Random-dot kinematograms were presented which contained coherent motion in a single direction or in two opposing directions. A greater proportion of signal dots was required for the detection of transparent motion than of motion in a single direction. This difference vanished when the two opposite directions of motion were presented with different disparities. These results suggest that the direction of global motion can be computed separately for surfaces which are clearly segregated in depth.

Visual processing and dyslexia.

Magnocellular-pathway deficits have been hypothesized to be responsible for the problems experienced by dyslexic individuals in reading. However, research has yet to provide a detailed account of the consequences of these deficits or to identify the behavioural link between them and reading disabilities. The aim of the present study was to determine the potential consequences of the magnocellular-pathway deficits for dyslexics in a comprehensive range of visual tasks. Dyslexics and nondyslexics were compared on their ability to (i) perform vernier-acuity and orientation-acuity tasks; (ii) perceive motion by using a range of measures common in the psychophysical literature (Dmin, Dmax, and global coherence); and (iii) perceive shapes presented in random-dot stereograms at a range of disparity pedestals, thereby dissociating stereopsis from vergence control. The results indicated no significant differences in performance between the dyslexic and nondyslexic subjects in terms of the visual-acuity measures. In general, dyslexics performed relatively poorly on measures of motion perception and stereopsis, although when considered individually some of the dyslexics performed better than some of the controls. The poor performance of the dyslexics in the stereo-gram tasks was attributable to a subgroup of dyslexics who also appeared to have severe difficulty with the motion-coherence task. These data are consistent with previous evidence that some dyslexics may have deficits within the magnocellular visual pathway.