Visual search for motion-in-depth: stereomotion does not 'pop out' from disparity noise.

In a visual search task, targets defined by motion or binocular disparity stand out effortlessly from stationary distractors ('pop-out'), suggesting that target and distractors are processed by different neural mechanisms. We used pop-out to explore whether motion directly toward or away from the observer (z-motion) is detected using binocular motion cues. A target moving laterally (x-motion) popped out amid stationary distractors with binocular disparity, but z-motion did not pop out. However, a small x-motion added to the target's z-motion caused it to pop out. We therefore suggest that the visual system may not be specifically sensitive to binocular motion differences.

The human visual system averages speed information.

It has been known for many years that human observers are unable to detect modest accelerations and decelerations in moving visual stimuli. We find that human observers can integrate speeds over many dots, moving at different speeds, producing a global speed percept analogous to the global direction percept first reported by Williams, D. W. and Sekuler, R. (1984, Vision Research, 24, 55-62). We measured speed discrimination for random dot stimuli which contained many different speeds. Our results show that observers always base their discrimination on the mean speed of the stimulus; changes in other stimulus characteristics (e.g. mode) are not detected. Moreover, discrimination thresholds for the global mean speed derived from many different speeds are comparable to those obtained with stimuli in which all dots move at the same speed suggesting that the internal noise associated with the encoding of speed information is quite high.

Temporal and spatial integration in dynamic random-dot stimuli.

Random-dot cinematograms comprising many different, spatially intermingled local motion vectors can produce a percept of global coherent motion in a single direction. Thresholds for discriminating the direction of global motion were measured under various conditions. Discrimination thresholds increased with the width of the distribution of directions in the cinematogram. Thresholds decreased as the duration of area of the cinematogram increased. Temporal integration for global direction discrimination extends over about 465 msec (9.3 frames) while the spatial integration limit is at least as large as 63 deg2 (circular aperture diameter = 9 deg). The large spatial integration area is consistent with the physiology of higher visual areas such as MT and MST.

Poor speed discrimination suggests that there is no specialized speed mechanism for cyclopean motion.

Luminance-defined and stereo-defined (cyclopean) motion share some common properties, suggesting that the two forms of motion may be detected by similar mechanisms. For luminance-defined motion there are at least two levels of processing: direction is detected and then speed is thought to be extracted by a specialized processing mechanism at a higher level. Here, we tested whether there is also a specialized speed processing mechanism for stereo-defined motion. Speed discrimination thresholds were compared for stimuli containing only stereo-defined motion, and stimuli that contained both stereo-defined and luminance-defined motion. When the stimulus contained luminance-defined motion, increment thresholds were around 0.05-0.1. For stereo-defined motion, increment thresholds were never better than 0.3. By careful analysis, it was possible to test what cues were being used to solve the speed discrimination task. Results were consistent with observers responding to distance cues rather than to speed for stereo-defined motion, suggesting that there is no specialized mechanism for processing the speed of stereo-defined motion.

Evidence for two speed signals: a coarse local signal for segregation and a precise global signal for discrimination.

In calculating the precise speed of an object, the visual system must integrate motion measurements across time and space while keeping motion measurements from different objects separate. We examined whether an initial coarse estimate of local speed may be used to segregate the motions of different objects prior to a precise calculation of object speed. Our stimuli consisted of 256 dots that moved upward at two speeds. In Expt 1, each dot alternated between the two speeds every 133 msec. When the speed alternations were asynchronous across dots, subject saw two transparent surfaces moving at different speeds and their ability to discriminate changes in the slow speed were unaffected by the presence of the fast speed. This experiment suggests that before integration, motion measurements may be segregated according to speed. We sought more conclusive evidence for this claim in Expts 2 and 3. In Expt 2, dots with 33 msec lifetimes were used to generate the two speeds. Although individual dots permitted only crude speed discrimination, subjects perceived this stimulus as two surfaces moving at different speeds and they precisely judged the slower speed. Apparently, the coarse local signals generated by the slow dots were segregated from those of the fast dots and then separately integrated to produce a precise speed signal. In Expt 3, the dots again moved at two speeds, but each speed was generated by a range of spatial and temporal displacements. Once more, subjects saw two surfaces and precisely judged the speed of the slower surface, demonstrating that segregation may be based solely on differences in local speed.(ABSTRACT TRUNCATED AT 250 WORDS)

Speed discrimination of motion-in-depth using binocular cues.

Although it is well known that motion-in-depth can be detected using binocular cues, it is not known whether those cues can be used to judge the speed of an object moving in depth. There are at least two possible binocular cues that could be used by the visual system to calculate three dimensional (3-D) speed: the rate of change of binocular disparity, or a comparison of the speeds of motion in the two eyes. We tested which of these cues is used to discriminate the speed of motion-in-depth. First, speed discrimination was measured for a dot moving away from the observer in depth (along the z-axis) and for a random dot stereogram in which a central square moved away from the observer in depth. These stimuli contained both disparity and monocular motion cues. Speed discrimination thresholds were as good for 3-D motion as for monocular sideways motion. Second, a dynamic random dot stereogram (in which the random dot pattern was replaced by a new dot pattern every frame) was used to remove consistent monocular cues. 3-D speed discrimination was now very poor, suggesting that the rate of change of disparity is not a good cue for 3-D speed. Finally, we tested whether observers were able to use the monocular motion cue from one eye to perform the speed discrimination task, or whether there had to be a comparison of the two eyes' monocular cues. By adding a small x-axis velocity component (with random direction) to the z-axis motion, it was possible to disrupt the monocular motion signals without altering the speed of the motion in 3-D. This manipulation did not disrupt the observers' performance, suggesting that monocular speed cues were not being used independently but that there was a comparison of monocular motion signals from the two eyes.

Human smooth pursuit direction discrimination.

The smooth pursuit system is usually studied using single moving objects as stimuli. However, the visual motion system can respond to stimuli that must be integrated spatially and temporally (Williams DG, Sekuler R. Vision Res 1984;24:55-62; Watamaniuk SNJ, Sekuler R, Williams DW. Vision Res 1989;29:47-59). For example, when each dot of a random-dot cinematogram (RDC) is assigned a new direction of motion each frame from a narrow distribution of directions, the whole field of dots appears to move in the average direction (Williams and Sekuler, 1984). We measured smooth pursuit eye movements generated in response to small (10 deg diameter) RDCs composed of 250 dynamic random dots. Smooth eye movements were assessed by analyzing only the first 130 ms of eye movements after pursuit initiation (open-loop period). Comparing smooth eye movements to RDCs and single spot targets, we find that both targets generate similar responses confirming that the signal supplied to the smooth pursuit system can result from a spatial integration of motion information. In addition, the change in directional precision of smooth eye movements to RDCs with different amounts of directional noise was similar to that found for psychophysical direction discrimination. These results imply that the motion processing system responsible for psychophysical performance may also provide input to the oculomotor system.

Spatial integration in human smooth pursuit.

When viewing a moving object, details may appear blurred if the object's motion is not compensated for by the eyes. Smooth pursuit is a voluntary eye movement that is used to stabilize a moving object. Most studies of smooth pursuit have used small, foveal targets as stimuli (e.g. Lisberger SG and Westbrook LE. J Neurosci 1985;5:1662-1673.). However, in the laboratory, smooth pursuit is poorer when a small object is tracked across a background, presumably due to a conflict between the primitive optokinetic reflex and smooth pursuit. Functionally, this could occur if the motion signal arising from the target and its surroundings were averaged, resulting in a smaller net motion signal. We asked if the smooth pursuit system could spatially summate coherent motion, i.e. if its response would improve when motion in the peripheral retina was in the same direction as motion in the fovea. Observers tracked random-dot cinematograms (RDC) which were devoid of consistent position cues to isolate the motion response. Either the height or the density of the display was systematically varied. Eye speed at the end of the open-loop period was greater for cinematograms than for a single spot. In addition, eye acceleration increased and latency decreased as the size of the aperture increased. Changes in the density produced similar but smaller effects on both acceleration and latency. The improved pursuit for larger motion stimuli suggests that neuronal mechanisms subserving smooth pursuit spatially average motion information to obtain a stronger motion signal.

Direction perception in complex dynamic displays: the integration of direction information.

We created random-dot cinematograms in which each dot's successive movements were independently drawn from a Gaussian distribution of directions of some characteristic bandwidth. Such a display, comprising many different, spatially intermingled local motion vectors, can produce a percept of global coherent motion in a single direction. Using pairs of cinematograms, direction discrimination of global motion was measured under various conditions of direction distribution bandwidth, exposure duration, and constancy of each dot's path. A line-element model gave an excellent account of the results: (i) over a considerable range, discrimination was unaffected by the cinematogram's direction distribution bandwidth; (ii) only for the briefest presentations did changes in duration have an effect; (iii) so long as the overall directional content of the cinematogram remained unchanged, the constancy or randomness of individual dots' paths did not affect discrimination. Finally, the line-element model continued to give a good account of the results when we made additional measurements with uniform rather than Gaussian distributions of directions.

The use of an implicit standard for measuring discrimination thresholds.

We measured thresholds for comparing the separation between lines, using either the method of constant stimuli (MCS) or the method of single stimuli (MSS). In the MCS an explicit standard is presented on each trial, whereas in the MSS the standard is the mean of the set. The thresholds for the MSS procedure were nearly identical to those with the MCS procedure, whether or not feedback was used. A statistical model is presented showing how the threshold error estimated by MSS varies according to the number of past stimuli used by the observer to calculate the mean of the set. If the model is an accurate representation of human processing, our observers were averaging over the last 10-20 trials to estimate the implicit standard. Our results show that the explicit standard in the MCS procedure is generally superfluous. Provided that the test range is small, and that the observer is given some practice trials, thresholds measured with MSS procedure are just as precise as those measured with the traditional MCS procedure.

Dependence of speed and direction perception on cinematogram dot density.

In the present experiments, we find that with abrupt decreases in dot density of random-dot cinematograms, perceived speed decreases, while with abrupt increases in dot density, perceived speed increases. Further, in steady-state conditions, perceived speed is also affected in the same way, but to a lesser degree, by the dot density of cinematograms. Direction discrimination of random-dot cinematograms is enhanced when dot density increases abruptly from one stimulus to the next, but is degraded when dot density decreases abruptly. Finally, speed discrimination remains constant even when density changes abruptly. The perceived-speed and direction-discrimination data are consistent with the Motion Coherence theory which motivated this study, and with models that include a smoothing stage similar to this theory. Of the other models that we consider, most predict that increasing dot density reduces perceived speed. The speed-discrimination data could not distinguish between the different theories.

Detecting a trajectory embedded in random-direction motion noise.

Human observers can easily detect a signal dot moving, in apparent motion, on a trajectory embedded in a background of random-direction motion noise. A high detection rate is possible even though the spatial and temporal characteristics (step size and frame rate) of the signal are identical to the noise, making the signal indistinguishable from the noise on the basis of a single pair of frames. The success rate for detecting the signal dot was as high as 90% when the probability of mismatch from frame-to-frame, based on nearest-neighbor matching, was 0.3. Control experiments showed that trajectory detection is not based on detecting a "string" of collinear dots, i.e. a stationary position cue. Nor is a trajectory detected because it produces stronger signals in single independent motion detectors. For one thing, trajectory detection improves with increases in duration, up to 250-400 msec, a duration longer than the integration typically associated with a single motion detector. For another, the signal dot need not travel in a straight line to be detectable. The signal dot was as reliably detected when it changed its direction a small amount (about 30 deg or less) each frame. Consistent with this, circular paths of sufficiently low curvature were as detectable as straight trajectories. Our data suggest that trajectory motion is highly detectable in motion noise because the component local motion signals are enhanced when motion detectors with similar directional tuning are stimulated in a sequence along their preferred direction.

Local motion detectors cannot account for the detectability of an extended trajectory in noise.

Previous work has shown that a single dot moving in a consistent direction is easily detected among noise dots in Brownian motion (Watamaniuk et al., Vis Res 1995;35:65-77). In this study we calculated the predictions of a commonly-used psychophysical motion model for a motion trajectory in noise. This model assumes local motion energy detectors optimally tuned to the signal, followed by a decision stage that implements the maximum rule. We first show that local motion detectors do indeed explain the detectability of brief trajectories (100 ms) that fall within a single unit, but that they severely underestimate the detectability of extended trajectories that span multiple units. For instance, a 200 ms trajectory is approximately three times more detectable than two isolated 100 ms trajectories presented together within an equivalent temporal interval. This result suggests a nonlinear interaction among local motion units. This interaction is not restricted to linear trajectories because circular trajectories with curvatures larger than 1 degree are almost as detectable as linear trajectories. Our data are consistent with a flexible network that feeds forward excitation among units tuned to similar directions of motion.

Temporal coherence theory for the detection and measurement of visual motion.

A recent challenge to the completeness of some influential models of local-motion detection has come from experiments in which subjects had to detect a single dot moving along a trajectory amidst noise dots undergoing Brownian motion. We propose and test a new theory of the detection and measurement of visual motion, which can account for these signal-in-Brownian-noise experiments. The theory postulates that the signals from local-motion detectors are made coherent in space and time by a special purpose network, and that this coherence boosts signals of features moving along non-random trajectories over time. Two experiments were performed to estimate parameters and test the theory. These experiments showed that detection is impaired with increasing eccentricity, an effect that varies inversely with step size. They also showed that detection improves over durations extending to at least 600 msec. An implementation of the theory accounts for these psychophysical detection measurements.

Is stereopsis effective in breaking camouflage for moving targets?

It has been suggested that breaking camouflage is one of the major functions of stereopsis (Julesz, 1971). In this study, we found that stereopsis is less effective in breaking camouflage for moving targets than for static ones. Observers were asked to detect a single dot moving on a straight trajectory amidst identical noise dots in random motion. In the three-dimensional (3D) condition, the noise dots filled a cylindrical volume 5.7 cm in height and diameter; the trajectory signal dot moved on an oblique 3D trajectory through the center of the cylinder. In the two-dimensional (2D) control condition, observers viewed one half-image of the 3D cylinder binocularly. Surprisingly, trajectory detection in the 3D condition was only slightly better than in the 2D condition. Stereoscopic tuning for motion detection was also measured with a novel target configuration in which the random motion noise was presented in two depth planes that straddled the fixation plane where the trajectory target was presented. As the disparity between the noise planes and the fixation plane was increased, trajectory detection improved, reaching a peak between 6 and 12 arcmin, and then declining to the 2D level at larger disparities, where the noise became diplopic. Similar tuning measurements were made for detecting a static pattern, a string of five aligned dots presented in the fixation plane between two planes of static noise dots. Adding disparity to the noise planes produced a far greater improvement in static detection than in motion detection, for a comparable range of disparities (1.5-12 arcmin). We speculate that the temporal characteristics of the stereo system are not well suited for responding to moving targets, with the result that stereo does not greatly enhance motion detection in noise.

Visible persistence is reduced by fixed-trajectory motion but not by random motion.

Despite the sluggish temporal response of the human visual system, moving objects appear clear and without blur, which suggests that visible persistence is reduced when objects move. It has been argued that spatiotemporal proximity alone can account for this modulation of visible persistence and that activation of a motion mechanism per se is not necessary. Experiments are reported which demonstrate that there is a motion-specific influence on visible persistence. Specifically, points moving in constant directions, or fixed trajectories, show less persistence than points moving with the same spatial and temporal displacements but taking random walks, randomly changing direction each frame. Subjects estimated the number of points present in the display for these two types of motion conditions. Under conditions chosen to produce 'good' apparent motion, ie small temporal and spatial increments, the apparent number of points for the fixed-trajectory condition was significantly lower than the apparent number in the random-walk condition. The traditional explanation of the suppression of persistence based on the spatiotemporal proximity of objects cannot account for these results. The enhanced suppression of persistence observed for a target moving in a consistent direction depends upon the activation of a directionally tuned motion mechanism extended over space and time.

Ideal observer for discrimination of the global direction of dynamic random-dot stimuli.

Random-dot cinematograms in which each dot's successive movements are randomly drawn from a Gaussian distribution of directions can produce a percept of global coherent motion in a single direction. Discrimination of global direction was measured for various exposure durations, stimulus areas, and dot densities and bandwidths of the distribution of directions. Increasing the duration produced a greater improvement in performance than did increasing either the area or the density. Performance decreased as the distribution bandwidth increased. An ideal-observer model was developed, and the absolute efficiency for human direction discrimination was evaluated. Efficiencies were highest at large distribution bandwidths, with average efficiencies reaching 35%. A local-global noise model of direction discrimination, based on the ideal-observer model, containing a spatial and temporal integration limit as well as internal noise, was found to fit the human data well. The utility of ideal-observer analyses for psychophysical tasks and the interpretation of efficiencies is discussed.

Simultaneous encoding of direction at a local and global scale.

Human observers can simultaneously encode direction information at two different scales, one local (an individual dot) and one global (the coherent motion of a field of dots distributed over a 10 degrees-diameter display). We assessed whether encoding global motion would preclude the encoding of a local trajectory component and vice versa. In the present experiments, a large number (100-150) of dots were randomly assigned directions in each frame from a uniform distribution of directions spanning a range of 160 degrees to create global motion in a single direction (Williams & Sekuler, 1984). Amidst these background dots, 1 dot moved in a consistent direction (trajectory) for the duration of the display. The direction of this "trajectory dot" was similar to the mean direction of the distribution of directions determining the movement of the background dots. Direction discrimination for both the global motion and the trajectory was measured, using the method of constant stimuli, under precued and postcued partial report conditions. A low- or high-frequency 85-msec tone signaled which motion the subject was to judge. In the precue condition, the tone was presented 200 msec before the onset of the stimulus, whereas in the postcue condition, the tone was presented immediately after the offset of the stimulus. Direction discrimination thresholds for both global and local motion in the postcued condition were not significantly different from those obtained in the precued condition. These results suggest that direction information for both global and local motion is encoded simultaneously and that the observer has access to either motion signal after the presentation of a stimulus.

Seeing motion behind occluders.

The visual system has no difficulty maintaining the identity of an object as it disappears and reappears behind stationary occluders. In the natural world, a moving object may differ from occluders by many characteristics (colour, depth, shape and so on). Scene segmentation based on these characteristics is thought to happen early in visual processing, and to influence how objects, including moving objects, are identified. What happens if the only characteristic distinguishing an object is its direction of motion? Experiments with random dot displays show that one dot moving in a constant trajectory is readily detected among identical dots in brownian motion. Detection declines sharply if the trajectory is intermittently broken, but improves if occluders obscure the breaks in the trajectory. It is not sufficient that these occluders be perceived as segmented from the rest of the display (such as by colour or depth). Rather, it is critical that the occluders do not contain motion that is similar in direction to that of the target trajectory. We conclude that detection of the trajectory is due to the integration of information within a network of low-level motion detectors and is not dependent on segmentation processes.