Deriving the number of salience maps an observer has from the number and quality of concurrent centroid judgments.

[C. Koch, S. Ullman, Hum. Neurobiol.4, 219-227 (1985)] proposed a 2D topographical salience map that took feature-map outputs as its input and represented the importance "saliency" of the feature inputs at each location as a real number. The computation on the map, "winner-take-all," was used to predict action priority. We propose that the same or a similar map is used to compute centroid judgments, the center of a cloud of diverse items. [P. Sun, V. Chu, G. Sperling, Atten. Percept. Psychophys.83, 934-955 (2021)] demonstrated that following a 250-msec exposure of a 24-dot array of 3 intermixed colors, subjects could accurately report the centroid of each dot color, thereby indicating that these subjects had at least three salience maps. Here, we use a postcue, partial-report paradigm to determine how many more salience maps subjects might have. In 11 experiments, subjects viewed 0.3-s flashes of 28 to 32 item arrays composed of M, M = 3,...,8, different features followed by a cue to mouse-click the centroid of items of just the post-cued feature. Ideal detector response analyses show that subjects utilized at least 12 to 17 stimulus items. By determining whether a subject's performance in (M-1)-feature experiments could/could-not predict performance in M-feature experiments, we conclude that one subject has at least 7 and the other two have at least five salience maps. A computational model shows that the primary performance-limiting factors are channel capacity for representing so many concurrently presented groups of items and working-memory capacity for so many computed centroids.

Color scrambles reveal red and green half-wave linear mechanisms plus a mechanism selective for low chromatic contrast.

This paper introduces a new method to determine how subjects make discriminations among red-green texture stimuli. More specifically, the method determines (1) the number of mechanisms in human vision sensitive to lights that vary along the constant-S cardinal axis (cSCA) of DKL space and (2) the sensitivity of each mechanism to cSCA lights. Each of five subjects was tested in four, separately-blocked tasks. In each task, the subject strove to detect the location of a patch of cSCA-scramble (a spatially random mixture of cSCA lights) in a large, annular background of cSCA-scramble with a different histogram. In different tasks the target patch was (1) redder, (2) greener, (3) higher in red-green contrast, and (4) lower in red-green contrast than the background. For each subject in each task, we measure how target salience is influenced by different cSCA lights. By assuming that in each task each subject uses a weighted sum of his-or-her available mechanisms to construct a "tool" that is optimal for detecting the target, we can derive the sensitivity functions of the mechanisms underlying performance. Results suggest that human vision possesses three mechanisms sensitive to cSCA lights: a red half-wave linear mechanism, a complementary green half-wave linear mechanism, and a third mechanism that is activated by color-scrambles with low chromatic contrast in high-chromatic-contrast backgrounds.

Multiple concurrent centroid judgments imply multiple within-group salience maps.

Subjects viewed a brief flash of 8-24 dots of either two or three colors randomly arrayed. Their task was to move a mouse cursor to the centroid (center-of-gravity) of each color in a pre-designated order. Conventional and idea-detector analyses show that subjects accurately judged all three centroids utilizing an astounding 13/24 stimulus dots, with only a modest loss of accuracy compared to judging a single-predesignated color centroid. The ability to concurrently compute three centroids is important because it is believed that centroid judgments are made on salience maps that record only salience and are ignorant of the features that produced the salience. Our explanation, instantiated in a computational model of salience processing, is that subjects have three salience maps. Dots are initially segregated into three groups according to color, then each color-group is recorded on a different salience map to compute a centroid. In Part 2, the data are analyzed in terms of Attention Operating Characteristics to characterize impairments in subjects' color-attention filters (mostly insignificant) and encoding efficiency (20% drop for the hardest task) in making multiple versus single centroid judgments. A new, more sensitive analysis measured five sources of subject error variance, four independent, additive sources of error variance: imperfect color-attention filters; a Bayesian-like bias towards a central tendency; storage, retrieval, and cursor misplacement error; a large residual error due mostly to inefficient encoding; and fifth, an interactive source - error in all four components that increases when multiple centroid judgments versus a single centroid judgment are required on each trial. SIGNIFICANCE STATEMENT: An important brain process is a salience map, a representation of the relative importance (salience) of the locations of visual space. It is needed to guide where to look next, for computing the center (technically "centroid") of a cluster of items, and for other important computations. Here we show that in a brief flash of dots of three different colors, randomly interleaved, subjects can compute all three centroids. As a single salience map cannot discriminate dots of different colors, accurately reporting three centroids demonstrates that subjects have not just one, as is commonly believed, but at least three salience maps.

Theory of the perceived motion direction of equal-spatial-frequency plaid stimuli.

At an early stage, 3 different systems independently extract visual motion information from visual inputs. At later stages, these systems combine their outputs. Here, we consider a much studied (>650 publications) class of visual stimuli, plaids, which are combinations of 2 sine waves. Currently, there is no quantitative theory that can account for the perceived motion of plaids. We consider only perceived plaid direction, not speed, and obtain a large set of data exploring the various dimensions in which same-spatial-frequency plaids differ. We find that only 2 of the 3 motion systems are active in plaid processing, and that plaids with temporal frequencies 10 Hz or greater typically stimulate only the first-order motion system, which combines the plaid components by vector summation: Each plaid component is represented by a contrast-strength vector whose length is contrast-squared times a factor representing the relative effectiveness of that component's temporal frequency. The third-order system, which becomes primary at low temporal frequencies, also represents a plaid as 2 vectors that sum according to their contrast strength: a pure plaid in which both components have equal contrast and a residual sine wave. Second-order motion is irrelevant for these plaids. These principles enable a contrast-strength-vector summation theory for the responses of the first-order and third-order motion systems. With zero parameters estimated from the data, the theory captures the essence of the full range of the plaid data and supports the counterintuitive hypothesis that motion direction is processed independently of speed at early stages of visual processing. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Variation in target and distractor heterogeneity impacts performance in the centroid task.

In a selective centroid task, the participant views a brief cloud of items of different types-some of which are targets, the others distractors-and strives to mouse-click the centroid of the target items, ignoring the distractors. Advantages of the centroid task are that multiple target types can appear in the same display and that influence functions, which estimate the weight of each stimulus type in the cloud on the perceived centroid for each participant, can be obtained easily and efficiently. Here we document the strong, negative impact on performance that results when the participant is instructed to attend to target dots that consist of two or more levels of a single feature dimension, even when those levels differ categorically from those of the distractor dots. The results also show a smaller, but still observable decrement in performance that results when there is heterogeneity in the distractor dots.

How can observers use perceived size? Centroid versus mean-size judgments.

statistical representations are aggregate properties of the environment that are presumed to be perceived automatically and preattentively. We investigated two tasks presumed to involve these representations: judgments of the centroid of a set of spatially arrayed items and judgments of the mean size of the items in the array. The question we ask is: When similar information is required for both tasks, do observers use it with equal postfilter efficiency (Sun, Chubb, Wright, & Sperling, 2016)? We find that, according to instructions, observers can either efficiently utilize item size in making centroid judgments or ignore it almost completely. Compared to centroid judgments, however, observers estimating mean size incorporate the size of individual items into the average with low efficiency.

High-capacity preconscious processing in concurrent groupings of colored dots.

Grouping is a perceptual process in which a subset of stimulus components (a group) is selected for a subsequent-typically implicit-perceptual computation. Grouping is a critical precursor to segmenting objects from the background and ultimately to object recognition. Here, we study grouping by color. We present subjects with 300-ms exposures of 12 dots colored with the same but unknown identical color interspersed among 14 dots of seven different colors. To indicate grouping, subjects point-click the remembered centroid ("center of gravity") of the set of homogeneous dots, of heterogeneous dots, or of all dots. Subjects accurately judge all of these centroids. Furthermore, after a single stimulus exposure, subjects can judge both the heterogeneous and homogeneous centroids, that is, subjects simultaneously group by similarity and by dissimilarity. The centroid paradigm reveals the relative weight of each dot among targets and distractors to the underlying grouping process, offering a more detailed, quantitative description of grouping than was previously possible. A change detection experiment reveals that conscious memory contains less than two dots and their locations, whereas an ideal detector would have to perfectly process at least 15 of 26 dots to match the subjects' centroid judgments-indicating an extraordinary capacity for preconscious grouping. A different color set yielded identical results. Grouping theories that rely on predefined feature maps would fail to explain these results. Rather, the results indicate that preconscious grouping is automatic, flexible, and rapid, and a far more complex process than previously believed.

Human attention filters for single colors.

The visual images in the eyes contain much more information than the brain can process. An important selection mechanism is feature-based attention (FBA). FBA is best described by attention filters that specify precisely the extent to which items containing attended features are selectively processed and the extent to which items that do not contain the attended features are attenuated. The centroid-judgment paradigm enables quick, precise measurements of such human perceptual attention filters, analogous to transmission measurements of photographic color filters. Subjects use a mouse to locate the centroid-the center of gravity-of a briefly displayed cloud of dots and receive precise feedback. A subset of dots is distinguished by some characteristic, such as a different color, and subjects judge the centroid of only the distinguished subset (e.g., dots of a particular color). The analysis efficiently determines the precise weight in the judged centroid of dots of every color in the display (i.e., the attention filter for the particular attended color in that context). We report 32 attention filters for single colors. Attention filters that discriminate one saturated hue from among seven other equiluminant distractor hues are extraordinarily selective, achieving attended/unattended weight ratios >20:1. Attention filters for selecting a color that differs in saturation or lightness from distractors are much less selective than attention filters for hue (given equal discriminability of the colors), and their filter selectivities are proportional to the discriminability distance of neighboring colors, whereas in the same range hue attention-filter selectivity is virtually independent of discriminabilty.

Evidence against global attention filters selective for absolute bar-orientation in human vision.

The finding that an item of type A pops out from an array of distractors of type B typically is taken to support the inference that human vision contains a neural mechanism that is activated by items of type A but not by items of type B. Such a mechanism might be expected to yield a neural image in which items of type A produce high activation and items of type B low (or zero) activation. Access to such a neural image might further be expected to enable accurate estimation of the centroid of an ensemble of items of type A intermixed with to-be-ignored items of type B. Here, it is shown that as the number of items in stimulus displays is increased, performance in estimating the centroids of horizontal (vertical) items amid vertical (horizontal) distractors degrades much more quickly and dramatically than does performance in estimating the centroids of white (black) items among black (white) distractors. Together with previous findings, these results suggest that, although human vision does possess bottom-up neural mechanisms sensitive to abrupt local changes in bar-orientation, and although human vision does possess and utilize top-down global attention filters capable of selecting multiple items of one brightness or of one color from among others, it cannot use a top-down global attention filter capable of selecting multiple bars of a given absolute orientation and filtering bars of the opposite orientation in a centroid task.

The centroid paradigm: Quantifying feature-based attention in terms of attention filters.

This paper elaborates a recent conceptualization of feature-based attention in terms of attention filters (Drew et al., Journal of Vision, 10(10:20), 1-16, 2010) into a general purpose centroid-estimation paradigm for studying feature-based attention. An attention filter is a brain process, initiated by a participant in the context of a task requiring feature-based attention, which operates broadly across space to modulate the relative effectiveness with which different features in the retinal input influence performance. This paper describes an empirical method for quantitatively measuring attention filters. The method uses a "statistical summary representation" (SSR) task in which the participant strives to mouse-click the centroid of a briefly flashed cloud composed of items of different types (e.g., dots of different luminances or sizes), weighting some types of items more strongly than others. In different attention conditions, the target weights for different item types in the centroid task are varied. The actual weights exerted on the participant's responses by different item types in any given attention condition are derived by simple linear regression. Because, on each trial, the centroid paradigm obtains information about the relative effectiveness of all the features in the display, both target and distractor features, and because the participant's response is a continuous variable in each of two dimensions (versus a simple binary choice as in most previous paradigms), it is remarkably powerful. The number of trials required to estimate an attention filter is an order of magnitude fewer than the number required to investigate much simpler concepts in typical psychophysical attention paradigms.

Factors that determine depth perception of trapezoids, windsurfers, runways.

We report here a windsurfer illusion, a naturally occurring trapezoidal illusion in which the small end of the sail viewed at a distance appears to be pointed away from the observer even when it is closer. This naturally occurring illusion is so compelling that observers are unaware of their gross perceptual misinterpretation of the scene. Four laboratory experiment of this kind of trapezoidal illusion investigated the joint effects of retinal orientation, head position, relative motion, and the relative direction of gravity on automatic depth perception. Observers viewed two adjacent white trapezoids outlined on a black background rotating back and forth ± 20° on a vertical axis much like the sails of two adjacent windsurfers. Observers reported which side of the trapezoids (long or short) appeared to be closer to them (i.e., in front). The longer edge of the trapezoid was reported in front 76 ± 2% of trials ("windsurfer effect") whether it was on the left or on the right. When the display was rotated 90°to produce a runway configuration, there was a striking asymmetry: the long edge was perceived to be in front 97% when it was on the bottom but only 43% when it was on top ("runway effect"). The runway effect persisted when the head was tilted 90° or when displays on the ceiling were viewed from the floor. Ninety-five percent of the variance of the variance in the strikingly different 3D perceptions produced by the same 2D trapezoid image was quantitatively explained by a model that assumes there are just three additive bias factors that account for perceiving an edge as closer: Implicit linear perspective, lower position on the retina (based on an automatic assumption of viewing from above), and being lower in world coordinates.

Two mechanisms that determine the Barber-Pole Illusion.

UNLABELLED: In the Barber-Pole Illusion (BPI), a diagonally moving grating is perceived as moving vertically because of the narrow, vertical, rectangular shape of the aperture window through which it is viewed. This strong shape-motion interaction persists through a wide range of parametric variations in the shape of the window, the spatial and temporal frequencies of the moving grating, the contrast of the moving grating, complex variations in the composition of the grating and window shape, and the duration of viewing. It is widely believed that end-stop-feature (third-order) motion computations determine the BPI, and that Fourier motion-energy (first-order) computations determine failures of the BPI. Here we show that the BPI is more complex: (1) In a wide variety of conditions, weak-feature stimuli (extremely fast, low contrast gratings, 21.5 Hz, 4% contrast) that stimulate only the Fourier (first-order) motion system actually produce a slightly better BPI illusion than classical strong-feature gratings (2.75 Hz, 32% contrast). (2) Reverse-phi barber-pole stimuli are seen exclusively in the feature (third-order) BPI direction when presented at 2.75 Hz and exclusively in the opposite (Fourier, first-order) BPI direction at 21.5Hz, indicating that both the first- and the third-order systems can produce the BPI. (3) The BPI in barber poles with scalloped aperture boundaries is much weaker than in normal straight-edge barber poles for 2.75 Hz stimuli but not in 21.5 Hz stimuli. CONCLUSIONS: Both first-order and third-order stimuli produce strong BPIs. In some stimuli, local Fourier motion-energy (first-order) produces the BPI via a subsequent motion-path-integration computation (Journal of Vision (2014) 14, 1--27); in other stimuli, the BPI is determined by various feature (third-order) motion inputs; in most stimuli, the BPI involves combinations of both. High temporal frequency, low-contrast stimuli favor the first-order motion-path-integration computation; low temporal frequency, high-contrast stimuli favor third-order motion computations.

A moving-barber-pole illusion.

In the barber-pole illusion (BPI), a diagonally moving grating is perceived as moving vertically because of the shape of the vertically oriented window through which it is viewed-a strong shape-motion interaction. We introduce a novel stimulus-the moving barber pole-in which a diagonal, drifting sinusoidal carrier is windowed by a raised, vertical, drifting sinusoidal modulator that moves independently of the carrier. In foveal vision, the moving-barber-pole stimulus can be perceived as several active barber poles drifting horizontally but also as other complex dynamic patterns. In peripheral vision, pure vertical motion (the moving-barber-pole illusion [MBPI]) is perceived for a wide range of conditions. In foveal vision, the MBPI is observed, but only when the higher-order modulator motion is masked. Theories to explain the BPI make indiscriminable predictions in a standard barber-pole display. But, in moving-barber-pole stimuli, the motion directions of features (e.g., end stops) of the first-order carrier and of the higher-order modulator are all different from the MBPI. High temporal frequency stimuli viewed peripherally greatly reduce the effectiveness of higher-order motion mechanisms and, ideally, isolate a single mechanism responsible for the MBPI. A three-stage motion-path integration mechanism that (a) computes local motion energies, (b) integrates them for a limited time period along various spatial paths, and (c) selects the path with the greatest motion energy, quantitatively accounts for these high-frequency data. The MBPI model also accounts for the perceived motion-direction in peripherally viewed moving-barber-pole stimuli that do and do not exhibit the MBPI over the entire range of modulator (0-10 Hz) and carrier (2.5-10 Hz) temporal frequencies tested.

Neural strategies for selective attention distinguish fast-action video game players.

We investigated the psychophysical and neurophysiological differences between fast-action video game players (specifically first person shooter players, FPS) and non-action players (role-playing game players, RPG) in a visual search task. We measured both successful detections (hit rates) and steady-state visually evoked EEG potentials (SSVEPs). Search difficulty was varied along two dimensions: number of adjacent attended and ignored regions (1, 2 and 4), and presentation rate of novel search arrays (3, 8.6 and 20 Hz). Hit rates decreased with increasing presentation rates and number of regions, with the FPS players performing on average better than the RPG players. The largest differences in hit rate, between groups, occurred when four regions were simultaneously attended. We computed signal-to-noise ratio (SNR) of SSVEPs and used partial least squares regression to model hit rates, SNRs and their relationship at 3 Hz and 8.6 Hz. The following are the most significant results: RPG players' parietal responses to the attended 8.6 Hz flicker were predictive of hit rate and were positively correlated with it, indicating attentional signal enhancement. FPS players' parietal responses to the ignored 3 Hz flicker were predictive of hit rate and were positively correlated with it, indicating distractor suppression. Consistent with these parietal responses, RPG players' frontal responses to the attended 8.6 Hz flicker, increased as task difficulty increased with number of regions; FPS players' frontal responses to the ignored 3 Hz flicker increased with number of regions. Thus the FPS players appear to employ an active suppression mechanism to deploy selective attention simultaneously to multiple interleaved regions, while RPG primarily use signal enhancement. These results suggest that fast-action gaming can affect neural strategies and the corresponding networks underlying attention, presumably by training mechanisms of distractor suppression.

Black-white asymmetry in visual perception.

With eleven different types of stimuli that exercise a wide gamut of spatial and temporal visual processes, negative perturbations from mean luminance are found to be typically 25% more effective visually than positive perturbations of the same magnitude (range 8-67%). In Experiment 12, the magnitude of the black-white asymmetry is shown to be a saturating function of stimulus contrast. Experiment 13 shows black-white asymmetry primarily involves a nonlinearity in the visual representation of decrements. Black-white asymmetry in early visual processing produces even-harmonic distortion frequencies in all ordinary stimuli and in illusions such as the perceived asymmetry of optically perfect sine wave gratings. In stimuli intended to stimulate exclusively second-order processing in which motion or shape are defined not by luminance differences but by differences in texture contrast, the black-white asymmetry typically generates artifactual luminance (first-order) motion and shape components. Because black-white asymmetry pervades psychophysical and neurophysiological procedures that utilize spatial or temporal variations of luminance, it frequently needs to be considered in the design and evaluation of experiments that involve visual stimuli. Simple procedures to compensate for black-white asymmetry are proposed.

Precise attention filters for Weber contrast derived from centroid estimations.

How well can observers selectively attend only to dots that are lighter or darker than the background when all dot intensities are present? Observers estimated centroids of briefly flashed, sparse clouds of 8 or 16 dots, ranging in intensity from dark black to bright white on a gray background. Attention instructions were to equally weight: (i) dots brighter than the background, assigning zero weight to others; (ii) dots darker than the background, assigning zero weight to others; (iii) all dots. For each observer, a quantitative estimate of the operational attention filter (the weight exerted in the centroid estimates as a function of dot intensity) was derived for each attention instruction in each dot condition. Attended dots typically have 4× the weights of unattended dots. Whereas observers performed remarkably well in estimating centroids and achieving the three required attention filters, they achieved higher accuracy when equally weighing all dots than when selectively attending to dots of only one contrast polarity. Although their attention filters are similar, individual observers use significantly different parameters in their centroid computations. The complete model of performance enables perceptual measurements of observers' attention filters for shades of gray that are as accurate as physical measurements of color filters.

Attention-based long-lasting sensitization and suppression of colors.

In contrast to the short-duration and quick reversibility of attention, a long-term sensitization to color based on protracted attention in a visual search task was reported by Tseng, Gobell, and Sperling (2004). When subjects were trained for a few hours to search for a red object among colored distracters, sensitivity to red was increased for weeks. This sensitization was quantified using ambiguous motion displays containing isoluminant red-green and texture-contrast gratings, in which the perceived motion-direction depended both on the attended color and on the relative red-green saturation. Such long-term effects could result from either sensitization of the attended color, or suppression of unattended colors, or a combination of the two. Here we unconfound these effects by eliminating one of the paired colors of the motion display from the search task. The other paired color in the motion display can then be either a target or a distracter in the search task. Thereby, we separately measure the effect of attention on sensitizing the target color or suppressing distracter colors. The results indicate that only sensitization of the target color in the search task is statistically significant for the present experimental conditions. We conclude that selective attention to a color in our visual search task caused long-term sensitization to the attended color but not significant long-term suppression of the unattended color.

When is motion 'motion'?

Examples of visual motion have become more and more abstract over the years, leading up to 'third-order' stimuli where direction is actually determined by the observer through top - down attention. But how far can this be pushed--are there motion stimuli that are yet more arbitrary and abstract? Actually, there is a broad class of 'conceptual motion' stimuli--things like a moving grating of faces, or a shifting pattern of words--that are perfect analogs to traditional 'perceptual motion' stimuli, solvable by the same motion computation and for which observers can readily make direction-of-motion judgments. Interestingly though, these do not produce a sensation of motion (among other automatic consequences of motion detection). Here we compare a luminance-based perceptual motion stimulus to a semantic-based conceptual motion stimulus to contrast the psychophysical hallmarks of these motion categories.

Contrast amplification in global texture orientation discrimination.

We show that adding a low-contrast texture stimulus that is far below its own detection threshold to an ambiguously oriented high-contrast texture can produce an easily perceived global orientation. When such a low-contrast (e.g., 0.1%) test texture and a high-contrast (e.g., 2%) amplifier texture are interleaved, the effective strength for global orientation detection closely approximates the product of the two contrasts. Therefore, adding two ambiguous textures, an amplifier texture at 5x its threshold contrast for global orientation discrimination and a test texture at 1/5x its threshold contrast, produces threshold global orientation discrimination, that is, 5x amplification of the below-threshold test texture. The observed 5x amplification factors are larger than facilitation effects reported in other pattern tasks. Amplification is 11x when orientation discrimination thresholds are compared to absolute detection thresholds. For second-order textures, maximum contrast amplification is about 2.5x. A contrast gain control model is presented that accounts for 90% of the variance in observed d' for texture patterns of differing geometries, exposure durations, and component contrasts. In the model, very low-contrast orientations are represented by power functions of their contrasts, with an exponent greater than two. As the contrast of an amplifier texture increases beyond about 4%, feed-forward gain control exerted by the amplifier ultimately nullifies the amplification effect and produces masking.

The three dimensions of human visual sensitivity to first-order contrast statistics.

This work studies the preattentive discrimination of achromatic textures composed of mixtures of different (Weber) contrasts. These textures differ not at all in local spatial structure, but only in the relative proportions of different contrasts they comprise. It is shown that, like chromatic discrimination, preattentive discrimination of such textures is three-dimensional. The current results do not uniquely determine the characteristics of the three texture filters mediating human discrimination of these textures; they do, however, define the space of textures with 4th-order polynomial histograms to which human vision is sensitive. Three real-valued functions of contrast that collectively capture human sensitivity to the textures in this space are presented.