Decoding chromaticity and luminance from patterns of EEG activity.

A long-standing question in the field of vision research is whether scalp-recorded EEG activity contains sufficient information to identify stimulus chromaticity. Recent multivariate work suggests that it is possible to decode which chromaticity an observer is viewing from the multielectrode pattern of EEG activity. There is debate, however, about whether the claimed effects of stimulus chromaticity on visual evoked potentials (VEPs) are instead caused by unequal stimulus luminances, which are achromatic differences. Here, we tested whether stimulus chromaticity could be decoded when potential confounds with luminance were minimized by (1) equating chromatic stimuli in luminance using heterochromatic flicker photometry for each observer and (2) independently varying the chromaticity and luminance of target stimuli, enabling us to test whether the pattern for a given chromaticity generalized across wide variations in luminance. We also tested whether luminance variations can be decoded from the topography of voltage across the scalp. In Experiment 1, we presented two chromaticities (appearing red and green) at three luminance levels during separate trials. In Experiment 2, we presented four chromaticities (appearing red, orange, yellow, and green) at two luminance levels. Using a pattern classifier and the multielectrode pattern of EEG activity, we were able to accurately decode the chromaticity and luminance level of each stimulus. Furthermore, we were able to decode stimulus chromaticity when we trained the classifier on chromaticities presented at one luminance level and tested at a different luminance level. Thus, EEG topography contains robust information regarding stimulus chromaticity, despite large variations in stimulus luminance.

Perceptual resolution of ambiguous neural representations for form and chromaticity.

A coherent percept of our visual world is important for functioning. Ambiguities, however, are implicit in visual neural representations and must be resolved for stable perception of objects and scenes. Grouping processes can link multiple neurally ambiguous fragments across the visual field. Experiments here determined how multiple visual features of each fragment contribute to perceptual resolution of ambiguity by grouping. Chromatic interocular-switch rivalry, a technique for presenting competing dichoptic images, was used to induce ambiguous neural representations for equiluminant chromatic discs and gratings. Two dichoptic stimuli were presented simultaneously to measure the amount of time they both appeared the same in at least one feature domain. The two stimuli were grouped when they appeared to share ambiguous features such as color, orientation, and spatial frequency more often than chance. Experiments here tested whether unshared and unambiguous features impeded grouping of the ambiguous components. Overall, the results show that grouping can be driven by neural ambiguity that is common for fragments across the visual field, even when the fragments also have other unshared, unambiguous features.

Chromatic induction in space and time.

The color appearance of a light depends on variation in the complete visual field over both space and time. In the spatial domain, a chromatic stimulus within a patterned chromatic surround can appear a different hue than the same stimulus within a uniform surround. In the temporal domain, a stimulus presented as an element of a continuously changing chromaticity can appear a different color compared to the identical stimulus, presented simultaneously but viewed alone. This is the flash-lag effect for color, which has an analog in the domain of motion: a pulsed object seen alone can appear to lag behind an identical pulsed object that is an element of a motion sequence. Studies of the flash-lag effect for motion have considered whether it is mediated by a neural representation for the moving physical stimulus or, alternatively, for the perceived motion. The current study addresses this question for the flash-lag effect for color by testing whether the color flash lag depends on a representation of only the changing chromatic stimulus or, alternatively, its color percept, which can be altered by chromatic induction. METHODS: baseline measurements for spatial chromatic induction determined the chromaticity of a flashed ring within a uniform surround that matched a flashed ring within a patterned surround. Baseline measurements for the color flash-lag effect determined the chromaticity of a pulsed ring presented alone (within a uniform surround) that matched a pulsed ring presented in a sequence of changing chromaticity over time (also within a uniform surround). Finally, the main experiments combined chromatic induction from a patterned surround and the flash-lag effect, in three conditions: (1) both the changing and pulsed rings were within a patterned chromatic surround; (2) the changing ring was within a patterned surround and the pulsed ring within a uniform surround; and (3) the changing ring was within a uniform surround and the pulsed ring within a patterned surround. RESULTS: the flash-lag measurements for a changing chromaticity were affected by perceptual changes induced by the surrounding chromatic pattern. Thus, the color shifts induced by a chromatic surround are incorporated in the neural representation mediating the flash-lag effect for color.

Contour adaptation reduces the spreading of edge induced colors.

Brief exposure to flickering achromatic outlines of an area causes a reduction in the brightness contrast of the surface inside the area. This contour adaptation to achromatic contours does not reduce surface contrast when the surface is chromatic (the saturation or colorimetric purity of the surface is maintained). In addition to reducing the brightness of physical luminance contrast, contour adaptation also reduces (or even reverses) the illusory brightness contrast seen in the Craik-O'Brien-Cornsweet illusion, in which two physically identical grey areas appear different brightness because of a sharp luminance edge separating them. Chromatic color spreading illusions also occur with chromatic inducing edges, and an unanswered question is whether contour adaptation can reduce the perceived contrast of illusory color spreading from edges, even though it cannot reduce the perceived contrast of physical surface color. The current studies use a color spreading illusion known as the watercolor effect in order to test whether illusory color spreading is affected by contour adaptation. The general findings of physical achromatic contrast being reduced and chromatic contrast being robust to contour adaptation were replicated. However, both illusory brightness and color were reduced by contour adaptation, even when the illusion edges only differed in chromatic contrast with each other and the background. Additional studies adapting to chromatic contours showed opposite effects on illusory color contrast than achromatic adaptation.

Asymmetric effects of luminance and chrominance in the watercolor illusion.

When bounded by a line of sufficient contrast, the desaturated hue of a colored line will spread over an enclosed area, an effect known as the watercolor illusion. The contrast of the two lines can be in luminance, chromaticity, or a combination of both. The effect is most salient when the enclosing line has greater contrast with the background than the line that induces the spreading color. In most prior experiments with watercolor spreading, the luminance of both lines has been lower than the background. An achromatic version of the illusion exists where a dark line will spread while being bounded by either a darker or brighter line. In a previous study we measured the strength of the watercolor effect in which the colored inducing line was isoluminant to the background, and found an illusion for both brighter and darker achromatic outer contours. We also found the strength of spreading is stronger for bluish (+S cone input) colors compared to yellowish (-S cone input) ones, when bounded by a dark line. The current study set out to measure the hue dependence of the watercolor illusion when inducing colors are flanked with brighter (increment) as opposed to darker outer lines. The asymmetry in the watercolor effect with S cone input was enhanced when the inducing contrast was an increment rather than a decrement. Further experiments explored the relationship between the perceived contrast of these chromatic lines when paired with luminance increments and decrements and revealed that the perceived contrast of luminance increments and decrements is dependent on which isoluminant color they are paired with. In addition to known hue asymmetries in the watercolor illusion there are asymmetries between luminance increments and decrements that are also hue dependent. These latter asymmetries may be related to the perceived contrast of the hue/luminance parings.

Physiological correlates of watercolor effect.

The watercolor effect is a visual illusion that manifests itself as a combination of long-range color spreading and figure-ground organization. The current study uses behavioral and physiological measures to study the watercolor effect. We utilize a novel technique of measuring the cortical response of the illusion using the visual evoked potential (VEP). To this end, three experiments were done to investigate the contributions of luminance and hue to the magnitude of the illusion. Results of both VEP and behavior indicate a marked decrease in the -S (yellow) direction in illusion magnitude compared to the +S (blue) illusion, even though these colors were previously matched for perceptual salience.