Neural representations of perceptual color experience in the human ventral visual pathway.

Color is a perceptual construct that arises from neural processing in hierarchically organized cortical visual areas. Previous research, however, often failed to distinguish between neural responses driven by stimulus chromaticity versus perceptual color experience. An unsolved question is whether the neural responses at each stage of cortical processing represent a physical stimulus or a color we see. The present study dissociated the perceptual domain of color experience from the physical domain of chromatic stimulation at each stage of cortical processing by using a switch rivalry paradigm that caused the color percept to vary over time without changing the retinal stimulation. Using functional MRI (fMRI) and a model-based encoding approach, we found that neural representations in higher visual areas, such as V4 and VO1, corresponded to the perceived color, whereas responses in early visual areas V1 and V2 were modulated by the chromatic light stimulus rather than color perception. Our findings support a transition in the ascending human ventral visual pathway, from a representation of the chromatic stimulus at the retina in early visual areas to responses that correspond to perceptually experienced colors in higher visual areas.

Slow Temporal Dynamics of Motion-Induced Brightness Shift Reveals Impact of Adaptation.

Brightness of an object is determined by various factors including ambient illumination, surface reflectance of the object, and spatial and temporal relation between the object and its surrounding context. Recently, it has been demonstrated that the motion of an object alters its own and nearby object's appearance such as brightness and color. This study aims to unveil mechanisms of the motion-induced brightness shift by measuring its temporal dynamics. We found that the motion-induced brightness shift occurred instantaneously with the motion onset when the motion was introduced abruptly. However, the brightness of a stationary object was altered gradually by a nearby moving object in about 2 s time window when the stationary dot was introduced abruptly. Two distinct temporal dynamics (slow vs. fast) of the motion-induced brightness shift demonstrate that both slow neural adaptation and fast neural normalization processes determine the brightness shift induced by the object's motion.

Reprioritization of Features of Multidimensional Objects Stored in Visual Working Memory.

A prevalent view of visual working memory (VWM) is that visual information is actively maintained in the form of perceptually integrated objects. Such reliance on object-based representations would predict that after an object is fully encoded into VWM, all features of that object would need to be maintained as a coherent unit. Here, we evaluated this idea by testing whether memory resources can be redeployed to a specific feature of an object already stored in VWM. We found that observers can utilize a retrospective cue presented during the maintenance period to attenuate both the gradual deterioration and complete loss of memory for a cued feature over time, but at the cost of accelerated loss of information regarding the uncued feature. Our findings demonstrate that object representations held within VWM can be decomposed into individual features and that having to retain additional features imposes greater demands on active maintenance processes.

Neural representation of form-contingent color filling-in in the early visual cortex.

Perceptual filling-in exemplifies the constructive nature of visual processing. Color, a prominent surface property of visual objects, can appear to spread to neighboring areas that lack any color. We investigated cortical responses to a color filling-in illusion that effectively dissociates perceived color from the retinal input (van Lier, Vergeer, & Anstis, 2009). Observers adapted to a star-shaped stimulus with alternating red- and cyan-colored points to elicit a complementary afterimage. By presenting an achromatic outline that enclosed one of the two afterimage colors, perceptual filling-in of that color was induced in the unadapted central region. Visual cortical activity was monitored with fMRI, and analyzed using multivariate pattern analysis. Activity patterns in early visual areas (V1-V4) reliably distinguished between the two color-induced filled-in conditions, but only higher extrastriate visual areas showed the predicted correspondence with color perception. Activity patterns allowed for reliable generalization between filled-in colors and physical presentations of perceptually matched colors in areas V3 and V4, but not in earlier visual areas. These findings suggest that the perception of filled-in surface color likely requires more extensive processing by extrastriate visual areas, in order for the neural representation of surface color to become aligned with perceptually matched real colors.

When audiovisual correspondence disturbs visual processing.

Multisensory integration is known to create a more robust and reliable perceptual representation of one's environment. Specifically, a congruent auditory input can make a visual stimulus more salient, consequently enhancing the visibility and detection of the visual target. However, it remains largely unknown whether a congruent auditory input can also impair visual processing. In the current study, we demonstrate that temporally congruent auditory input disrupts visual processing, consequently slowing down visual target detection. More importantly, this cross-modal inhibition occurs only when the contrast of visual targets is high. When the contrast of visual targets is low, enhancement of visual target detection is observed, consistent with the prediction based on the principle of inverse effectiveness (PIE) in cross-modal integration. The switch of the behavioral effect of audiovisual interaction from benefit to cost further extends the PIE to encompass the suppressive cross-modal interaction.

Radial bias for orientation and direction of motion modulates access to visual awareness during continuous flash suppression.

Two types of radial bias have been demonstrated in the primate visual cortex: for orientation and for direction of motion. Considering that a visual neuron's directional selectivity is generally perpendicular to its preferred orientation, it is counterintuitive that radial biases for orientation and direction of motion coexist in retinotopic cortex including primary visual cortex. The current study measured the influence of radial bias for orientation and direction of motion on the access to visual awareness during continuous flash suppression. Strength of static and moving target stimuli, inferred by time to breakup of suppression, was modulated by the orientation and motion direction of the suppressed target stimulus according to its spatial location, indicating radial biases for both orientation and motion direction. However, orientation dominated over direction of motion when they were perpendicular to each other. These results indicate that, first, orientation-specific neural responses may be stronger than direction-specific neural responses at the stage of visual processing where interocular suppression is resolved. Second, the preferential processing of both orientation and direction of motion may result from anisotropic distribution of orientation- and direction-selective cells. Third, the neural substrate of the radial direction bias may reflect an orientation-specific neural response induced by fast-moving random dot patterns.

Color updating on the apparent motion path.

When a static stimulus appears successively at two distant locations, we perceive illusory motion of the stimulus across them-long-range apparent motion (AM). Previous studies have shown that when the apparent motion stimuli differ in shape, interpolation between the two shapes is perceived across the AM path. In contrast, the perceived color during AM has been shown to abruptly change from the color of the first stimulus into that of the second, suggesting interpolation does not occur for color during AM. Here, we report the first evidence to our knowledge, that an interpolated color, distinct from the colors of either apparent motion stimulus, is represented as the intermediate percept on the path of apparent motion. Using carefully chosen target colors-cyan, pink, and lime-that are perceptually and neurally intermediate between blue and green, orange and magenta, and green and orange respectively, we show that detection of a target presented on the apparent motion path was impaired when the color of the target was "in-between" the initial and terminal stimulus colors. Furthermore, we show that this feature-specific masking effect for the intermediate color cannot be accounted for by color similarity between the intermediate color and the color of the terminal inducer. Our findings demonstrate that intermediate colors can be interpolated over the apparent motion trajectory as in the case of shape, possibly involving similar interpolation processes for shape and color during apparent motion.

The role of pattern coherence in interocular grouping during binocular rivalry: Insights from individual differences.

Interocular grouping during binocular rivalry occurs when two images presented to each eye combine into a coherent pattern. The experience of interocular grouping is thought to be influenced by both eye-of-origin, which involves excitatory lateral connections among monocular neurons, and pattern coherence, which results from top-down intervention from higher visual areas. However, it remains unclear which factor plays a more significant role in the interocularly-grouped percepts during binocular rivalry. The current study employed an individual difference approach to investigate whether grouping dynamics are mainly determined by eye-of-origin or pattern coherence. We found that participants who perceived interocularly-driven coherent percepts for a longer duration also tended to experience longer periods of monocularly-driven coherent percepts. In contrast, participants who experienced non-coherent piecemeal percepts for an extended duration in conventional rivalry also had longer duration of non-coherent percepts in the interocular coherence setting. This individual differences in experiencing interocular grouping suggest that pattern coherence exerts a stronger influence on grouping dynamics during binocular rivalry compared to eye-of-origin factors.

The eveningness chronotype is associated with nightmare distress and dream recall: a cross-sectional study.

Dreaming may be affected by sleep behavior; however, evidence of the effect of chronotypes on dreaming is limited. We investigated sleep patterns, dream recall, and nightmare distress according to chronotypes. This cross-sectional study retrospectively enrolled adult participants (age > 18 years) who visited a sleep laboratory between 2016 and 2021 and underwent standard polysomnography (PSG) and completed a self-reported questionnaire. Patients with major sleep disorders were excluded. Chronotypes and dreaming components were assessed using the Korean version of the morningness-eveningness questionnaire and a nine-item dreaming questionnaire (nightmare distress and dream recall), respectively. Among healthy participants without major sleep disorders, the eveningness chronotype correlated with better dream recall than the morningness and intermediate chronotypes. Participants with the eveningness chronotype were younger and more likely to be unmarried than those with the other chronotypes. No significant chronotype-based difference was observed in the subjective measurements of sleep quality, insomnia, daytime sleepiness, depression, and anxiety or in respiration and movement events on PSG. In multivariate linear regression analysis, the chronotypes were independently related to nightmare distress (b = - 0.296; p = 0.002) and dream recall (b = - 0.334; p = 0.002). The apnea-hypopnea index was associated with nightmare distress (b = - 0.209; p = 0.029) and dream recall (b = - 0.189; p = 0.044). Depression was positively correlated with nightmare distress (b = 0.450; p = 0.002). Dream recall was best in the eveningness group among healthy adults. Greater eveningness was associated with higher nightmare distress and better dream recall. Further research is needed to understand the role of chronotypes in dreaming.

Clinical Aspects of the Differential Diagnosis of Parkinson's Disease and Parkinsonism.

Parkinsonism is a clinical syndrome presenting with bradykinesia, tremor, rigidity, and postural instability. Nonmotor symptoms have recently been included in the parkinsonian syndrome, which was traditionally associated with motor symptoms only. Various pathologically distinct and unrelated diseases have the same clinical manifestations as parkinsonism or parkinsonian syndrome. The etiologies of parkinsonism are classified as neurodegenerative diseases related to the accumulation of toxic protein molecules or diseases that are not neurodegenerative. The former class includes Parkinson's disease (PD), multiple-system atrophy, progressive supranuclear palsy, and corticobasal degeneration. Over the past decade, clinical diagnostic criteria have been validated and updated to improve the accuracy of diagnosing these diseases. The latter class of disorders unrelated to neurodegenerative diseases are classified as secondary parkinsonism, and include drug-induced parkinsonism (DIP), vascular parkinsonism, and idiopathic normal-pressure hydrocephalus (iNPH). DIP and iNPH are regarded as reversible and treatable forms of parkinsonism. However, studies have suggested that the absence of protein accumulation in the nervous system as well as managing the underlying causes do not guarantee recovery. Here we review the differential diagnosis of PD and parkinsonism, mainly focusing on the clinical aspects. In addition, we describe recent updates to the clinical criteria of various disorders sharing clinical symptoms with parkinsonism.

Multivariate summary of a complex scene.

The current study investigated how people summarize and represent objects with multiple features to cope with the complexity due to the number of objects and feature dimensions. We presented a set of circles whose color and size were either correlated perfectly (r = 1) or not correlated at all (r = 0). Using a membership identification task, we found that participants formed a statistical representation that included information about conjunctions as well as each color and size dimensions. In addition, we found that participants represented different set boundaries depending on the correlation between features of a set. Lastly, a pair-matching task revealed that participants predicted one feature value from the other feature value based on the correlation between features of a set. Our findings suggest that people represent a multi-feature ensemble statistically as a multivariate feature distribution, which is an efficient strategy to cope with scene complexity.

Adaptation aftereffects to facial expressions suppressed from visual awareness.

The study of adaptation aftereffects has been used as a tool to investigate the neural events that give rise to face perception. Recent adaptation studies suggest that face processing does not occur outside of awareness since identity- and gender-specific face aftereffects cannot be induced when the adapting face is rendered perceptually invisible using interocular suppression. However there is substantial evidence suggesting that facial expression, unlike identity and gender, is an attribute of faces that may recruit processes that are engaged automatically and independent of observers' awareness and attention. Therefore we investigated whether adaptation aftereffects specific to facial expressions could arise under continuous flash suppression (CFS). Our results show that adaptation to facial expressions is virtually abolished, when faces are suppressed from awareness. Moreover, this loss in aftereffect strength cannot be attributed to contrast adaptation exclusively, since results show only modest changes in perceived contrast following face adaptation. When observers endogenously attend to the location of the suppressed adapting stimulus, expression-specific aftereffects are enhanced. Our findings suggest that neural activity specifying affective information of facial expressions is highly vulnerable to the disruptive effect of interocular suppression, but that allocation of attentional resources can partially counteract suppression's effect.

Behavioral inhibition system sensitivity moderates audio-visual neutral information processing.

BACKGROUND AND OBJECTIVES: Misperception of other people's intention and emotions could cause and worsen interpersonal problems, thereby increasing the likelihood of developing depression and anxiety disorders among individuals who are already at risk for those conditions. Although multisensory emotional information is ubiquitous in the real world, most previous research focused exclusively on processing facial expressions. Addressing this gap, the current study examined the association between behavioral inhibition system (BIS) sensitivity and audio-visual emotional information processing. Sensitive BIS suggests heightened sensitivity to anxiety provoking stimuli and is a known risk factor for developing emotional disorders. We hypothesized that higher BIS levels would be associated with inefficient multisensory emotional processing, which might be pronounced for neutral stimuli. METHODS: Seventy-six undergraduates (40 women) completed a task while target faces (disgusted, happy, and neutral) were rendered invisible, and a voice (disgusted, happy, and neutral) or no voice was presented simultaneously. Participants' reaction times to indicate the location of the interocularly suppressed faces were measured. RESULTS: Individuals with lower BIS levels detected neutral faces faster when accompanied by neutral voices than by no voice; individuals with higher BIS levels, however, did not benefit from congruent auditory information when processing neutral faces. LIMITATIONS: The current study cannot address whether the finding is due to attentional biases, interpretation biases, or both in individuals who are prone to become anxious. CONCLUSION: Multisensory processing of neutral information is modulated by individuals' propensity to become anxious.

Color-binding errors during rivalrous suppression of form.

How does a physical stimulus determine a conscious percept? Binocular rivalry provides useful insights into this question because constant physical stimulation during rivalry causes different visual experiences. For example, presentation of vertical stripes to one eye and horizontal stripes to the other eye results in a percept that alternates between horizontal and vertical stripes. Presentation of a different color to each eye (color rivalry) produces alternating percepts of the two colors or, in some cases, a color mixture. The experiments reported here reveal a novel and instructive resolution of rivalry for stimuli that differ in both form and color: perceptual alternation between the rivalrous forms (e.g., horizontal or vertical stripes), with both eyes' colors seen simultaneously in separate parts of the currently perceived form. Thus, the colors presented to the two eyes (a) maintain their distinct neural representations despite resolution of form rivalry and (b) can bind separately to distinct parts of the perceived form.

Perception of facial expressions of emotion during binocular rivalry.

Binocular rivalry is the perceptual alternation between two incompatible stimuli presented simultaneously but to each eye separately. The observer's perception switches back and forth between the two stimuli that are competing for perceptual dominance. In two studies, pictures of emotional faces (disgust and happy) were pitted against each other or against pictures of faces with neutral expressions. Study 1 demonstrated that (a) emotional facial expressions predominate over neutral expressions, and (b) positive facial expressions predominate over negative facial expression (i.e., positivity bias). Study 2 examined individual differences in emotional predominance and positivity bias during binocular rivalry. Although the positivity bias was not affected by the levels of depressive symptoms, results demonstrated that emotional predominance diminished as the level of depressive symptoms increased. These results indicate that individuals who report more depressive symptoms compared to their less depressed counterparts tend to assign more meaning to neutral faces.

Binocular rivalry between identical retinal stimuli with an induced color difference.

An open question in color rivalry is whether alternation between two colors is caused by a difference in receptoral stimulation or a difference in the neural representation of color appearance. This question was examined with binocular rivalry between physically identical lights that differed in appearance due to chromatic induction. Perceptual alternation was measured between gratings of the same chromaticity; each one was presented within a different patterned surround that caused the gratings, one to each eye, to appear unequal in hue because of chromatic induction. The gratings were presented dichoptically with binocular disparity so the rivalrous gratings appeared in front of the surround. Perceptual alternation in hue was found for the two physically identical chromaticities. Stereoscopic depth also was perceived, corroborating binocular neural combination despite color rivalry (Treisman, 1962). The results show that color rivalry is resolved after color-appearance shifts caused by chromatic context, and that color rivalry does not require competing unequal cone excitations from the rivalrous stimuli.

Misbinding of color to form in afterimages.

Under dichoptic viewing conditions, rivalrous gratings that differ in both color and form can give the percept of the color from one eye in part of the form in the other eye. This study examined the afterimage following such misbinding of color to form. The first experiment established that afterimages of the misbound percept were seen. Two possible mechanisms for the misbound afterimage are (1) persisting retinal representations that are rivalrous and subsequently resolved to give misbinding, as during rivalrous viewing, and (2) a persisting response from a central neural representation of the misbound percept with the form from one eye and color from the other eye. The results support afterimage formation from a central representation of the misbound percept, not from resolution of rivalrous monocular representations.

Early visual mechanisms do not contribute to synesthetic color experience.

Color-graphemic synesthetes perceive colors when viewing alphanumeric characters. Theories of color-graphemic synesthesia posit that synesthetic color experience arises from activation of neural mechanisms also involved in ordinary color vision. To learn how early in visual processing those mechanisms exist, we performed several experiments. In one experiment, real colors were altered in appearance by the lightness of their backgrounds, but the appearance of synesthetic colors was immune to surrounding light levels. In the second experiment using a hue cancellation technique, adaptation to synesthetic color had no subsequent effect on the amount of cancelling light to achieve equilibrium yellow, whereas adaptation to real colors did. In the third experiment, vivid synesthetic color had no influence on equilibrium yellow settings of the actual color of the characters evoking synesthesia. Because brightness contrast and chromatic adaptation are putatively mediated by neural mechanisms early in visual processing including retina and primary visual cortex, our results imply that neural events responsible for synesthetic color emerge subsequent to these early visual stages.

The influence of chromatic context on binocular color rivalry: perception and neural representation.

The predominance of rivalrous targets is affected by surrounding context when stimuli rival in orientation, motion or color. This study investigated the influence of chromatic context on binocular color rivalry. The predominance of rivalrous chromatic targets was measured in various surrounding contexts. The first experiment showed that a chromatic surround's influence was stronger when the surround was uniform or a grating with luminance contrast (chromatic/black grating) compared to an equiluminant grating (chromatic/white). The second experiment revealed virtually no effect of the orientation of the surrounding chromatic context, using chromatically rivalrous vertical gratings. These results are consistent with a chromatic representation of the context by a non-oriented, chromatically selective and spatially antagonistic receptive field. Neither a double-opponent receptive field nor a receptive field without spatial antagonism accounts for the influence of context on binocular color rivalry.

Intensity dependence in high-level facial expression adaptation aftereffect.

Perception of a facial expression can be altered or biased by a prolonged viewing of other facial expressions, known as the facial expression adaptation aftereffect (FEAA). Recent studies using antiexpressions have demonstrated a monotonic relation between the magnitude of the FEAA and adaptor extremity, suggesting that facial expressions are opponent coded and represented continuously from one expression to its antiexpression. However, it is unclear whether the opponent-coding scheme can account for the FEAA between two facial expressions. In the current study, we demonstrated that the magnitude of the FEAA between two facial expressions increased monotonically as a function of the intensity of adapting facial expressions, consistent with the predictions based on the opponent-coding model. Further, the monotonic increase in the FEAA occurred even when the intensity of an adapting face was too weak for its expression to be recognized. These results together suggest that multiple facial expressions are encoded and represented by balanced activity of neural populations tuned to different facial expressions.