Congruent or conflicting? The interaction between emoji and textual sentence is not that simple!

As a Japanese graphic symbol widely used in the world, Emoji plays an important role in computer mediated communication. Despite its prevalent use, the interaction dynamics between emoji and textual sentences remain inadequately explored. Based on the emotional function of emoji, this study uses the indirect priming method to explore the emotional impact of emoji on subsequent text in computer mediated communication through two progressive behavioral experiments. The results show that: (1) Emoji positioned at the onset of a sentence induce an emotional priming effect; (2) The processing speed is slowest when emoji and text are emotionally conflicting, while in non-conflicting condition, the type of emoji moderates the processing of combined sentences; (3) The emotional influence of emoji plays an auxiliary role, and the valence of textual sentence plays a decisive role in emotional perception.

A spatial version of the Stroop task for examining proactive and reactive control independently from non-conflict processes.

Conflict-induced control refers to humans' ability to regulate attention in the processing of target information (e.g., the color of a word in the color-word Stroop task) based on experience with conflict created by distracting information (e.g., an incongruent color word), and to do so either in a proactive (preparatory) or a reactive (stimulus-driven) fashion. Interest in conflict-induced control has grown recently, as has the awareness that effects attributed to those processes might be affected by conflict-unrelated processes (e.g., the learning of stimulus-response associations). This awareness has resulted in the recommendation to move away from traditional interference paradigms with small stimulus/response sets and towards paradigms with larger sets (at least four targets, distractors, and responses), paradigms that allow better control of non-conflict processes. Using larger sets, however, is not always feasible. Doing so in the Stroop task, for example, would require either multiple arbitrary responses that are difficult for participants to learn (e.g., manual responses to colors) or non-arbitrary responses that can be difficult for researchers to collect (e.g., vocal responses in online experiments). Here, we present a spatial version of the Stroop task that solves many of those problems. In this task, participants respond to one of six directions indicated by an arrow, each requiring a specific, non-arbitrary manual response, while ignoring the location where the arrow is displayed. We illustrate the usefulness of this task by showing the results of two experiments in which evidence for proactive and reactive control was obtained while controlling for the impact of non-conflict processes.

Both task-irrelevant and task-relevant information trigger reactive conflict adaptation in the item-specific proportion-congruent paradigm.

Adapting attention flexibly is a fundamental ability of the human control system. In the color-word Stroop task, for example, congruency effects are typically smaller for colors and words that appear mainly in incongruent stimuli (mostly-incongruent items) than for colors and words that appear mainly in congruent stimuli (mostly-congruent items). At least part of this item-specific proportion-congruent (ISPC) effect is due to a process of reactive conflict adaptation that affords higher selectivity (i.e., more efficient selection of task-relevant information) when a specific stimulus is presented that is frequently associated in the experiment with conflicting task-irrelevant information. What is unclear, however, is whether, normally, this stimulus-specific adaptation is triggered by the task-relevant component, the task-irrelevant component, or both components of the stimulus. In two experiments, using modified color-word (Experiment 1) and spatial (Experiment 2) Stroop tasks that allowed task-relevant and task-irrelevant triggering processes to be dissociated, we found that the two processes have approximately equivalent impacts. Because these results were obtained in experiments imposing no limitations on the processes potentially contributing to the ISPC effect, these results challenge claims that the ISPC effect involves conflict-adaptation processes only in special situations. The ISPC effect may involve conflict-adaptation processes in most situations, with both task-relevant and task-irrelevant information triggering such processes.

Virtual Reality Experiments on Emotional Face Recognition Find No Evidence of Mood-Congruent Effects.

Mood-congruent effects have been demonstrated many times, but few studies have managed to replicate the effect with natural moods. Additionally, the ecological validity of mood induction and real-time observation deficiency remain unresolved. Using a newly developed, virtual-reality-based eye-tracking technique, the present study conducted real-time observations of mood effects on emotional face recognition with simulated "real-life" pleasant and grisly scenes. In experiment 1, participants performed an emotional face recognition task in both positive and negative virtual reality scenes. The recognition tests and gaze tracking results failed to support mood-congruent effects but did show a mood effect independent of a strong emotional face effect. In experiment 2, participants performed a neutral face recognition task in pleasant and grisly scenes that were matched for arousal levels, and the mood effect disappeared. The results also revealed a robust negativity bias in emotional face recognition, which was found to accompany a mood repair effect.

Item-specific control of attention in the Stroop task: Contingency learning is not the whole story in the item-specific proportion-congruent effect.

A robust finding in the Stroop literature is that congruency effects (i.e., the color-naming latency difference between color words presented in incongruent vs. congruent colors) are larger for color words presented most often in their congruent color than for color words presented most often in incongruent colors. However, the cause of this item-specific proportion congruent (ISPC) effect is unclear, as it might be produced by either a conflict-adaptation strategy (e.g., prepare for conflict when the word RED appears) and/or a more general learning mechanism of stimulus-response contingencies (e.g., prepare to respond blue when the word RED appears). Thus far, attempts to directly dissociate the two processes appear to indicate no role for conflict adaptation, at least in situations in which contingency learning is also possible. We re-examined this conclusion in a Stroop task in which contingency learning and item-specific conflict frequency were manipulated partially independently. In addition to a contingency-learning effect emerging for stimuli matched on conflict frequency, a conflict-adaptation effect also emerged for stimuli matched on contingency. The two effects also had different time courses, with the contingency-learning effect emerging early and remaining stable throughout the experiment and the conflict-adaptation effect arising later in the experiment. These results challenge not only the contingency-learning account of the ISPC effect, an account that denies the existence of a conflict-adaptation process, but also control accounts that assume that, although conflict-adaptation processes do exist, they are not used when contingency learning is also possible.

Independent control processes? Evidence for concurrent distractor inhibition and attentional usage of distractor information.

Interference evoked by a distractor presented prior to a target stimulus is reduced when the distractor-target SOA is increased, suggesting inhibition of distractor-related activation. Distractor processing is also assumed to be (strategically) adjusted to the proportions of congruent and incongruent target-distractor combinations, yielding a larger distractor interference effect when the proportion of congruent trials is higher (i.e., Proportion Congruent Effect, PCE). To explore the interplay of proportion congruent-based processing adjustment and the time course of distractor-related activation we varied the proportions of congruent and incongruent trials as well as the distractor-target SOA. To control for item-specific priming we kept distractor-related contingencies (i.e., frequency of individual distractor-target conjunctions) constant for a subset of the stimuli (and used a different subset to manipulate the proportions of congruent and incongruent trials). A PCE occurred, even for the subset of stimuli associated with constant distractor-related contingencies, thus ruling out item-specific contingency learning. Distractor interference was reduced when the SOA was increased, but this reduction did not differ between the proportion congruent conditions, as confirmed by a Bayesian analysis. Our results are consistent with independent processes pertaining to usage of distractor information for biasing response selection and distractor inhibition during the SOA. Alternative interpretations of the independent effects of the PC manipulation and the distractor-target SOA are discussed.

Affective Influence on Context-Specific Proportion Congruent (CSPC) Effect.

Congruency effects diminish in contexts associated with mostly incongruent trials compared with contexts associated with mostly congruent trials. Here, we aimed to assess affective influences on this context-specific proportion congruent (CSPC) effect. We presented either neutral or affective faces as context stimuli in a Flanker task and associated mostly incongruent trials with male/female faces for a neutral-context group and with angry/happy faces for a affective-context group. To assess general influences of affective valence, we compared CSPC effects between the neutral-context group and the affective-context group. To assess valence-specific influences, we compared the size of CSPC effects - for the affective-context group only - between participants for whom mostly incongruent trials were associated with angry faces and participants for whom mostly incongruent trials were associated with happy faces. However, the modulating influence on the CSPC effect from affective versus neutral contexts or from valence-proportion mappings was not statistically significant.

Evidence against conflict monitoring and adaptation: An updated review.

One of the most influential ideas in recent decades in the cognitive psychology literature is conflict monitoring theory. According to this account, each time we experience a conflict (e.g., between a colour word and print colour in the Stroop task), attentional control is upregulated to minimize distraction on subsequent trials. Though influential, evidence purported to support this theoretical model (primarily, proportion congruent and congruency sequence effects) has been frequently criticized. Furious debate has centered on whether or not conflict monitoring does or does not occur and, if so, under which conditions. The present article presents an updated review of this debate. In particular, the article considers new research that either (a) seems particularly damaging for the conflict monitoring view or (b) seems to provide support for the theory. The author argues that new findings of the latter sort are still not compelling, several of which have already-demonstrated confounds and others which are plausibly confounded. Further progress has, to a greater extent than not, provided even stronger support for the position that conflict monitoring is merely an illusion. Instead, the net results can be more coherently understood in terms of (relatively) simpler learning/memory biases unrelated to conflict or attention that confound the key paradigms.

Context-Specific Proportion Congruency Effects: An Episodic Learning Account and Computational Model.

In the Stroop task, participants identify the print color of color words. The congruency effect is the observation that response times and errors are increased when the word and color are incongruent (e.g., the word "red" in green ink) relative to when they are congruent (e.g., "red" in red). The proportion congruent (PC) effect is the finding that congruency effects are reduced when trials are mostly incongruent rather than mostly congruent. This PC effect can be context-specific. For instance, if trials are mostly incongruent when presented in one location and mostly congruent when presented in another location, the congruency effect is smaller for the former location. Typically, PC effects are interpreted in terms of strategic control of attention in response to conflict, termed conflict adaptation or conflict monitoring. In the present manuscript, however, an episodic learning account is presented for context-specific proportion congruent (CSPC) effects. In particular, it is argued that context-specific contingency learning can explain part of the effect, and context-specific rhythmic responding can explain the rest. Both contingency-based and temporal-based learning can parsimoniously be conceptualized within an episodic learning framework. An adaptation of the Parallel Episodic Processing model is presented. This model successfully simulates CSPC effects, both for contingency-biased and contingency-unbiased (transfer) items. The same fixed-parameter model can explain a range of other findings from the learning, timing, binding, practice, and attentional control domains.

Interplay Between the Object and Its Symbol: The Size-Congruency Effect.

Grounded cognition suggests that conceptual processing shares cognitive resources with perceptual processing. Hence, conceptual processing should be affected by perceptual processing, and vice versa. The current study explored the relationship between conceptual and perceptual processing of size. Within a pair of words, we manipulated the font size of each word, which was either congruent or incongruent with the actual size of the referred object. In Experiment 1a, participants compared object sizes that were referred to by word pairs. Higher accuracy was observed in the congruent condition (e.g., word pairs referring to larger objects in larger font sizes) than in the incongruent condition. This is known as the size-congruency effect. In Experiments 1b and 2, participants compared the font sizes of these word pairs. The size-congruency effect was not observed. In Experiments 3a and 3b, participants compared object and font sizes of word pairs depending on a task cue. Results showed that perceptual processing affected conceptual processing, and vice versa. This suggested that the association between conceptual and perceptual processes may be bidirectional but further modulated by semantic processing. Specifically, conceptual processing might only affect perceptual processing when semantic information is activated. The current study.

Contingency learning is not affected by conflict experience: Evidence from a task conflict-free, item-specific Stroop paradigm.

A contingency learning account of the item-specific proportion congruent effect has been described as an associative stimulus-response learning process that has nothing to do with controlling the Stroop conflict. As supportive evidence, contingency learning has been demonstrated with response conflict-free stimuli, such as neutral words. However, what gives rise to response conflict and to Stroop interference in general is task conflict. The present study investigated whether task conflict can constitute a trigger or, alternatively, a booster to the contingency learning process. This was done by employing a "task conflict-free" condition (i.e., geometric shapes) and comparing it with a "task conflict" condition (i.e., neutral words). The results showed a significant contingency learning effect in both conditions, refuting the possibility that contingency learning is triggered by the presence of a task conflict. Contingency learning was also not enhanced by the task conflict experience, indicating its complete insensitivity to Stroop conflict(s). Thus, the results showed no evidence that performance optimization as a result of contingency learning is greater under conflict, implying that contingency learning is not recruited to assist the control system to overcome conflict.

Generalizing attentional control across dimensions and tasks: evidence from transfer of proportion-congruent effects.

Three experiments investigated transfer of list-wide proportion congruent (LWPC) effects from a set of congruent and incongruent items with different frequency (inducer task) to a set of congruent and incongruent items with equal frequency (diagnostic task). Experiments 1 and 2 mixed items from horizontal and vertical Simon tasks. Tasks always involved different stimuli that varied on the same dimension (colour) in Experiment 1 and on different dimensions (colour, shape) in Experiment 2. Experiment 3 mixed trials from a manual Simon task with trials from a vocal Stroop task, with colour being the relevant stimulus in both tasks. There were two major results. First, we observed transfer of LWPC effects in Experiments 1 and 3, when tasks shared the relevant dimension, but not in Experiment 2. Second, sequential modulations of congruency effects transferred in Experiment 1 only. Hence, the different transfer patterns suggest that LWPC effects and sequential modulations arise from different mechanisms. Moreover, the observation of transfer supports an account of LWPC effects in terms of list-wide cognitive control, while being at odds with accounts in terms of stimulus-response (contingency) learning and item-specific control.

Creatures of habit (and control): a multi-level learning perspective on the modulation of congruency effects.

The congruency sequence effect (CSE) describes the finding that congruency effects in classic probes of selective attention (like the Stroop, Simon, and flanker tasks) are smaller following an incongruent than following a congruent trial. The past two decades have generated a large literature on determinants and boundary conditions for the CSE and similar, congruency-proportion based modulations of congruency effects. A prolonged and heated theoretical discussion has been guided primarily by a historically motivated dichotomy between "top-down control" versus "associative bottom-up" explanations for these effects. In the present article, I attempt to integrate and contextualize the major empirical findings in this field by arguing that CSEs (and related effects) are best understood as reflecting a composite of multiple levels of learning that differ in their level of abstraction. Specifically, learning does not only involve the trial-by-trial encoding, binding, and cued retrieval of specific stimulus-response associations, but also of more abstract trial features. Moreover, these more abstract trial or event features can be both external, such as the spatial and temporal context in which a stimulus occurs, as well as internal, like the experience of difficulty, and the attentional control settings that were employed in dealing with the stimulus. From this perspective, top-down control and bottom-up priming processes work in concert rather than in opposition. They represent different levels of abstraction in the same learning scheme and they serve a single, common goal: forming memory ensembles that will facilitate fast and appropriate responding to recurring stimuli or events in the environment.