Neural dynamics underlying the illusion of control during reward processing.

The illusion of control refers to a behavioral bias in which people believe they have greater control over completely stochastic events than they actually do, leading to an inflated estimate of reward probability than objective probability warrants. In this study, we examined how reward system is modulated by the illusion of control through the lens of neural dynamics. Participants in a behavioral task exhibited a classical illusion of control, assigning a higher value to the gambling wheels they picked themselves than to those given randomly. An event-related potential study of the same task revealed that this behavioral bias is associated with reduced reward anticipation as indexed by the stimulus-preceding negativity, diminished positive prediction error signals as reflected by the reward positivity, and enhanced motivational salience as revealed by the P300. Our findings offer a mechanistic understanding of the illusion of control in terms of reward dynamics.

Effects of mindfulness-based music listening on conflict control in young adults with insomnia disorder: behavioral and event-related potential evidence.

Introduction: Insomnia Disorder (ID) has become the second most prevalent mental disorder, with significant negative effects on daytime cognitive functions. Previous studies suggested that mindfulness-based music listening (MBML) can effectively improve conflict control and attentional processing in healthy adults. However, the behavioral and neurophysiological characteristics of MBML in young adults with ID remain unclear. Methods: To explore the behavioral and neurophysiological characteristics of MBML in regulating negative emotions among young Chinese adults with ID, 60 young adults with ID were asked to complete an emotion-word Stroop task under three mood states while recording event-related potentials (ERPs). Results: Task and questionnaire results showed that (1) negative emotion induced by the negative simulated video significantly suppressed the attentional processing of emotional faces and words in the conflict control task among young people with ID, (2) MBML reduced cognitive and physical arousal levels, enhanced positive mood, and improved attentional control abilities in young adults with ID. The ERP results showed that a greater N3 effect and the smaller P3 and late positive component (LPC) effects reflected that MBML effectively regulated negative emotions induced by the negative simulated video and attentional processing abilities for conflict control in young adults with ID. Discussion: Maintaining mindfulness while listening to music may enhance positive emotional experiences and improve cognitive ability, and exhibit larger N3 effects and smaller P3 and LPC effects in the electrophysiology mechanism, with a reduction in the hyperarousal level in young adults with insomnia disorders.

The effect of temporal predictability on sensory gating: Cortical responses inform perception.

Prepulse inhibition of perceived stimulus intensity (PPIPSI) is a phenomenon where a weak stimulus preceding a stronger one reduces the perceived intensity of the latter. Previous studies have shown that PPIPSI relies on attention and is sensitive to stimulus onset asynchrony (SOA). Longer SOAs may increase conscious awareness of the impact of gating mechanisms on perception by allowing more time for attention to be directed toward relevant processing channels. In other psychophysiological paradigms, temporal predictability improves attention to task relevant stimuli and processes. We hypothesized that temporal predictability may similarly facilitate attention being directed toward the pulse and its processing in PPIPSI. To examine this, we conducted a 2 (SOA: 90 ms, 150 ms) × 2 (predictability: low, high) experiment, where participants were tasked with comparing the perceived intensity of an acoustic pulse-alone against one preceded by a prepulse. The relationship between PPIPSI and cortical PPI (N1-P2 inhibition) was also investigated. Significant main effects of temporal predictability, SOA, and cortical PPI were revealed. Under high temporal predictability, both SOAs (90 and 150 ms) elicited greater PPIPSI. The findings indicate that temporal predictability enhances the timely allocation of finite attentional resources, increasing PPIPSI observations by facilitating perceptual access to the gated pulse signal. Moreover, the finding that reductions in N1-P2 magnitude by a prepulse are associated with increased probability of the participants perceiving the pulse "with prepulse" as less intense, suggests that under various experimental conditions, the link between these cortical processes and perception is similarly engaged.

EEG might be better left alone, but ERPs must be attended to: Optimizing the late positive potential preprocessing pipeline.

The late positive potential (LPP) is an ERP component commonly used to study emotional processes and has been proposed as a neuroaffective biomarker for research and clinical uses. These applications, however, require standardized procedures for elicitation and ERP data processing. We evaluated the impact of different EEG preprocessing steps on the LPP's data quality and statistical power. Using a diverse sample of 158 adults, we implemented a multiverse analytical approach to compare preprocessing pipelines that progressively incorporated more steps: artifact detection and rejection, bad channel interpolation, and bad segment deletion. We assessed each pipeline's effectiveness by computing the standardized measurement error (SME) and conducting simulated experiments to estimate statistical power in detecting significant LPP differences between emotional and neutral images. Our findings highlighted that artifact rejection is crucial for enhancing data quality and statistical power. Voltage thresholds to reject trials contaminated by artifacts significantly affected SME and statistical power. Once artifact detection was optimized, further steps provided minor improvements in data quality and statistical power. Importantly, different preprocessing pipelines yielded similar outcomes. These results underscore the robustness of the LPP's affective modulation to preprocessing choices and the critical role of effective artifact management. By refining and standardizing preprocessing procedures, the LPP can become a reliable neuroaffective biomarker, supporting personalized clinical interventions for affective disorders.

On the lasting impact of mild traumatic brain injury on working memory: Behavioural and electrophysiological evidence.

Despite increasing recognition of the significance of mild traumatic brain injury (mTBI), the long-term cognitive consequences of the injury remain unclear. More sensitive measures that can detect subtle cognitive changes and consideration of individual variability are needed to properly characterise cognitive outcomes following mTBI. Here, we used complex behavioural tasks, individual differences approaches, and electrophysiology to investigate the long-term cognitive effects of a history of mTBI. In Experiment 1, participants with self-reported mTBI history (n=82) showed poorer verbal working memory performance on the operation span task compared to control participants (n=88), but there were no group differences in visual working memory, multitasking, cognitive flexibility, attentional control, visuospatial ability, or information processing speed. Individual differences analyses revealed that time since injury and presence of memory loss predicted visual working memory capacity and visuospatial ability, respectively, in those with mTBI history. In Experiment 2, participants with mTBI history (n=20) again demonstrated poorer verbal working memory on the operation span task compared to control participants (n=38), but no group differences were revealed on a visuospatial complex span task or simpler visual working memory measures. We also explored the electrophysiological indices of visual working memory using EEG during a change detection task. No differences were observed in early sensory event-related potentials (P1, N1) or the later negative slow wave associated with visual working memory capacity. Together, these findings suggest that mTBI history may be associated with a lasting, isolated disruption in the subsystem underlying verbal working memory storage. The results emphasize the importance of sensitive cognitive measures and accounting for individual variability in injury characteristics when assessing mTBI outcomes.

The bidirectional influence between emotional language and inhibitory control in Chinese: An ERP study.

The bidirectional influence between emotional language and inhibitory processes has been studied in alphabetic languages, highlighting the need for additional investigation in nonalphabetic languages to explore potential cross-linguistic differences. The present ERP study investigated the bidirectional influence in the context of Mandarin, a language with unique linguistic features and neural substrates. In Experiment 1, emotional adjectives preceded the Go/NoGo cue. The ERPs revealed that negative emotional language facilitated inhibitory control. In Experiment 2, with a Go/NoGo cue preceding the emotional language, the study confirmed that inhibitory control facilitated the semantic integration of negative language in Chinese, whereas the inhibited state may not affect deeper refinement of the emotional content. However, no interaction was observed in positive emotional language processing. These results suggest an interaction between inhibitory control and negative emotional language processing in Chinese, supporting the integrative emotion-cognition view.

Lower frequency range of auditory input facilitates stream segregation in older adults.

The current study investigated the effect of lower frequency input on stream segregation acuity in older, normal hearing adults. Using event-related brain potentials (ERPs) and perceptual performance measures, we previously showed that stream segregation abilities were less proficient in older compared to younger adults. However, in that study we used frequency ranges greater than 1500 Hz. In the current study, we lowered the target frequency range below 1500 Hz and found similar stream segregation abilities in younger and older adults. These results indicate that the perception of complex auditory scenes is influenced by the spectral content of the auditory input and suggest that lower frequency ranges of input in older adults may facilitate listening ability in complex auditory environments. These results also have implications for the advancement of prosthetic devices.

Processing of emotional connotations in Chinese monomorphic and compound words reflected by the early posterior negativity.

Writing stands as one of humanity's most profound inventions, facilitating the efficient sharing and transmission of vast amounts of information. Similar to images and facial expressions, visual (written) words possess the ability to evoke emotional connotations. Understanding how the brain perceives these emotional nuances encoded in highly symbolic visual words is a key focus of the emerging field of "affective neurolinguistics." At the core of this inquiry lies the examination of the early posterior negativity (EPN), an event-related potentials (ERPs) component peaking around 300 ms after stimulus onset in the occipitotemporal scalp region. EPN has consistently emerged in response to emotional stimuli, encompassing pictures, faces, and visual words. However, prior research has notably lacked observation of EPN in response to Chinese emotional words, raising questions about potential differences in emotional processing between Chinese and other languages. Given the logographic nature of the Chinese writing system and the prevalence of compound words in the Chinese lexicon, this study aims to explore whether the emotional processing of Chinese monomorphic and compound words elicits an EPN response. Two experiments were conducted: Experiment 1 utilized one-character words (monomorphic words), while Experiment 2 employed two-character words (compound words). Participants were assigned a go/no-go task, instructed to respond to unknown words (word recognition task) or blue stimuli (color decision task). Data analysis using a data-driven mass univariate approach revealed significant ERP differences between emotional and neutral words. Notably, the time course, scalp topography, and cortical generators of the difference ERP presented a characteristic EPN response in both experiments. These findings strongly support the notion that the processing of emotional connotations in both Chinese monomorphic and compound words is reflected by the EPN, paving the way for future research using EPN as an emotion-related ERP component for investigating emotional processing of Chinese words.

Neural Signals Associated with Orienting Response and Arousal Inhibition in Concealed Information Test.

Recent theory suggests that both the orienting response and arousal inhibition play roles in the effect of the concealed information test (CIT). However, the neural signatures associated with these two processes remain unclear. To address this issue, participants were motivated to either conceal or reveal crime-related stimulus during CIT while EEG was recorded. By using a temporal principal component analysis, we found that crime-related stimuli produced a larger early P3 than crime-irrelevant stimuli in both the conceal condition and reveal condition. This result suggests that this early P3 reflects an orienting response. In addition, we found that crime-related stimuli elicited a larger frontal negative slow wave than crime-irrelevant stimuli in the conceal condition but not the reveal condition, which suggests that the frontal negative slow wave reflects the arousal inhibition process. These results provide crucial evidence for understanding the neural basis underlying CIT.

Functional benefits of continuous vs. categorical listening strategies on the neural encoding and perception of noise-degraded speech.

Acoustic information in speech changes continuously, yet listeners form discrete perceptual categories to ease the demands of perception. Being a more continuous/gradient as opposed to a more discrete/categorical listener may be further advantageous for understanding speech in noise by increasing perceptual flexibility and resolving ambiguity. The degree to which a listener's responses to a continuum of speech sounds are categorical versus continuous can be quantified using visual analog scaling (VAS) during speech labeling tasks. Here, we recorded event-related brain potentials (ERPs) to vowels along an acoustic-phonetic continuum (/u/ to /a/) while listeners categorized phonemes in both clean and noise conditions. Behavior was assessed using standard two alternative forced choice (2AFC) and VAS paradigms to evaluate categorization under task structures that promote discrete vs. continuous hearing, respectively. Behaviorally, identification curves were steeper under 2AFC vs. VAS categorization but were relatively immune to noise, suggesting robust access to abstract, phonetic categories even under signal degradation. Behavioral slopes were correlated with listeners' QuickSIN scores; shallower slopes corresponded with better speech in noise performance, suggesting a perceptual advantage to noise degraded speech comprehension conferred by a more gradient listening strategy. At the neural level, P2 amplitudes and latencies of the ERPs were modulated by task and noise; VAS responses were larger and showed greater noise-related latency delays than 2AFC responses. More gradient responders had smaller shifts in ERP latency with noise, suggesting their neural encoding of speech was more resilient to noise degradation. Interestingly, source-resolved ERPs showed that more gradient listening was also correlated with stronger neural responses in left superior temporal gyrus. Our results demonstrate that listening strategy modulates the categorical organization of speech and behavioral success, with more continuous/gradient listening being advantageous to sentential speech in noise perception.

Impaired cognitive flexibility in major depressive disorder: Evidences from spatial-temporal ERPs analysis.

BACKGROUND: Major Depressive Disorder (MDD) may exhibit impairments in cognitive flexibility. This study investigated whether the cognitive flexibility deficits in MDD are evident across general stimuli or specific to emotional stimuli, while exploring the underlying neuropsychological mechanism. METHODS: A total of 41 MDD patients and 42 healthy controls (HCs) were recruited. Event-related potentials (ERPs) were recorded when participants performed a non-emotional and an emotional task switching paradigm (N-ETSP and ETSP), both of which assessed cognitive flexibility. Microstate and source localization analysis were applied to reflect brain activity among different brain areas during task switching. RESULTS: In the N-ETSP, MDD group showed larger P3 difference wave (Pd3) amplitudes and longer P2 difference wave (Pd2) latencies. In the ETSP, MDD group displayed smaller N2 difference wave (Nd2) amplitudes and larger Pd3 amplitudes. The comparison of sLORETA images of emotional switch task and emotional repeat task showed that MDD group had increased activation in the precentral gyrus in microstate2 of the P2 time window and had reduced activation in the middle occipital gyrus in microstate3 of the N2 time window. LIMITATIONS: The cross-sectional design failed to capture dynamic changes in cognitive flexibility in MDD. CONCLUSIONS: MDD demonstrated impaired cognitive flexibility respond to both non-emotional and emotional stimuli, with greater impairment for negative emotional stimuli. These deficits are evident in abnormal ERPs component during the early attention stage and the later task preparation stage. Furthermore, abnormal emotional switching cost in MDD appears to be related to early abnormal perceptual control in the parietal-occipital cortex.

Task-specific relationships between error-related ERPs and behavior: Flanker, Stroop, and Go/Nogo tasks.

Performance monitoring has been widely studied during different forced-choice response tasks. Participants typically show longer response times (RTs) and increased accuracy following errors, but there are inconsistencies regarding the connection between error-related event-related brain potentials (ERPs) and behavior, such as RT and accuracy. The specific task in any given study could contribute to these inconsistencies, as different tasks may require distinct cognitive processes that impact ERP-behavior relationships. The present study sought to determine whether task moderates ERP-behavior relationships and whether these relationships are robustly observed when tasks and stimuli are treated as random effects. ERPs and behavioral indices (RTs and accuracy) recorded during flanker, Stroop, and Go/Nogo tasks from 180 people demonstrated a task-specific effect on ERP-behavior relationships, such that larger previous-trial error-related negativity (ERN) predicted longer RTs and greater likelihood of a correct response on subsequent trials during flanker and Stroop tasks but not during Go/Nogo task. Additionally, larger previous-trial error positivity (Pe) predicted faster RTs and smaller variances of RTs on subsequent trials for Stroop and Go/Nogo tasks but not for flanker task. When tasks and stimuli were treated as random effects, ERP-behavior relationships were not observed. These findings support the need to consider the task used for recording performance monitoring measures when interpreting results across studies.

Neurophysiological effects of cognitive behavioral therapy in social anxiety: An ERP study using a dot-probe task.

BACKGROUND: Social anxious individuals show attention bias towards emotional stimuli, this phenomenon is considered to be an important cause of anxiety generation and maintenance. Cognitive-behavioral therapy (CBT) is a standard psychotherapy for social anxiety disorder. CBT decreases attention biases by correcting the maladaptive beliefs of socially anxious individuals, but it is not clear whether CBT alters neurophysiological features of socially anxious individuals at early automatic and/or late cognitive strategy stage of attentional processing. METHOD: To address this knowledge gap, we collected pre-treatment event-related potential data of 22 socially anxious individuals while they performed a dot-probe task. These participants then received eight weeks of CBT, and post-treatment ERP data were collected after completion of CBT treatment. We also included 29 healthy controls and compared them with individuals with social anxiety to determine the neural mechanisms underlying the effectiveness of CBT. RESULTS: Participants' social anxiety level was significantly alleviated with CBT. ERP results revealed that (1) compared to pre-treatment phase, P1 amplitudes induced by probes significantly decreased at post-treatment phase, whereas P3 amplitudes increased at post-treatment phase; the P1 amplitudes induced by probes following happy-neutral face pairs in socially anxious individuals after treatment was significantly different with that in healthy controls; (2) amplitude of components elicited by face pairs did not change significantly between pre-treatment and post-treatment phases; (3) changes of Liebowitz Social Anxiety Scale were positively correlated with changes of P1 amplitude, and negatively correlated with changes of N1 amplitude. LIMITATIONS: Our sample was university students and lacked randomization, which limits the generalizability of the results. CONCLUSION: The present results demonstrated that CBT may adjust cognitive strategies in the later stage of attentional processing, indicating by changed ERPs appeared in probe-presenting stage for social anxiety.

The influence of task-irrelevant color perception on flanker task performance: Insights from behavioral and ERP data.

Perception of color as a task-relevant stimulus can affect cognition and behavior in the flanker task; however, it remains unclear whether it has the same impact when it is a task-irrelevant stimulus dimension. To this end, we applied four-letter flanker tasks with or without colored (red/blue) to 23 healthy young adults, while recording the event-related potentials (ERPs) and behavioral performance. The flanker task included four kinds of color types: non-color letter (NC), all color letter (AC), flanker color letter (FC), and target color letter (TC), each flanker task included congruent and incongruent conditions. The behavioral data demonstrated the classic conflict effect across all color types of flanker tasks in both reaction times (RTs) and accuracy, the significant interaction and main effect of color type factors were only observed in accuracy. The ERP results showed significant interaction between conflict factor (congruent, incongruent) and color type (NC, AC, FC, and TC), and the color type factor enhanced the fronto-central P2 (180-200 ms), descended the fronto-centro-parietal N2b (260-320 ms), and increased the fronto-central P3b (360-520 ms). The fronto-central P2 and the fronto-central P3b were larger for TC than NC, AC, and FC in the congruent condition, while the fronto-central P3b was smaller for NC than AC, FC, and TC in the incongruent condition. Furthermore, the fronto-centro-parietal N2b was decreased successively in NC, AC, FC, and TC in both congruent and incongruent conditions. Overall, our findings suggested that the task-irrelevant stimuli dimension of color can capture some attentional resources and is affected by the location of color (target/flanker) and the type of task trial (congruent/incongruent) in the flanker task.

When social hierarchy matters grammatically: Investigation of the processing of honorifics in Korean.

Korean grammar encodes relative social hierarchies among interlocutors in various ways. This study utilized honorific subject-verb agreement in Korean to investigate how social hierarchies are processed during sentence comprehension. The experimental results showed that honorific violations elicited processing difficulties. The use of an honorific verb with an unhonorifiable subject resulted in lower naturalness ratings, longer reading times, and elicited a P600, similar to effects observed with number, person, and gender agreement in Spanish or English. These findings suggest that social hierarchies have become integrated into grammar, constraining how native Korean speakers process sentences. However, the agreement between honorific subjects and verbs seems asymmetrical; the mismatch effect was smaller or absent when an honorifiable subject was not accompanied by an honorific verb, suggesting that while an honorific verb requires an honorifiable subject, the reverse is not necessarily true. The results indicate that the -si agreement in Korean is a form of morpho-syntactic agreement, despite its asymmetrical nature.

An ERP investigation of perceptual vs motoric iconicity in sign production.

The type of form-meaning mapping for iconic signs can vary. For perceptually-iconic signs there is a correspondence between visual features of a referent (e.g., the beak of a bird) and the form of the sign (e.g., extended thumb and index finger at the mouth for the American Sign Language (ASL) sign BIRD). For motorically-iconic signs there is a correspondence between how an object is held/manipulated and the form of the sign (e.g., the ASL sign FLUTE depicts how a flute is played). Previous studies have found that iconic signs are retrieved faster in picture-naming tasks, but type of iconicity has not been manipulated. We conducted an ERP study in which deaf signers and a control group of English speakers named pictures that targeted perceptually-iconic, motorically-iconic, or non-iconic ASL signs. For signers (unlike the control group), naming latencies varied by iconicity type: perceptually-iconic < motorically-iconic < non-iconic signs. A reduction in the N400 amplitude was only found for the perceptually-iconic signs, compared to both non-iconic and motorically-iconic signs. No modulations of N400 amplitudes were observed for the control group. We suggest that this pattern of results arises because pictures eliciting perceptually-iconic signs can more effectively prime lexical access due to greater alignment between features of the picture and the semantic and phonological features of the sign. We speculate that naming latencies are facilitated for motorically-iconic signs due to later processes (e.g., faster phonological encoding via cascading activation from semantic features). Overall, the results indicate that type of iconicity plays role in sign production when elicited by picture-naming tasks.

Overt and Covert Effects of Mental Fatigue on Attention Networks: Evidence from Event-Related Potentials during the Attention Network Test.

Mental fatigue is a variation in the psychophysiological state that subjects encounter during or after prolonged cognitive activity periods, affecting top-down attention and cognitive control. The present study aimed to investigate the effects of mental fatigue on attention in the context of the three attention networks according to the Posnerian model (alerting, orienting, and executive networks) by combining the Attentional Network Test (ANT) and event-related potentials technique. Thirty healthy subjects were enrolled in the study. A continuous arithmetic task lasting one hour induced mental fatigue, and EEG recordings were conducted before and after the task while subjects were performing the ANT. The efficiencies of three networks were comparable between groups, while RTs shortened only in the control group and the accuracy related to the alerting and conflict networks declined only after mental effort. Mental fatigue reduced N1 amplitude during alerting network engagement and p3 amplitude during orienting. It also reduced N2 and P3 amplitude during the conflict, particularly the incongruent target-locked response. These findings underscore the covert effects of mental fatigue on attention, suggesting that even in healthy young subjects, compensatory mechanisms may maintain adequate overt performances, but fatigue still has a detrimental effect on top-down attentional mechanisms.

How the Degree of Anthropomorphism of Human-like Robots Affects Users' Perceptual and Emotional Processing: Evidence from an EEG Study.

Anthropomorphized robots are increasingly integrated into human social life, playing vital roles across various fields. This study aimed to elucidate the neural dynamics underlying users' perceptual and emotional responses to robots with varying levels of anthropomorphism. We investigated event-related potentials (ERPs) and event-related spectral perturbations (ERSPs) elicited while participants viewed, perceived, and rated the affection of robots with low (L-AR), medium (M-AR), and high (H-AR) levels of anthropomorphism. EEG data were recorded from 42 participants. Results revealed that H-AR induced a more negative N1 and increased frontal theta power, but decreased P2 in early time windows. Conversely, M-AR and L-AR elicited larger P2 compared to H-AR. In later time windows, M-AR generated greater late positive potential (LPP) and enhanced parietal-occipital theta oscillations than H-AR and L-AR. These findings suggest distinct neural processing phases: early feature detection and selective attention allocation, followed by later affective appraisal. Early detection of facial form and animacy, with P2 reflecting higher-order visual processing, appeared to correlate with anthropomorphism levels. This research advances the understanding of emotional processing in anthropomorphic robot design and provides valuable insights for robot designers and manufacturers regarding emotional and feature design, evaluation, and promotion of anthropomorphic robots.

Habituation of Central and Electrodermal Responses to an Auditory Two-Stimulus Oddball Paradigm.

The orienting reaction (OR) towards a new stimulus is subject to habituation, i.e., progressively attenuates with stimulus repetition. The skin conductance responses (SCRs) are known to represent a reliable measure of OR at the peripheral level. Yet, it is still a matter of debate which of the P3 subcomponents is the most likely to represent the central counterpart of the OR. The aim of the present work was to study habituation, recovery, and dishabituation phenomena intrinsic to a two-stimulus auditory oddball paradigm, one of the most-used paradigms both in research and clinic, by simultaneously recording SCRs and P3 in twenty healthy volunteers. Our findings show that the target stimulus was capable of triggering a more marked OR, as indexed by both SCRs and P3, compared to the standard stimulus, that could be due to its affective saliency and relevance for task completion; the application of temporal principal components analysis (PCA) to the P3 complex allowed us to identify several subcomponents including both early and late P3a (eP3a; lP3a), P3b, novelty P3 (nP3), and both a positive and a negative Slow Wave (+SW; -SW). Particularly, lP3a and P3b subcomponents showed a similar behavior to that observed for SCRs , suggesting them as central counterparts of OR. Finally, the P3 evoked by the first standard stimulus after the target showed a significant dishabituation phenomenon which could represent a sign of the local stimulus change. However, it did not reach a sufficient level to trigger an SCR/OR since it did not represent a salient event in the context of the task.

Semantic and syntactic processing of emojis in sentential intermediate positions.

The current study investigated the neuro mechanisms of emoji processing as sentence predicate in written context. In the hybrid textuality which is more cognitively engaging, emojis in sentential intermediate positions were designed as either congruent or incongruent to the context. The results showed that incongruent words led to a robust N400 effect, while incongruent emojis only elicited the P600 effect. It implies that semantics and syntax of words can be separated while those of emojis seem to be integrated together. That is, when the meaning of the emoji is violated to the sentential context, its grammatical role cannot be well interpreted, especially when it is used as a key grammatical component in a sentence, such as the predicate. Thus, it shows that even though the meaning of emojis can be interpreted by readers, their syntactic and semantic functions cannot be clearly separated. In comparison with word processing, the larger amplitude with emojis in the time window of 350-500 ms shows more cognitive efforts in emoji semantic processing, possibly arising from the switch of modalities within the visual channel, that is, the multimodal cognitive load.