Individual differences in the neural dynamics of visual narrative comprehension: The effects of proficiency and age of acquisition.

Understanding visual narrative sequences, as found in comics, is known to recruit similar cognitive mechanisms to verbal language. As measured by event-related potentials (ERPs), these manifest as initial negativities (N400, LAN) and subsequent positivities (P600). While these components are thought to index discrete processing stages, they differentially arise across participants for any given stimulus. In language contexts, proficiency modulates brain responses, with smaller N400 effects and larger P600 effects appearing with increasing proficiency. In visual narratives, recent work has also emphasized the role of proficiency in neural response patterns. We thus explored whether individual differences in proficiency modulate neural responses to visual narrative sequencing in similar ways as in language. We combined ERP data from 12 studies examining semantic and/or grammatical processing of visual narrative sequences. Using linear mixed effects modeling, we demonstrate differential effects of visual language proficiency and "age of acquisition" on N400 and P600 responses. Our results align with those reported in language contexts, providing further evidence for the similarity of linguistic and visual narrative processing, and emphasize the role of both proficiency and age of acquisition in visual narrative comprehension.

Identifying neuroanatomical and behavioral features for autism spectrum disorder diagnosis in children using machine learning.

Autism spectrum disorder (ASD) is a neurodevelopmental disorder that can cause significant social, communication, and behavioral challenges. Diagnosis of ASD is complicated and there is an urgent need to identify ASD-associated biomarkers and features to help automate diagnostics and develop predictive ASD models. The present study adopts a novel evolutionary algorithm, the conjunctive clause evolutionary algorithm (CCEA), to select features most significant for distinguishing individuals with and without ASD, and is able to accommodate datasets having a small number of samples with a large number of feature measurements. The dataset is unique and comprises both behavioral and neuroimaging measurements from a total of 28 children from 7 to 14 years old. Potential biomarker candidates identified include brain volume, area, cortical thickness, and mean curvature in specific regions around the cingulate cortex, frontal cortex, and temporal-parietal junction, as well as behavioral features associated with theory of mind. A separate machine learning classifier (i.e., k-nearest neighbors algorithm) was used to validate the CCEA feature selection and for ASD prediction. Study findings demonstrate how machine learning tools might help move the needle on improving diagnostic and predictive models of ASD.

The time-locked neurodynamics of semantic processing in autism spectrum disorder: an EEG study.

Language processing is often an area of difficulty in Autism Spectrum Disorder (ASD). Semantic processing-the ability to add meaning to a stimulus-is thought to be especially affected in ASD. However, the neurological origin of these deficits, both structurally and temporally, have yet to be discovered. To further previous behavioral findings on language differences in ASD, the present study used an implicit semantic priming paradigm and electroencephalography (EEG) to compare the level of theta coherence throughout semantic processing, between typically developing (TD) and ASD participants. Theta coherence is an indication of synchronous EEG oscillations and was of particular interest due to its previous links with semantic processing. Theta coherence was analyzed in response to semantically related or unrelated pairs of words and pictures across bilateral short, medium, and long electrode connections. We found significant results across a variety of conditions, but most notably, we observed reduced coherence for language stimuli in the ASD group at a left fronto-parietal connection from 100 to 300 ms. This replicates previous findings of underconnectivity in left fronto-parietal language networks in ASD. Critically, the early time window of this underconnectivity, from 100 to 300 ms, suggests that impaired semantic processing of language in ASD may arise during pre-semantic processing, during the initial communication between lower-level linguistic processing and higher-level semantic processing. Our results suggest that language processing functions are unique in ASD compared to TD, and that subjects with ASD might rely on a temporally different language processing loop altogether.

Implicit Semantic Processing of Linguistic and Non-linguistic Stimuli in Adults with Autism Spectrum Disorder.

While many individuals with autism spectrum disorder (ASD) experience difficulties with language processing, non-linguistic semantic processing may be intact. We examined neural responses to an implicit semantic priming task by comparing N400 responses-an event-related potential related to semantic processing-in response to semantically related or unrelated pairs of words or pictures. Adults with ASD showed larger N400 responses than typically developing adults for pictures, but no group differences occurred for words. However, we also observed complex modulations of N400 amplitude by age and by level of autistic traits. These results offer important implications for how groups are delineated and compared in autism research.

Predictability modulates neurocognitive semantic processing of non-verbal narratives.

Predictability is known to modulate semantic processing in language, but it is unclear to what extent this applies for other modalities. Here we ask whether similar cognitive processes are at play in predicting upcoming events in a non-verbal visual narrative. Typically developing adults viewed comics sequences in which a target panel was highly predictable ("high cloze"), less predictable ("low cloze"), or incongruent with the preceding narrative context ("anomalous") during EEG recording. High and low predictable sequences were determined by a pretest where participants assessed "what happened next?", resulting in cloze probability scores for sequence outcomes comparable to those used to measure predictability in sentence processing. Through both factorial and correlational analyses, we show a significant modulation of neural responses by cloze such that N400 effects are diminished as a target panel in a comic sequence becomes more predictable. Predictability thus appears to play a similar role in non-verbal comprehension of sequential images as in language comprehension, providing further evidence for the domain generality of semantic processing in the brain.

Lack of awareness despite complex visual processing: Evidence from event-related potentials in a case of selective metamorphopsia.

Visual awareness is thought to result from integration of low- and high-level processing; instances of integration failure provide a crucial window into the cognitive and neural bases of awareness. We present neurophysiological evidence of complex cognitive processing in the absence of awareness, raising questions about the conditions necessary for visual awareness. We describe an individual with a neurodegenerative disease who exhibits impaired visual awareness for the digits 2 to 9, and stimuli presented in close proximity to these digits, due to perceptual distortion. We identified robust event-related potential responses indicating 1) face detection with the N170 component and 2) task-dependent target-word detection with the P3b component, despite no awareness of the presence of faces or target words. These data force us to reconsider the relationship between neural processing and visual awareness; even stimuli processed by a workspace-like cognitive system can remain inaccessible to awareness. We discuss how this finding challenges and constrains theories of visual awareness.

Dismantling the "Visual Ease Assumption:" A Review of Visual Narrative Processing in Clinical Populations.

Visual narratives, such as wordless picture books and picture sequences like comics, have a long history in clinical testing, research, and intervention settings. The widespread "Visual Ease Assumption" rests on the premise that visual narratives, given their non-linguistic nature, may alleviate processing difficulties in populations that struggle with language. In this paper, I review the evidence for and against this Visual Ease Assumption in three clinical populations in which language deficits are common or diagnostic: autism spectrum disorder (ASD), specific language impairment (SLI; now known as Developmental Language Disorder, DLD), and aphasia. I first redefine the Visual Ease Assumption as two testable predictions: (a) that visual narrative processing should be unimpaired for clinical populations compared to neurotypical (NT) populations; and (b) that in clinical populations, visual narrative processing should be less impaired than linguistic narrative processing. Through a review of the limited evidence available to test these predictions in ASD, SLI, and aphasia, I show that the Visual Ease Assumption is largely unsupported in empirical studies. Furthermore, I outline three additional limitations of the Visual Ease Assumption regarding the complexity of narrative processing, visual narrative tasks, and cognitive deficits in different clinical populations. Therefore, visual narratives should not be assumed to be "easier" for clinical populations that struggle with language; instead, a more thorough consideration of the cognitive processes involved in visual narrative processing is needed.

Implicit Measures of Receptive Vocabulary Knowledge in Individuals With Level 3 Autism.

Implicit measures of cognition are essential for assessing knowledge in people with Level 3 autism because such individuals are often unable to make reliable overt behavioral responses. In this study, we investigated whether three implicit measures-eye movement (EM) monitoring, pupillary dilation (PD), and event-related potentials (ERPs)-can be used to reliably estimate vocabulary knowledge in individuals with Level 3 autism. Five adults with Level 3 autism were tested in a repeated-measures design with two tasks. High-frequency 'known' words (eg, bus, airplane) and low-frequency 'unknown' words (eg, ackee, cherimoya) were presented in a visual world task (during which EM and PD data were collected) and a picture-word congruity task (during which ERP data were collected). Using a case-study approach with single-subject analyses, we found that these implicit measures have the potential to provide estimates of receptive vocabulary knowledge in individuals with Level 3 autism. Participants differed with respect to which measures were the most sensitive and which variables best predicted vocabulary knowledge. These implicit measures may be useful to assess language abilities in individuals with Level 3 autism, but their use should be tailored to each individual.

Visual and linguistic narrative comprehension in autism spectrum disorders: Neural evidence for modality-independent impairments.

Individuals with autism spectrum disorders (ASD) have notable language difficulties, including with understanding narratives. However, most narrative comprehension studies have used written or spoken narratives, making it unclear whether narrative difficulties stem from language impairments or more global impairments in the kinds of general cognitive processes (such as understanding meaning and structural sequencing) that are involved in narrative comprehension. Using event-related potentials (ERPs), we directly compared semantic comprehension of linguistic narratives (short sentences) and visual narratives (comic panels) in adults with ASD and typically-developing (TD) adults. Compared to the TD group, the ASD group showed reduced N400 effects for both linguistic and visual narratives, suggesting comprehension impairments for both types of narratives and thereby implicating a more domain-general impairment. Based on these results, we propose that individuals with ASD use a more bottom-up style of processing during narrative comprehension.

A Semantic Priming Event-related Potential (ERP) Task to Study Lexico-semantic and Visuo-semantic Processing in Autism Spectrum Disorder.

Individuals with autism spectrum disorder (ASD) have characteristic deficits in understanding the meaning of language, or semantic processing. However, some evidence indicates that semantic processing of non-linguistic stimuli is intact, suggesting that semantic deficits may be language-specific. To appropriately characterize semantic processing deficits in individuals with ASD, comparison of within-modality linguistic (e.g., written words) and non-linguistic (e.g., pictures) stimuli is required. This paper describes such a methodology that makes use of a semantic priming paradigm during concurrent recording of electroencephalographic (EEG) data. EEG provides a dynamic measure of brain activity that is well-suited to characterize subtle differences in semantic processing that may not be observable at the behavioral level. The semantic priming paradigm presents a prime picture or word (e.g., dog) followed by a target picture or word that is either related (e.g., cat) or unrelated (e.g., pencil) to the prime. This paradigm can thus be used to evaluate semantic processing across different modalities, and to compare lexico-semantic and visuo-semantic processing abilities in individuals with ASD and how they might differ from TD individuals. The specific steps involved in creating the stimuli, performing the EEG testing, and analyzing the EEG data are discussed. Representative results illustrate how the N400 component of the event-related potential (ERP) is reduced following semantically-related prime-target pairs compared to unrelated pairs. Comparisons of the N400 between conditions, modalities, and groups can provide estimates of the success of semantic processing, and can thereby be used to characterize semantic deficits in individuals with ASD or other clinical populations.

Linguistic and Non-Linguistic Semantic Processing in Individuals with Autism Spectrum Disorders: An ERP Study.

Individuals with autism spectrum disorders (ASD) experience difficulties with language, particularly higher-level functions like semantic integration. Yet some studies indicate that semantic processing of non-linguistic stimuli is not impaired, suggesting a language-specific deficit in semantic processing. Using a semantic priming task, we compared event-related potentials (ERPs) in response to lexico-semantic processing (written words) and visuo-semantic processing (pictures) in adults with ASD and adults with typical development (TD). The ASD group showed successful lexico-semantic and visuo-semantic processing, indicated by similar N400 effects between groups for word and picture stimuli. However, differences in N400 latency and topography in word conditions suggested different lexico-semantic processing mechanisms: an expectancy-based strategy for the TD group but a controlled post-lexical integration strategy for the ASD group.

The Functional Overlap of Executive Control and Language Processing in Bilinguals.

The need to control multiple languages is thought to require domain-general executive control (EC) in bilinguals such that the EC and language systems become interdependent. However, there has been no systematic investigation into how and where EC and language processes overlap in the bilingual brain. If the concurrent recruitment of EC during bilingual language processing is domain-general and extends to non-linguistic EC, we hypothesize that regions commonly involvement in language processing, linguistic EC, and non-linguistic EC may be selectively altered in bilinguals compared to monolinguals. A conjunction of functional magnetic resonance imaging (fMRI) data from a flanker task with linguistic and nonlinguistic distractors and a semantic categorization task showed functional overlap in the left inferior frontal gyrus (LIFG) in bilinguals, whereas no overlap occurred in monolinguals. This research therefore identifies a neural locus of functional overlap of language and EC in the bilingual brain.

The effect of script similarity on executive control in bilinguals.

The need for executive control (EC) during bilingual language processing is thought to enhance these abilities, conferring a "bilingual advantage" on EC tasks. Recently, the reliability and robustness of the bilingual advantage has been questioned, with many variables reportedly affecting the size and presence of the bilingual advantage. This study investigates one further variable that may affect bilingual EC abilities: the similarity of a bilingual's two languages. We hypothesize that bilinguals whose two languages have a larger degree of orthographic overlap will require greater EC to manage their languages compared to bilinguals who use two languages with less overlap. We tested three groups of bilinguals with language pairs ranging from high- to low-similarity (German-English (GE), Polish-English (PE), and Arabic-English (AE), respectively) and a group of English monolinguals on a Stroop and Simon task. Two components of the bilingual advantage were investigated: an interference advantage, such that bilinguals have smaller interference effects than monolinguals; and a global RT advantage, such that bilinguals are faster overall than monolinguals. Between bilingual groups, these effects were expected to be modulated by script similarity. AE bilinguals showed the smallest Stroop interference effects, but the longest overall RTs in both tasks. These seemingly contradictory results are explained by the presence of cross-linguistic influences in the Stroop task. We conclude that similar-script bilinguals demonstrated more effective domain-general EC than different-script bilinguals, since high orthographic overlap creates more cross-linguistic activation and increases the daily demands on cognitive control. The role of individual variation is also discussed. These results suggest that script similarity is an important variable to consider in investigations of bilingual executive control abilities.

Electrophysiological explorations of the bilingual advantage: evidence from a Stroop task.

Bilinguals have been shown to exhibit a performance advantage on executive control tasks, outperforming their monolingual counterparts. Although a wealth of research has investigated this 'bilingual advantage' behaviourally, electrophysiological correlates are lacking. Using EEG with a Stroop task that manipulated the stimulus onset asynchrony (SOA) of word and colour presentation, the current study addressed two facets of the bilingual advantage. The possibility that bilinguals experience superior conflict processing relative to monolinguals (a 'conflict-specific advantage') was investigated by comparing behavioural interference effects as well as the amplitude of the Ninc, a conflict-related ERP component occurring from approximately 300-500 ms after the onset of conflict. In contrast, the hypothesis that bilinguals experience domain-general, conflict-independent enhancements in executive processing (a 'non-conflict-specific advantage') was evaluated by comparing the control condition (symbol strings) between groups. There was some significant, but inconsistent, evidence for a conflict-specific bilingual advantage. In contrast, strong evidence emerged for a non-conflict-specific advantage, with bilinguals demonstrating faster RTs and reduced ERP amplitudes on control trials compared to monolinguals. Importantly, when the control stimulus was presented before the colour, ERPs to control trials revealed group differences before the onset of conflict, suggesting differences in the ability to ignore or suppress distracting irrelevant information. This indicates that bilinguals experience superior executive processing even in the absence of conflict and semantic salience, and suggests that the advantage extends to more efficient proactive management of the environment.

Modulations of the executive control network by stimulus onset asynchrony in a Stroop task.

BACKGROUND: Manipulating task difficulty is a useful way of elucidating the functional recruitment of the brain's executive control network. In a Stroop task, pre-exposing the irrelevant word using varying stimulus onset asynchronies ('negative' SOAs) modulates the amount of behavioural interference and facilitation, suggesting disparate mechanisms of cognitive processing in each SOA. The current study employed a Stroop task with three SOAs (-400, -200, 0 ms), using functional magnetic resonance imaging to investigate for the first time the neural effects of SOA manipulation. Of specific interest were 1) how SOA affects the neural representation of interference and facilitation; 2) response priming effects in negative SOAs; and 3) attentional effects of blocked SOA presentation. RESULTS: The results revealed three regions of the executive control network that were sensitive to SOA during Stroop interference; the 0 ms SOA elicited the greatest activation of these areas but experienced relatively smaller behavioural interference, suggesting that the enhanced recruitment led to more efficient conflict processing. Response priming effects were localized to the right inferior frontal gyrus, which is consistent with the idea that this region performed response inhibition in incongruent conditions to overcome the incorrectly-primed response, as well as more general action updating and response preparation. Finally, the right superior parietal lobe was sensitive to blocked SOA presentation and was most active for the 0 ms SOA, suggesting that this region is involved in attentional control. CONCLUSIONS: SOA exerted both trial-specific and block-wide effects on executive processing, providing a unique paradigm for functional investigations of the cognitive control network.

The timing and magnitude of Stroop interference and facilitation in monolinguals and bilinguals.

Executive control abilities and lexical access speed in Stroop performance were investigated in English monolinguals and two groups of bilinguals (English-Chinese and Chinese-English) in their first (L1) and second (L2) languages. Predictions were based on a bilingual cognitive advantage hypothesis, implicating cognitive control ability as the critical factor determining Stroop interference; and two bilingual lexical disadvantage hypotheses, focusing on lexical access speed. Importantly, each hypothesis predicts different response patterns in a Stroop task manipulating stimulus onset asynchrony (SOA). There was evidence for a bilingual cognitive advantage, although this effect was sensitive to a number of variables including proficiency, language immersion, and script. In lexical access speed, no differences occurred between monolinguals and bilinguals in their native languages, but there was evidence for a delay in L2 processing speed relative to the L1. Overall, the data highlight the multitude of factors affecting executive control and lexical access speed in bilinguals.

The Influence of Cross-Language Similarity on within- and between-Language Stroop Effects in Trilinguals.

This study investigated effects of cross-language similarity on within- and between-language Stroop interference and facilitation in three groups of trilinguals. Trilinguals were either proficient in three languages that use the same-script (alphabetic in German-English-Dutch trilinguals), two similar scripts and one different script (Chinese and alphabetic scripts in Chinese-English-Malay trilinguals), or three completely different scripts (Arabic, Chinese, and alphabetic in Uyghur-Chinese-English trilinguals). The results revealed a similar magnitude of within-language Stroop interference for the three groups, whereas between-language interference was modulated by cross-language similarity. For the same-script trilinguals, the within- and between-language interference was similar, whereas the between-language Stroop interference was reduced for trilinguals with languages written in different scripts. The magnitude of within-language Stroop facilitation was similar across the three groups of trilinguals, but smaller than within-language Stroop interference. Between-language Stroop facilitation was also modulated by cross-language similarity such that these effects became negative for trilinguals with languages written in different scripts. The overall pattern of Stroop interference and facilitation effects can be explained in terms of diverging and converging color and word information across languages.

Ichi, Ni, 3, 4: neural representation of kana, kanji, and Arabic numbers in native Japanese speakers.

The Japanese language represents numbers in kana digit words (a syllabic notation), kanji numbers and Arabic numbers (logographic notations). Kanji and Arabic numbers have previously shown similar patterns of numerical processing, and because of their shared logographic properties may exhibit similar brain areas of numerical representation. Kana digit words require a larger phonetic component, and therefore may show different areas of numerical representation as compared to kanji or Arabic numbers. The present study investigated behavioral reaction times and brain activation with fMRI during the numerical processing of kana digit words, kanji numbers and Arabic numbers. No differences in behavioral reaction time were found between kanji and Arabic numbers. In contrast, kana digit words produced a longer reaction time as compared to the other two notations. The imaging data showed that kana activated the posterior cingulate cortex when compared to kanji and Arabic numbers. It is suggested that this posterior cingulate activation reflects an additional attentional demand in this script which may be related to the infrequent use of kana digit words, or may reflect an extra step of phonological mediation in converting the visual word form to the verbal word form. Overall, the data suggest that number reading is processed differently in these three notations.