Event-Related Potentials in Assessing Visual Speech Cues in the Broader Autism Phenotype: Evidence from a Phonemic Restoration Paradigm.

Audiovisual speech perception includes the simultaneous processing of auditory and visual speech. Deficits in audiovisual speech perception are reported in autistic individuals; however, less is known regarding audiovisual speech perception within the broader autism phenotype (BAP), which includes individuals with elevated, yet subclinical, levels of autistic traits. We investigate the neural indices of audiovisual speech perception in adults exhibiting a range of autism-like traits using event-related potentials (ERPs) in a phonemic restoration paradigm. In this paradigm, we consider conditions where speech articulators (mouth and jaw) are present (AV condition) and obscured by a pixelated mask (PX condition). These two face conditions were included in both passive (simply viewing a speaking face) and active (participants were required to press a button for a specific consonant-vowel stimulus) experiments. The results revealed an N100 ERP component which was present for all listening contexts and conditions; however, it was attenuated in the active AV condition where participants were able to view the speaker's face, including the mouth and jaw. The P300 ERP component was present within the active experiment only, and significantly greater within the AV condition compared to the PX condition. This suggests increased neural effort for detecting deviant stimuli when visible articulation was present and visual influence on perception. Finally, the P300 response was negatively correlated with autism-like traits, suggesting that higher autistic traits were associated with generally smaller P300 responses in the active AV and PX conditions. The conclusions support the finding that atypical audiovisual processing may be characteristic of the BAP in adults.

Neural and Behavioral Differences in Speech Perception for Children With Autism Spectrum Disorders Within an Audiovisual Context.

PURPOSE: Reduced use of visible articulatory information on a speaker's face has been implicated as a possible contributor to language deficits in autism spectrum disorders (ASD). We employ an audiovisual (AV) phonemic restoration paradigm to measure behavioral performance (button press) and event-related potentials (ERPs) of visual speech perception in children with ASD and their neurotypical peers to assess potential neural substrates that contribute to group differences. METHOD: Two sets of speech stimuli, /ba/-"/a/" ("/a/" was created from the /ba/ token by a reducing the initial consonant) and /ba/-/pa/, were presented within an auditory oddball paradigm to children aged 6-13 years with ASD (n = 17) and typical development (TD; n = 33) within two conditions. The AV condition contained a fully visible speaking face; the pixelated (PX) condition included a face, but the mouth and jaw were PX, removing all articulatory information. When articulatory features were present for the /ba/-"/a/" contrast, it was expected that the influence of the visual articulators would facilitate a phonemic restoration effect in which "/a/" would be perceived as /ba/. ERPs were recorded during the experiment while children were required to press a button for the deviant sound for both sets of speech contrasts within both conditions. RESULTS: Button press data revealed that TD children were more accurate in discriminating between /ba/-"/a/" and /ba/-/pa/ contrasts in the PX condition relative to the ASD group. ERPs in response to the /ba/-/pa/ contrast within both AV and PX conditions differed between children with ASD and TD children (earlier P300 responses for children with ASD). CONCLUSION: Children with ASD differ in the underlying neural mechanisms responsible for speech processing compared with TD peers within an AV context.

Where on the face do we look during phonemic restoration: An eye-tracking study.

Face to face communication typically involves audio and visual components to the speech signal. To examine the effect of task demands on gaze patterns in response to a speaking face, adults participated in two eye-tracking experiments with an audiovisual (articulatory information from the mouth was visible) and a pixelated condition (articulatory information was not visible). Further, task demands were manipulated by having listeners respond in a passive (no response) or an active (button press response) context. The active experiment required participants to discriminate between speech stimuli and was designed to mimic environmental situations which require one to use visual information to disambiguate the speaker's message, simulating different listening conditions in real-world settings. Stimuli included a clear exemplar of the syllable /ba/ and a second exemplar in which the formant initial consonant was reduced creating an /a/-like consonant. Consistent with our hypothesis, results revealed that the greatest fixations to the mouth were present in the audiovisual active experiment and visual articulatory information led to a phonemic restoration effect for the /a/ speech token. In the pixelated condition, participants fixated on the eyes, and discrimination of the deviant token within the active experiment was significantly greater than the audiovisual condition. These results suggest that when required to disambiguate changes in speech, adults may look to the mouth for additional cues to support processing when it is available.

The temporal dynamics of bilingual language control.

Bilinguals need to control interference from the nontarget language, to avoid saying words in the wrong language. This study investigates how often bilinguals apply such control in a dual-language mode, when speaking one language after the other when the two languages cannot be used interchangeably: over and over (every time they say a word), or only once (the first time they use a word or language after a language switch). Three groups of Spanish-English bilinguals named pictures first in their dominant, then in their nondominant, and then again in their dominant language; a fourth control group of bilinguals named pictures in their dominant language throughout. The study targeted language control aftereffects on the dominant language after nondominant naming, typically assumed to reflect recovery from previously applied inhibition. If the dominant language is inhibited every time a nondominant word is produced, subsequent dominant-language naming latencies should increase in proportion to the number of pictures previously named in the nondominant language. We found, however, that the number of nondominant picture-naming trials did not affect subsequent naming latencies in the dominant language, despite ample statistical power to detect such effects if they existed. The results suggest that, in a dual-language mode, bilingual (inhibitory) control is applied over a word's translation upon the word's first mention but not over and over with subsequent repetitions. This conclusion holds true equally for inhibitory and non-inhibitory language control mechanisms.

Precision fMRI reveals that the language-selective network supports both phrase-structure building and lexical access during language production.

A fronto-temporal brain network has long been implicated in language comprehension. However, this network's role in language production remains debated. In particular, it remains unclear whether all or only some language regions contribute to production, and which aspects of production these regions support. Across 3 functional magnetic resonance imaging experiments that rely on robust individual-subject analyses, we characterize the language network's response to high-level production demands. We report 3 novel results. First, sentence production, spoken or typed, elicits a strong response throughout the language network. Second, the language network responds to both phrase-structure building and lexical access demands, although the response to phrase-structure building is stronger and more spatially extensive, present in every language region. Finally, contra some proposals, we find no evidence of brain regions-within or outside the language network-that selectively support phrase-structure building in production relative to comprehension. Instead, all language regions respond more strongly during production than comprehension, suggesting that production incurs a greater cost for the language network. Together, these results align with the idea that language comprehension and production draw on the same knowledge representations, which are stored in a distributed manner within the language-selective network and are used to both interpret and generate linguistic utterances.

Five actionable pillars to engage the next generation of leaders in the co-design of transformative ocean solutions.

Solutions to complex and unprecedented global challenges are urgently needed. Overcoming these challenges requires input and innovative solutions from all experts, including Early Career Ocean Professionals (ECOPs). To achieve diverse inclusion from ECOPs, fundamental changes must occur at all levels-from individuals to organizations. Drawing on insights from across the globe, we propose 5 actionable pillars that support the engagement of ECOPs in co-design processes that address ocean sustainability: sharing knowledge through networks and mentorship, providing cross-boundary training and opportunities, incentivizing and celebrating knowledge co-design, creating inclusive and participatory governance structures, and catalyzing culture change for inclusivity. Foundational to all actions are the cross-cutting principles of justice, equity, diversity, and inclusivity. In addition, the pillars are cross-boundary in nature, including collaboration and innovation across sectors, disciplines, regions, generations, and backgrounds. Together, these recommendations provide an actionable and iterative path toward inclusive engagement and intergenerational exchange that can develop ocean solutions for a sustainable future.

The P300 event related potential predicts phonological working memory skills in school-aged children.

The P300 event related potential (ERP) has been cited as a marker of phonological working memory (PWM); however, little is known regarding its relationship to behavioral PWM skills in early school-aged children. The current study investigates the P300 ERP recorded in response to native and non-native (English and Spanish) phoneme contrasts as a predictor of PWM skills in monolingual English-speaking first and second grade children. Thirty-three typically developing children, ages 6-9, completed a battery of phonological processing, language, and cognitive assessments. ERPs were recorded within an auditory oddball paradigm in response to both English phoneme contrasts (/ta/, /pa/) and Spanish contrasts (/t̪a/, /d̪a/). The P300 ERP recorded in response to English phoneme contrasts significantly predicted standard scores on the Nonword Repetition subtest of the Comprehensive Test of Phonological Processing, Second Edition. Spanish contrasts did not elicit a P300 response, nor were amplitude or latency values within the P300 timeframe (250-500 ms) recorded in response to Spanish contrasts related to English nonword repetition performance. This study provides further evidence that the P300 ERP in response to native phonemic contrasts indexes PWM skills, specifically nonword repetition performance, in monolingual children. Further work is necessary to determine the extent to which the P300 response to changing phonological stimuli reflects PWM skills in other populations.

Lasting effects of the COVID-19 pandemic on language processing.

A central question in understanding human language is how people store, access, and comprehend words. The ongoing COVID-19 pandemic presented a natural experiment to investigate whether language comprehension can be changed in a lasting way by external experiences. We leveraged the sudden increase in the frequency of certain words (mask, isolation, lockdown) to investigate the effects of rapid contextual changes on word comprehension, measured over 10 months within the first year of the pandemic. Using the phonemic restoration paradigm, in which listeners are presented with ambiguous auditory input and report which word they hear, we conducted four online experiments with adult participants across the United States (combined N = 899). We find that the pandemic has reshaped language processing for the long term, changing how listeners process speech and what they expect from ambiguous input. These results show that abrupt changes in linguistic exposure can cause enduring changes to the language system.

Event-Related Potentials to Speech Relate to Speech Sound Production and Language in Young Children.

This research was funded through the American Speech and Hearing Foundation's 2012 StudentResearch Grant in Early Childhood Language Development awarded to Vanessa Harwood as well as an anonymous generous donation to Haskins Laboratories. Electrophysiological measures of language within early childhood provide important information about neurolinguistic development. We investigated associations between amplitude and latency of the P1 and N2 event-related potential components in response to spoken pseudowords, and clinical measures of language performance within a sample of 58 typically developing children between 24 and 48 months. N2 amplitude differences between repeated and new tokens were correlated with measures of expressive and receptive language and speech sound production. Phonemic sensitivity measured by the N2 component may reflect the integrity of neural networks that are important for speech perception and production in young children.

Audiovisual Speech Perception in Children with Autism Spectrum Disorders: Evidence from Visual Phonemic Restoration.

Children with autism spectrum disorders have been reported to be less influenced by a speaker's face during speech perception than those with typically development. To more closely examine these reported differences, a novel visual phonemic restoration paradigm was used to assess neural signatures (event-related potentials [ERPs]) of audiovisual processing in typically developing children and in children with autism spectrum disorder. Video of a speaker saying the syllable /ba/ was paired with (1) a synthesized /ba/ or (2) a synthesized syllable derived from /ba/ in which auditory cues for the consonant were substantially weakened, thereby sounding more like /a/. The auditory stimuli are easily discriminable; however, in the context of a visual /ba/, the auditory /a/ is typically perceived as /ba/, producing a visual phonemic restoration. Only children with ASD showed a large /ba/-/a/ discrimination response in the presence of a speaker producing /ba/, suggesting reduced influence of visual speech.

Widespread effects of dMRI data quality on diffusion measures in children.

Diffusion magnetic resonance imaging (dMRI) datasets are susceptible to several confounding factors related to data quality, which is especially true in studies involving young children. With the recent trend of large-scale multicenter studies, it is more critical to be aware of the varied impacts of data quality on measures of interest. Here, we investigated data quality and its effect on different diffusion measures using a multicenter dataset. dMRI data were obtained from 691 participants (5-17 years of age) from six different centers. Six data quality metrics-contrast to noise ratio, outlier slices, and motion (absolute, relative, translation, and rotational)-and four diffusion measures-fractional anisotropy, mean diffusivity, tract density, and length-were computed for each of 36 major fiber tracts for all participants. The results indicated that four out of six data quality metrics (all except absolute and translation motion) differed significantly between centers. Associations between these data quality metrics and the diffusion measures differed significantly across the tracts and centers. Moreover, these effects remained significant after applying recently proposed harmonization algorithms that purport to remove unwanted between-site variation in diffusion data. These results demonstrate the widespread impact of dMRI data quality on diffusion measures. These tracts and measures have been routinely associated with individual differences as well as group-wide differences between neurotypical populations and individuals with neurological or developmental disorders. Accordingly, for analyses of individual differences or group effects (particularly in multisite dataset), we encourage the inclusion of data quality metrics in dMRI analysis.

Researcher-practitioner partnerships and in-school laboratories facilitate translational research in reading.

Educational neuroscience approaches have helped to elucidate the brain basis of Reading Disability (RD) and of reading intervention response; however, there is often limited translation of this knowledge to the broader scientific and educational communities. Moreover, this work is traditionally lab-based, and thus the underlying theories and research questions are siloed from classroom practices. With growing awareness of the neurobiological origins of RD and increasing popularity of putative "brain-based" approaches in clinics and classrooms, it is imperative that we create more direct and bidirectional communication between scientists and practitioners. Such direct collaborations can help dispel neuromyths, and lead to increased understanding of the promises and pitfalls of neuroscience approaches. Moreover, direct partnerships between researchers and practitioners can lead to greater ecological validity in study designs to improve upon the translational potential of findings. To this end, we have forged collaborative partnerships, and built cognitive neuroscience laboratories within independent reading disabilities schools. This approach affords frequent and ecologically valid neurobiological assessment as children's reading improves in response to intervention. It also permits the creation of dynamic models of leading and lagging relationships of students' learning, and identification of individual-level predictors of intervention response. The partnerships also provide in-depth knowledge of student characteristics and classroom practices, which, when combined with the data we acquire, may facilitate optimization of instructional approaches. In this commentary, we discuss the creation of our partnerships, the scientific problem we are addressing (variable response to reading intervention), and the epistemological significance of researcher-practitioner bi-directional learning.

Older bilinguals reverse language dominance less than younger bilinguals: Evidence for the inhibitory deficit hypothesis.

Inhibitory control is thought to play a key role in how bilinguals switch languages and may decline in aging. We tested these hypotheses by examining age group differences in the reversed language dominance effect-a signature of inhibition of the dominant language that leads bilinguals to name pictures more slowly in the dominant than the nondominant language in mixed-language testing blocks. Twenty-five older and 48 younger Spanish-English bilinguals completed a cued language-switching task. To test if inhibition is applied at the whole-language or lexical level, we first presented one set of pictures repeatedly, then introduced a second list halfway through the experiment. Younger bilinguals exhibited significantly greater reversed language dominance effects than older bilinguals (who exhibited nonsignificant language dominance effects). In younger bilinguals, dominance reversal transferred to, and was even larger in, the second list (compared to the first). The latter result may suggest that inhibition is partially offset by repetition in ways that are not yet fully understood. More generally, these results support the hypotheses that aging impairs inhibitory control of the dominant language, which young bilinguals rely on to switch languages. Additionally, inhibition is applied primarily at the whole-language level, and speculatively, this form of language control may be analogous to nonlinguistic proactive control. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Mediated phonological-semantic priming in spoken word production: Evidence for cascaded processing from picture-word interference.

The cognitive architecture that allows humans to retrieve words from the mental lexicon has been investigated for decades. While there is consensus regarding a two-step architecture involving lexical-conceptual and phonological word-form levels of processing, accounts of how activation spreads between them (e.g., in a serial, cascaded, or interactive fashion) remain contentious. In addition, production models differ with respect to whether selection occurs at lexical or postlexical levels. The purpose of this study was to examine whether mediated phonological-semantic relations (e.g., drip is phonologically related to drill that is semantically related to hammer) influence production in adults as predicted by models implementing cascaded processing and feedback between levels. Two experiments using the picture-word interference (PWI) paradigm were conducted using auditory (Exp. 1) and written (Exp. 2) distractors. We hypothesised that a mediated semantic interference effect would be observable in the former with the involvement of both spoken word production and recognition, and in the latter if lexical representations are shared between written and spoken words in English, as assumed by some production accounts. Furthermore, we hypothesised a mediated semantic interference effect would be inconsistent with a postlexical selection account as the distractors do not constitute a relevant response for the target picture (e.g., drip-HAMMER). We observed mediated semantic interference only from auditory distractors, while observing the standard semantic interference effect from both auditory and written distractors. The current findings represent the first chronometric evidence involving spoken word production and recognition in support of cascaded processing during lexical retrieval in adults and present a significant challenge for the postlexical selection account.

Which bilinguals reverse language dominance and why?

When naming pictures in mixed-language blocks, bilinguals sometimes exhibit reversed language dominance effects. These have been attributed to proactive inhibitory control of the dominant language, or adaptation of language-specific selection thresholds. Even though reversed dominance arguably provides the most striking evidence of inhibition, few studies have focused on when and why this effect occurs. We investigated this topic in a large data set (>400 bilinguals) using a continuous and objective measure of language dominance. We found larger reversed language dominance effects in more (vs. less) balanced bilinguals in mixed-language blocks. However, after taking into account standard language dominance effects in single-language blocks, the extent to which dominance effects changed across block types was actually significantly smaller for more balanced bilinguals, which is in line with the inhibitory control account. Interestingly, dominance reversal was not associated with increased overall speed in the mixed-language block. Thus, dominance reversal is more likely in balanced bilinguals not because they are better at applying proactive control, but because they are more likely to overshoot when the goal is to make both languages about equally accessible - and overall, unbalanced bilinguals apply more proactive control than balanced bilinguals to facilitate picture naming in mixed-language blocks.

Collaboration Matters: Honey Bee Health as a Transdisciplinary Model for Understanding Real-World Complexity.

We develop a transdisciplinary deliberative model that moves beyond traditional scientific collaborations to include nonscientists in designing complexity-oriented research. We use the case of declining honey bee health as an exemplar of complex real-world problems requiring cross-disciplinary intervention. Honey bees are important pollinators of the fruits and vegetables we eat. In recent years, these insects have been dying at alarming rates. To prompt the reorientation of research toward the complex reality in which bees face multiple challenges, we came together as a group, including beekeepers, farmers, and scientists. Over a 2-year period, we deliberated about how to study the problem of honey bee deaths and conducted field experiments with bee colonies. We show trust and authority to be crucial factors shaping such collaborative research, and we offer a model for structuring collaboration that brings scientists and nonscientists together with the key objects and places of their shared concerns across time.

Inhibition accumulates over time at multiple processing levels in bilingual language control.

It is commonly assumed that bilinguals enable production in their nondominant language by inhibiting their dominant language temporarily, fully lifting inhibition to switch back. In a re-analysis of data from 416 Spanish-English bilinguals who repeatedly named a small set of pictures while switching languages in response to cues, we separated trials into different types that revealed three cumulative effects. Bilinguals named each picture (a) faster for every time they had previously named that same picture in the same language, an asymmetric repetition priming effect that was greater in their nondominant language, and (b) more slowly for every time they had previously named that same picture in the other language, an effect that was equivalent across languages and implies symmetric lateral inhibition between translation equivalents. Additionally, (c) bilinguals named pictures in the dominant language more slowly for every time they had previously named unrelated pictures in the nondominant language, exhibiting asymmetric language-wide global inhibition. These mechanisms dynamically alter the balances of activation between languages and between lemmas, providing evidence for an oft-assumed but seldom demonstrated key mechanism of bilingual control (competition between translations), resolving the mystery of why reversed language dominance sometimes emerges (the combined forces of asymmetrical effects emerge over time in mixed-language blocks), and also explaining other longer-lasting effects (block order). Key signatures of bilingual control can depend on seemingly trivial methodological details (e.g., the number of trials in a block) because inhibition is applied cumulatively at both local and global levels, persisting long after each individual act of selection.

Speaking Two Languages for the Price of One: Bypassing Language Control Mechanisms via Accessibility-Driven Switches.

How do bilinguals switch easily between languages in everyday conversation, even though studies have consistently found that switching slows responses? In previous work, researchers have not considered that although switches may happen for different reasons, only some switches-including those typically studied in laboratory experiments-might be costly. Using a repeated picture-naming task, we found that bilinguals can maintain and use two languages as efficiently as a single language, switching between them frequently without any cost, if they switch only when a word is more accessible in the other language. These results suggest that language switch costs arise during lexical selection, that top-down language control mechanisms can be suspended, and that language-mixing efficiency can be strategically increased with instruction. Thus, bilinguals might switch languages spontaneously because doing so is not always costly, and there appears to be greater flexibility and efficiency in the cognitive mechanisms that enable switching than previously assumed.

Attention demands of language production in adults who stutter.

OBJECTIVE: We investigated whether language production is atypically resource-demanding in adults who stutter (AWS) versus typically-fluent adults (TFA). METHODS: Fifteen TFA and 15 AWS named pictures overlaid with printed Semantic, Phonological or Unrelated Distractor words while monitoring frequent low tones versus rare high tones. Tones were presented at a short or long Stimulus Onset Asynchrony (SOA) relative to picture onset. Group, Tone Type, Tone SOA and Distractor Type effects on P3 amplitudes were the main focus. P3 amplitude was also investigated separately in a simple tone oddball task. RESULTS: P3 morphology was similar between groups in the simple task. In the dual task, a P3 effect was detected in TFA in all three distractor conditions at each Tone SOA. In AWS, a P3 effect was attenuated or undetectable at the Short Tone SOA depending on Distractor Type. CONCLUSIONS: In TFA, attentional resources were available for P3-indexed processes in tone perception and categorization in all distractor conditions at both Tone SOAs. For AWS, availability of attentional resources for secondary task processing was reduced as competition in word retrieval was resolved. SIGNIFICANCE: Results suggest that language production can be atypically resource-demanding in AWS. Theoretical and clinical implications of the findings are discussed.

Single-word predictions of upcoming language during comprehension: Evidence from the cumulative semantic interference task.

Comprehenders predict upcoming speech and text on the basis of linguistic input. How many predictions do comprehenders make for an upcoming word? If a listener strongly expects to hear the word "sock", is the word "shirt" partially expected as well, is it actively inhibited, or is it ignored? The present research addressed these questions by measuring the "downstream" effects of prediction on the processing of subsequently presented stimuli using the cumulative semantic interference paradigm. In three experiments, subjects named pictures (sock) that were presented either in isolation or after strongly constraining sentence frames ("After doing his laundry, Mark always seemed to be missing one…"). Naming sock slowed the subsequent naming of the picture shirt - the standard cumulative semantic interference effect. However, although picture naming was much faster after sentence frames, the interference effect was not modulated by the context (bare vs. sentence) in which either picture was presented. According to the only model of cumulative semantic interference that can account for such a pattern of data, this indicates that comprehenders pre-activated and maintained the pre-activation of best sentence completions (sock) but did not maintain the pre-activation of less likely completions (shirt). Thus, comprehenders predicted only the most probable completion for each sentence.