Children with developmental dyslexia have equivalent audiovisual speech perception performance but their perceptual weights differ.

As reading is inherently a multisensory, audiovisual (AV) process where visual symbols (i.e., letters) are connected to speech sounds, the question has been raised whether individuals with reading difficulties, like children with developmental dyslexia (DD), have broader impairments in multisensory processing. This question has been posed before, yet it remains unanswered due to (a) the complexity and contentious etiology of DD along with (b) lack of consensus on developmentally appropriate AV processing tasks. We created an ecologically valid task for measuring multisensory AV processing by leveraging the natural phenomenon that speech perception improves when listeners are provided visual information from mouth movements (particularly when the auditory signal is degraded). We designed this AV processing task with low cognitive and linguistic demands such that children with and without DD would have equal unimodal (auditory and visual) performance. We then collected data in a group of 135 children (age 6.5-15) with an AV speech perception task to answer the following questions: (1) How do AV speech perception benefits manifest in children, with and without DD? (2) Do children all use the same perceptual weights to create AV speech perception benefits, and (3) what is the role of phonological processing in AV speech perception? We show that children with and without DD have equal AV speech perception benefits on this task, but that children with DD rely less on auditory processing in more difficult listening situations to create these benefits and weigh both incoming information streams differently. Lastly, any reported differences in speech perception in children with DD might be better explained by differences in phonological processing than differences in reading skills. RESEARCH HIGHLIGHTS: Children with versus without developmental dyslexia have equal audiovisual speech perception benefits, regardless of their phonological awareness or reading skills. Children with developmental dyslexia rely less on auditory performance to create audiovisual speech perception benefits. Individual differences in speech perception in children might be better explained by differences in phonological processing than differences in reading skills.

Sound Level Changes the Auditory Cortical Activation Detected with Functional Near-Infrared Spectroscopy.

BACKGROUND: Functional near-infrared spectroscopy (fNIRS) is a viable non-invasive technique for functional neuroimaging in the cochlear implant (CI) population; however, the effects of acoustic stimulus features on the fNIRS signal have not been thoroughly examined. This study examined the effect of stimulus level on fNIRS responses in adults with normal hearing or bilateral CIs. We hypothesized that fNIRS responses would correlate with both stimulus level and subjective loudness ratings, but that the correlation would be weaker with CIs due to the compression of acoustic input to electric output. METHODS: Thirteen adults with bilateral CIs and 16 with normal hearing (NH) completed the study. Signal-correlated noise, a speech-shaped noise modulated by the temporal envelope of speech stimuli, was used to determine the effect of stimulus level in an unintelligible speech-like stimulus between the range of soft to loud speech. Cortical activity in the left hemisphere was recorded. RESULTS: Results indicated a positive correlation of cortical activation in the left superior temporal gyrus with stimulus level in both NH and CI listeners with an additional correlation between cortical activity and perceived loudness for the CI group. The results are consistent with the literature and our hypothesis. CONCLUSIONS: These results support the potential of fNIRS to examine auditory stimulus level effects at a group level and the importance of controlling for stimulus level and loudness in speech recognition studies. Further research is needed to better understand cortical activation patterns for speech recognition as a function of both stimulus presentation level and perceived loudness.

Reduced Glx and GABA Inductions in the Anterior Cingulate Cortex and Caudate Nucleus Are Related to Impaired Control of Attention in Attention-Deficit/Hyperactivity Disorder.

Attention-deficit/hyperactivity disorder (ADHD) is a neurodevelopmental disorder that impairs the control of attention and behavioral inhibition in affected individuals. Recent genome-wide association findings have revealed an association between glutamate and GABA gene sets and ADHD symptoms. Consistently, people with ADHD show altered glutamate and GABA content in the brain circuitry that is important for attention control function. Yet, it remains unknown how glutamate and GABA content in the attention control circuitry change when people are controlling their attention, and whether these changes can predict impaired attention control in people with ADHD. To study these questions, we recruited 18 adults with ADHD (31-51 years) and 16 adults without ADHD (28-54 years). We studied glutamate + glutamine (Glx) and GABA content in the fronto-striatal circuitry while participants performed attention control tasks. We found that Glx and GABA concentrations at rest did not differ between participants with ADHD or without ADHD. However, while participants were performing the attention control tasks, participants with ADHD showed smaller Glx and GABA increases than participants without ADHD. Notably, smaller GABA increases in participants with ADHD significantly predicted their poor task performance. Together, these findings provide the first demonstration showing that attention control deficits in people with ADHD may be related to insufficient responses of the GABAergic system in the fronto-striatal circuitry.

Auditory attention switching with listening difficulty: Behavioral and pupillometric measures.

Pupillometry has emerged as a useful tool for studying listening effort. Past work involving listeners with normal audiological thresholds has shown that switching attention between competing talker streams evokes pupil dilation indicative of listening effort [McCloy, Lau, Larson, Pratt, and Lee (2017). J. Acoust. Soc. Am. 141(4), 2440-2451]. The current experiment examines behavioral and pupillometric data from a two-stream target detection task requiring attention-switching between auditory streams, in two participant groups: audiometrically normal listeners who self-report difficulty localizing sound sources and/or understanding speech in reverberant or acoustically crowded environments, and their age-matched controls who do not report such problems. Three experimental conditions varied the number and type of stream segregation cues available. Participants who reported listening difficulty showed both behavioral and pupillometric signs of increased effort compared to controls, especially in trials where listeners had to switch attention between streams, or trials where only a single stream segregation cue was available.

Pupillometry shows the effort of auditory attention switching.

Successful speech communication often requires selective attention to a target stream amidst competing sounds, as well as the ability to switch attention among multiple interlocutors. However, auditory attention switching negatively affects both target detection accuracy and reaction time, suggesting that attention switches carry a cognitive cost. Pupillometry is one method of assessing mental effort or cognitive load. Two experiments were conducted to determine whether the effort associated with attention switches is detectable in the pupillary response. In both experiments, pupil dilation, target detection sensitivity, and reaction time were measured; the task required listeners to either maintain or switch attention between two concurrent speech streams. Secondary manipulations explored whether switch-related effort would increase when auditory streaming was harder. In experiment 1, spatially distinct stimuli were degraded by simulating reverberation (compromising across-time streaming cues), and target-masker talker gender match was also varied. In experiment 2, diotic streams separable by talker voice quality and pitch were degraded by noise vocoding, and the time alloted for mid-trial attention switching was varied. All trial manipulations had some effect on target detection sensitivity and/or reaction time; however, only the attention-switching manipulation affected the pupillary response: greater dilation was observed in trials requiring switching attention between talkers.

Attention drives synchronization of alpha and beta rhythms between right inferior frontal and primary sensory neocortex.

The right inferior frontal cortex (rIFC) is specifically associated with attentional control via the inhibition of behaviorally irrelevant stimuli and motor responses. Similarly, recent evidence has shown that alpha (7-14 Hz) and beta (15-29 Hz) oscillations in primary sensory neocortical areas are enhanced in the representation of non-attended stimuli, leading to the hypothesis that allocation of these rhythms plays an active role in optimal inattention. Here, we tested the hypothesis that selective synchronization between rIFC and primary sensory neocortex occurs in these frequency bands during inattention. We used magnetoencephalography to investigate phase synchrony between primary somatosensory (SI) and rIFC regions during a cued-attention tactile detection task that required suppression of response to uncertain distractor stimuli. Attentional modulation of synchrony between SI and rIFC was found in both the alpha and beta frequency bands. This synchrony manifested as an increase in the alpha-band early after cue between non-attended SI representations and rIFC, and as a subsequent increase in beta-band synchrony closer to stimulus processing. Differences in phase synchrony were not found in several proximal control regions. These results are the first to reveal distinct interactions between primary sensory cortex and rIFC in humans and suggest that synchrony between rIFC and primary sensory representations plays a role in the inhibition of irrelevant sensory stimuli and motor responses.

Temporal alignment of pupillary response with stimulus events via deconvolution.

Analysis of pupil dilation has been used as an index of attentional effort in the auditory domain. Previous work has modeled the pupillary response to attentional effort as a linear time-invariant system with a characteristic impulse response, and used deconvolution to estimate the attentional effort that gives rise to changes in pupil size. Here it is argued that one parameter of the impulse response (the latency of response maximum, t(max)) has been mis-estimated in the literature; a different estimate is presented, and it is shown how deconvolution with this value of t(max) yields more intuitively plausible and informative results.

Auditory attention strategy depends on target linguistic properties and spatial configuration.

Whether crossing a busy intersection or attending a large dinner party, listeners sometimes need to attend to multiple spatially distributed sound sources or streams concurrently. How they achieve this is not clear-some studies suggest that listeners cannot truly simultaneously attend to separate streams, but instead combine attention switching with short-term memory to achieve something resembling divided attention. This paper presents two oddball detection experiments designed to investigate whether directing attention to phonetic versus semantic properties of the attended speech impacts listeners' ability to divide their auditory attention across spatial locations. Each experiment uses four spatially distinct streams of monosyllabic words, variation in cue type (providing phonetic or semantic information), and requiring attention to one or two locations. A rapid button-press response paradigm is employed to minimize the role of short-term memory in performing the task. Results show that differences in the spatial configuration of attended and unattended streams interact with linguistic properties of the speech streams to impact performance. Additionally, listeners may leverage phonetic information to make oddball detection judgments even when oddballs are semantically defined. Both of these effects appear to be mediated by the overall complexity of the acoustic scene.

Switching auditory attention using spatial and non-spatial features recruits different cortical networks.

Switching attention between different stimuli of interest based on particular task demands is important in many everyday settings. In audition in particular, switching attention between different speakers of interest that are talking concurrently is often necessary for effective communication. Recently, it has been shown by multiple studies that auditory selective attention suppresses the representation of unwanted streams in auditory cortical areas in favor of the target stream of interest. However, the neural processing that guides this selective attention process is not well understood. Here we investigated the cortical mechanisms involved in switching attention based on two different types of auditory features. By combining magneto- and electro-encephalography (M-EEG) with an anatomical MRI constraint, we examined the cortical dynamics involved in switching auditory attention based on either spatial or pitch features. We designed a paradigm where listeners were cued in the beginning of each trial to switch or maintain attention halfway through the presentation of concurrent target and masker streams. By allowing listeners time to switch during a gap in the continuous target and masker stimuli, we were able to isolate the mechanisms involved in endogenous, top-down attention switching. Our results show a double dissociation between the involvement of right temporoparietal junction (RTPJ) and the left inferior parietal supramarginal part (LIPSP) in tasks requiring listeners to switch attention based on space and pitch features, respectively, suggesting that switching attention based on these features involves at least partially separate processes or behavioral strategies.

Multimodal neuroimaging dissociates hemodynamic and electrophysiological correlates of error processing.

Recognizing errors and adjusting responses are fundamental to adaptive behavior. The error-related negativity (ERN) and error-related functional MRI (fMRI) activation of the dorsal anterior cingulate cortex (dACC) index these processes and are thought to reflect the same neural mechanism. In the present study, we evaluated this hypothesis. Although errors elicited robust dACC activation using fMRI, combined electroencephalography and magnetoencephalography data localized the ERN to the posterior cingulate cortex (PCC). ERN amplitude correlated with fMRI activation in both the PCC and dACC, and these two regions showed coordinated activity based on functional connectivity MRI. Finally, increased microstructural integrity of the posterior cingulum bundle, as measured by diffusion tensor imaging, predicted faster error correction. These findings suggest that the PCC generates the ERN and communicates with the dACC to subserve error processing. They challenge current models that view fMRI activation of the dACC as the hemodynamic reflection of the ERN.

Note on the Dual-Task Paradigm and its Use to Measure Listening Effort.

People regularly communicate in complex environments, requiring them to flexibly shift their attention across multiple sources of sensory information. Increasing recruitment of the executive functions that support successful speech comprehension in these multitasking settings is thought to contribute to the sense of effort that listeners often experience. One common research method employed to quantify listening effort is the dual-task paradigm in which individuals recognize speech and concurrently perform a secondary (often visual) task. Effort is operationalized as performance decrements on the secondary task as speech processing demands increase. However, recent reviews have noted critical inconsistencies in the results of dual-task experiments, likely in part due to how and when the two tasks place demands on a common set of mental resources and how flexibly individuals can allocate their attention to them. We propose that in order to move forward to address this gap, we need to first look backward: better integrating theoretical models of resource capacity and allocation as well as of task-switching that have been historically developed in domains outside of hearing research (viz., cognitive psychology and neuroscience). With this context in mind, we describe how dual-task experiments could be designed and interpreted such that they provide better and more robust insights into the mechanisms that contribute to effortful listening.

Audiovisual Speech Perception Benefits are Stable from Preschool through Adolescence.

The ability to leverage visual cues in speech perception - especially in noisy backgrounds - is well established from infancy to adulthood. Yet, the developmental trajectory of audiovisual benefits stays a topic of debate. The inconsistency in findings can be attributed to relatively small sample sizes or tasks that are not appropriate for given age groups. We designed an audiovisual speech perception task that was cognitively and linguistically age-appropriate from preschool to adolescence and recruited a large sample ( N = 161) of children (age 4-15). We found that even the youngest children show reliable speech perception benefits when provided with visual cues and that these benefits are consistent throughout development when auditory and visual signals match. Individual variability is explained by how the child experiences their speech-in-noise performance rather than the quality of the signal itself. This underscores the importance of visual speech for young children who are regularly in noisy environments like classrooms and playgrounds.

Multi-site EEG studies in early infancy: Methods to enhance data quality.

Brain differences linked to autism spectrum disorder (ASD) can manifest before observable symptoms. Studying these early neural precursors in larger and more diverse cohorts is crucial for advancing our understanding of developmental pathways and potentially facilitating earlier identification. EEG is an ideal tool for investigating early neural differences in ASD, given its scalability and high tolerability in infant populations. In this context, we integrated EEG into an existing multi-site MRI study of infants with a higher familial likelihood of developing ASD. This paper describes the comprehensive protocol established to collect longitudinal, high-density EEG data from infants across five sites as part of the Infant Brain Imaging Study (IBIS) Network and reports interim feasibility and data quality results. We evaluated feasibility by measuring the percentage of infants from whom we successfully collected each EEG paradigm. The quality of task-free data was assessed based on the duration of EEG recordings remaining after artifact removal. Preliminary analyses revealed low data loss, with average in-session loss rates at 4.16 % and quality control loss rates at 11.66 %. Overall, the task-free data retention rate, accounting for both in-session issues and quality control, was 84.16 %, with high consistency across sites. The insights gained from this preliminary analysis highlight key sources of data attrition and provide practical considerations to guide similar research endeavors.

Nothing is irrelevant in a noisy world: sensory illusions reveal obligatory within-and across-modality integration.

In the "flash-beep illusion," a single light flash is perceived as multiple flashes when presented in close temporal proximity to multiple auditory beeps. Accounts of this illusion argue that temporal auditory information interferes with visual information because temporal acuity is better in audition than vision. However, it may also be that whenever there are multiple sensory inputs, the interference caused by a to-be-ignored stimulus on an attended stimulus depends on the likelihood that the stimuli are perceived as coming from a single distal source. Here we explore, in human observers, perceptual interactions between competing auditory and visual inputs while varying spatial proximity, which affects object formation. When two spatially separated streams are presented in the same (visual or auditory) modality, temporal judgments about a target stream from one direction are biased by the content of the competing distractor stream. Cross-modally, auditory streams from both target and distractor directions bias the perceived number of events in a target visual stream; however, importantly, the auditory stream from the target direction influences visual judgments more than does the auditory stream from the opposite hemifield. As in the original flash-beep illusion, visual streams weakly influence auditory judgments, regardless of spatial proximity. We also find that perceptual interference in the flash-beep illusion is similar to within-modality interference from a competing same-modality stream. Results reveal imperfect and obligatory within- and across-modality integration of information, and hint that the strength of these interactions depends on object binding.

The cortical dynamics underlying effective switching of auditory spatial attention.

Successful rapid deployment of attention to relevant sensory stimuli is critical for survival. In a complex environment, attention can be captured by salient events or be deployed volitionally. Furthermore, when multiple events are of interest concurrently, effective interaction with one's surroundings hinges on efficient top-down control of shifting attention. It has been hypothesized that two separate cortical networks coordinate attention shifts across multiple modalities. However, the cortical dynamics of these networks and their behavioral relevance to switching of auditory attention are unknown. Here we show that the strength of each subject's right temporoparietal junction (RTPJ, part of the ventral network) activation was highly correlated with their behavioral performance in an auditory task. We also provide evidence that the recruitment of the RTPJ likely precedes the right frontal eye fields (FEF; participating in both the dorsal and ventral networks) and middle frontal gyrus (MFG) by around 100 ms when subjects switch their auditory spatial attention.

Influence of preparation time and pitch separation in switching of auditory attention between streams.

The ability to consciously switch attention between speakers of interest is necessary for communication in many environments, especially when multiple talkers speak simultaneously. Segregating sounds of interest from the background, which is necessary for selective attention, depends on stimulus acoustics such as differences in spectrotemporal properties of the target and masker. However, the relationship between top-down attention control and bottom-up stimulus segregation is not well understood. Here, two experiments were conducted to examine the time necessary for listeners to switch auditory attention, and how the ability to switch attention relates to the pitch separation cue available for bottom-up stream segregation.

The prevalence and developmental course of auditory processing differences in autistic children.

Auditory processing differences, including hyper- or hyposensitivity to sound, aversions to sound, and difficulty listening under noisy, real-world conditions, are commonly reported in autistic individuals. However, the developmental course and functional impact of these auditory processing differences are unclear. In this study, we investigate the prevalence, developmental trajectory, and functional impact of auditory processing differences in autistic children throughout childhood using a longitudinal study design. Auditory processing differences were measured using the Short Sensory Profile, a caregiver questionnaire, in addition to adaptive behaviors and disruptive/concerning behaviors at 3, 6, and 9 years of age. Our results showed that auditory processing differences were reported in greater than 70% of the autistic children in our sample at all three timepoints, maintained a high prevalence through 9 years of age, and were associated with increased disruptive/concerning behaviors and difficulty with adaptive behaviors. Furthermore, in our sample of children, auditory processing differences at age 3 years predicted disruptive/concerning behaviors and difficulty with adaptive behaviors at age 9 years. These findings warrant further investigations of the potential benefit of incorporating measures of auditory processing during routine clinical evaluations as well as interventions targeting auditory processing differences in autistic children.

Disconnectivity of the cortical ocular motor control network in autism spectrum disorders.

Response inhibition, or the suppression of prepotent but contextually inappropriate behaviors, is essential to adaptive, flexible responding. Individuals with autism spectrum disorders (ASD) consistently show deficient response inhibition during antisaccades. In our prior functional MRI study, impaired antisaccade performance was accompanied by reduced functional connectivity between the frontal eye field (FEF) and dorsal anterior cingulate cortex (dACC), regions critical to volitional ocular motor control. Here we employed magnetoencephalography (MEG) to examine the spectral characteristics of this reduced connectivity. We focused on coherence between FEF and dACC during the preparatory period of antisaccade and prosaccade trials, which occurs after the presentation of the task cue and before the imperative stimulus. We found significant group differences in alpha band mediated coherence. Specifically, neurotypical participants showed significant alpha band coherence between the right inferior FEF and right dACC and between the left superior FEF and bilateral dACC across antisaccade, prosaccade, and fixation conditions. Relative to the neurotypical group, ASD participants showed reduced coherence between these regions in all three conditions. Moreover, while neurotypical participants showed increased coherence between the right inferior FEF and the right dACC in preparation for an antisaccade compared to a prosaccade or fixation, ASD participants failed to show a similar increase in preparation for the more demanding antisaccade. These findings demonstrate reduced long-range functional connectivity in ASD, specifically in the alpha band. The failure in the ASD group to increase alpha band coherence with increasing task demand may reflect deficient top-down recruitment of additional neural resources in preparation to perform a difficult task.

Saccadic preparation in the frontal eye field is modulated by distinct trial history effects as revealed by magnetoencephalography.

Optimizing outcomes involves rapidly and continuously adjusting behavior based on context. While most behavioral studies focus on immediate task conditions, responses to events are also influenced by recent history. We used magnetoencephalography and a saccadic paradigm to investigate the neural bases of 2 trial history effects that are well characterized in the behavioral eye movement literature: task-switching and the prior-antisaccade effect. We found that switched trials were associated with increased errors and transient increases in activity in the frontal eye field (FEF) and anterior cingulate cortex early in the preparatory period. These activity changes are consistent with active reconfiguration of the task set, a time-limited process that is triggered by the instructional cue. Following an antisaccade versus prosaccade, there was increased activity in the FEF and prefrontal cortex that persisted into the preparatory period of the subsequent trial, and saccadic latencies were prolonged. We attribute these effects to persistent inhibition of the ocular motor response system from the prior antisaccade. These findings refine our understanding of how trial history interacts with current task demands to adjust responses. Such dynamic modulations of neural activity and behavior by recent experience are at the heart of adaptive flexible behavior.

Selective attention in an overcrowded auditory scene: implications for auditory-based brain-computer interface design.

Listeners are good at attending to one auditory stream in a crowded environment. However, is there an upper limit of streams present in an auditory scene at which this selective attention breaks down? Here, participants were asked to attend one stream of spoken letters amidst other letter streams. In half of the trials, an initial primer was played, cueing subjects to the sound configuration. Results indicate that performance increases with token repetitions. Priming provided a performance benefit, suggesting that stream selection, not formation, is the bottleneck associated with attention in an overcrowded scene. Results' implications for brain-computer interfaces are discussed.