Children with developmental dyslexia have equivalent audiovisual speech perception performance but their perceptual weights differ.

As reading is inherently a multisensory, audiovisual (AV) process where visual symbols (i.e., letters) are connected to speech sounds, the question has been raised whether individuals with reading difficulties, like children with developmental dyslexia (DD), have broader impairments in multisensory processing. This question has been posed before, yet it remains unanswered due to (a) the complexity and contentious etiology of DD along with (b) lack of consensus on developmentally appropriate AV processing tasks. We created an ecologically valid task for measuring multisensory AV processing by leveraging the natural phenomenon that speech perception improves when listeners are provided visual information from mouth movements (particularly when the auditory signal is degraded). We designed this AV processing task with low cognitive and linguistic demands such that children with and without DD would have equal unimodal (auditory and visual) performance. We then collected data in a group of 135 children (age 6.5-15) with an AV speech perception task to answer the following questions: (1) How do AV speech perception benefits manifest in children, with and without DD? (2) Do children all use the same perceptual weights to create AV speech perception benefits, and (3) what is the role of phonological processing in AV speech perception? We show that children with and without DD have equal AV speech perception benefits on this task, but that children with DD rely less on auditory processing in more difficult listening situations to create these benefits and weigh both incoming information streams differently. Lastly, any reported differences in speech perception in children with DD might be better explained by differences in phonological processing than differences in reading skills. RESEARCH HIGHLIGHTS: Children with versus without developmental dyslexia have equal audiovisual speech perception benefits, regardless of their phonological awareness or reading skills. Children with developmental dyslexia rely less on auditory performance to create audiovisual speech perception benefits. Individual differences in speech perception in children might be better explained by differences in phonological processing than differences in reading skills.

Sound Level Changes the Auditory Cortical Activation Detected with Functional Near-Infrared Spectroscopy.

BACKGROUND: Functional near-infrared spectroscopy (fNIRS) is a viable non-invasive technique for functional neuroimaging in the cochlear implant (CI) population; however, the effects of acoustic stimulus features on the fNIRS signal have not been thoroughly examined. This study examined the effect of stimulus level on fNIRS responses in adults with normal hearing or bilateral CIs. We hypothesized that fNIRS responses would correlate with both stimulus level and subjective loudness ratings, but that the correlation would be weaker with CIs due to the compression of acoustic input to electric output. METHODS: Thirteen adults with bilateral CIs and 16 with normal hearing (NH) completed the study. Signal-correlated noise, a speech-shaped noise modulated by the temporal envelope of speech stimuli, was used to determine the effect of stimulus level in an unintelligible speech-like stimulus between the range of soft to loud speech. Cortical activity in the left hemisphere was recorded. RESULTS: Results indicated a positive correlation of cortical activation in the left superior temporal gyrus with stimulus level in both NH and CI listeners with an additional correlation between cortical activity and perceived loudness for the CI group. The results are consistent with the literature and our hypothesis. CONCLUSIONS: These results support the potential of fNIRS to examine auditory stimulus level effects at a group level and the importance of controlling for stimulus level and loudness in speech recognition studies. Further research is needed to better understand cortical activation patterns for speech recognition as a function of both stimulus presentation level and perceived loudness.

Reduced Glx and GABA Inductions in the Anterior Cingulate Cortex and Caudate Nucleus Are Related to Impaired Control of Attention in Attention-Deficit/Hyperactivity Disorder.

Attention-deficit/hyperactivity disorder (ADHD) is a neurodevelopmental disorder that impairs the control of attention and behavioral inhibition in affected individuals. Recent genome-wide association findings have revealed an association between glutamate and GABA gene sets and ADHD symptoms. Consistently, people with ADHD show altered glutamate and GABA content in the brain circuitry that is important for attention control function. Yet, it remains unknown how glutamate and GABA content in the attention control circuitry change when people are controlling their attention, and whether these changes can predict impaired attention control in people with ADHD. To study these questions, we recruited 18 adults with ADHD (31-51 years) and 16 adults without ADHD (28-54 years). We studied glutamate + glutamine (Glx) and GABA content in the fronto-striatal circuitry while participants performed attention control tasks. We found that Glx and GABA concentrations at rest did not differ between participants with ADHD or without ADHD. However, while participants were performing the attention control tasks, participants with ADHD showed smaller Glx and GABA increases than participants without ADHD. Notably, smaller GABA increases in participants with ADHD significantly predicted their poor task performance. Together, these findings provide the first demonstration showing that attention control deficits in people with ADHD may be related to insufficient responses of the GABAergic system in the fronto-striatal circuitry.

Auditory attention switching with listening difficulty: Behavioral and pupillometric measures.

Pupillometry has emerged as a useful tool for studying listening effort. Past work involving listeners with normal audiological thresholds has shown that switching attention between competing talker streams evokes pupil dilation indicative of listening effort [McCloy, Lau, Larson, Pratt, and Lee (2017). J. Acoust. Soc. Am. 141(4), 2440-2451]. The current experiment examines behavioral and pupillometric data from a two-stream target detection task requiring attention-switching between auditory streams, in two participant groups: audiometrically normal listeners who self-report difficulty localizing sound sources and/or understanding speech in reverberant or acoustically crowded environments, and their age-matched controls who do not report such problems. Three experimental conditions varied the number and type of stream segregation cues available. Participants who reported listening difficulty showed both behavioral and pupillometric signs of increased effort compared to controls, especially in trials where listeners had to switch attention between streams, or trials where only a single stream segregation cue was available.

Pupillometry shows the effort of auditory attention switching.

Successful speech communication often requires selective attention to a target stream amidst competing sounds, as well as the ability to switch attention among multiple interlocutors. However, auditory attention switching negatively affects both target detection accuracy and reaction time, suggesting that attention switches carry a cognitive cost. Pupillometry is one method of assessing mental effort or cognitive load. Two experiments were conducted to determine whether the effort associated with attention switches is detectable in the pupillary response. In both experiments, pupil dilation, target detection sensitivity, and reaction time were measured; the task required listeners to either maintain or switch attention between two concurrent speech streams. Secondary manipulations explored whether switch-related effort would increase when auditory streaming was harder. In experiment 1, spatially distinct stimuli were degraded by simulating reverberation (compromising across-time streaming cues), and target-masker talker gender match was also varied. In experiment 2, diotic streams separable by talker voice quality and pitch were degraded by noise vocoding, and the time alloted for mid-trial attention switching was varied. All trial manipulations had some effect on target detection sensitivity and/or reaction time; however, only the attention-switching manipulation affected the pupillary response: greater dilation was observed in trials requiring switching attention between talkers.

Attention drives synchronization of alpha and beta rhythms between right inferior frontal and primary sensory neocortex.

The right inferior frontal cortex (rIFC) is specifically associated with attentional control via the inhibition of behaviorally irrelevant stimuli and motor responses. Similarly, recent evidence has shown that alpha (7-14 Hz) and beta (15-29 Hz) oscillations in primary sensory neocortical areas are enhanced in the representation of non-attended stimuli, leading to the hypothesis that allocation of these rhythms plays an active role in optimal inattention. Here, we tested the hypothesis that selective synchronization between rIFC and primary sensory neocortex occurs in these frequency bands during inattention. We used magnetoencephalography to investigate phase synchrony between primary somatosensory (SI) and rIFC regions during a cued-attention tactile detection task that required suppression of response to uncertain distractor stimuli. Attentional modulation of synchrony between SI and rIFC was found in both the alpha and beta frequency bands. This synchrony manifested as an increase in the alpha-band early after cue between non-attended SI representations and rIFC, and as a subsequent increase in beta-band synchrony closer to stimulus processing. Differences in phase synchrony were not found in several proximal control regions. These results are the first to reveal distinct interactions between primary sensory cortex and rIFC in humans and suggest that synchrony between rIFC and primary sensory representations plays a role in the inhibition of irrelevant sensory stimuli and motor responses.

Temporal alignment of pupillary response with stimulus events via deconvolution.

Analysis of pupil dilation has been used as an index of attentional effort in the auditory domain. Previous work has modeled the pupillary response to attentional effort as a linear time-invariant system with a characteristic impulse response, and used deconvolution to estimate the attentional effort that gives rise to changes in pupil size. Here it is argued that one parameter of the impulse response (the latency of response maximum, t(max)) has been mis-estimated in the literature; a different estimate is presented, and it is shown how deconvolution with this value of t(max) yields more intuitively plausible and informative results.

Auditory attention strategy depends on target linguistic properties and spatial configuration.

Whether crossing a busy intersection or attending a large dinner party, listeners sometimes need to attend to multiple spatially distributed sound sources or streams concurrently. How they achieve this is not clear-some studies suggest that listeners cannot truly simultaneously attend to separate streams, but instead combine attention switching with short-term memory to achieve something resembling divided attention. This paper presents two oddball detection experiments designed to investigate whether directing attention to phonetic versus semantic properties of the attended speech impacts listeners' ability to divide their auditory attention across spatial locations. Each experiment uses four spatially distinct streams of monosyllabic words, variation in cue type (providing phonetic or semantic information), and requiring attention to one or two locations. A rapid button-press response paradigm is employed to minimize the role of short-term memory in performing the task. Results show that differences in the spatial configuration of attended and unattended streams interact with linguistic properties of the speech streams to impact performance. Additionally, listeners may leverage phonetic information to make oddball detection judgments even when oddballs are semantically defined. Both of these effects appear to be mediated by the overall complexity of the acoustic scene.

Switching auditory attention using spatial and non-spatial features recruits different cortical networks.

Switching attention between different stimuli of interest based on particular task demands is important in many everyday settings. In audition in particular, switching attention between different speakers of interest that are talking concurrently is often necessary for effective communication. Recently, it has been shown by multiple studies that auditory selective attention suppresses the representation of unwanted streams in auditory cortical areas in favor of the target stream of interest. However, the neural processing that guides this selective attention process is not well understood. Here we investigated the cortical mechanisms involved in switching attention based on two different types of auditory features. By combining magneto- and electro-encephalography (M-EEG) with an anatomical MRI constraint, we examined the cortical dynamics involved in switching auditory attention based on either spatial or pitch features. We designed a paradigm where listeners were cued in the beginning of each trial to switch or maintain attention halfway through the presentation of concurrent target and masker streams. By allowing listeners time to switch during a gap in the continuous target and masker stimuli, we were able to isolate the mechanisms involved in endogenous, top-down attention switching. Our results show a double dissociation between the involvement of right temporoparietal junction (RTPJ) and the left inferior parietal supramarginal part (LIPSP) in tasks requiring listeners to switch attention based on space and pitch features, respectively, suggesting that switching attention based on these features involves at least partially separate processes or behavioral strategies.

Multimodal neuroimaging dissociates hemodynamic and electrophysiological correlates of error processing.

Recognizing errors and adjusting responses are fundamental to adaptive behavior. The error-related negativity (ERN) and error-related functional MRI (fMRI) activation of the dorsal anterior cingulate cortex (dACC) index these processes and are thought to reflect the same neural mechanism. In the present study, we evaluated this hypothesis. Although errors elicited robust dACC activation using fMRI, combined electroencephalography and magnetoencephalography data localized the ERN to the posterior cingulate cortex (PCC). ERN amplitude correlated with fMRI activation in both the PCC and dACC, and these two regions showed coordinated activity based on functional connectivity MRI. Finally, increased microstructural integrity of the posterior cingulum bundle, as measured by diffusion tensor imaging, predicted faster error correction. These findings suggest that the PCC generates the ERN and communicates with the dACC to subserve error processing. They challenge current models that view fMRI activation of the dACC as the hemodynamic reflection of the ERN.

Using a linear dynamic system to measure functional connectivity from M/EEG.

OBJECTIVE: Measures of functional connectivity (FC) can elucidate which cortical regions work together in order to complete a variety of behavioral tasks. This study's primary objective was to expand a previously published model of measuring FC to include multiple subjects and several regions of interest. While FC has been more extensively investigated in vision and other sensorimotor tasks, it is not as well understood in audition. The secondary objective of this study was to investigate how auditory regions are functionally connected to other cortical regions when attention is directed to different distinct auditory stimuli. Approach. This study implements a linear dynamic system (LDS) to measure the structured time-lagged dependence across several cortical regions in order to estimate their FC during a dual-stream auditory attention task. Results. The model's output shows consistent functionally connected regions across different listening conditions, indicative of an auditory attention network that engages regardless of endogenous switching of attention or different auditory cues being attended. Significance. The LDS implemented in this study implements a multivariate autoregression to infer FC across cortical regions during an auditory attention task. This study shows how a first-order autoregressive function can reliably measure functional connectivity from M/EEG data. Additionally, the study shows how auditory regions engage with the supramodal attention network outlined in the visual attention literature.

Nothing is irrelevant in a noisy world: sensory illusions reveal obligatory within-and across-modality integration.

In the "flash-beep illusion," a single light flash is perceived as multiple flashes when presented in close temporal proximity to multiple auditory beeps. Accounts of this illusion argue that temporal auditory information interferes with visual information because temporal acuity is better in audition than vision. However, it may also be that whenever there are multiple sensory inputs, the interference caused by a to-be-ignored stimulus on an attended stimulus depends on the likelihood that the stimuli are perceived as coming from a single distal source. Here we explore, in human observers, perceptual interactions between competing auditory and visual inputs while varying spatial proximity, which affects object formation. When two spatially separated streams are presented in the same (visual or auditory) modality, temporal judgments about a target stream from one direction are biased by the content of the competing distractor stream. Cross-modally, auditory streams from both target and distractor directions bias the perceived number of events in a target visual stream; however, importantly, the auditory stream from the target direction influences visual judgments more than does the auditory stream from the opposite hemifield. As in the original flash-beep illusion, visual streams weakly influence auditory judgments, regardless of spatial proximity. We also find that perceptual interference in the flash-beep illusion is similar to within-modality interference from a competing same-modality stream. Results reveal imperfect and obligatory within- and across-modality integration of information, and hint that the strength of these interactions depends on object binding.

The cortical dynamics underlying effective switching of auditory spatial attention.

Successful rapid deployment of attention to relevant sensory stimuli is critical for survival. In a complex environment, attention can be captured by salient events or be deployed volitionally. Furthermore, when multiple events are of interest concurrently, effective interaction with one's surroundings hinges on efficient top-down control of shifting attention. It has been hypothesized that two separate cortical networks coordinate attention shifts across multiple modalities. However, the cortical dynamics of these networks and their behavioral relevance to switching of auditory attention are unknown. Here we show that the strength of each subject's right temporoparietal junction (RTPJ, part of the ventral network) activation was highly correlated with their behavioral performance in an auditory task. We also provide evidence that the recruitment of the RTPJ likely precedes the right frontal eye fields (FEF; participating in both the dorsal and ventral networks) and middle frontal gyrus (MFG) by around 100 ms when subjects switch their auditory spatial attention.

Influence of preparation time and pitch separation in switching of auditory attention between streams.

The ability to consciously switch attention between speakers of interest is necessary for communication in many environments, especially when multiple talkers speak simultaneously. Segregating sounds of interest from the background, which is necessary for selective attention, depends on stimulus acoustics such as differences in spectrotemporal properties of the target and masker. However, the relationship between top-down attention control and bottom-up stimulus segregation is not well understood. Here, two experiments were conducted to examine the time necessary for listeners to switch auditory attention, and how the ability to switch attention relates to the pitch separation cue available for bottom-up stream segregation.

The prevalence and developmental course of auditory processing differences in autistic children.

Auditory processing differences, including hyper- or hyposensitivity to sound, aversions to sound, and difficulty listening under noisy, real-world conditions, are commonly reported in autistic individuals. However, the developmental course and functional impact of these auditory processing differences are unclear. In this study, we investigate the prevalence, developmental trajectory, and functional impact of auditory processing differences in autistic children throughout childhood using a longitudinal study design. Auditory processing differences were measured using the Short Sensory Profile, a caregiver questionnaire, in addition to adaptive behaviors and disruptive/concerning behaviors at 3, 6, and 9 years of age. Our results showed that auditory processing differences were reported in greater than 70% of the autistic children in our sample at all three timepoints, maintained a high prevalence through 9 years of age, and were associated with increased disruptive/concerning behaviors and difficulty with adaptive behaviors. Furthermore, in our sample of children, auditory processing differences at age 3 years predicted disruptive/concerning behaviors and difficulty with adaptive behaviors at age 9 years. These findings warrant further investigations of the potential benefit of incorporating measures of auditory processing during routine clinical evaluations as well as interventions targeting auditory processing differences in autistic children.

Disconnectivity of the cortical ocular motor control network in autism spectrum disorders.

Response inhibition, or the suppression of prepotent but contextually inappropriate behaviors, is essential to adaptive, flexible responding. Individuals with autism spectrum disorders (ASD) consistently show deficient response inhibition during antisaccades. In our prior functional MRI study, impaired antisaccade performance was accompanied by reduced functional connectivity between the frontal eye field (FEF) and dorsal anterior cingulate cortex (dACC), regions critical to volitional ocular motor control. Here we employed magnetoencephalography (MEG) to examine the spectral characteristics of this reduced connectivity. We focused on coherence between FEF and dACC during the preparatory period of antisaccade and prosaccade trials, which occurs after the presentation of the task cue and before the imperative stimulus. We found significant group differences in alpha band mediated coherence. Specifically, neurotypical participants showed significant alpha band coherence between the right inferior FEF and right dACC and between the left superior FEF and bilateral dACC across antisaccade, prosaccade, and fixation conditions. Relative to the neurotypical group, ASD participants showed reduced coherence between these regions in all three conditions. Moreover, while neurotypical participants showed increased coherence between the right inferior FEF and the right dACC in preparation for an antisaccade compared to a prosaccade or fixation, ASD participants failed to show a similar increase in preparation for the more demanding antisaccade. These findings demonstrate reduced long-range functional connectivity in ASD, specifically in the alpha band. The failure in the ASD group to increase alpha band coherence with increasing task demand may reflect deficient top-down recruitment of additional neural resources in preparation to perform a difficult task.

Saccadic preparation in the frontal eye field is modulated by distinct trial history effects as revealed by magnetoencephalography.

Optimizing outcomes involves rapidly and continuously adjusting behavior based on context. While most behavioral studies focus on immediate task conditions, responses to events are also influenced by recent history. We used magnetoencephalography and a saccadic paradigm to investigate the neural bases of 2 trial history effects that are well characterized in the behavioral eye movement literature: task-switching and the prior-antisaccade effect. We found that switched trials were associated with increased errors and transient increases in activity in the frontal eye field (FEF) and anterior cingulate cortex early in the preparatory period. These activity changes are consistent with active reconfiguration of the task set, a time-limited process that is triggered by the instructional cue. Following an antisaccade versus prosaccade, there was increased activity in the FEF and prefrontal cortex that persisted into the preparatory period of the subsequent trial, and saccadic latencies were prolonged. We attribute these effects to persistent inhibition of the ocular motor response system from the prior antisaccade. These findings refine our understanding of how trial history interacts with current task demands to adjust responses. Such dynamic modulations of neural activity and behavior by recent experience are at the heart of adaptive flexible behavior.

Selective attention in an overcrowded auditory scene: implications for auditory-based brain-computer interface design.

Listeners are good at attending to one auditory stream in a crowded environment. However, is there an upper limit of streams present in an auditory scene at which this selective attention breaks down? Here, participants were asked to attend one stream of spoken letters amidst other letter streams. In half of the trials, an initial primer was played, cueing subjects to the sound configuration. Results indicate that performance increases with token repetitions. Priming provided a performance benefit, suggesting that stream selection, not formation, is the bottleneck associated with attention in an overcrowded scene. Results' implications for brain-computer interfaces are discussed.

Audiovisual Speech Processing in Relationship to Phonological and Vocabulary Skills in First Graders.

PURPOSE: It is generally accepted that adults use visual cues to improve speech intelligibility in noisy environments, but findings regarding visual speech benefit in children are mixed. We explored factors that contribute to audiovisual (AV) gain in young children's speech understanding. We examined whether there is an AV benefit to speech-in-noise recognition in children in first grade and if visual salience of phonemes influences their AV benefit. We explored if individual differences in AV speech enhancement could be explained by vocabulary knowledge, phonological awareness, or general psychophysical testing performance. METHOD: Thirty-seven first graders completed online psychophysical experiments. We used an online single-interval, four-alternative forced-choice picture-pointing task with age-appropriate consonant-vowel-consonant words to measure auditory-only, visual-only, and AV word recognition in noise at -2 and -8 dB SNR. We obtained standard measures of vocabulary and phonological awareness and included a general psychophysical test to examine correlations with AV benefits. RESULTS: We observed a significant overall AV gain among children in first grade. This effect was mainly attributed to the benefit at -8 dB SNR, for visually distinct targets. Individual differences were not explained by any of the child variables. Boys showed lower auditory-only performances, leading to significantly larger AV gains. CONCLUSIONS: This study shows AV benefit, of distinctive visual cues, to word recognition in challenging noisy conditions in first graders. The cognitive and linguistic constraints of the task may have minimized the impact of individual differences of vocabulary and phonological awareness on AV benefit. The gender difference should be studied on a larger sample and age range.

Analysis methods for measuring passive auditory fNIRS responses generated by a block-design paradigm.

Significance: Functional near-infrared spectroscopy (fNIRS) is an increasingly popular tool in auditory research, but the range of analysis procedures employed across studies may complicate the interpretation of data. Aim: We aim to assess the impact of different analysis procedures on the morphology, detection, and lateralization of auditory responses in fNIRS. Specifically, we determine whether averaging or generalized linear model (GLM)-based analysis generates different experimental conclusions when applied to a block-protocol design. The impact of parameter selection of GLMs on detecting auditory-evoked responses was also quantified. Approach: 17 listeners were exposed to three commonly employed auditory stimuli: noise, speech, and silence. A block design, comprising sounds of 5 s duration and 10 to 20 s silent intervals, was employed. Results: Both analysis procedures generated similar response morphologies and amplitude estimates, and both indicated that responses to speech were significantly greater than to noise or silence. Neither approach indicated a significant effect of brain hemisphere on responses to speech. Methods to correct for systemic hemodynamic responses using short channels improved detection at the individual level. Conclusions: Consistent with theoretical considerations, simulations, and other experimental domains, GLM and averaging analyses generate the same group-level experimental conclusions. We release this dataset publicly for use in future development and optimization of algorithms.