Selective spatial attention in lateralized multi-talker speech perception: EEG correlates and the role of age.

Speech comprehension under dynamic cocktail party conditions requires auditory search for relevant speech content and focusing spatial attention on the target talker. Here, we investigated the development of these cognitive processes in a population of 329 participants aged 20-70 years. We used a multi-talker speech detection and perception task in which pairs of words (each consisting of a cue and a target word) were simultaneously presented from lateralized positions. Participants attended to predefined cue words and responded to the corresponding target. Task difficulty was varied by presenting cue and target stimuli at different intensity levels. Decline in performance was observed only in the oldest group (age range 53-70 years) and only in the most difficult condition. The EEG analysis of neurocognitive correlates of lateralized auditory attention and stimulus evaluation (N2ac, LPCpc, alpha power lateralization) revealed age-associated changes in focussing on and processing of task-relevant information, while no such deficits were found on early auditory search and target segregation. Irrespective of age, more challenging listening conditions were associated with an increased allocation of attentional resources.

Cross-modal interactions at the audiovisual cocktail-party revealed by behavior, ERPs, and neural oscillations.

Theories of attention argue that objects are the units of attentional selection. In real-word environments such objects can contain visual and auditory features. To understand how mechanisms of selective attention operate in multisensory environments, in this pre-registered study, we created an audiovisual cocktail-party situation, in which two speakers (left and right of fixation) simultaneously articulated brief numerals. In three separate blocks, informative auditory speech was presented (a) alone or paired with (b) congruent or (c) uninformative visual speech. In all blocks, subjects localized a pre-defined numeral. While audiovisual-congruent and uninformative speech improved response times and speed of information uptake according to diffusion modeling, an ERP analysis revealed that this did not coincide with enhanced attentional engagement. Yet, consistent with object-based attentional selection, the deployment of auditory spatial attention (N2ac) was accompanied by visuo-spatial attentional orienting (N2pc) irrespective of the informational content of visual speech. Notably, an N2pc component was absent in the auditory-only condition, demonstrating that a sound-induced shift of visuo-spatial attention relies on the availability of audio-visual features evolving coherently in time. Additional exploratory analyses revealed cross-modal interactions in working memory and modulations of cognitive control.

When long appears short: Effects of auditory distraction on event-related potential correlates of time perception.

Attentional models of time perception assume that the perceived duration of a stimulus depends on the extent to which attentional resources are allocated to its temporal information. Here, we studied the effects of auditory distraction on time perception, using a combined attentional-distraction duration-discrimination paradigm. Participants were confronted with a random sequence of long and short tone stimuli, most of which having a uniform (standard) pitch and only a few a different (deviant) pitch. As observed in previous studies, pitch-deviant tones impaired the discrimination of tone duration and triggered a sequence of event-related potentials (ERPs) reflecting a cycle of deviance detection, involuntary attentional distraction and reorientation (MMN, P3a, RON). Contrasting ERPs of short and long tone durations revealed that long tones elicited a more pronounced fronto-central contingent negative variation (CNV) in the time interval after the expected offset of the short tone as well as a more prominent centro-parietal late positive complex (LPC). Relative to standard-pitch tones, deviant-pitch tones especially impaired the correct discrimination of long tones, which was associated with a reduction of the CNV and LPC. These results are interpreted within the theoretical framework of resource-based models of time perception, in which involuntary distraction due to a deviant event led to a withdrawal of attentional resources from the processing of time information.

Do congruent lip movements facilitate speech processing in a dynamic audiovisual multi-talker scenario? An ERP study with older and younger adults.

In natural conversations, visible mouth and lip movements play an important role in speech comprehension. There is evidence that visual speech information improves speech comprehension, especially for older adults and under difficult listening conditions. However, the neurocognitive basis is still poorly understood. The present EEG experiment investigated the benefits of audiovisual speech in a dynamic cocktail-party scenario with 22 (aged 20-34 years) younger and 20 (aged 55-74 years) older participants. We presented three simultaneously talking faces with a varying amount of visual speech input (still faces, visually unspecific and audiovisually congruent). In a two-alternative forced-choice task, participants had to discriminate target words ("yes" or "no") among two distractors (one-digit number words). In half of the experimental blocks, the target was always presented from a central position, in the other half, occasional switches to a lateral position could occur. We investigated behavioral and electrophysiological modulations due to age, location switches and the content of visual information, analyzing response times and accuracy as well as the P1, N1, P2, N2 event-related potentials (ERPs) and the contingent negative variation (CNV) in the EEG. We found that audiovisually congruent speech information improved performance and modulated ERP amplitudes in both age groups, suggesting enhanced preparation and integration of the subsequent auditory input. In the older group, larger amplitude measures were found in early phases of processing (P1-N1). Here, amplitude measures were reduced in response to audiovisually congruent stimuli. In later processing phases (P2-N2) we found decreased amplitude measures in the older group, while an amplitude reduction for audiovisually congruent compared to visually unspecific stimuli was still observable. However, these benefits were only observed as long as no location switches occurred, leading to enhanced amplitude measures in later processing phases (P2-N2). To conclude, meaningful visual information in a multi-talker setting, when presented from the expected location, is shown to be beneficial for both younger and older adults.

EEG correlates of spatial shifts of attention in a dynamic multi-talker speech perception scenario in younger and older adults.

Speech perception under "cocktail-party" conditions critically depends on the focusing of attention toward the talker of interest. In dynamic auditory scenes, changes in talker settings require rapid shifts of attention, which is especially relevant when the position of a target talker switches from one location to another. Here, we explored electrophysiological correlates of shifts in spatial auditory attention, using a free-field speech perception task, in which sequences of short words (a company name, followed by a numeric value, e.g., "Bosch-6") were presented in the participants' left and right horizontal plane. Younger and older participants responded to the value of a pre-defined target company, while ignoring three simultaneously presented pairs of concurrent company names and values from different locations. All four stimulus pairs were spoken by different talkers, alternating from trial-to-trial. The location of the target company was within either the left or right hemisphere for a variable number of consecutive trials (between 3 and 42 trials) and then changed, switching from the left to the right hemispace or vice versa. Thus, when a switch occurred, the participants had to search for the new position of the target company among the concurrent streams of auditory information and re-focus their attention on the relevant location. As correlates of lateralized spatial auditory attention, the anterior contralateral N2 subcomponent (N2ac) and the posterior alpha power lateralization were analyzed in trials immediately before and after switches of the target location. Both measures were increased after switches, while only the increase in N2ac was related to better speech perception performance (i.e., a reduced post-switch decline in accuracy). While both age groups showed a similar pattern of switch-related attentional modulations, N2ac and alpha lateralization to the task-relevant stimulus (the target company's value) was overall greater in the younger, than older, group. The results suggest that N2ac and alpha lateralization reflect different attentional processes in multi-talker speech perception, the first being primarily associated with auditory search and the focusing of attention, and the second with the in-depth attentional processing of task-relevant information. Especially the second process appears to be prone to age-related cognitive decline.

Visually guided auditory attention in a dynamic "cocktail-party" speech perception task: ERP evidence for age-related differences.

Speech understanding in the presence of concurring sound is a major challenge especially for older persons. In particular, conversational turn-takings usually result in switch costs, as indicated by declined speech perception after changes in the relevant target talker. Here, we investigated whether visual cues indicating the future position of a target talker may reduce the costs of switching in younger and older adults. We employed a speech perception task, in which sequences of short words were simultaneously presented by three talkers, and analysed behavioural measures and event-related potentials (ERPs). Informative cues resulted in increased performance after a spatial change in target talker compared to uninformative cues, not indicating the future target position. Especially the older participants benefited from knowing the future target position in advance, indicated by reduced response times after informative cues. The ERP analysis revealed an overall reduced N2, and a reduced P3b to changes in the target talker location in older participants, suggesting reduced inhibitory control and context updating. On the other hand, a pronounced frontal late positive complex (f-LPC) to the informative cues indicated increased allocation of attentional resources to changes in target talker in the older group, in line with the decline-compensation hypothesis. Thus, knowing where to listen has the potential to compensate for age-related decline in attentional switching in a highly variable cocktail-party environment.

Driver state examination--Treading new paths.

A large proportion of crashes in road driving can be attributed to driver fatigue. Several types of fatigue are discussed, comprising sleep-related fatigue, active task-related fatigue (as a consequence of workload in demanding driving situations) as well as passive task-related fatigue (as related to monotonous driving situations). The present study investigated actual states of fatigue in a monotonous driving situation, using EEG measures and a long-lasting driving simulation experiment, in which drivers had to keep the vehicle on track by compensating crosswind of different strength. Performance data and electrophysiological correlates of mental fatigue (EEG Alpha and Theta power, Inter Trial Coherence (ITC), and auditory event-related potentials to short sound stimuli) were analyzed. Driving errors and driving lane variability increased with time on task and with increasing crosswind. The posterior Alpha and Theta power also increased with time on task, but decreased with stronger crosswind. The P3a to sound stimuli decreased with time on task when the crosswind was weak, but remained stable when the crosswind was strong. The analysis of ITC revealed less frontal Alpha and Theta band synchronization with time on task, but no effect of crosswind. The results suggest that Alpha power in monotonous driving situations reflects boredom or attentional withdrawal due to monotony rather than the decline of processing abilities as a consequence of high mental effort. A more valid indicator of declining mental resources with increasing time on task seems to be provided by brain oscillatory synchronization measures and event-related activity.

What does successful speech-in-noise perception in aging depend on? Electrophysiological correlates of high and low performance in older adults.

Aging usually decreases the ability to understand language under difficult listening conditions. However, aging is also associated with increased between-subject variability. Here, we studied potential sources of inter-individual differences and investigated spoken language understanding of younger and older adults (age ranges 21-35 and 57-74 years, respectively) in a simulated "cocktail-party" scenario. A naturalistic "stock-price monitoring" task was employed in which prices of listed companies were simultaneously recited by four speakers at different locations in space. The participants responded when prices of a target company exceeded specific values, while ignoring all other companies. According to their individual performance levels three subgroups of participants were composed, consisting of 12 high-performing and 12 low-performing older adults, and 12 young adults matching the high-performing older group. The analysis of the event-related brain potentials indicated that all older adults showed delayed attentional control (indicated by a later P2) and reduced speech processing (indicated by a reduced N400), relative to the younger adults. High-performing older adults differed in increased allocation of attention and inhibitory control (indicated by a stronger P2-N2 complex) from their low-performing counterparts. The results are consistent with the idea of an adjustment of mental resources that could help compensating potential deficiencies in peripheral and central auditory processing.

ERP correlates of auditory goal-directed behavior of younger and older adults in a dynamic speech perception task.

The ability to understand speech under adverse listening conditions deteriorates with age. In addition to genuine hearing deficits, age-related declines in attentional and inhibitory control are assumed to contribute to these difficulties. Here, the impact of task-irrelevant distractors on speech perception was studied in 28 younger and 24 older participants in a simulated "cocktail party" scenario. In a two-alternative forced-choice word discrimination task, the participants responded to a rapid succession of short speech stimuli ("on" and "off") that was presented at a frequent standard location or at a rare deviant location in silence or with a concurrent distractor speaker. Behavioral responses and event-related potentials (mismatch negativity MMN, P3a, and reorienting negativity RON) were analyzed to study the interplay of distraction, orientation, and refocusing in the presence of changes in target location. While shifts in target location decreased performance of both age groups, this effect was more pronounced in the older group. Especially in the distractor condition, the electrophysiological measures indicated a delayed attention capture and a delayed re-focussing of attention toward the task-relevant stimulus feature in the older group, relative to the young group. In sum, the results suggest that a delay in the attention switching mechanism contribute to the age-related difficulties in speech perception in dynamic listening situations with multiple speakers.

The timing of stimulus localisation and the Simon effect: an ERP study.

The Simon effect, an acceleration of responses at the same side that a stimulus is presented, is assumed to be the consequence of an automatic response activation evoked by the processing of the irrelevant stimulus location. This activation has been reported to decline as responses become slower. Consequently, the Simon effect decays over time. However, it remains unclear when this activation starts and what process initiates it. Up to now, the decaying hypothesis and its temporal properties have been based on indirect evidence. In the present study we tested the timing of the decay of the Simon effect more directly by combining a localisation task and a Simon task in an EEG study. It can be shown that the response activation is evoked by visual spatial processing, and that the size of the Simon effect steadily decreases as a function of the time between this localisation process and the manual response. However, this finding only holds if the encoding of relevant stimulus features follows the localisation process unequivocally.