Intraoperative assessment of cochlear nerve functionality in various vestibular schwannoma scenarios: Lessons learned.

The use of cochlear implants (CIs) is on the rise for patients with vestibular schwannoma (VS). Besides CI following tumor resection, new scenarios such as implantation in observed and/or irradiated tumors are becoming increasingly common. A significant emerging trend is the need of intraoperative evaluation of the functionality of the cochlear nerve in order to decide if a CI would be placed. The purpose of this paper is to explore the experience of a tertiary center with the application of the Auditory Nerve Test System (ANTS) in various scenarios regarding VS patients. The results are compared to that of the studies that have previously used the ANTS in this condition. Patients with unilateral or bilateral VS (NF2) who were evaluated with the ANTS prior to considering CI in a tertiary center between 2021 and 2023 were analyzed. The presence of a robust wave V was chosen to define a positive electrical auditory brainstem response (EABR). Two patients underwent promontory stimulation (PromStim) EABR previous to ANTS evaluation. Seven patients, 2 NF-2 and 5 with sporadic VS were included. The initial scenario was simultaneous translabyrinthine (TL) tumor resection and CI in 3 cases while a CI placement without tumor resection was planned in 4 cases. The ANTS was positive in 4 cases, negative in 2 cases, and uncertain in one case. Two patients underwent simultaneous TL and CI, 1 patient simultaneous TL and auditory brainstem implant, 3 patients posterior tympanotomy with CI, and 1 patient had no implant placement. In the 5 patients undergoing CI, sound detection was present. There was a good correlation between the PromStim and ANTS EABR. The literature research yielded 35 patients with complete information about EABR response. There was one false negative and one false positive case; that is, the 28 implanted cases with a present wave V following tumor resection had some degree of auditory perception in all but one case. The ANTS is a useful intraoperative tool to asses CI candidacy in VS patients undergoing observation, irradiation or surgery. A positive strongly predicts at least sound detection with the CI.

Gradient boosted decision trees reveal nuances of auditory discrimination behavior.

Animal psychophysics can generate rich behavioral datasets, often comprised of many 1000s of trials for an individual subject. Gradient-boosted models are a promising machine learning approach for analyzing such data, partly due to the tools that allow users to gain insight into how the model makes predictions. We trained ferrets to report a target word's presence, timing, and lateralization within a stream of consecutively presented non-target words. To assess the animals' ability to generalize across pitch, we manipulated the fundamental frequency (F0) of the speech stimuli across trials, and to assess the contribution of pitch to streaming, we roved the F0 from word token to token. We then implemented gradient-boosted regression and decision trees on the trial outcome and reaction time data to understand the behavioral factors behind the ferrets' decision-making. We visualized model contributions by implementing SHAPs feature importance and partial dependency plots. While ferrets could accurately perform the task across all pitch-shifted conditions, our models reveal subtle effects of shifting F0 on performance, with within-trial pitch shifting elevating false alarms and extending reaction times. Our models identified a subset of non-target words that animals commonly false alarmed to. Follow-up analysis demonstrated that the spectrotemporal similarity of target and non-target words rather than similarity in duration or amplitude waveform was the strongest predictor of the likelihood of false alarming. Finally, we compared the results with those obtained with traditional mixed effects models, revealing equivalent or better performance for the gradient-boosted models over these approaches.

Towards ASSR-based hearing assessment using natural sounds.

Objective. The auditory steady-state response (ASSR) allows estimation of hearing thresholds. The ASSR can be estimated from electroencephalography (EEG) recordings from electrodes positioned on both the scalp and within the ear (ear-EEG). Ear-EEG can potentially be integrated into hearing aids, which would enable automatic fitting of the hearing device in daily life. The conventional stimuli for ASSR-based hearing assessment, such as pure tones and chirps, are monotonous and tiresome, making them inconvenient for repeated use in everyday situations. In this study we investigate the use of natural speech sounds for ASSR estimation.Approach.EEG was recorded from 22 normal hearing subjects from both scalp and ear electrodes. Subjects were stimulated monaurally with 180 min of speech stimulus modified by applying a 40 Hz amplitude modulation (AM) to an octave frequency sub-band centered at 1 kHz. Each 50 ms sub-interval in the AM sub-band was scaled to match one of 10 pre-defined levels (0-45 dB sensation level, 5 dB steps). The apparent latency for the ASSR was estimated as the maximum average cross-correlation between the envelope of the AM sub-band and the recorded EEG and was used to align the EEG signal with the audio signal. The EEG was then split up into sub-epochs of 50 ms length and sorted according to the stimulation level. ASSR was estimated for each level for both scalp- and ear-EEG.Main results. Significant ASSRs with increasing amplitude as a function of presentation level were recorded from both scalp and ear electrode configurations.Significance. Utilizing natural sounds in ASSR estimation offers the potential for electrophysiological hearing assessment that are more comfortable and less fatiguing compared to existing ASSR methods. Combined with ear-EEG, this approach may allow convenient hearing threshold estimation in everyday life, utilizing ambient sounds. Additionally, it may facilitate both initial fitting and subsequent adjustments of hearing aids outside of clinical settings.

Lower Childhood Socioeconomic Status Is Associated with Greater Neural Responses to Ambient Auditory Changes in Adulthood.

Humans' early life experience varies by socioeconomic status (SES), raising the question of how this difference is reflected in the adult brain. An important aspect of brain function is the ability to detect salient ambient changes while focusing on a task. Here, we ask whether subjective social status during childhood is reflected by the way young adults' brain detecting changes in irrelevant information. In two studies (total n = 58), we examine electrical brain responses in the frontocentral region to a series of auditory tones, consisting of standard stimuli (80%) and deviant stimuli (20%) interspersed randomly, while participants were engaged in various visual tasks. Both studies showed stronger automatic change detection indexed by MMN in lower SES individuals, regardless of the unattended sound's feature, attended emotional content, or study type. Moreover, we observed a larger MMN in lower-SES participants, although they did not show differences in brain and behavior responses to the attended task. Lower-SES people also did not involuntarily orient more attention to sound changes (i.e., deviant stimuli), as indexed by the P3a. The study indicates that individuals with lower subjective social status may have an increased ability to automatically detect changes in their environment, which may suggest their adaptation to their childhood environments.

The Costs (and Benefits?) of Effortful Listening for Older Adults: Insights from Simultaneous Electrophysiology, Pupillometry, and Memory.

Although the impact of acoustic challenge on speech processing and memory increases as a person ages, older adults may engage in strategies that help them compensate for these demands. In the current preregistered study, older adults (n = 48) listened to sentences-presented in quiet or in noise-that were high constraint with either expected or unexpected endings or were low constraint with unexpected endings. Pupillometry and EEG were simultaneously recorded, and subsequent sentence recognition and word recall were measured. Like young adults in prior work, we found that noise led to increases in pupil size, delayed and reduced ERP responses, and decreased recall for unexpected words. However, in contrast to prior work in young adults where a larger pupillary response predicted a recovery of the N400 at the cost of poorer memory performance in noise, older adults did not show an associated recovery of the N400 despite decreased memory performance. Instead, we found that in quiet, increases in pupil size were associated with delays in N400 onset latencies and increased recognition memory performance. In conclusion, we found that transient variation in pupil-linked arousal predicted trade-offs between real-time lexical processing and memory that emerged at lower levels of task demand in aging. Moreover, with increased acoustic challenge, older adults still exhibited costs associated with transient increases in arousal without the corresponding benefits.

Assessment of Interaural Attenuation in Infants and Young Children Using Bone-Conducted Auditory Brainstem Response.

OBJECTIVES: In hearing assessment, the term interaural attenuation (IAA) is used to quantify the reduction in test signal intensity as it crosses from the side of the test ear to the nontest ear. In the auditory brainstem response (ABR) testing of infants and young children, the size of the IAA of bone-conducted (BC) stimuli is essential for the appropriate use of masking, which is needed for the accurate measurement of BC ABR thresholds. This study aimed to assess the IAA for BC ABR testing using 0.5 to 4 kHz narrowband (NB) CE-chirp LS stimuli in infants and toddlers with normal hearing from birth to three years of age and to examine the effects of age and frequency on IAA. DESIGN: A total of 55 infants and toddlers with normal hearing participated in the study. They were categorized into three age groups: the young group (n = 31, infants from birth to 3 mo), middle-aged group (n = 13, infants aged 3-12 mo), and older group (n = 11, toddlers aged 12-36 mo). The participants underwent BC ABR threshold measurements for NB CE-chirp LS stimuli at 0.5 to 4 kHz. For each participant, one ear was randomly defined as the "test ear" and the other as the "nontest ear." BC ABR thresholds were measured under two conditions. In both conditions, traces were recorded from the channel ipsilateral to the test ear, whereas masking was delivered to the nontest ear. In condition A, the bone oscillator was placed on the mastoid of the test ear, whereas in condition B, the bone oscillator was placed on the mastoid contralateral to the test ear. The difference between the thresholds obtained under conditions A and B was calculated to assess IAA. RESULTS: The means of IAA (and range) in the young age group for the frequencies 0.5, 1, 2, and 4 kHz were 5.38 (0-15) dB, 11.67 (0-30) dB, 21.15 (10-40) dB, and 23.53 (15-35) dB, respectively. Significant effects were observed for both age and frequency on BC IAA. BC IAA levels decreased with age from birth to 36 mo. In all age groups, smaller values were observed at lower frequencies and increased values were observed at higher frequencies. CONCLUSIONS: BC IAA levels were both age and frequency dependent. The study found that the BC IAA values for lower stimulus frequencies were smaller than previously assumed, even in infants younger than 3 mo. These results suggest that masking should be applied in BC ABR threshold assessments for NB CE-chirp LS stimuli at 0.5, 1, and 2 kHz, even in young infants. Masking may not be necessary for testing at 4 kHz if a clear response is obtained at 15 dB normal-hearing level (nHL) in infants younger than 3 mo.

The Development of a Wearable Biofeedback System to Elicit Temporal Gait Asymmetry using Rhythmic Auditory Stimulation and an Assessment of Immediate Effects.

Temporal gait asymmetry (TGA) is commonly observed in individuals facing mobility challenges. Rhythmic auditory stimulation (RAS) can improve temporal gait parameters by promoting synchronization with external cues. While biofeedback for gait training, providing real-time feedback based on specific gait parameters measured, has been proven to successfully elicit changes in gait patterns, RAS-based biofeedback as a treatment for TGA has not been explored. In this study, a wearable RAS-based biofeedback gait training system was developed to measure temporal gait symmetry in real time and deliver RAS accordingly. Three different RAS-based biofeedback strategies were compared: open- and closed-loop RAS at constant and variable target levels. The main objective was to assess the ability of the system to induce TGA with able-bodied (AB) participants and evaluate and compare each strategy. With all three strategies, temporal symmetry was significantly altered compared to the baseline, with the closed-loop strategy yielding the most significant changes when comparing at different target levels. Speed and cadence remained largely unchanged during RAS-based biofeedback gait training. Setting the metronome to a target beyond the intended target may potentially bring the individual closer to their symmetry target. These findings hold promise for developing personalized and effective gait training interventions to address TGA in patient populations with mobility limitations using RAS.

A Guinea Pig Model Suggests That Objective Assessment of Acoustic Hearing Preservation in Human Ears With Cochlear Implants Is Confounded by Shifts in the Spatial Origin of Acoustically Evoked Potential Measurements Along the Cochlear Length.

OBJECTIVES: Our recent empirical findings have shown that the auditory nerve compound action potential (CAP) evoked by a low-level tone burst originates from a narrow cochlear region tuned to the tone burst frequency. At moderate to high sound levels, the origins shift to the most sensitive audiometric regions rather than the extended high-frequency regions of the cochlear base. This means that measurements evoked from extended high-frequency sound stimuli can shift toward the apex with increasing level. Here we translate this study to understand the spatial origin of acoustically evoked responses from ears that receive cochlear implants, an emerging area of research and clinical practice that is not completely understood. An essential step is to first understand the influence of the cochlear implant in otherwise naive ears. Our objective was to understand how function of the high-frequency cochlear base, which can be excited by the intense low-frequency sounds that are frequently used for objective intra- and postoperative monitoring, can be influenced by the presence of the cochlear implant. DESIGN: We acoustically evoked responses and made measurements with an electrode placed near the guinea pig round window. The cochlear implant was not utilized for either electrical stimulation or recording purposes. With the cochlear implant in situ, CAPs were acoustically evoked from 2 to 16 kHz tone bursts of various levels while utilizing the slow perfusion of a kainic acid solution from the cochlear apex to the cochlear aqueduct in the base, which sequentially reduced neural responses from finely spaced cochlear frequency regions. This cochlear perfusion technique reveals the spatial origin of evoked potential measurements and provides insight on what influence the presence of an implant has on acoustical hearing. RESULTS: Threshold measurements at 3 to 11 kHz were elevated by implantation. In an individual ear, thresholds were elevated and lowered as cochlear implant was respectively inserted and removed, indicative of "conductive hearing loss" induced by the implant. The maximum threshold elevation occurred at most sensitive region of the naive guinea pig ear (33.66 dB at 8 kHz), making 11 kHz the most sensitive region to acoustic sounds for guinea pig ears with cochlear implants. Conversely, the acute implantation did not affect the low-frequency, 500 Hz thresholds and suprathreshold function, as shown by the auditory nerve overlapped waveform. As the sound pressure level of the tone bursts increased, mean data show that the spatial origin of CAPs along the cochlear length shifted toward the most sensitive cochlear region of implanted ears, not the extended high-frequency cochlear regions. However, data from individual ears showed that after implantation, measurements from moderate to high sound pressure levels originate in places that are unique to each ear. CONCLUSIONS: Alterations to function of the cochlear base from the in situ cochlear implant may influence objective measurements of implanted ears that are frequently made with intense low-frequency sound stimuli. Our results from guinea pigs advance the interpretation of measurements used to understand how and when residual acoustic hearing is lost in human ears receiving a cochlear implant.

Comparative Assessment of Physiological Responses to Emotional Elicitation by Auditory and Visual Stimuli.

The study of emotions through the analysis of the induced physiological responses gained increasing interest in the past decades. Emotion-related studies usually employ films or video clips, but these stimuli do not give the possibility to properly separate and assess the emotional content provided by sight or hearing in terms of physiological responses. In this study we have devised an experimental protocol to elicit emotions by using, separately and jointly, pictures and sounds from the widely used International Affective Pictures System and International Affective Digital Sounds databases. We processed galvanic skin response, electrocardiogram, blood volume pulse, pupillary signal and electroencephalogram from 21 subjects to extract both autonomic and central nervous system indices to assess physiological responses in relation to three types of stimulation: auditory, visual, and auditory/visual. Results show a higher galvanic skin response to sounds compared to images. Electrocardiogram and blood volume pulse show different trends between auditory and visual stimuli. The electroencephalographic signal reveals a greater attention paid by the subjects when listening to sounds compared to watching images. In conclusion, these results suggest that emotional responses increase during auditory stimulation at both central and peripheral levels, demonstrating the importance of sounds for emotion recognition experiments and also opening the possibility toward the extension of auditory stimuli in other fields of psychophysiology. Clinical and Translational Impact Statement- These findings corroborate auditory stimuli's importance in eliciting emotions, supporting their use in studying affective responses, e.g., mood disorder diagnosis, human-machine interaction, and emotional perception in pathology.

Validation of cost-efficient EEG experimental setup for neural tracking in an auditory attention task.

When individuals listen to speech, their neural activity phase-locks to the slow temporal rhythm, which is commonly referred to as "neural tracking". The neural tracking mechanism allows for the detection of an attended sound source in a multi-talker situation by decoding neural signals obtained by electroencephalography (EEG), known as auditory attention decoding (AAD). Neural tracking with AAD can be utilized as an objective measurement tool for diverse clinical contexts, and it has potential to be applied to neuro-steered hearing devices. To effectively utilize this technology, it is essential to enhance the accessibility of EEG experimental setup and analysis. The aim of the study was to develop a cost-efficient neural tracking system and validate the feasibility of neural tracking measurement by conducting an AAD task using an offline and real-time decoder model outside the soundproof environment. We devised a neural tracking system capable of conducting AAD experiments using an OpenBCI and Arduino board. Nine participants were recruited to assess the performance of the AAD using the developed system, which involved presenting competing speech signals in an experiment setting without soundproofing. As a result, the offline decoder model demonstrated an average performance of 90%, and real-time decoder model exhibited a performance of 78%. The present study demonstrates the feasibility of implementing neural tracking and AAD using cost-effective devices in a practical environment.

EEG-based assessment of temporal fine structure and envelope effect in mandarin syllable and tone perception.

In recent years, speech perception research has benefited from low-frequency rhythm entrainment tracking of the speech envelope. However, speech perception is still controversial regarding the role of speech envelope and temporal fine structure, especially in Mandarin. This study aimed to discuss the dependence of Mandarin syllables and tones perception on the speech envelope and the temporal fine structure. We recorded the electroencephalogram (EEG) of the subjects under three acoustic conditions using the sound chimerism analysis, including (i) the original speech, (ii) the speech envelope and the sinusoidal modulation, and (iii) the fine structure of time and the modulation of the non-speech (white noise) sound envelope. We found that syllable perception mainly depended on the speech envelope, while tone perception depended on the temporal fine structure. The delta bands were prominent, and the parietal and prefrontal lobes were the main activated brain areas, regardless of whether syllable or tone perception was involved. Finally, we decoded the spatiotemporal features of Mandarin perception from the microstate sequence. The spatiotemporal feature sequence of the EEG caused by speech material was found to be specific, suggesting a new perspective for the subsequent auditory brain-computer interface. These results provided a new scheme for the coding strategy of new hearing aids for native Mandarin speakers.

Assessment of Vestigial Auriculomotor Activity to Acoustic Stimuli Using Electrodes In and Around the Ear.

Recently, it has been demonstrated that electromyographic (EMG) activity of auricular muscles in humans, especially the postauricular muscle (PAM), depends on the spatial location of auditory stimuli. This observation has only been shown using wet electrodes placed directly on auricular muscles. To move towards a more applied, out-of-the-laboratory setting, this study aims to investigate if similar results can be obtained using electrodes placed in custom-fitted earpieces. Furthermore, with the exception of the ground electrode, only dry-contact electrodes were used to record EMG signals, which require little to no skin preparation and can therefore be applied extremely fast. In two experiments, auditory stimuli were presented to ten participants from different spatial directions. In experiment 1, stimuli were rapid onset naturalistic stimuli presented in silence, and in experiment 2, the corresponding participant's first name, presented in a "cocktail party" environment. In both experiments, ipsilateral responses were significantly larger than contralateral responses. Furthermore, machine learning models objectively decoded the direction of stimuli significantly above chance level on a single trial basis (PAM: ≈ 80%, in-ear: ≈ 69%). There were no significant differences when participants repeated the experiments after several weeks. This study provides evidence that auricular muscle responses can be recorded reliably using an almost entirely dry-contact in-ear electrode system. The location of the PAM, and the fact that in-ear electrodes can record comparable signals, would make hearing aids interesting devices to record these auricular EMG signals and potentially utilize them as control signals in the future.

A Fundamental Inequality Governing the Rate Coding Response of Sensory Neurons.

A fundamental inequality governing the spike activity of peripheral neurons is derived and tested against auditory data. This inequality states that the steady-state firing rate must lie between the arithmetic and geometric means of the spontaneous and peak activities during adaptation. Implications towards the development of auditory mechanistic models are explored.

Estimating vibration artifacts in preclinical experimental assessment of actuator efficiency in bone-conduction hearing devices.

OBJECTIVES: Test feasibility of a means to distinguish artifact from relevant signal in an experimental method for pre-clinical assessment of bone conduction (BC) stimulation efficiency based on measurement of intracochlear pressure (ICP). METHODS: Experiments were performed on fresh-frozen human temporal bones and cadaver heads. In a first step, fiber optic pressure sensors inserted into the cochlea through cochleostomies were intentionally vibrated to generate relative motion versus the stationary specimen, and the resulting ICP artifact recorded, before and after attaching the sensor fiber to the bone with glue. In a second step, BC stimulation was applied in the conventional location for a commercial bone anchored implant, as well as two alternative locations closer to the otic capsule. Again, ICP was recorded and compared with an estimated artifact, calculated from the previous measurements with intentional vibration of the fiber. RESULTS: Intentional vibration of the sensor fiber creates relative motion between fiber and bone, as intended, and causes an ICP signal. The stimulus does not create substantial promontory vibration, indicating that the measured ICP is all artifact, i.e. would not occur if the sensor were not in place. Fixating the sensor fiber to the bone with glue reduces the ICP artifact by at least 20 dB. BC stimulation also creates relative motion between sensor fiber and bone, as expected, from which an estimated ICP artifact level can be calculated. The ICP signal measured during BC stimulation is well above the estimated artifact, at least in some specimens and at some frequencies, indicating "real" cochlear stimulation, which would result in an auditory percept in a live subject. Stimulation at the alternative locations closer to the otic capsule appear to result in higher ICP (no statistical analysis performed), indicating a trend towards more efficient stimulation than at the conventional location. CONCLUSIONS: Intentional vibration of the fiber optic sensor for measurement of ICP can be used to derive an estimate of the artifact to be expected when measuring ICP during BC stimulation, and to characterize the effectiveness of glues or other means of reducing the artifact caused by relative motion of fiber and bone.

Behavioral Assessment of Zwicker Tone Percepts in Gerbils.

The Zwicker tone illusion - an auditory phantom percept after hearing a notched noise stimulus - can serve as an interesting model for acute tinnitus. Recent mechanistic models suggest that the underlying neural mechanisms of both percepts are similar. To date it is not clear if animals do perceive the Zwicker tone, as up to now no behavioral paradigms are available to objectively assess the presence of this phantom percept. Here we introduce, for the first time, a modified version of the gap pre-pulse inhibition of the acoustic startle reflex (GPIAS) paradigm to test if it is possible to induce a Zwicker tone percept in our rodent model, the Mongolian gerbil. Furthermore, we developed a new aversive conditioning learning paradigm and compare the two approaches. We found a significant increase in the GPIAS effect when presenting a notched noise compared to white noise gap pre-pulse inhibition, which is consistent with the interpretation of a Zwicker tone percept in these animals. In the aversive conditioning learning paradigm, no clear effect could be observed in the discrimination performance of the tested animals. When investigating the first 33% of the correct conditioned responses, an effect of a possible Zwicker tone percept can be seen, i.e. animals show identical behavior as if a pure tone was presented, but the paradigm needs to be further improved. Nevertheless, the results indicate that Mongolian gerbils are able to perceive a Zwicker tone and can serve as a neurophysiological model for human tinnitus generation.

Dealing with correlations in the multichannel EEG using bipolar derivations and Monte Carlo simulations: application to the detection of auditory steady-state responses.

The multichannel objective response detection (MORD) techniques are statistical methods, which use information from more than one electroencephalography (EEG) channel, to infer the presence of evoked potential. However, the correlation level between the channels can lead to a decrease in MORD performance, such as an increase in the false positive (FP) rate and/or a decrease in the detection rate (DR). The present study aims to propose a method to deal with the correlations in the multichannel EEG. The method consists of making an adjustment in the Monte Carlo simulation, considering the information between channels. The MORD techniques with and without the new method were applied to an auditory steady-state response (ASSR) database, composed of the EEG multichannel of eleven volunteers during multifrequency stimulation. The proposed method kept the FP rate at values equal to or less than the significance level of the test and led to an increase of 8.51% in the DR in relation to non-application of the method. Results of this study indicate that the proposed method is an alternative to deal with the effect of the correlation between channels in situations where MORD techniques are applied.

Relationships among age, socioeconomic status, and distractibility in preschoolers as assessed by the Competitive Attention Test.

In children, the ability to attend to relevant auditory information and ignore distracting information is crucial for learning and educational achievement. Distractibility, the propensity to pay attention to irrelevant information, depends on multiple components of cognition (voluntary attention orienting, sustained attention, distraction resulting from the capture of attention by a distractor, phasic arousal, impulsivity, and motor control) that may mature at different ages. Here, we used the Competitive Attention Test (CAT) to measure these components in children aged 3 to 5 years. Our goal was to characterize changes in the efficiency of attention during the preschool period and to determine whether distractibility varies as a function of socioeconomic status (SES). All 3-year-olds (n = 14) and some 4- and 5-year-olds (n = 21) needed to be excluded from the sample due to noncompliance with instructions, suggesting that the CAT might not be suitable for children with poorly developed skills in sustained attention. Among 4- and 5-year-olds who completed the CAT (n = 71), sustained attention improved with age, whereas voluntary attention orienting remained immature. Independent of age, task-irrelevant sounds induced distraction, phasic arousal, and impulsivity. There was no relationship between SES and children's distraction. Finally, children from lower SES backgrounds showed reduced sustained attention abilities and increased impulsivity. Taken together, these findings suggest that distractibility is still developing during the preschool period and is likely to vary depending on the SES background of a child's family.

Costs and benefits of audiovisual interactions.

A strong temporal correlation promotes integration of concurrent sensory signals, either within a single sensory modality, or from different modalities. Although the benefits of such integration are well known, far less attention has been given to possible costs incurred when concurrent sensory signals are uncorrelated. In two experiments, subjects categorized the rate at which a visual object modulated in size, while they also tried to ignore a concurrent task-irrelevant broadband sound. Overall, the experiments showed that (i) losses in accuracy from mismatched auditory and visual rates were larger than gains from matched rates and (ii) mismatched auditory and visual rates slowed responses more than they were sped up when rates matched. Experiment One showed that audiovisual interaction varied with the difference between the visual modulation rate and the modulation rate of a concurrent auditory stimulus. Experiment Two showed that audiovisual interaction depended upon the strength of the task-irrelevant auditory modulation. Although our stimuli involved abstract, low-dimensional stimuli, not speech, the effects we observed parallel key findings on interference in multi-speaker settings.

Reality and illusion: the assessment of angular separation of multi-modal signallers in a duetting bird.

The spatial distribution of cooperating individuals plays a strategic role in territorial interactions of many group-living animals, and can indicate group cohesion. Vocalizations are commonly used to judge the distribution of signallers, but the spatial resolution of sounds is poor. Many species therefore accompany calls with movement; however, little is known about the role of audio-visual perception in natural interactions. We studied the effect of angular separation on the efficacy of multimodal duets in the Australian magpie-lark, Grallina cyanoleuca. We tested specifically whether conspicuous wing movements, which typically accompany duets, affect responses to auditory angular separation. Multimodal playbacks of duets using robotic models and speakers showed that birds relied primarily on acoustic cues when visual and auditory angular separations were congruent, but used both modalities to judge separation between the signallers when modalities were spatially incongruent. The visual component modified the effect of acoustic separation: robotic models that were apart weakened the response when speakers were together, while models that were together strengthened responses when speakers were apart. Our results show that responses are stronger when signallers are together, and suggest that males were are able to bind information cross-modally on the senders' spatial location, which is consistent with a multisensory illusion.

Preferred music listening is associated with perceptual learning enhancement at the expense of self-focused attention.

Can preferred music listening improve following attentional and learning performances? Here we suggest that this may be the case. In Experiment 1, following preferred and non-preferred musical-piece listening, we recorded electrophysiological responses to an auditory roving-paradigm. We computed the mismatch negativity (MMN - the difference between responses to novel and repeated stimulation), as an index of perceptual learning, and we measured the correlation between trial-by-trial EEG responses and the fluctuations in Bayesian Surprise, as a quantification of the neural attunement with stimulus informational value. Furthermore, during music listening, we recorded oscillatory cortical activity. MMN and trial-by-trial correlation with Bayesian surprise were significantly larger after subjectively preferred versus non-preferred music, indicating the enhancement of perceptual learning. The analysis on oscillatory activity during music listening showed a selective alpha power increased in response to preferred music, an effect often related to cognitive enhancements. In Experiment 2, we explored whether this learning improvement was realized at the expense of self-focused attention. Therefore, after preferred versus non-preferred music listening, we collected Heart-Beat Detection (HBD) accuracy, as a measure of the attentional focus toward the self. HBD was significantly lowered following preferred music listening. Overall, our results suggest the presence of a specific neural mechanism that, in response to aesthetically pleasing stimuli, and through the modulation of alpha oscillatory activity, redirects neural resources away from the self and toward the environment. This attentional up-weighting of external stimuli might be fruitfully exploited in a wide area of human learning activities, including education, neurorehabilitation and therapy.