Horizontal sound localization in cochlear implant users with a contralateral hearing aid.

Interaural differences in sound arrival time (ITD) and in level (ILD) enable us to localize sounds in the horizontal plane, and can support source segregation and speech understanding in noisy environments. It is uncertain whether these cues are also available to hearing-impaired listeners who are bimodally fitted, i.e. with a cochlear implant (CI) and a contralateral hearing aid (HA). Here, we assessed sound localization behavior of fourteen bimodal listeners, all using the same Phonak HA and an Advanced Bionics CI processor, matched with respect to loudness growth. We aimed to determine the availability and contribution of binaural (ILDs, temporal fine structure and envelope ITDs) and monaural (loudness, spectral) cues to horizontal sound localization in bimodal listeners, by systematically varying the frequency band, level and envelope of the stimuli. The sound bandwidth had a strong effect on the localization bias of bimodal listeners, although localization performance was typically poor for all conditions. Responses could be systematically changed by adjusting the frequency range of the stimulus, or by simply switching the HA and CI on and off. Localization responses were largely biased to one side, typically the CI side for broadband and high-pass filtered sounds, and occasionally to the HA side for low-pass filtered sounds. HA-aided thresholds better than 45 dB HL in the frequency range of the stimulus appeared to be a prerequisite, but not a guarantee, for the ability to indicate sound source direction. We argue that bimodal sound localization is likely based on ILD cues, even at frequencies below 1500 Hz for which the natural ILDs are small. These cues are typically perturbed in bimodal listeners, leading to a biased localization percept of sounds. The high accuracy of some listeners could result from a combination of sufficient spectral overlap and loudness balance in bimodal hearing.

Acquired prior knowledge modulates audiovisual integration.

Orienting responses to audiovisual events in the environment can benefit markedly by the integration of visual and auditory spatial information. However, logically, audiovisual integration would only be considered successful for stimuli that are spatially and temporally aligned, as these would be emitted by a single object in space-time. As humans do not have prior knowledge about whether novel auditory and visual events do indeed emanate from the same object, such information needs to be extracted from a variety of sources. For example, expectation about alignment or misalignment could modulate the strength of multisensory integration. If evidence from previous trials would repeatedly favour aligned audiovisual inputs, the internal state might also assume alignment for the next trial, and hence react to a new audiovisual event as if it were aligned. To test for such a strategy, subjects oriented a head-fixed pointer as fast as possible to a visual flash that was consistently paired, though not always spatially aligned, with a co-occurring broadband sound. We varied the probability of audiovisual alignment between experiments. Reaction times were consistently lower in blocks containing only aligned audiovisual stimuli than in blocks also containing pseudorandomly presented spatially disparate stimuli. Results demonstrate dynamic updating of the subject's prior expectation of audiovisual congruency. We discuss a model of prior probability estimation to explain the results.

Eye position determines audiovestibular integration during whole-body rotation.

When a sound is presented in the free field at a location that remains fixed to the head during whole-body rotation in darkness, it is heard displaced in the direction opposing the rotation. This phenomenon is known as the audiogyral illusion. Consequently, the subjective auditory median plane (AMP) (the plane where the binaural difference cues for sound localization are perceived to be zero) shifts in the direction of body rotation. Recent experiments, however, have suggested opposite AMP results when using a fixation light that also moves with the head. Although in this condition the eyes remain stationary in the head, an ocular pursuit signal cancels the vestibulo-ocular reflex, which could induce an additional AMP shift. We tested whether the AMP is influenced by vestibular signals, eye position or eye velocity. We rotated subjects sinusoidally at different velocities, either in darkness or with a head-fixed fixation light, while they judged the laterality (left vs. right with respect to the midsagittal plane of the head) of broadband sounds presented over headphones. Subjects also performed the same task without vestibular stimulation while tracking a sinusoidally moving visual target, which mimicked the average eye-movement patterns of the vestibular experiments in darkness. Results show that whole-body rotation in darkness induces a shift of the AMP in the direction of body rotation. In contrast, we obtained no significant AMP change when a fixation light was used. The pursuit experiments showed a shift of the AMP in the direction of eccentric eye position but not at peak pursuit velocity. We therefore conclude that the vestibular-induced shift in average eye position underlies both the audiogyral illusion and the AMP shift.