Some, but not all, cochlear implant users prefer music stimuli with congruent haptic stimulation.

Cochlear implant (CI) users often report being unsatisfied by music listening through their hearing device. Vibrotactile stimulation could help alleviate those challenges. Previous research has shown that musical stimuli was given higher preference ratings by normal-hearing listeners when concurrent vibrotactile stimulation was congruent in intensity and timing with the corresponding auditory signal compared to incongruent. However, it is not known whether this is also the case for CI users. Therefore, in this experiment, we presented 18 CI users and 24 normal-hearing listeners with five melodies and five different audio-to-tactile maps. Each map varied the congruence between the audio and tactile signals related to intensity, fundamental frequency, and timing. Participants were asked to rate the maps from zero to 100, based on preference. It was shown that almost all normal-hearing listeners, as well as a subset of the CI users, preferred tactile stimulation, which was congruent with the audio in intensity and timing. However, many CI users had no difference in preference between timing aligned and timing unaligned stimuli. The results provide evidence that vibrotactile music enjoyment enhancement could be a solution for some CI users; however, more research is needed to understand which CI users can benefit from it most.

The effect of auditory training on listening effort in hearing-aid users: insights from a pupillometry study.

OBJECTIVE: The study investigated how auditory training affects effort exerted by hearing-impaired listeners in speech-in-noise task. DESIGN: Pupillometry was used to characterise listening effort during a hearing in noise test (HINT) before and after phoneme-in-noise identification training. Half of the study participants completed the training, while the other half formed an active control group. STUDY SAMPLE: Twenty 63-to-79 years old experienced hearing-aid users. RESULTS: Higher peak pupil dilations (PPDs) were obtained at the end of the study compared to the beginning in both groups of the participants. The analysis of pupil dilation in an extended time window revealed, however, that the magnitude of pupillary response increased more in the training than in the control group. The effect of training on effort was observed in pupil responses even when no improvement in HINT was found. CONCLUSION: The results demonstrate that using a listening effort metric adds additional insights into the effectiveness of auditory training compared to the situation when only speech-in-noise performance is considered. Trends observed in pupil responses suggested increased effort-both after the training and the placebo intervention-most likely reflecting the effect of the individual's motivation.

The effect of phoneme-based auditory training on speech intelligibility in hearing-aid users.

OBJECTIVE: Hearing loss commonly causes difficulties in understanding speech in the presence of background noise. The benefits of hearing-aids in terms of speech intelligibility in challenging listening scenarios remain limited. The present study investigated if phoneme-in-noise discrimination training improves phoneme identification and sentence intelligibility in noise in hearing-aid users. DESIGN: Two groups of participants received either a two-week training program or a control intervention. Three phoneme categories were trained: onset consonants (C1), vowels (V) and post-vowel consonants (C2) in C1-V-C2-/i/ logatomes from the Danish nonsense word corpus (DANOK). Phoneme identification test and hearing in noise test (HINT) were administered before and after the respective interventions and, for the training group only, after three months. STUDY SAMPLE: Twenty 63-to-79 years old individuals with a mild-to-moderate sensorineural hearing loss and at least one year of experience using hearing-aids. RESULTS: The training provided an improvement in phoneme identification scores for vowels and post-vowel consonants, which was retained over three months. No significant performance improvement in HINT was found. CONCLUSION: The study demonstrates that the training induced a robust refinement of auditory perception at a phoneme level but provides no evidence for the generalisation to an untrained sentence intelligibility task.

Effect of audio-tactile congruence on vibrotactile music enhancement.

Music listening experiences can be enhanced with tactile vibrations. However, it is not known which parameters of the tactile vibration must be congruent with the music to enhance it. Devices that aim to enhance music with tactile vibrations often require coding an acoustic signal into a congruent vibrotactile signal. Therefore, understanding which of these audio-tactile congruences are important is crucial. Participants were presented with a simple sine wave melody through supra-aural headphones and a haptic actuator held between the thumb and forefinger. Incongruent versions of the stimuli were made by randomizing physical parameters of the tactile stimulus independently of the auditory stimulus. Participants were instructed to rate the stimuli against the incongruent stimuli based on preference. It was found making the intensity of the tactile stimulus incongruent with the intensity of the auditory stimulus, as well as misaligning the two modalities in time, had the biggest negative effect on ratings for the melody used. Future vibrotactile music enhancement devices can use time alignment and intensity congruence as a baseline coding strategy, which improved strategies can be tested against.

A modification of the scale illusion into a detection task for assessment of binaural streaming.

Binaural streaming by frequency-proximity was investigated without subjective listener-feedback by modifying the scale illusion of Deutsch [J. Acoust. Soc. Am. 57, 1156-1160 (1975)] into a detection-task. Nineteen listeners had to detect one deviation within a repeating melody stream, while simultaneously presented with a randomized distractor stream. Every second note in each stream was presented to the opposite ear, requiring binaural streaming to detect the deviant. Listeners performed well in this test but adding interaural delay or timbre-difference let the listeners group by lateralization instead. This confirms the grouping by frequency-proximity. The method could be used to investigate binaural streaming in hearing-impaired patients, where interaural percepts might differ.

The relationship between time and place coding with cochlear implants with long electrode arrays.

The auditory system can theoretically encode frequencies by either the rate or place of stimulation within the cochlea. Previous work with cochlear implants has demonstrated that both changes in timing and place can be described as pitch changes but are perceptually orthogonal. Using multidimensional scaling, the present experiment extends the previous findings that timing and place changes are perceptually orthogonal into the cochlear apex using long 31-mm electrode arrays. However, temporal cues seem to be more reliable across subjects at the apex while place cues seem to be more reliable at the middle of the cochlea.

Effects of the relative timing of opposite-polarity pulses on loudness for cochlear implant listeners.

The symmetric biphasic pulses used in contemporary cochlear implants (CIs) consist of both cathodic and anodic currents, which may stimulate different sites on spiral ganglion neurons and, potentially, interact with each other. The effect on the order of anodic and cathodic stimulation on loudness at short inter-pulse intervals (IPIs; 0-800 µs) is investigated. Pairs of opposite-polarity pseudomonophasic (PS) pulses were used and the amplitude of each pulse was manipulated independently. In experiment 1 the two PS pulses differed in their current level in order to elicit the same loudness when presented separately. Six users of the Advanced Bionics CI (Valencia, CA) loudness-ranked trains of the pulse pairs using a midpoint-comparison procedure. Stimuli with anodic-leading polarity were louder than those with cathodic-leading polarity for IPIs shorter than 400 µs. This effect was small-about 0.3 dB-but consistent across listeners. When the same procedure was repeated with both PS pulses having the same current level (experiment 2), anodic-leading stimuli were still louder than cathodic-leading stimuli at very short intervals. However, when using symmetric biphasic pulses (experiment 3) the effect disappeared at short intervals and reversed at long intervals. Possible peripheral sources of such polarity interactions are discussed.

Pitch matching in bimodal cochlear implant patients: Effects of frequency, spectral envelope, and level.

This study systematically investigated the effects of frequency, level, and spectral envelope on pitch matching in twelve bimodal cochlear implant (CI) users. The participants were asked to vary the frequency and level of a pure or complex tone (adjustable sounds) presented in the non-implanted ear to match the pitch and loudness of different reference stimuli presented to the implanted ear. Three reference sounds were used: single electrode pulse trains, pure tones, and piano notes. The data showed a significant effect of the frequency and complexity of the reference sounds. No significant effect of the level of the reference sounds was found. The magnitude of effect of frequency was compressed in the implanted ear: on average a difference of seven semitones in the non-implanted ear induced the same pitch change as a difference of 19 to 24 semitones for a stimulus presented to the implanted ear. The spectral envelope of the adjustable sound presented to the non-implanted ear also had a significant effect. The matched frequencies were higher by an average of six semitones for the pure tone compared to a complex tone. Overall, the CI listeners might have matched the stimuli based on timbre characteristics such as brightness.

Linear combination of auditory steady-state responses evoked by co-modulated tones.

Up to medium intensities and in the 80-100-Hz region, the auditory steady-state response (ASSR) to a multi-tone carrier is commonly considered to be a linear sum of the dipoles from each tone specific ASSR generator. Here, this hypothesis was investigated when a unique modulation frequency is used for all carrier components. Listeners were presented with a co-modulated dual-frequency carrier (1 and 4 kHz), from which the modulator starting phase Φi of the 1-kHz component was systematically varied. The results support the hypothesis of a linear superposition of the dipoles originating from different frequency specific ASSR generators.

Towards Objective Measures of Functional Hearing Abilities.

AIMS: People with impaired hearing often have difficulties in hearing sounds in a noisy background. This problem is partially a result of the auditory systems reduced capacity to process temporal information in the sound signal. In this study we examined the relationships between perceptual sensitivity to temporal fine structure (TFS) cues, brainstem encoding of complex harmonic and amplitude modulated sounds, and the ability to understand speech in noise. Understanding these links will allow the development of an objective measure that could be used to detect changes in functional hearing before the onset of permanent threshold shifts. METHODS: We measured TFS sensitivity and speech in noise performance (QuickSIN) behaviourally in 34 normally hearing adults with ages ranging from 18 to 63 years. We recorded brainstem responses to complex harmonic sounds and a 4000 Hz carrier signal modulated at 110 Hz. We performed cross correlations between the stimulus waveforms and scalp-recorded brainstem responses to generate a simple measure of stimulus encoding accuracy, and correlated these measures with age, TFS sensitivity and speech-in-noise performance. RESULTS: Speech-in-noise performance was positively correlated with TFS sensitivity, and negatively correlated with age. TFS sensitivity was also positively correlated with stimulus encoding accuracy for the complex harmonic stimulus, while increasing age was associated with lower stimulus encoding accuracy for the modulated tone stimulus. CONCLUSIONS: The results show that even in a group of people with normal hearing, increasing age was associated with reduced speech understanding, reduced TFS sensitivity, and reduced stimulus encoding accuracy (for the modulated tone stimulus). People with good TFS sensitivity also generally had less faithful brainstem encoding of a complex harmonic tone.

Reducing preferred listening levels in headphones through coherent audiotactile stimulation.

Using headphones may expose the listener to potentially harmful levels of sound. This study examines whether introducing tactile vibrations to the listening experience would encourage them to reduce their headphone volume. Fifteen participants adjusted their preferred listening levels for four diverse music tracks under audio-only and audiotactile conditions. Results indicated a significant decrease in preferred audio levels with added tactile stimulation. This effect was particularly significant in songs featuring a strong beat. In contrast, only a minimal effect was observed for genres such as classical music, which typically lack a pronounced beat, at higher vibration intensities. These findings suggest that integrating tactile feedback could be a viable strategy for lowering sound exposure risk.

Cochlear Implantation in Sporadic Intralabyrinthine Schwannomas with Single-Sided Deafness: Implications for Binaural Hearing.

BACKGROUND AND OBJECTIVE: Intralabyrinthine schwannomas (ILSs) may have detrimental effects on ipsilateral hearing, commonly leading to single-sided deafness (SSD). Cochlear implantation in patients with ILSs is an option to partly restore ipsilateral hearing; however, the available literature fails to account for the binaural hearing benefits of a cochlear implant (CI) for ILSs. METHODS: We prospectively evaluated SSD patients with sporadic ILS undergoing cochlear implantation with simultaneous tumor resection (n = 10) or with tumor observation (n = 1). Patients completed the Speech, Spatial and Qualities Questionnaire (SSQ12) and the Nijmegen Cochlear Implant Questionnaire (NCIQ) pre- and postoperatively, as well as the Bern Benefit in Single-Sided Deafness (BBSSD) questionnaire postoperatively. Patients were also tested postoperatively with and without their CI to measure the effect on localization ability and binaural summation, squelch, and head shadow. RESULTS: Evaluation was completed for nine and six patients (subjective and objective data, respectively). The CI significantly improved the speech reception threshold (SRT) in the head shadow condition where the target signal was presented to the CI side and the noise to the front (SCIN0). On the other hand, the SRTs in the colocated condition (S0N0) and the condition where the target signal was presented to the front and the noise to the CI side (S0NCI) were unaffected by the CI. The mean localization error decreased significantly from 102° to 61° (p = 0.0031) with the addition of a CI. The scores from SSQ12 demonstrated nonsignificant changes. For NCIQ, the self-esteem and the social interaction domains increased significantly but insignificantly for the remaining domains. The BBSSD responses ranged from +0.5 to +3.5 points. CONCLUSION: After implantation, patients achieved significantly better scores across some of the patient-reported and objective parameters. In addition to reporting on a number of ILS cases where implantation was performed, the study is the first of its kind to document patient-reported and objective binaural hearing improvement after cochlear implantation in patients with ILS and, thereby, lends support to the active management of ILS.

A cochlear implant user with exceptional musical hearing ability.

UNLABELLED: Although the perception of music is generally poor in cochlear implant users, there are a few excellent performers. OBJECTIVE: The aim of this study was the assessment of different aspects of music perception in one exceptional cochlear implant user. DESIGN: The assessments included pitch direction discrimination, melody and timbre recognition, relative and absolute pitch judgment, and consonance rating of musical notes presented through the sound processor(s). STUDY SAMPLE: An adult cochlear implant user with musical background who lost her hearing postlingually, and five normally-hearing listeners with musical training participated in the study. RESULTS: The CI user discriminated pitch direction for sounds differing by one semitone and recognized melody with nearly 100% accuracy. Her results in timbre recognition were better than average published data for cochlear implant users. Her consonance rating, and relative and absolute pitch perception were comparable to normally-hearing listeners with musical training. CONCLUSION: The results in this study showed that excellent performance is possible on musical perception tasks including pitch perception using present day cochlear implant technologies. Factors that may explain this user's exceptional performance are short duration of deafness, pre- and post-deafness musical training, and perfect pitch abilities before the onset of deafness.

Temporal Cues in the Judgment of Music Emotion for Normal and Cochlear Implant Listeners.

Several studies have established that Cochlear implant (CI) listeners rely on the tempo of music to judge the emotional content of music. However, a re-analysis of a study in which CI listeners judged the emotion conveyed by piano pieces on a scale from happy to sad revealed a weak correlation between tempo and emotion. The present study explored which temporal cues in music influence emotion judgments among normal hearing (NH) listeners, which might provide insights into the cues utilized by CI listeners. Experiment 1 was a replication of the Vannson et al. study with NH listeners using rhythmic patterns of piano created with congas. The temporal cues were preserved while the tonal ones were removed. The results showed (i) tempo was weakly correlated with emotion judgments, (ii) NH listeners' judgments for congas were similar to CI listeners' judgments for piano. In Experiment 2, two tasks were administered with congas played at three different tempi: emotion judgment and a tapping task to record listeners' perceived tempo. Perceived tempo was a better predictor than the tempo, but its physical correlate, mean onset-to-onset difference (MOOD), a measure of the average time between notes, yielded higher correlations with NH listeners' emotion judgments. This result suggests that instead of the tempo, listeners rely on the average time between consecutive notes to judge the emotional content of music. CI listeners could utilize this cue to judge the emotional content of music.

Effect of Vibrotactile Stimulation on Auditory Timbre Perception for Normal-Hearing Listeners and Cochlear-Implant Users.

The study tests the hypothesis that vibrotactile stimulation can affect timbre perception. A multidimensional scaling experiment was conducted. Twenty listeners with normal hearing and nine cochlear implant users were asked to judge the dissimilarity of a set of synthetic sounds that varied in attack time and amplitude modulation depth. The listeners were simultaneously presented with vibrotactile stimuli, which varied also in attack time and amplitude modulation depth. The results showed that alterations to the temporal waveform of the tactile stimuli affected the listeners' dissimilarity judgments of the audio. A three-dimensional analysis revealed evidence of crossmodal processing where the audio and tactile equivalents combined accounted for their dissimilarity judgments. For the normal-hearing listeners, 86% of the first dimension was explained by audio impulsiveness and 14% by tactile impulsiveness; 75% of the second dimension was explained by the audio roughness or fast amplitude modulation, while its tactile counterpart explained 25%. Interestingly, the third dimension revealed a combination of 43% of audio impulsiveness and 57% of tactile amplitude modulation. For the CI listeners, the first dimension was mostly accounted for by the tactile roughness and the second by the audio impulsiveness. This experiment shows that the perception of timbre can be affected by tactile input and could lead to the developing of new audio-tactile devices for people with hearing impairment.

Improved speech intelligibility in the presence of congruent vibrotactile speech input.

Vibrotactile stimulation is believed to enhance auditory speech perception, offering potential benefits for cochlear implant (CI) users who may utilize compensatory sensory strategies. Our study advances previous research by directly comparing tactile speech intelligibility enhancements in normal-hearing (NH) and CI participants, using the same paradigm. Moreover, we assessed tactile enhancement considering stimulus non-specific, excitatory effects through an incongruent audio-tactile control condition that did not contain any speech-relevant information. In addition to this incongruent audio-tactile condition, we presented sentences in an auditory only and a congruent audio-tactile condition, with the congruent tactile stimulus providing low-frequency envelope information via a vibrating probe on the index fingertip. The study involved 23 NH listeners and 14 CI users. In both groups, significant tactile enhancements were observed for congruent tactile stimuli (5.3% for NH and 5.4% for CI participants), but not for incongruent tactile stimulation. These findings replicate previously observed tactile enhancement effects. Juxtaposing our study with previous research, the informational content of the tactile stimulus emerges as a modulator of intelligibility: Generally, congruent stimuli enhanced, non-matching tactile stimuli reduced, and neutral stimuli did not change test outcomes. We conclude that the temporal cues provided by congruent vibrotactile stimuli may aid in parsing continuous speech signals into syllables and words, consequently leading to the observed improvements in intelligibility.

Timbre and speech perception in bimodal and bilateral cochlear-implant listeners.

OBJECTIVES: This study was designed to evaluate the contribution of temporal and spectral cues for timbre perception in listeners with a cochlear implant (CI) in one ear and low-frequency residual hearing in the contralateral ear (bimodal hearing), and listeners with two CIs. Specifically, it examined the relationship between timbre and speech perception in these two groups of listeners. It was hypothesized that, similar to speech recognition, temporal-envelope cues are dominant cues for timbre perception, and the reliance of spectral cues was reduced in both bimodal and bilateral CI users compared with that in normal-hearing listeners. It was further hypothesized that the patterns of results with regard to combined benefit would be similar between timbre and speech perception. DESIGN: Seven bimodal and five bilateral CI users participated. Sixteen stimuli that synthesized western musical instruments were used for the timbre-perception task. Sixteen consonants in the /aCa/ context and nine monophthongs in the /hVd/ context were used for the phoneme-recognition task. Each subject was tested on three listening conditions-individual device alone (single CI, or hearing aid [HA] alone) and combined use of devices (CI + HA, or 2CIs). For the timbre-perception task, each listener made judgments of dissimilarity between stimulus pairs. Multidimensional scaling analysis was performed to derive the coordinates of the dimensions that best fit the data. Correlational analyses were performed to relate the coordinates of each dimension and the temporal-envelope (impulsiveness) and spectral-envelope (spectral-centroid) features of the stimuli. For phoneme-recognition task, each listener identified the phoneme he or she heard by choosing an answer displayed on the computer screen. Overall percent correct phoneme-identification scores and percent information transmission for consonant and vowel features were calculated. RESULTS: There were strong correlations between impulsiveness and the first dimension (Dim 1) of the timbre space, but correlations between spectral centroid and the second dimension (Dim 2) were weak for all listening conditions for both groups of listeners. As a group, the combined use of devices did not significantly improve listeners' ability to perceive differences in musical timbre compared with the better single-device condition. Some of the bimodal and bilateral CI users showed a considerably strengthened correlation between spectral centroid and Dim 2 in the combined condition compared with a single CI or an HA. There was a lack of relationship between percent correct phoneme recognition and timbre perception for all listening conditions. However, there was a consistent pattern regarding the combined benefit between timbre perception and vowel recognition. In general, listeners who demonstrated combined benefit for vowel recognition also showed a considerable increase in correlation between spectral centroid and Dim 2 with the combined use of devices compared with the single-device conditions. Improved correlation was not evident for those who did not demonstrate combined benefit for vowel recognition. CONCLUSIONS: Similar to speech recognition, temporal envelope was a dominant cue for timbre perception in bimodal and bilateral CI users. In addition, there was a close relationship between timbre perception and vowel recognition with regard to combined benefit. The present findings suggest that speech recognition and timbre perception could be enhanced when listeners received different spectral cues from individual devices.

The effects of aging and musicianship on the use of auditory streaming cues.

Auditory stream segregation, or separating sounds into their respective sources and tracking them over time, is a fundamental auditory ability. Previous research has separately explored the impacts of aging and musicianship on the ability to separate and follow auditory streams. The current study evaluated the simultaneous effects of age and musicianship on auditory streaming induced by three physical features: intensity, spectral envelope and temporal envelope. In the first study, older and younger musicians and non-musicians with normal hearing identified deviants in a four-note melody interleaved with distractors that were more or less similar to the melody in terms of intensity, spectral envelope and temporal envelope. In the second study, older and younger musicians and non-musicians participated in a dissimilarity rating paradigm with pairs of melodies that differed along the same three features. Results suggested that auditory streaming skills are maintained in older adults but that older adults rely on intensity more than younger adults while musicianship is associated with increased sensitivity to spectral and temporal envelope, acoustic features that are typically less effective for stream segregation, particularly in older adults.

The Perception of Ramped Pulse Shapes in Cochlear Implant Users.

The electric stimulation provided by current cochlear implants (CI) is not power efficient. One underlying problem is the poor efficiency by which information from electric pulses is transformed into auditory nerve responses. A novel stimulation paradigm using ramped pulse shapes has recently been proposed to remedy this inefficiency. The primary motivation is a better biophysical fit to spiral ganglion neurons with ramped pulses compared to the rectangular pulses used in most contemporary CIs. Here, we tested the hypotheses that ramped pulses provide more efficient stimulation compared to rectangular pulses and that a rising ramp is more efficient than a declining ramp. Rectangular, rising ramped and declining ramped pulse shapes were compared in terms of charge efficiency and discriminability, and threshold variability in seven CI listeners. The tasks included single-channel threshold detection, loudness-balancing, discrimination of pulse shapes, and threshold measurement across the electrode array. Results showed that reduced charge, but increased peak current amplitudes, was required at threshold and most comfortable levels with ramped pulses relative to rectangular pulses. Furthermore, only one subject could reliably discriminate between equally-loud ramped and rectangular pulses, suggesting variations in neural activation patterns between pulse shapes in that participant. No significant difference was found between rising and declining ramped pulses across all tests. In summary, the present findings show some benefits of charge efficiency with ramped pulses relative to rectangular pulses, that the direction of a ramped slope is of less importance, and that most participants could not perceive a difference between pulse shapes.

Ramped pulse shapes are more efficient for cochlear implant stimulation in an animal model.

In all commercial cochlear implant (CI) devices, the electric stimulation is performed with a rectangular pulse that generally has two phases of opposite polarity. To date, developing new stimulation strategies has relied on the efficacy of this shape. Here, we investigate the potential of a novel stimulation paradigm that uses biophysically-inspired electrical ramped pulses. Using electrically-evoked auditory brainstem response (eABR) recordings in mice, we found that less charge, but higher current level amplitude, is needed to evoke responses with ramped shapes that are similar in amplitude to responses obtained with rectangular shapes. The most charge-efficient pulse shape had a rising ramp over both phases, supporting findings from previous in vitro studies. This was also true for longer phase durations. Our study presents the first physiological data on CI-stimulation with ramped pulse shapes. By reducing charge consumption ramped pulses have the potential to produce more battery-efficient CIs and may open new perspectives for designing other efficient neural implants in the future.