Improved tactile speech robustness to background noise with a dual-path recurrent neural network noise-reduction method.

Many people with hearing loss struggle to understand speech in noisy environments, making noise robustness critical for hearing-assistive devices. Recently developed haptic hearing aids, which convert audio to vibration, can improve speech-in-noise performance for cochlear implant (CI) users and assist those unable to access hearing-assistive devices. They are typically body-worn rather than head-mounted, allowing additional space for batteries and microprocessors, and so can deploy more sophisticated noise-reduction techniques. The current study assessed whether a real-time-feasible dual-path recurrent neural network (DPRNN) can improve tactile speech-in-noise performance. Audio was converted to vibration on the wrist using a vocoder method, either with or without noise reduction. Performance was tested for speech in a multi-talker noise (recorded at a party) with a 2.5-dB signal-to-noise ratio. An objective assessment showed the DPRNN improved the scale-invariant signal-to-distortion ratio by 8.6 dB and substantially outperformed traditional noise-reduction (log-MMSE). A behavioural assessment in 16 participants showed the DPRNN improved tactile-only sentence identification in noise by 8.2%. This suggests that advanced techniques like the DPRNN could substantially improve outcomes with haptic hearing aids. Low-cost haptic devices could soon be an important supplement to hearing-assistive devices such as CIs or offer an alternative for people who cannot access CI technology.

Improved tactile speech perception using audio-to-tactile sensory substitution with formant frequency focusing.

Haptic hearing aids, which provide speech information through tactile stimulation, could substantially improve outcomes for both cochlear implant users and for those unable to access cochlear implants. Recent advances in wide-band haptic actuator technology have made new audio-to-tactile conversion strategies viable for wearable devices. One such strategy filters the audio into eight frequency bands, which are evenly distributed across the speech frequency range. The amplitude envelopes from the eight bands modulate the amplitudes of eight low-frequency tones, which are delivered through vibration to a single site on the wrist. This tactile vocoder strategy effectively transfers some phonemic information, but vowels and obstruent consonants are poorly portrayed. In 20 participants with normal touch perception, we tested (1) whether focusing the audio filters of the tactile vocoder more densely around the first and second formant frequencies improved tactile vowel discrimination, and (2) whether focusing filters at mid-to-high frequencies improved obstruent consonant discrimination. The obstruent-focused approach was found to be ineffective. However, the formant-focused approach improved vowel discrimination by 8%, without changing overall consonant discrimination. The formant-focused tactile vocoder strategy, which can readily be implemented in real time on a compact device, could substantially improve speech perception for haptic hearing aid users.

Improving speech perception for hearing-impaired listeners using audio-to-tactile sensory substitution with multiple frequency channels.

Cochlear implants (CIs) have revolutionised treatment of hearing loss, but large populations globally cannot access them either because of disorders that prevent implantation or because they are expensive and require specialist surgery. Recent technology developments mean that haptic aids, which transmit speech through vibration, could offer a viable low-cost, non-invasive alternative. One important development is that compact haptic actuators can now deliver intense stimulation across multiple frequencies. We explored whether these multiple frequency channels can transfer spectral information to improve tactile phoneme discrimination. To convert audio to vibration, the speech amplitude envelope was extracted from one or more audio frequency bands and used to amplitude modulate one or more vibro-tactile tones delivered to a single-site on the wrist. In 26 participants with normal touch sensitivity, tactile-only phoneme discrimination was assessed with one, four, or eight frequency bands. Compared to one frequency band, performance improved by 5.9% with four frequency bands and by 8.4% with eight frequency bands. The multi-band signal-processing approach can be implemented in real-time on a compact device, and the vibro-tactile tones can be reproduced by the latest compact, low-powered actuators. This approach could therefore readily be implemented in a low-cost haptic hearing aid to deliver real-world benefits.

Macrophages in the cochlea; an immunological link between risk factors and progressive hearing loss.

Macrophages are abundant in the cochlea; however, their role in hearing loss is not well understood. Insults to the cochlea, such as noise or insertion of a cochlear implant, cause an inflammatory response, which includes activation of tissue-resident macrophages. Activation is characterized by changes in macrophage morphology, mediator expression, and distribution. Evidence from other organs shows activated macrophages can become primed, whereby subsequent insults cause an elevated inflammatory response. Primed macrophages in brain pathologies respond to circulating inflammatory mediators by disproportionate synthesis of inflammatory mediators. This signaling occurs behind an intact blood-brain barrier, similar to the blood-labyrinth barrier in the cochlea. Local tissue damage can occur as the result of mediator release by activated macrophages. Damage is typically localized; however, if it is to structures with limited ability to repair, such as neurons or hair cells within the cochlea, it is feasible that this contributes to the progressive loss of function seen in hearing loss. We propose that macrophages in the cochlea link risk factors and hearing loss. Injury to the cochlea causes local macrophage activation that typically resolves. However, in susceptible individuals, some macrophages enter a primed state. Once primed, these macrophages can be further activated, as a consequence of circulating inflammatory molecules associated with common co-morbidities. Hypothetically, this would lead to further cochlear damage and loss of hearing. We review the evidence for the role of tissue-resident macrophages in the cochlea and propose that cochlear macrophages contribute to the trajectory of hearing loss and warrant further study.

Electro-Haptic Stimulation: A New Approach for Improving Cochlear-Implant Listening.

Cochlear implants (CIs) have been remarkably successful at restoring speech perception for severely to profoundly deaf individuals. Despite their success, several limitations remain, particularly in CI users' ability to understand speech in noisy environments, locate sound sources, and enjoy music. A new multimodal approach has been proposed that uses haptic stimulation to provide sound information that is poorly transmitted by the implant. This augmenting of the electrical CI signal with haptic stimulation (electro-haptic stimulation; EHS) has been shown to improve speech-in-noise performance and sound localization in CI users. There is also evidence that it could enhance music perception. We review the evidence of EHS enhancement of CI listening and discuss key areas where further research is required. These include understanding the neural basis of EHS enhancement, understanding the effectiveness of EHS across different clinical populations, and the optimization of signal-processing strategies. We also discuss the significant potential for a new generation of haptic neuroprosthetic devices to aid those who cannot access hearing-assistive technology, either because of biomedical or healthcare-access issues. While significant further research and development is required, we conclude that EHS represents a promising new approach that could, in the near future, offer a non-invasive, inexpensive means of substantially improving clinical outcomes for hearing-impaired individuals.

Inflammation at the Tissue-Electrode Interface in a Case of Rapid Deterioration in Hearing Performance Leading to Explant After Cochlear Implantation.

OBJECTIVE: The reasons for soft failure after cochlear implantation require investigation. This study proposes a method to study and characterize the tissue response to the array in a case of soft failure in a person undergoing reimplantation. CASE: The woman in her 50s, with an underlying autoimmune condition, received a cochlear implant using hearing preservation technique after developing profound hearing loss more than 2 kHz with a moderate loss of less than 500 Hz over a 10-year period. The case was identified as a soft failure due to deteriorating performance, discomfort, and migration over the 10 months after implantation. Impedance telemetry, speech perception measures, and audiometric thresholds are described. At explantation there was evidence of fibrosis. INTERVENTIONS: To use histology and immunohistochemistry to determine the cellular response of the tissue associated with the electrode array at time of explantation. MAIN OUTCOME MEASURES: Identification of the cell types, regional variations, and inflammatory marker expression in the fibrotic tissue associated with the array. RESULTS: Neutrophils and eosinophils were identified, along with a variable pattern of collagen deposition. CD68 and CD163-positive macrophages and T cells were variably distributed through the tissue and interleukin-1 beta and vascular endothelial growth factor receptor-2 expression was identified. CONCLUSIONS: The expression profile is evidence of active inflammation in the tissue despite the time since implantation. This study is the first to characterize the tissue response to the array in a person undergoing reimplantation, and who can be followed to determine the individual response to arrays. It establishes that the investigation of explanted devices after soft-failure is feasible.

Exploiting Routine Clinical Measures to Inform Strategies for Better Hearing Performance in Cochlear Implant Users.

Neuroprostheses designed to interface with the nervous system to replace injured or missing senses can significantly improve a patient's quality of life. The challenge remains to provide implants that operate optimally over several decades. Changes in the implant-tissue interface may precede performance problems. Tools to identify and characterize such changes using existing clinical measures would be highly valuable. Modern cochlear implant (CI) systems allow easy and regular measurements of electrode impedance (EI). This measure is routinely performed as a hardware integrity test, but it also allows a level of insight into the immune-mediated response to the implant, which is associated with performance outcomes. This study is a 5-year retrospective investigation of MED-EL CI users at the University of Southampton Auditory Implant Service including 176 adult ears (18-91) and 74 pediatric ears (1-17). The trend in EI in adults showed a decrease at apical electrodes. An increase was seen at the basal electrodes which are closest to the surgery site. The trend in the pediatric cohort was increasing EI over time for nearly all electrode positions, although this group showed greater variability and had a smaller sample size. We applied an outlier-labeling rule to statistically identify individuals that exhibit raised impedance. This highlighted 14 adult ears (8%) and 3 pediatric ears (5%) with impedance levels that deviated from the group distribution. The slow development of EI suggests intra-cochlear fibrosis and/or osteogenesis as the underlying mechanism. The usual clinical intervention for extreme impedance readings is to deactivate the relevant electrode. Our findings highlight some interesting clinical contradictions: some cases with raised (but not extreme) impedance had not prompted an electrode deactivation; and many cases of electrode deactivation had been informed by subjective patient reports. This emphasizes the need for improved objective evidence to inform electrode deactivations in borderline cases, for which our outlier-labeling approach is a promising candidate. A data extraction and analysis protocol that allows ongoing and automated statistical analysis of routinely collected data could benefit both the CI and wider neuroprosthetics communities. Our approach provides new tools to inform practice and to improve the function and longevity of neuroprosthetic devices.

A Music-Related Quality of Life Measure to Guide Music Rehabilitation for Adult Cochlear Implant Users.

PURPOSE: A music-related quality of life (MuRQoL) questionnaire was developed for the evaluation of music rehabilitation for adult cochlear implant (CI) users. The present studies were aimed at refinement and validation. METHOD: Twenty-four experts reviewed the MuRQoL items for face validity. A refined version was completed by 147 adult CI users, and psychometric techniques were used for item selection, assessment of reliability, and definition of the factor structure. The same participants completed the Short Form Health Survey for construct validation. MuRQoL responses from 68 CI users were compared with those of a matched group of adults with normal hearing. RESULTS: Eighteen items measuring music perception and engagement and 18 items measuring their importance were selected; they grouped together into 2 domains. The final questionnaire has high internal consistency and repeatability. Significant differences between CI users and adults with normal hearing and a correlation between music engagement and quality of life support construct validity. Scores of music perception and engagement and importance for the 18 items can be combined to assess the impact of music on the quality of life. CONCLUSION: The MuRQoL questionnaire is a reliable and valid measure of self-reported music perception, engagement, and their importance for adult CI users with potential to guide music aural rehabilitation.

Modelling the effect of round window stiffness on residual hearing after cochlear implantation.

Preservation of residual hearing after cochlear implantation is now considered an important goal of surgery. However, studies indicate an average post-operative hearing loss of around 20 dB at low frequencies. One factor which may contribute to post-operative hearing loss, but which has received little attention in the literature to date, is the increased stiffness of the round window, due to the physical presence of the cochlear implant, and to its subsequent thickening or to bone growth around it. A finite element model was used to estimate that there is approximately a 100-fold increase in the round window stiffness due to a cochlear implant passing through it. A lumped element model was then developed to study the effects of this change in stiffness on the acoustic response of the cochlea. As the round window stiffness increases, the effects of the cochlear and vestibular aqueducts become more important. An increase of round window stiffness by a factor of 10 is predicted to have little effect on residual hearing, but increasing this stiffness by a factor of 100 reduces the acoustic sensitivity of the cochlea by about 20 dB, below 1 kHz, in reasonable agreement with the observed loss in residual hearing after implantation. It is also shown that the effect of this stiffening could be reduced by incorporating a small gas bubble within the cochlear implant.

Perception of the pitch and naturalness of popular music by cochlear implant users.

OBJECTIVES: To assess the perceived pitch and naturalness of popular music by cochlear implant (CI) users. METHODS: Eleven experienced post-lingually deafened adult CI users rated the pitch, naturalness, and clarity of a popular song with 10 frequency allocation settings, including the default. The alternative settings all had logarithmic frequency spacing and frequency shifts of less than one octave compared with the default map. For maps which were perceived as having incorrect pitch, participants adjusted the pitch of the song in real time using a slider, in order to normalize it, and the amount of adjustment was recorded. RESULTS: The default map was rated as having close to correct pitch. Naturalness rating was negatively correlated with basal shift from a baseline logarithmic map, which was the same as the default map for basal electrodes (R(2) = 0.77). Ratings of the clarity of the lyrics were adversely affected by basal shift. The majority of participants were able to rate and adjust pitch appropriately. The frequency shift in the map was highly correlated with participants' adjustments of the pitch slider (R(2) = 0.94), but the adjustments were less than expected for the majority of participants. DISCUSSION: The pitch ratings for the default allocation suggest that participants have acclimatized to their processors' frequency allocations. Adjustment of the pitch of the song was possible for the majority and suggested that all but one participant was experiencing frequency compression. Expansion of the frequency allocation might help to alleviate this. CONCLUSION: Adjustment of the pitch of a popular song could be helpful for tuning CIs.

Optimizing frequency-to-electrode allocation for individual cochlear implant users.

Individual adjustment of frequency-to-electrode assignment in cochlear implants (CIs) may potentially improve speech perception outcomes. Twelve adult CI users were recruited for an experiment, in which frequency maps were adjusted using insertion angles estimated from post-operative x rays; results were analyzed for ten participants with good quality x rays. The allocations were a mapping to the Greenwood function, a compressed map limited to the area containing spiral ganglion (SG) cells, a reduced frequency range map (RFR), and participants' clinical maps. A trial period of at least six weeks was given for the clinical, Greenwood, and SG maps although participants could return to their clinical map if they wished. Performance with the Greenwood map was poor for both sentence and vowel perception and correlated with insertion angle; performance with the SG map was poorer than for the clinical map. The RFR map was significantly better than the clinical map for three participants, for sentence perception, but worse for three others. Those with improved performance had relatively deep insertions and poor electrode discrimination ability for apical electrodes. The results suggest that CI performance could be improved by adjustment of the frequency allocation, based on a measure of insertion angle and/or electrode discrimination ability.

Auditory localization abilities in bilateral cochlear implant recipients.

OBJECTIVE: To quantify binaural advantage for auditory localization in the horizontal plane by bilateral cochlear implant (CI) recipients. Also, to determine whether the use of dual microphones with one implant improves localization. METHODS: Twenty subjects from the UK multicenter trial of bilateral cochlear implantation with Nucleus 24 K/M device were recruited. Sound localization was assessed in an anechoic room with an 11-loudspeaker array under four test conditions: right CI, left CI, binaural CI, and dual microphone. Two runs were undertaken for each of five stimuli (speech, tones, noise, transients, and reverberant speech). Order of conditions was counterbalanced across subjects. RESULTS: Mean localization error with bilateral implants was 24 degrees compared with 67 degrees for monaural implant and dual microphone conditions (chance performance is 65 degrees). Normal controls average 2 to 3 degrees in similar conditions. Binaural performance was significantly better than monaural performance for all subjects, for all stimulus types, and for different sound sources. Only small differences in performance with different stimuli were observed. CONCLUSIONS: Bilateral cochlear implantation with the Nucleus 24 device provides marked improvement in horizontal plane localization abilities compared with unilateral CI use for a range of stimuli having different spectral and temporal characteristics. Benefit was obtained by all subjects, for all stimulus types, and for all sound directions. However, binaural performance was still worse than that obtained by normal hearing listeners and hearing aid users with the same methodology. Monaural localization performance was at chance. There is no benefit for localization with dual microphones.