SoftVoice Improves Speech Recognition and Reduces Listening Effort in Cochlear Implant Users.

OBJECTIVES: The ability to perceive soft speech by cochlear implant (CI) users is restricted in part by the inherent system noise produced by the speech processor, and in particular by the microphone(s). The algorithm "SoftVoice" (SV) was developed by Advanced Bionics to enhance the perception of soft speech by reducing the system noise in speech processors. The aim of this study was to examine the effects of SV on speech recognition and listening effort. DESIGN: Seventeen adult Advanced Bionics CI recipients were recruited and tested in two sessions. The effect of SV on speech recognition was tested by determining the SRT in quiet using the Matrix test. Based on the individual subjects' SRTs, we investigated speech-recognition scores at fixed speech levels, namely SRT -5 dB, SRT +0 dB, SRT +5 dB, and SRT +10 dB, again in quiet and using the Matrix test. Listening effort was measured at each of these speech levels subjectively by using a rating scale, and objectively by determining pupil dilation with pupillometry. To verify whether SoftVoice had any negative effects on speech perception in noise, we determined the SRT in steady state, speech-weighted noise of 60 dBA. RESULTS: Our results revealed a significant improvement of 2.0 dB on the SRT in quiet with SoftVoice. The average SRT in quiet without SoftVoice was 38 dBA. SoftVoice did not affect the SRT in steady state, speech-weighted noise of 60 dB. At an average speech level of 33 dBA (SRT -5 dB) and 38 dBA (SRT +0 dB) in quiet, significant improvements of 17% and 9% on speech-recognition scores were found with SoftVoice, respectively. At higher speech levels, SoftVoice did not significantly affect speech recognition. Pupillometry did not show significant effects of SoftVoice at any speech level. However, subjective ratings of listening effort indicated a decrease of listening effort with SoftVoice at a speech level of 33 dBA. CONCLUSIONS: We conclude that SoftVoice substantially improves recognition of soft speech and lowers subjective listening effort at low speech levels in quiet. However, no significant effect of SoftVoice was found on pupil dilation. As SRTs in noise were not statistically significantly affected by SoftVoice, we conclude that SoftVoice can be used in noisy listening conditions with little negative impact on speech recognition, if any. The increased power demands of the algorithm are considered to be negligible. It is expected that SoftVoice will reduce power consumption at low ambient sound levels. These results support the use of SoftVoice as a standard feature of Advanced Bionics CI fittings for everyday use.

Perceptual and Model-Based Evaluation of Ideal Time-Frequency Noise Reduction in Hearing-Impaired Listeners.

State-of-the-art hearing aids (HAs) try to overcome the deficit of poor speech intelligibility (SI) in noisy listening environments using digital noise reduction (NR) techniques. The application of time-frequency masks to the noisy sound input is a common NR technique to increase SI. The binary mask with its binary weights and the Wiener filter with continuous weights are representatives of a hard- and a soft-decision approach for time-frequency masking. In normal-hearing listeners, the ideal Wiener filter (IWF) outperforms the ideal binary mask (IBM) in terms of SI and speech quality with perfect SI even at very low signal-to-noise ratios. In this paper, both approaches were investigated for hearing-impaired (HI) listeners. Perceptual and auditory model-based measures were used for the evaluation. The IWF outperformed the IBM in terms of SI. Quality-wise, there was no overall difference between the NR algorithms perceived. Additionally, the processed signals were evaluated based on an auditory nerve model using the neurogram similarity metric (NSIM). The mean NSIM values were significantly different for intelligible and unintelligible sentences. The results suggest that a soft-mask seems to be promising for application in HAs.

Speech onset enhancement improves intelligibility in adverse listening conditions for cochlear implant users.

Speech perception by cochlear implant (CI) users can be very good in quiet but their speech intelligibility (SI) performance decreases in noisy environments. Because recent studies have shown that transient parts of the speech envelope are most important for SI in normal-hearing (NH) listeners, the enhanced envelope (EE) strategy was developed to emphasize onset cues of the speech envelope in the CI signal processing chain. The influence of enhancement of the onsets of the speech envelope on SI was investigated with CI users for speech in stationary speech-shaped noise (SSN) and with an interfering talker. All CI users showed an immediate benefit when a priori knowledge was used for the onset enhancement. A SI improvement was obtained at signal-to-noise ratios (SNRs) below 6 dB, corresponding to a speech reception threshold (SRT) improvement of 2.1 dB. Furthermore, stop consonant reception was improved with the EE strategy in quiet and in SSN at 6 dB SNR. For speech in speech, the SRT improvements were 2.1 dB and 1 dB when the onsets of the target speaker with a priori knowledge of the signal components or of the mixture of the target and the interfering speaker were enhanced, respectively. The latter demonstrates that a small benefit can be obtained without a priori knowledge.

Comparison of Psychophysical and Physical Measurements of Real Ear to Coupler Differences.

OBJECTIVES: The purpose of the study is to compare real ear to coupler difference (RECD) curves based on physical and psychophysical measures. For the physically measured RECD, the RECD was measured with real ear and coupler measurements for the ear simulator and HA1- and HA2 2-cc couplers. The psychophysically measured RECDs were derived from audiogram measures. DESIGN: RECDs were measured in 19 normally hearing subjects. The coupler measurement was done with the probe microphone and the coupler microphone itself. Psychophysically measured RECDs were derived for all subjects by measuring the audiogram in sound field and with an ER-3A insert phone. RESULTS: Reference data were obtained for the three coupler types. It was possible to derive the RECD curve with psychophysical methods. There was no overall statistical difference between the physically and psychophysically measured RECD curves for the HA2 2-cc coupler and the ear simulator. The standard deviation was, however, much higher for the psychophysically derived RECD, indicating that physically measured RECDs are more precise than psychophysically derived RECDs. CONCLUSIONS: For the physical RECD measurements, the coupler microphone should be used for the coupler measurement. Physically measured RECDs were validated on group level by the reliable derivation of the RECD curve from audiogram measures.

Ideal time-frequency masking algorithms lead to different speech intelligibility and quality in normal-hearing and cochlear implant listeners.

Hearing impaired listeners using cochlear implants (CIs) suffer from a decrease in speech intelligibility (SI) in adverse listening conditions. Time-frequency masks are often applied to perform noise suppression in an attempt to increase SI. Two important masks are the so-called ideal binary mask (IBM) with its binary weights and the ideal Wiener filter (IWF) with its continuous weights. It is unclear which of the masks has the highest potential for SI and speech quality enhancement in CI users. In this study, both approaches for SI and quality enhancement were compared. The investigations were conducted in normal-hearing (NH) subjects listening to noise vocoder CI simulations and in CI users. The potential for SI improvement was assessed in a sentence recognition task with ideal mask estimates in multitalker babble and with an interfering talker. The robustness of the approaches was evaluated with simulated estimation errors. CI users assessed the speech quality in a preference rating. The IWF outperformed the IBM in NH listeners. In contrast, no significant difference was obtained in CI users. Estimation errors degraded SI in CI users for both approaches. In terms of quality, the IWF outperformed, slightly, the IBM processed signals. The outcomes of this study suggest that the mask pattern is not that crucial for CIs. Results of speech enhancement algorithms obtained with NH subjects listening to vocoded or normally processed stimuli do not translate to CI users. This outcome means that the effect of new strategies has to be quantified with the user group considered.

Development and validation of the Leuven intelligibility sentence test with male speaker (LIST-m).

OBJECTIVE: In addition to the LIST with a female speaker ( van Wieringen & Wouters, 2008 ), a new speech perception test with a male voice was developed and validated, for evaluating the intelligibility performance of cochlear implant (CI) users or severely hearing-impaired persons. DESIGN: Three experimental steps were carried out: (1) a perceptual optimization of the recorded materials, (2) an evaluation in normal-hearing (NH) listeners, and (3) a validation in CI-users. Measurements were performed both in quiet and in noise. STUDY SAMPLE: Forty-four NH subjects and six CI-users participated. RESULTS: After selecting the sentences with a similar intelligibility, the reference psychometric curve for NH listeners was determined, showing steep slopes for measurements in quiet (12.3%/dB) and in noise (18.7%/dB), similar to the LIST with female voice. The 38 lists of 10 sentences yielded equal scores, and the within-subject test-retest reliability was high (1.7 dB in quiet, 1.1 dB in noise). For the CI-users, parallel psychometric curves were found between the LIST with male and female voice. CONCLUSIONS: The LIST-m is a reliable and valid speech intelligibility test that can be used for CI-users, both in quiet and in noise.

The potential of onset enhancement for increased speech intelligibility in auditory prostheses.

Recent studies have shown that transient parts of a speech signal contribute most to speech intelligibility in normal-hearing listeners. In this study, the influence of enhancing the onsets of the envelope of the speech signal on speech intelligibility in noisy conditions using an eight channel cochlear implant vocoder simulation was investigated. The enhanced envelope (EE) strategy emphasizes the onsets of the speech envelope by deriving an additional peak signal at the onsets in each frequency band. A sentence recognition task in stationary speech shaped noise showed a significant speech reception threshold (SRT) improvement of 2.5 dB for the EE in comparison to the reference continuous interleaved sampling strategy and of 1.7 dB when an ideal Wiener filter was used for the onset extraction on the noisy signal. In a competitive talker condition, a significant SRT improvement of 2.6 dB was measured. A benefit was obtained in all experiments with the peak signal derived from the clean speech. Although the EE strategy is not effective in many real-life situations, the results suggest that there is potential for speech intelligibility improvement when an enhancement of the onsets of the speech envelope is included in the signal processing of auditory prostheses.