The effect of tone-vocoding on spatial release from masking for old, hearing-impaired listeners.

Old, hearing-impaired listeners generally benefit little from lateral separation of multiple talkers when listening to one of them. This study aimed to determine how spatial release from masking (SRM) in such listeners is affected when the interaural time differences (ITDs) in the temporal fine structure (TFS) are manipulated by tone-vocoding (TVC) at the ears by a master hearing aid system. Word recall was compared, with and without TVC, when target and masker sentences from a closed set were played simultaneously from the front loudspeaker (co-located) and when the maskers were played 45° to the left and right of the listener (separated). For 20 hearing-impaired listeners aged 64 to 86, SRM was 3.7 dB smaller with TVC than without TVC. This difference in SRM correlated with mean audiometric thresholds below 1.5 kHz, even when monaural TFS sensitivity (discrimination of frequency-shifts in identically filtered complexes) was partialed out, suggesting that low-frequency audiometric thresholds may be a good indicator of candidacy for hearing aids that preserve ITDs. The TVC difference in SRM was not correlated with age, pure-tone ITD thresholds, nor fundamental frequency difference limens, and only with monaural TFS sensitivity before control for low-frequency audiometric thresholds.

The role of excitation-pattern cues in the detection of frequency shifts in bandpass-filtered complex tones.

One task intended to measure sensitivity to temporal fine structure (TFS) involves the discrimination of a harmonic complex tone from a tone in which all harmonics are shifted upwards by the same amount in hertz. Both tones are passed through a fixed bandpass filter centered on the high harmonics to reduce the availability of excitation-pattern cues and a background noise is used to mask combination tones. The role of frequency selectivity in this "TFS1" task was investigated by varying level. Experiment 1 showed that listeners performed more poorly at a high level than at a low level. Experiment 2 included intermediate levels and showed that performance deteriorated for levels above about 57 dB sound pressure level. Experiment 3 estimated the magnitude of excitation-pattern cues from the variation in forward masking of a pure tone as a function of frequency shift in the complex tones. There was negligible variation, except for the lowest level used. The results indicate that the changes in excitation level at threshold for the TFS1 task would be too small to be usable. The results are consistent with the TFS1 task being performed using TFS cues, and with frequency selectivity having an indirect effect on performance via its influence on TFS cues.

Deafness in cochlear and auditory nerve disorders.

Sensorineural hearing loss is the most common type of hearing impairment worldwide. It arises as a consequence of damage to the cochlea or auditory nerve, and several structures are often affected simultaneously. There are many causes, including genetic mutations affecting the structures of the inner ear, and environmental insults such as noise, ototoxic substances, and hypoxia. The prevalence increases dramatically with age. Clinical diagnosis is most commonly accomplished by measuring detection thresholds and comparing these to normative values to determine the degree of hearing loss. In addition to causing insensitivity to weak sounds, sensorineural hearing loss has a number of adverse perceptual consequences, including loudness recruitment, poor perception of pitch and auditory space, and difficulty understanding speech, particularly in the presence of background noise. The condition is usually incurable; treatment focuses on restoring the audibility of sounds made inaudible by hearing loss using either hearing aids or cochlear implants.

Phase locked neural activity in the human brainstem predicts preference for musical consonance.

When musical notes are combined to make a chord, the closeness of fit of the combined spectrum to a single harmonic series (the 'harmonicity' of the chord) predicts the perceived consonance (how pleasant and stable the chord sounds; McDermott, Lehr, & Oxenham, 2010). The distinction between consonance and dissonance is central to Western musical form. Harmonicity is represented in the temporal firing patterns of populations of brainstem neurons. The current study investigates the role of brainstem temporal coding of harmonicity in the perception of consonance. Individual preference for consonant over dissonant chords was measured using a rating scale for pairs of simultaneous notes. In order to investigate the effects of cochlear interactions, notes were presented in two ways: both notes to both ears or each note to different ears. The electrophysiological frequency following response (FFR), reflecting sustained neural activity in the brainstem synchronised to the stimulus, was also measured. When both notes were presented to both ears the perceptual distinction between consonant and dissonant chords was stronger than when the notes were presented to different ears. In the condition in which both notes were presented to the both ears additional low-frequency components, corresponding to difference tones resulting from nonlinear cochlear processing, were observable in the FFR effectively enhancing the neural harmonicity of consonant chords but not dissonant chords. Suppressing the cochlear envelope component of the FFR also suppressed the additional frequency components. This suggests that, in the case of consonant chords, difference tones generated by interactions between notes in the cochlea enhance the perception of consonance. Furthermore, individuals with a greater distinction between consonant and dissonant chords in the FFR to individual harmonics had a stronger preference for consonant over dissonant chords. Overall, the results provide compelling evidence for the role of neural temporal coding in the perception of consonance, and suggest that the representation of harmonicity in phase locked neural firing drives the perception of consonance.

The effects of age and hearing loss on interaural phase difference discrimination.

The discrimination of interaural phase differences (IPDs) requires accurate binaural temporal processing and has been used as a measure of sensitivity to temporal envelope and temporal fine structure (TFS). Previous studies found that TFS-IPD discrimination declined with age and with sensorineural hearing loss (SNHL), but age and SNHL have often been confounded. The aim of this study was to determine the independent contributions of age and SNHL to TFS and envelope IPD discrimination by using a sample of adults with a wide range of ages and SNHL. A two-interval, two-alternative forced-choice procedure was used to measure IPD discrimination thresholds for 20-Hz amplitude-modulated tones with carrier frequencies of 250 or 500 Hz when the IPD was in either the stimulus envelope or TFS. There were positive correlations between absolute thresholds and TFS-IPD thresholds, but not envelope-IPD thresholds, when age was accounted for. This supports the idea that SNHL affects TFS processing independently to age. Age was positively correlated with envelope-IPD thresholds at both carrier frequencies and TFS-IPD thresholds at 500 Hz, when absolute thresholds were accounted for. These results suggest that age negatively affects the binaural processing of envelope and TFS at some frequencies independently of SNHL.

Differences in short-term training for interaural phase difference discrimination between two different forced-choice paradigms.

Improvement in interaural phase difference (IPD) discrimination over 2 to 3 h was compared for two two-alternative forced-choice paradigms: A three-interval paradigm, in which the IPD was in interval two or three, and a paradigm with two intervals of four stimuli in which the IPD was in the second and fourth stimuli of one interval (AAAA vs ABAB). The difference in performance between the beginning and end of the testing period was smaller for the two-interval paradigm, supporting the use of this paradigm for fast measurement of discrimination thresholds without the need for a long period of training.

The effect of compression speed on intelligibility: simulated hearing-aid processing with and without original temporal fine structure information.

Hearing aids use amplitude compression to compensate for the effects of loudness recruitment. The compression speed that gives the best speech intelligibility varies among individuals. Moore [(2008). Trends Amplif. 12, 300-315] suggested that an individual's sensitivity to temporal fine structure (TFS) information may affect which compression speed gives most benefit. This hypothesis was tested using normal-hearing listeners with a simulated hearing loss. Sentences in a competing talker background were processed using multi-channel fast or slow compression followed by a simulation of threshold elevation and loudness recruitment. Signals were either tone vocoded with 1-ERB(N)-wide channels (where ERB(N) is the bandwidth of normal auditory filters) to remove the original TFS information, or not processed further. In a second experiment, signals were vocoded with either 1 - or 2-ERB(N)-wide channels, to test whether the available spectral detail affects the optimal compression speed. Intelligibility was significantly better for fast than slow compression regardless of vocoder channel bandwidth. The results suggest that the availability of original TFS or detailed spectral information does not affect the optimal compression speed. This conclusion is tentative, since while the vocoder processing removed the original TFS information, listeners may have used the altered TFS in the vocoded signals.

Effect of speech material on the benefit of temporal fine structure information in speech for young normal-hearing and older hearing-impaired participants.

OBJECTIVE: The purpose of this study was to investigate the influence of the type of speech material on the benefit obtained from temporal fine structure (TFS) information in speech for young normal-hearing (YNH) and older hearing-impaired (OHI) participants. DESIGN: The design was based on the work of . They measured the speech reception thresholds for a target talker in a background talker as a function of the frequency range over which TFS information was available. The signal was split into 32 channels, each with a bandwidth equal to the equivalent rectangular bandwidth of the "normal" auditory filter at the same center frequency. Above a cutoff (CO) channel, channels were vocoded and contained only temporal envelope information. Channels up to and including CO were not processed. Hopkins et al. found that, as CO was increased, speech reception thresholds decreased more for normal-hearing participants than for participants with cochlear hearing loss, suggesting that the latter were less able to use TFS information. We used the same design, but compared results when the target speech materials were open-set sentences, as used by Hopkins et al., and when they were more predictable sentences with a closed word set (Danish Dantale 2). RESULTS: With the open-set material, YNH listeners benefited more from TFS information than OHI listeners, replicating . For the YNH participants, the benefit of adding TFS was greater for the open-set material than for the closed-set material, while no difference in TFS benefit across speech materials was found for the OHI participants. CONCLUSIONS: The choice of speech material is important when assessing the benefit of TFS. Several factors may facilitate recognition in the absence of TFS cues, including small set size, predictable temporal structure of the target speech, and contextual effects. We speculate that TFS information is useful for reducing informational masking, by providing cues for the perceptual segregation of the target and background. When the target speech is highly predictable, informational masking may be minimal, rendering TFS cues unnecessary.

The effects of age and cochlear hearing loss on temporal fine structure sensitivity, frequency selectivity, and speech reception in noise.

Temporal fine structure (TFS) sensitivity, frequency selectivity, and speech reception in noise were measured for young normal-hearing (NHY), old normal-hearing (NHO), and hearing-impaired (HI) subjects. Two measures of TFS sensitivity were used: the "TFS-LF test" (interaural phase difference discrimination) and the "TFS2 test" (discrimination of harmonic and frequency-shifted tones). These measures were not significantly correlated with frequency selectivity (after partialing out the effect of audiometric threshold), suggesting that insensitivity to TFS cannot be wholly explained by a broadening of auditory filters. The results of the two tests of TFS sensitivity were significantly but modestly correlated, suggesting that performance of the tests may be partly influenced by different factors. The NHO group performed significantly more poorly than the NHY group for both measures of TFS sensitivity, but not frequency selectivity, suggesting that TFS sensitivity declines with age in the absence of elevated audiometric thresholds or broadened auditory filters. When the effect of mean audiometric threshold was partialed out, speech reception thresholds in modulated noise were correlated with TFS2 scores, but not measures of frequency selectivity or TFS-LF test scores, suggesting that a reduction in sensitivity to TFS can partly account for the speech perception difficulties experienced by hearing-impaired subjects.

The effects of the addition of low-level, low-noise noise on the intelligibility of sentences processed to remove temporal envelope information.

The intelligibility of sentences processed to remove temporal envelope information, as far as possible, was assessed. Sentences were filtered into N analysis channels, and each channel signal was divided by its Hilbert envelope to remove envelope information but leave temporal fine structure (TFS) intact. Channel signals were combined to give TFS speech. The effect of adding low-level low-noise noise (LNN) to each channel signal before processing was assessed. The addition of LNN reduced the amplification of low-level signal portions that contained large excursions in instantaneous frequency, and improved the intelligibility of simple TFS speech sentences, but not more complex sentences. It also reduced the time needed to reach a stable level of performance. The recovery of envelope cues by peripheral auditory filtering was investigated by measuring the intelligibility of 'recovered-envelope speech', formed by filtering TFS speech with an array of simulated auditory filters, and using the envelopes at the output of these filters to modulate sinusoids with frequencies equal to the filter center frequencies (i.e., tone vocoding). The intelligibility of TFS speech and recovered-envelope speech fell as N increased, although TFS speech was still highly intelligible for values of N for which the intelligibility of recovered-envelope speech was low.

Development of a fast method for measuring sensitivity to temporal fine structure information at low frequencies.

Recent work suggests that hearing-impaired subjects are relatively insensitive to temporal fine structure (TFS) information, but that sensitivity among subjects varies considerably. Moore and Sek (2009) developed a fast and easy to administer test of sensitivity to TFS, but it can only be used at medium to high frequencies. Here we describe a binaural method that can be used at lower frequencies. An adaptive two-alternative forced-choice task was used. Each interval contained four tones with frequency f; in one interval all tones were diotic, and in the other tones one and three were diotic while tones two and four had an interaural phase shift, Δϕ. The task was to identify the interval with the phase-shifted tones. For normal-hearing subjects, the effects of sensation level and training on performance were small, and the test could be performed reliably for f = 250, 500, and 750 Hz.

The importance of temporal fine structure information in speech at different spectral regions for normal-hearing and hearing-impaired subjects.

Speech reception thresholds (SRTs) were measured for target and competing-speech signals, processed to contain variable amounts of temporal fine structure (TFS) information. Signals were filtered into 30 1-ERB(N) wide channels (where ERB(N) refers to the bandwidth of normal auditory filters), which were either tone vocoded, preserving temporal envelope information (extracted using the Hilbert transform), or left unprocessed, containing both TFS and envelope information. Improvements in SRT were compared when TFS was progressively introduced, starting with the high- or low-frequency channels. The results suggest some redundancy in the TFS information across frequency regions. In a second experiment, the signal was divided into five, 6-ERB(N)-wide spectral regions, four of which were tone vocoded. The remaining region was either absent (creating a spectral notch) or was present and unprocessed. SRTs were measured for normal-hearing and hearing-impaired subjects. Conditions where all channels were vocoded or unprocessed were also included. Normal-hearing subjects benefited similarly when TFS information was added to each region, suggesting that TFS information is important over a wide frequency range. Hearing-impaired subjects benefited less, although the benefit varied across subjects. Benefit from TFS information in speech was correlated with a psychophysical measure of TFS sensitivity obtained at two center frequencies.

Discrimination of complex tones with unresolved components using temporal fine structure information.

The information used to discriminate complex tones with (largely) unresolved components was assessed. In experiment 1, subjects discriminated a harmonic complex tone, H, with fundamental frequency F0, from an inharmonic tone, I, in which all components were shifted upwards by the same amount in hertz. Tones H and I had the same envelope repetition rate but different temporal fine structure (TFS). The tones were passed through a fixed bandpass filter centered on harmonic N, to reduce excitation pattern cues. For all F0s (35-400 Hz), performance decreased as N was increased from 11 to 15, but, except for F0=35 Hz, remained above chance for N=15, where all harmonics should be unresolved. This suggests that discrimination can be based on TFS rather than on partially resolved components. In experiment 2, subjects discriminated the F0 of complex tones filtered as in experiment 1. Here, both envelope rate and TFS cues were available. Except for F0=35 Hz, discrimination thresholds, expressed as the Weber fraction for a change in time interval, were similar to those measured in experiment 1, suggesting that performance in experiment 2 was dominated by the use of TFS rather than envelope cues.

Effects of moderate cochlear hearing loss on the ability to benefit from temporal fine structure information in speech.

Speech reception thresholds (SRTs) were measured with a competing talker background for signals processed to contain variable amounts of temporal fine structure (TFS) information, using nine normal-hearing and nine hearing-impaired subjects. Signals (speech and background talker) were bandpass filtered into channels. Channel signals for channel numbers above a "cut-off channel" (CO) were vocoded to remove TFS information, while channel signals for channel numbers of CO and below were left unprocessed. Signals from all channels were combined. As a group, hearing-impaired subjects benefited less than normal-hearing subjects from the additional TFS information that was available as CO increased. The amount of benefit varied between hearing-impaired individuals, with some showing no improvement in SRT and one showing an improvement similar to that for normal-hearing subjects. The reduced ability to take advantage of TFS information in speech may partially explain why subjects with cochlear hearing loss get less benefit from listening in a fluctuating background than normal-hearing subjects. TFS information may be important in identifying the temporal "dips" in such a background.

Moderate cochlear hearing loss leads to a reduced ability to use temporal fine structure information.

The ability of normally hearing and hearing-impaired subjects to use temporal fine structure information in complex tones was measured. Subjects were required to discriminate a harmonic complex tone from a tone in which all components were shifted upwards by the same amount in Hz, in a three-alternative, forced-choice task. The tones either contained five equal-amplitude components (non-shaped stimuli) or contained many components, but were passed through a fixed bandpass filter to reduce excitation pattern changes (shaped stimuli). Components were centered at nominal harmonic numbers (N) 7, 11, and 18. For the shaped stimuli, hearing-impaired subjects performed much more poorly than normally hearing subjects, with most of the former scoring no better than chance when N=11 or 18, suggesting that they could not access the temporal fine structure information. Performance for the hearing-impaired subjects was significantly improved for the non-shaped stimuli, presumably because they could benefit from spectral cues. It is proposed that normal-hearing subjects can use temporal fine structure information provided the spacing between fine structure peaks is not too small relative to the envelope period, but subjects with moderate cochlear hearing loss make little use of temporal fine structure information for unresolved components.