Subcortical and cortical correlates of pitch discrimination: Evidence for two levels of neuroplasticity in musicians.

Musicians are highly trained to discriminate fine pitch changes but the neural bases of this ability are poorly understood. It is unclear whether such training-dependent differences in pitch processing arise already in the subcortical auditory system or are linked to more central stages. To address this question, we combined psychoacoustic testing with functional MRI to measure cortical and subcortical responses in musicians and non-musicians during a pitch-discrimination task. First, we estimated behavioral pitch-discrimination thresholds for complex tones with harmonic components that were either resolved or unresolved in the auditory system. Musicians outperformed non-musicians, showing lower pitch-discrimination thresholds in both conditions. The same participants underwent task-related functional MRI, while they performed a similar pitch-discrimination task. To account for the between-group differences in pitch-discrimination, task difficulty was adjusted to each individual's pitch-discrimination ability. Relative to non-musicians, musicians showed increased neural responses to complex tones with either resolved or unresolved harmonics especially in right-hemispheric areas, comprising the right superior temporal gyrus, Heschl's gyrus, insular cortex, inferior frontal gyrus, and in the inferior colliculus. Both subcortical and cortical neural responses predicted the individual pitch-discrimination performance. However, functional activity in the inferior colliculus correlated with differences in pitch discrimination across all participants, but not within the musicians group alone. Only neural activity in the right auditory cortex scaled with the fine pitch-discrimination thresholds within the musicians. These findings suggest two levels of neuroplasticity in musicians, whereby training-dependent changes in pitch processing arise at the collicular level and are preserved and further enhanced in the right auditory cortex.

On-site and laboratory evaluations of soundscape quality in recreational urban spaces.

CONTEXT: Regulations for quiet urban areas are typically based on sound level limits alone. However, the nonacoustic context may be crucial for subjective soundscape quality. AIMS: This study aimed at comparing the role of sound level and nonacoustic context for subjective urban soundscape assessment in the presence of the full on-site context, the visual context only, and without context. MATERIALS AND METHODS: Soundscape quality was evaluated for three recreational urban spaces by using four subjective attributes: loudness, acceptance, stressfulness, and comfort. The sound level was measured at each site and simultaneous sound recordings were obtained. Participants answered questionnaires either on site or during laboratory listening tests, in which the sound recordings were presented with or without each site's visual context consisting of two pictures. They rated the four subjective attributes along with their preference toward eight sound sources. RESULTS: The sound level was found to be a good predictor of all subjective parameters in the laboratory, but not on site. Although all attributes were significantly correlated in the laboratory setting, they did not necessarily covary on site. Moreover, the availability of the visual context in the listening experiment had no significant effect on the ratings. The participants were overall more positive toward natural sound sources on site. CONCLUSION: The full immersion in the on-site nonacoustic context may be important when evaluating overall soundscape quality in urban recreational areas. Laboratory evaluations may not fully reflect how subjective loudness, acceptance, stressfulness, and comfort are affected by sound level.

Effect of modulation depth, frequency, and intermittence on wind turbine noise annoyance.

Amplitude modulation (AM) may be an important factor for the perceived annoyance of wind turbine noise (WTN). Two AM types, typically referred to as "normal AM" (NAM) and "other AM" (OAM), characterize WTN AM, OAM corresponding to having intermittent periods with larger AM depth in lower frequency regions than NAM. The extent to which AM depth, frequency, and type affect WTN annoyance remains uncertain. Moreover, the temporal variations of WTN AM have often not been considered. Here, realistic stimuli accounting for such temporal variations were synthesized such that AM depth, frequency, and type, while determined from real on-site recordings, could be varied systematically. Listening tests with both original and synthesized stimuli showed that a reduction in mean AM depth across the spectrum led to a significant decrease in annoyance. When the spectrotemporal characteristics of the original far-field stimuli and the temporal AM variations were taken into account, the effect of AM frequency remained limited and the presence of intermittent OAM periods did not affect annoyance. These findings suggest that, at a given overall level, the AM depth of NAM periods is the most crucial AM parameter for WTN annoyance.

The role of reverberation-related binaural cues in the externalization of speech.

The perception of externalization of speech sounds was investigated with respect to the monaural and binaural cues available at the listeners' ears in a reverberant environment. Individualized binaural room impulse responses (BRIRs) were used to simulate externalized sound sources via headphones. The measured BRIRs were subsequently modified such that the proportion of the response containing binaural vs monaural information was varied. Normal-hearing listeners were presented with speech sounds convolved with such modified BRIRs. Monaural reverberation cues were found to be sufficient for the externalization of a lateral sound source. In contrast, for a frontal source, an increased amount of binaural cues from reflections was required in order to obtain well externalized sound images. It was demonstrated that the interaction between the interaural cues of the direct sound and the reverberation strongly affects the perception of externalization. An analysis of the short-term binaural cues showed that the amount of fluctuations of the binaural cues corresponded well to the externalization ratings obtained in the listening tests. The results further suggested that the precedence effect is involved in the auditory processing of the dynamic binaural cues that are utilized for externalization perception.

Pitch perception beyond the traditional existence region of pitch.

Humans' ability to recognize musical melodies is generally limited to pure-tone frequencies below 4 or 5 kHz. This limit coincides with the highest notes on modern musical instruments and is widely believed to reflect the upper limit of precise stimulus-driven spike timing in the auditory nerve. We tested the upper limits of pitch and melody perception in humans using pure and harmonic complex tones, such as those produced by the human voice and musical instruments, in melody recognition and pitch-matching tasks. We found that robust pitch perception can be elicited by harmonic complex tones with fundamental frequencies below 2 kHz, even when all of the individual harmonics are above 6 kHz--well above the currently accepted existence region of pitch and above the currently accepted limits of neural phase locking. The results suggest that the perception of musical pitch at high frequencies is not constrained by temporal phase locking in the auditory nerve but may instead stem from higher-level constraints shaped by prior exposure to harmonic sounds.

Effects of spontaneous otoacoustic emissions on pure-tone frequency difference limens.

Pure-tone frequency difference limens (FDLs) have been shown to vary in the vicinity of spontaneous otoacoustic emissions (SOAEs). As lower FDLs have been observed near SOAEs when measured ipsi- and contralaterally to the emission ear, it has been proposed that prolonged ongoing stimulation of nerve cells tuned to the SOAE frequency could lead to a central oversensitivity to that frequency, hence a better frequency-discrimination ability. However, it is also known that tones close in frequency to an SOAE can "entrain" the emission to oscillate at their own frequency. This may instead explain the variations in FDL near SOAE frequencies as arising from peripheral interactions between SOAEs and external tones in the cochlea. To test these two hypotheses, SOAE entrainment patterns and FDLs were recorded in seven subjects with an ipsilateral SOAE and no neighboring contralateral SOAE. Ipsilateral FDLs were lowest in the SOAE entrainment region and worsened significantly when beating between the external tone and SOAE occurred. FDLs remained unaffected in the non-emission ear and did not alter with continuous ipsilateral or contralateral presentation of a pure tone aimed at emulating an SOAE. These findings suggest a mechanical rather than neural origin for the variations in FDL near SOAE frequencies.

Influence of impedance phase angle on sound pressures and reverberation times in a rectangular room.

In most room acoustic predictions, phase shift on reflection has been overlooked. This study aims to quantify the effects of the surface impedance phase angle of the boundary surfaces on room acoustic conditions. As a preliminary attempt, a medium-sized rectangular room is simulated by a phased beam tracing model, after verifying it numerically against boundary element simulations. First, the absorption characteristic of the boundary surfaces varies uniformly from 0.2 to 0.8, but with various impedance phase angles. Second, typical non-uniform cases having hard walls and floor, but with an absorptive ceiling are investigated. The zero phase angle, which has commonly been assumed in practice, is regarded as reference and differences in the sound pressure level and early decay time from the reference are quantified. As expected, larger differences in the room acoustic parameters are found for larger impedance phase angles. Additionally, binaural impulse responses are compared in a listening test for the uniform absorption cases, revealing that non-zero impedance phase angle cases can be perceptually different from the reference condition in terms of reverberance perception. For the non-uniform settings, the change in the impedance phase angle of the ceiling does not affect the acoustic conditions significantly.

The effect of interaural-level-difference fluctuations on the externalization of sound.

Real-world sound sources are usually perceived as externalized and thus properly localized in both direction and distance. This is largely due to (1) the acoustic filtering by the head, torso, and pinna, resulting in modifications of the signal spectrum and thereby a frequency-dependent shaping of interaural cues and (2) interaural cues provided by the reverberation inside an enclosed space. This study first investigated the effect of room reverberation on the spectro-temporal behavior of interaural level differences (ILDs) by analyzing dummy-head recordings of speech played at different distances in a standard listening room. Next, the effect of ILD fluctuations on the degree of externalization was investigated in a psychoacoustic experiment performed in the same listening room. Individual binaural impulse responses were used to simulate a distant sound source delivered via headphones. The ILDs were altered using a gammatone filterbank for analysis and resynthesis, where the envelopes of the left and right-ear signals were modified such that the naturally occurring fluctuations of the ILDs were restricted. This manipulation reduced the perceived degree of externalization. This was consistent with the analysis of short-term ILDs at different distances showing that a decreased distance to the sound source also reduced the ILD fluctuations.

Relating binaural pitch perception to the individual listener's auditory profile.

The ability of eight normal-hearing listeners and fourteen listeners with sensorineural hearing loss to detect and identify pitch contours was measured for binaural-pitch stimuli and salience-matched monaurally detectable pitches. In an effort to determine whether impaired binaural pitch perception was linked to a specific deficit, the auditory profiles of the individual listeners were characterized using measures of loudness perception, cognitive ability, binaural processing, temporal fine structure processing, and frequency selectivity, in addition to common audiometric measures. Two of the listeners were found not to perceive binaural pitch at all, despite a clear detection of monaural pitch. While both binaural and monaural pitches were detectable by all other listeners, identification scores were significantly lower for binaural than for monaural pitch. A total absence of binaural pitch sensation coexisted with a loss of a binaural signal-detection advantage in noise, without implying reduced cognitive function. Auditory filter bandwidths did not correlate with the difference in pitch identification scores between binaural and monaural pitches. However, subjects with impaired binaural pitch perception showed deficits in temporal fine structure processing. Whether the observed deficits stemmed from peripheral or central mechanisms could not be resolved here, but the present findings may be useful for hearing loss characterization.

On the possibility of a place code for the low pitch of high-frequency complex tones.

Harmonics are considered unresolved when they interact with neighboring harmonics and cannot be heard out separately. Several studies have suggested that the pitch derived from unresolved harmonics is coded via temporal fine-structure cues emerging from their peripheral interactions. Such conclusions rely on the assumption that the components of complex tones with harmonic ranks down to at least 9 were indeed unresolved. The present study tested this assumption via three different measures: (1) the effects of relative component phase on pitch matches, (2) the effects of dichotic presentation on pitch matches, and (3) listeners' ability to hear out the individual components. No effects of relative component phase or dichotic presentation on pitch matches were found in the tested conditions. Large individual differences were found in listeners' ability to hear out individual components. Overall, the results are consistent with the coding of individual harmonic frequencies, based on the tonotopic activity pattern or phase locking to individual harmonics, rather than with temporal coding of single-channel interactions. However, they are also consistent with more general temporal theories of pitch involving the across-channel summation of information from resolved and/or unresolved harmonics. Simulations of auditory-nerve responses to the stimuli suggest potential benefits to a spatiotemporal mechanism.

Corrigendum: Auditory tests for characterizing hearing deficits in listeners with various hearing abilities: The BEAR test battery.

[This corrects the article DOI: 10.3389/fnins.2021.724007.].

Towards Auditory Profile-Based Hearing-Aid Fittings: BEAR Rationale and Clinical Implementation.

(1) Background: To improve hearing-aid rehabilitation, the Danish 'Better hEAring Rehabilitation' (BEAR) project recently developed methods for individual hearing loss characterization and hearing-aid fitting. Four auditory profiles differing in terms of audiometric hearing loss and supra-threshold hearing abilities were identified. To enable auditory profile-based hearing-aid treatment, a fitting rationale leveraging differences in gain prescription and signal-to-noise (SNR) improvement was developed. This report describes the translation of this rationale to clinical devices supplied by three industrial partners. (2) Methods: Regarding the SNR improvement, advanced feature settings were proposed and verified based on free-field measurements made with an acoustic mannikin fitted with the different hearing aids. Regarding the gain prescription, a clinically feasible fitting tool and procedure based on real-ear gain adjustments were developed. (3) Results: Analyses of the collected real-ear gain and SNR improvement data confirmed the feasibility of the clinical implementation. Differences between the auditory profile-based fitting strategy and a current 'best practice' procedure based on the NAL-NL2 fitting rule were verified and are discussed in terms of limitations and future perspectives. (4) Conclusion: Based on a joint effort from academic and industrial partners, the BEAR fitting rationale was transferred to commercially available hearing aids.

The role of temporal fine structure information for the low pitch of high-frequency complex tones.

The fused low pitch evoked by complex tones containing only unresolved high-frequency components demonstrates the ability of the human auditory system to extract pitch using a temporal mechanism in the absence of spectral cues. However, the temporal features used by such a mechanism have been a matter of debate. For stimuli with components lying exclusively in high-frequency spectral regions, the slowly varying temporal envelope of sounds is often assumed to be the only information contained in auditory temporal representations, and it has remained controversial to what extent the fast amplitude fluctuations, or temporal fine structure (TFS), of the conveyed signal can be processed. Using a pitch matching paradigm, the present study found that the low pitch of inharmonic transposed tones with unresolved components was consistent with the timing between the most prominent TFS maxima in their waveforms, rather than envelope maxima. Moreover, envelope cues did not take over as the absolute frequency or rank of the lowest component was raised and TFS cues thus became less effective. Instead, the low pitch became less salient. This suggests that complex pitch perception does not rely on envelope coding as such, and that TFS representation might persist at higher frequencies than previously thought.

Towards Auditory Profile-Based Hearing-Aid Fitting: Fitting Rationale and Pilot Evaluation.

Background-The clinical characterization of hearing deficits for hearing-aid fitting purposes is typically based on the pure-tone audiogram only. In a previous study, a group of hearing-impaired listeners completed a comprehensive test battery that was designed to tap into different dimensions of hearing abilities. A data-driven analysis of the data yielded four clinically relevant patient sub-populations or "auditory profiles". The purpose of the current study was to propose and pilot-test profile-based hearing-aid settings in order to explore their potential for providing more targeted hearing-aid treatment. Methods-Four candidate hearing-aid settings were developed and evaluated by a subset of the participants tested previously. The evaluation consisted of multi-comparison preference ratings that were carried out in realistic sound scenarios. Results-Listeners belonging to the different auditory profiles showed different patterns of preference for the tested hearing-aid settings that were largely consistent with the expectations. Conclusions-The results of this pilot evaluation support further investigations into stratified, profile-based hearing-aid fitting with wearable hearing aids.

Effects of Hearing Aid Noise Reduction on Early and Late Cortical Representations of Competing Talkers in Noise.

OBJECTIVES: Previous research using non-invasive (magnetoencephalography, MEG) and invasive (electrocorticography, ECoG) neural recordings has demonstrated the progressive and hierarchical representation and processing of complex multi-talker auditory scenes in the auditory cortex. Early responses (<85 ms) in primary-like areas appear to represent the individual talkers with almost equal fidelity and are independent of attention in normal-hearing (NH) listeners. However, late responses (>85 ms) in higher-order non-primary areas selectively represent the attended talker with significantly higher fidelity than unattended talkers in NH and hearing-impaired (HI) listeners. Motivated by these findings, the objective of this study was to investigate the effect of a noise reduction scheme (NR) in a commercial hearing aid (HA) on the representation of complex multi-talker auditory scenes in distinct hierarchical stages of the auditory cortex by using high-density electroencephalography (EEG). DESIGN: We addressed this issue by investigating early (<85 ms) and late (>85 ms) EEG responses recorded in 34 HI subjects fitted with HAs. The HA noise reduction (NR) was either on or off while the participants listened to a complex auditory scene. Participants were instructed to attend to one of two simultaneous talkers in the foreground while multi-talker babble noise played in the background (+3 dB SNR). After each trial, a two-choice question about the content of the attended speech was presented. RESULTS: Using a stimulus reconstruction approach, our results suggest that the attention-related enhancement of neural representations of target and masker talkers located in the foreground, as well as suppression of the background noise in distinct hierarchical stages is significantly affected by the NR scheme. We found that the NR scheme contributed to the enhancement of the foreground and of the entire acoustic scene in the early responses, and that this enhancement was driven by better representation of the target speech. We found that the target talker in HI listeners was selectively represented in late responses. We found that use of the NR scheme resulted in enhanced representations of the target and masker speech in the foreground and a suppressed representation of the noise in the background in late responses. We found a significant effect of EEG time window on the strengths of the cortical representation of the target and masker. CONCLUSION: Together, our analyses of the early and late responses obtained from HI listeners support the existing view of hierarchical processing in the auditory cortex. Our findings demonstrate the benefits of a NR scheme on the representation of complex multi-talker auditory scenes in different areas of the auditory cortex in HI listeners.

Creating Clarity in Noisy Environments by Using Deep Learning in Hearing Aids.

Hearing aids continue to acquire increasingly sophisticated sound-processing features beyond basic amplification. On the one hand, these have the potential to add user benefit and allow for personalization. On the other hand, if such features are to benefit according to their potential, they require clinicians to be acquainted with both the underlying technologies and the specific fitting handles made available by the individual hearing aid manufacturers. Ensuring benefit from hearing aids in typical daily listening environments requires that the hearing aids handle sounds that interfere with communication, generically referred to as "noise." With this aim, considerable efforts from both academia and industry have led to increasingly advanced algorithms that handle noise, typically using the principles of directional processing and postfiltering. This article provides an overview of the techniques used for noise reduction in modern hearing aids. First, classical techniques are covered as they are used in modern hearing aids. The discussion then shifts to how deep learning, a subfield of artificial intelligence, provides a radically different way of solving the noise problem. Finally, the results of several experiments are used to showcase the benefits of recent algorithmic advances in terms of signal-to-noise ratio, speech intelligibility, selective attention, and listening effort.

Auditory Tests for Characterizing Hearing Deficits in Listeners With Various Hearing Abilities: The BEAR Test Battery.

The Better hEAring Rehabilitation (BEAR) project aims to provide a new clinical profiling tool-a test battery-for hearing loss characterization. Although the loss of sensitivity can be efficiently measured using pure-tone audiometry, the assessment of supra-threshold hearing deficits remains a challenge. In contrast to the classical "attenuation-distortion" model, the proposed BEAR approach is based on the hypothesis that the hearing abilities of a given listener can be characterized along two dimensions, reflecting independent types of perceptual deficits (distortions). A data-driven approach provided evidence for the existence of different auditory profiles with different degrees of distortions. Ten tests were included in a test battery, based on their clinical feasibility, time efficiency, and related evidence from the literature. The tests were divided into six categories: audibility, speech perception, binaural processing abilities, loudness perception, spectro-temporal modulation sensitivity, and spectro-temporal resolution. Seventy-five listeners with symmetric, mild-to-severe sensorineural hearing loss were selected from a clinical population. The analysis of the results showed interrelations among outcomes related to high-frequency processing and outcome measures related to low-frequency processing abilities. The results showed the ability of the tests to reveal differences among individuals and their potential use in clinical settings.

Robust Data-Driven Auditory Profiling Towards Precision Audiology.

The sources and consequences of a sensorineural hearing loss are diverse. While several approaches have aimed at disentangling the physiological and perceptual consequences of different etiologies, hearing deficit characterization and rehabilitation have been dominated by the results from pure-tone audiometry. Here, we present a novel approach based on data-driven profiling of perceptual auditory deficits that attempts to represent auditory phenomena that are usually hidden by, or entangled with, audibility loss. We hypothesize that the hearing deficits of a given listener, both at hearing threshold and at suprathreshold sound levels, result from two independent types of "auditory distortions." In this two-dimensional space, four distinct "auditory profiles" can be identified. To test this hypothesis, we gathered a data set consisting of a heterogeneous group of listeners that were evaluated using measures of speech intelligibility, loudness perception, binaural processing abilities, and spectrotemporal resolution. The subsequent analysis revealed that distortion type-I was associated with elevated hearing thresholds at high frequencies and reduced temporal masking release and was significantly correlated with elevated speech reception thresholds in noise. Distortion type-II was associated with low-frequency hearing loss and abnormally steep loudness functions. The auditory profiles represent four robust subpopulations of hearing-impaired listeners that exhibit different degrees of perceptual distortions. The four auditory profiles may provide a valuable basis for improved hearing rehabilitation, for example, through profile-based hearing-aid fitting.

Investigating the Effects of Four Auditory Profiles on Speech Recognition, Overall Quality, and Noise Annoyance With Simulated Hearing-Aid Processing Strategies.

Effective hearing aid (HA) rehabilitation requires personalization of the HA fitting parameters, but in current clinical practice only the gain prescription is typically individualized. To optimize the fitting process, advanced HA settings such as noise reduction and microphone directionality can also be tailored to individual hearing deficits. In two earlier studies, an auditory test battery and a data-driven approach that allow classifying hearing-impaired listeners into four auditory profiles were developed. Because these profiles were found to be characterized by markedly different hearing abilities, it was hypothesized that more tailored HA fittings would lead to better outcomes for such listeners. Here, we explored potential interactions between the four auditory profiles and HA outcome as assessed with three different measures (speech recognition, overall quality, and noise annoyance) and six HA processing strategies with various noise reduction, directionality, and compression settings. Using virtual acoustics, a realistic speech-in-noise environment was simulated. The stimuli were generated using a HA simulator and presented to 49 habitual HA users who had previously been profiled. The four auditory profiles differed clearly in terms of their mean aided speech reception thresholds, thereby implying different needs in terms of signal-to-noise ratio improvement. However, no clear interactions with the tested HA processing strategies were found. Overall, these findings suggest that the auditory profiles can capture some of the individual differences in HA processing needs and that further research is required to identify suitable HA solutions for them.

Effects of Musical Training and Hearing Loss on Fundamental Frequency Discrimination and Temporal Fine Structure Processing: Psychophysics and Modeling.

Several studies have shown that musical training leads to improved fundamental frequency (F0) discrimination for young listeners with normal hearing (NH). It is unclear whether a comparable effect of musical training occurs for listeners whose sensory encoding of F0 is degraded. To address this question, the effect of musical training was investigated for three groups of listeners (young NH, older NH, and older listeners with hearing impairment, HI). In a first experiment, F0 discrimination was investigated using complex tones that differed in harmonic content and phase configuration (sine, positive, or negative Schroeder). Musical training was associated with significantly better F0 discrimination of complex tones containing low-numbered harmonics for all groups of listeners. Part of this effect was caused by the fact that musicians were more robust than non-musicians to harmonic roving. Despite the benefit relative to their non-musicians counterparts, the older musicians, with or without HI, performed worse than the young musicians. In a second experiment, binaural sensitivity to temporal fine structure (TFS) cues was assessed for the same listeners by estimating the highest frequency at which an interaural phase difference was perceived. Performance was better for musicians for all groups of listeners and the use of TFS cues was degraded for the two older groups of listeners. These findings suggest that musical training is associated with an enhancement of both TFS cues encoding and F0 discrimination in young and older listeners with or without HI, although the musicians' benefit decreased with increasing hearing loss. Additionally, models of the auditory periphery and midbrain were used to examine the effect of HI on F0 encoding. The model predictions reflected the worsening in F0 discrimination with increasing HI and accounted for up to 80 % of the variance in the data.