Effects of sound segregation cues on multi-sound intensity discrimination.

The effects of sound segregation cues on the sensitivity to intensity increments were explored. Listeners indicated whether the second and fourth sounds (harmonic complexes) within a five-sound sequence were increased in intensity. The target sound had a fundamental frequency of 250 Hz. In different conditions, nontarget sounds had different fundamental frequencies, different spectral shapes, and unique frequency regions relative to the target. For targets more intense than nontargets, nontarget characteristics did not affect thresholds. For targets less intense than the nontargets, thresholds improved when the targets and nontargets had unique frequency regions.

Cross-frequency weights in normal and impaired hearing: Stimulus factors, stimulus dimensions, and associations with speech recognition.

Previous studies of level discrimination reported that listeners with high-frequency sensorineural hearing loss (SNHL) place greater weight on high frequencies than normal-hearing (NH) listeners. It is not clear whether these results are influenced by stimulus factors (e.g., group differences in presentation levels, cross-frequency discriminability of level differences used to measure weights) and whether such weights generalize to other tasks. Here, NH and SNHL weights were measured for level, duration, and frequency discrimination of two-tone complexes after measuring discriminability just-noticeable differences for each frequency and stimulus dimension. Stimuli were presented at equal sensation level (SL) or equal sound pressure level (SPL). Results showed that weights could change depending on which frequency contained the more discriminable level difference with uncontrolled cross-frequency discriminability. When cross-frequency discriminability was controlled, weights were consistent for level and duration discrimination, but not for frequency discrimination. Comparing equal SL and equal SPL weights indicated greater weight on the higher-level tone for level and duration discrimination. Weights were unrelated to improvements in recognition of low-pass-filtered speech with increasing cutoff frequency. These results suggest that cross-frequency weights and NH and SNHL weighting differences are influenced by stimulus factors and may not generalize to the use of speech cues in specific frequency regions.

Speech-Driven Spectrotemporal Receptive Fields Beyond the Auditory Cortex.

We recently developed a method to estimate speech-driven spectrotemporal receptive fields (STRFs) using fMRI. The method uses spectrotemporal modulation filtering, a form of acoustic distortion that renders speech sometimes intelligible and sometimes unintelligible. Using this method, we found significant STRF responses only in classic auditory regions throughout the superior temporal lobes. However, our analysis was not optimized to detect small clusters of STRFs as might be expected in non-auditory regions. Here, we re-analyze our data using a more sensitive multivariate statistical test for cross-subject alignment of STRFs, and we identify STRF responses in non-auditory regions including the left dorsal premotor cortex (dPM), left inferior frontal gyrus (IFG), and bilateral calcarine sulcus (calcS). All three regions responded more to intelligible than unintelligible speech, but left dPM and calcS responded significantly to vocal pitch and demonstrated strong functional connectivity with early auditory regions. Left dPM's STRF generated the best predictions of activation on trials rated as unintelligible by listeners, a hallmark auditory profile. IFG, on the other hand, responded almost exclusively to intelligible speech and was functionally connected with classic speech-language regions in the superior temporal sulcus and middle temporal gyrus. IFG's STRF was also (weakly) able to predict activation on unintelligible trials, suggesting the presence of a partial 'acoustic trace' in the region. We conclude that left dPM is part of the human dorsal laryngeal motor cortex, a region previously shown to be capable of operating in an 'auditory mode' to encode vocal pitch. Further, given previous observations that IFG is involved in syntactic working memory and/or processing of linear order, we conclude that IFG is part of a higher-order speech circuit that exerts a top-down influence on processing of speech acoustics. Finally, because calcS is modulated by emotion, we speculate that changes in the quality of vocal pitch may have contributed to its response.

Sub-optimal construction of an auditory profile from temporally distributed spectral information.

When spectral components of a complex sound are presented not simultaneously but distributed over time, human listeners can still, to a degree, perceptually recover the spectral profile of the sound. This capability of integrating spectral information over time was investigated using a cued informational masking paradigm. Listeners detected a 1-kHz pure tone in a simultaneous masker composed of six random-frequency tones drawn on every trial. The spectral profile of the masker was cued using a precursor sound that consisted of a sequence of 50-ms bursts, separated by inter-burst intervals of 100 ms. Each burst in the precursor consisted of pure tones at the masker frequencies with tones appearing at each of the masker frequencies at different presentation probabilities. As the presentation probability increased in different conditions, the detectability of the target improved, indicating reliable precursor cuing regarding the spectral content of the masker. For many listeners, performance did not significantly improve as the number of precursor bursts increased from 2 to 16, indicating inefficient integration of information beyond 2 bursts. Additional analyses suggest that when intensity of the bursts is relatively constant, the contribution of the precursor is dominated by information in the initial burst.

Neural fluctuation cues for simultaneous notched-noise masking and profile-analysis tasks: Insights from model midbrain responses.

Results of simultaneous notched-noise masking are commonly interpreted as reflecting the bandwidth of underlying auditory filters. This interpretation assumes that listeners detect a tone added to notched-noise based on an increase in energy at the output of an auditory filter. Previous work challenged this assumption by showing that randomly and independently varying (roving) the levels of each stimulus interval does not substantially worsen listener thresholds [Lentz, Richards, and Matiasek (1999). J. Acoust. Soc. Am. 106, 2779-2792]. Lentz et al. further challenged this assumption by showing that filter bandwidths based on notched-noise results were different from those based on a profile-analysis task [Green (1983). Am. Psychol. 38, 133-142; (1988). (Oxford University Press, New York)], although these estimates were later reconciled by emphasizing spectral peaks of the profile-analysis stimulus [Lentz (2006). J. Acoust. Soc. Am. 120, 945-956]. Here, a single physiological model is shown to account for performance in fixed- and roving-level notched-noise tasks and the Lentz et al. profile-analysis task. This model depends on peripheral neural fluctuation cues that are transformed into the average rates of model inferior colliculus neurons. Neural fluctuations are influenced by peripheral filters, synaptic adaptation, cochlear amplification, and saturation of inner hair cells, an element not included in previous theories of envelope-based cues for these tasks. Results suggest reevaluation of the interpretation of performance in these paradigms.

Potential cues for the "level discrimination" of a noise band in the presence of flanking bands.

To evaluate the ability of a restricted range of auditory-nerve fibers to encode a large perceptual dynamic range, Viemeister [(1983). Science 221, 1206-1208] examined the detection of a change in the level of a high-frequency band of noise flanked by more intense fixed-level noise maskers. Here, stimuli and procedures similar to Viemeister's were used, but random manipulations of level and notch cutoff frequency were included to evaluate predictions of energy-based models. The results indicate that cues other than the change in level per se are available, and suggest the potential contribution of changes in pitch/timbre for this task.

Toward Routine Assessments of Auditory Filter Shape.

Purpose A Bayesian adaptive procedure, that is, the quick auditory filter (qAF) procedure, has been shown to improve the efficiency for estimating auditory filter shapes of listeners with normal hearing. The current study evaluates the accuracy and test-retest reliability of the qAF procedure for naïve listeners with a variety of ages and hearing status. Method Fifty listeners who were naïve to psychophysical experiments and exhibit wide ranges of age (19-70 years) and hearing threshold (-5 to 70 dB HL at 2 kHz) were recruited. Their auditory filter shapes were estimated for a 15-dB SL target tone at 2 kHz using both the qAF procedure and the traditional threshold-based procedure. The auditory filter model was defined using 3 parameters: (a) the sharpness of the tip portion of the auditory filter, p; (b) the prominence of the low-frequency tail of the filter, 10log( w); and (c) the listener's efficiency in detection, 10log( K). Results The estimated parameters of the auditory filter model were consistent between 2 qAF runs tested on 2 separate days. The parameter estimates from the 2 qAF runs also agreed well with those estimated using the traditional procedure despite being substantially faster. Across the 3 auditory filter estimates, the dependence of the auditory filter parameters on listener age and hearing threshold was consistent across procedures, as well as consistent with previously published estimates. Conclusions The qAF procedure demonstrates satisfactory test-retest reliability and good agreement to the traditional procedure for listeners with a wide range of ages and with hearing status ranging from normal hearing to moderate hearing impairment.

Identification of the Spectrotemporal Modulations That Support Speech Intelligibility in Hearing-Impaired and Normal-Hearing Listeners.

Purpose Age-related sensorineural hearing loss can dramatically affect speech recognition performance due to reduced audibility and suprathreshold distortion of spectrotemporal information. Normal aging produces changes within the central auditory system that impose further distortions. The goal of this study was to characterize the effects of aging and hearing loss on perceptual representations of speech. Method We asked whether speech intelligibility is supported by different patterns of spectrotemporal modulations (STMs) in older listeners compared to young normal-hearing listeners. We recruited 3 groups of participants: 20 older hearing-impaired (OHI) listeners, 19 age-matched normal-hearing listeners, and 10 young normal-hearing (YNH) listeners. Listeners performed a speech recognition task in which randomly selected regions of the speech STM spectrum were revealed from trial to trial. The overall amount of STM information was varied using an up-down staircase to hold performance at 50% correct. Ordinal regression was used to estimate weights showing which regions of the STM spectrum were associated with good performance (a "classification image" or CImg). Results The results indicated that (a) large-scale CImg patterns did not differ between the 3 groups; (b) weights in a small region of the CImg decreased systematically as hearing loss increased; (c) CImgs were also nonsystematically distorted in OHI listeners, and the magnitude of this distortion predicted speech recognition performance even after accounting for audibility; and (d) YNH listeners performed better overall than the older groups. Conclusion We conclude that OHI/older normal-hearing listeners rely on the same speech STMs as YNH listeners but encode this information less efficiently. Supplemental Material https://doi.org/10.23641/asha.7859981.

Hierarchy of speech-driven spectrotemporal receptive fields in human auditory cortex.

Existing data indicate that cortical speech processing is hierarchically organized. Numerous studies have shown that early auditory areas encode fine acoustic details while later areas encode abstracted speech patterns. However, it remains unclear precisely what speech information is encoded across these hierarchical levels. Estimation of speech-driven spectrotemporal receptive fields (STRFs) provides a means to explore cortical speech processing in terms of acoustic or linguistic information associated with characteristic spectrotemporal patterns. Here, we estimate STRFs from cortical responses to continuous speech in fMRI. Using a novel approach based on filtering randomly-selected spectrotemporal modulations (STMs) from aurally-presented sentences, STRFs were estimated for a group of listeners and categorized using a data-driven clustering algorithm. 'Behavioral STRFs' highlighting STMs crucial for speech recognition were derived from intelligibility judgments. Clustering revealed that STRFs in the supratemporal plane represented a broad range of STMs, while STRFs in the lateral temporal lobe represented circumscribed STM patterns important to intelligibility. Detailed analysis recovered a bilateral organization with posterior-lateral regions preferentially processing STMs associated with phonological information and anterior-lateral regions preferentially processing STMs associated with word- and phrase-level information. Regions in lateral Heschl's gyrus preferentially processed STMs associated with vocalic information (pitch).

The effect of prior knowledge and intelligibility on the cortical entrainment response to speech.

It has been suggested that cortical entrainment plays an important role in speech perception by helping to parse the acoustic stimulus into discrete linguistic units. However, the question of whether the entrainment response to speech depends on the intelligibility of the stimulus remains open. Studies addressing this question of intelligibility have, for the most part, significantly distorted the acoustic properties of the stimulus to degrade the intelligibility of the speech stimulus, making it difficult to compare across "intelligible" and "unintelligible" conditions. To avoid these acoustic confounds, we used priming to manipulate the intelligibility of vocoded speech. We used EEG to measure the entrainment response to vocoded target sentences that are preceded by natural speech (nonvocoded) prime sentences that are either valid (match the target) or invalid (do not match the target). For unintelligible speech, valid primes have the effect of restoring intelligibility. We compared the effect of priming on the entrainment response for both 3-channel (unintelligible) and 16-channel (intelligible) speech. We observed a main effect of priming, suggesting that the entrainment response depends on prior knowledge, but not a main effect of vocoding (16 channels vs. 3 channels). Furthermore, we found no difference in the effect of priming on the entrainment response to 3-channel and 16-channel vocoded speech, suggesting that for vocoded speech, entrainment response does not depend on intelligibility.NEW & NOTEWORTHY Neural oscillations have been implicated in the parsing of speech into discrete, hierarchically organized units. Our data suggest that these oscillations track the acoustic envelope rather than more abstract linguistic properties of the speech stimulus. Our data also suggest that prior experience with the stimulus allows these oscillations to better track the stimulus envelope.

Auditory "bubbles": Efficient classification of the spectrotemporal modulations essential for speech intelligibility.

Speech intelligibility depends on the integrity of spectrotemporal patterns in the signal. The current study is concerned with the speech modulation power spectrum (MPS), which is a two-dimensional representation of energy at different combinations of temporal and spectral (i.e., spectrotemporal) modulation rates. A psychophysical procedure was developed to identify the regions of the MPS that contribute to successful reception of auditory sentences. The procedure, based on the two-dimensional image classification technique known as "bubbles" (Gosselin and Schyns (2001). Vision Res. 41, 2261-2271), involves filtering (i.e., degrading) the speech signal by removing parts of the MPS at random, and relating filter patterns to observer performance (keywords identified) over a number of trials. The result is a classification image (CImg) or "perceptual map" that emphasizes regions of the MPS essential for speech intelligibility. This procedure was tested using normal-rate and 2×-time-compressed sentences. The results indicated: (a) CImgs could be reliably estimated in individual listeners in relatively few trials, (b) CImgs tracked changes in spectrotemporal modulation energy induced by time compression, though not completely, indicating that "perceptual maps" deviated from physical stimulus energy, and

Attention selectively modulates cortical entrainment in different regions of the speech spectrum.

Recent studies have uncovered a neural response that appears to track the envelope of speech, and have shown that this tracking process is mediated by attention. It has been argued that this tracking reflects a process of phase-locking to the fluctuations of stimulus energy, ensuring that this energy arrives during periods of high neuronal excitability. Because all acoustic stimuli are decomposed into spectral channels at the cochlea, and this spectral decomposition is maintained along the ascending auditory pathway and into auditory cortex, we hypothesized that the overall stimulus envelope is not as relevant to cortical processing as the individual frequency channels; attention may be mediating envelope tracking differentially across these spectral channels. To test this we reanalyzed data reported by Horton et al. (2013), where high-density EEG was recorded while adults attended to one of two competing naturalistic speech streams. In order to simulate cochlear filtering, the stimuli were passed through a gammatone filterbank, and temporal envelopes were extracted at each filter output. Following Horton et al. (2013), the attended and unattended envelopes were cross-correlated with the EEG, and local maxima were extracted at three different latency ranges corresponding to distinct peaks in the cross-correlation function (N1, P2, and N2). We found that the ratio between the attended and unattended cross-correlation functions varied across frequency channels in the N1 latency range, consistent with the hypothesis that attention differentially modulates envelope-tracking activity across spectral channels.

Psychometric functions for sentence recognition in sinusoidally amplitude-modulated noises.

Listeners' speech reception is better when speech is masked by a modulated masker compared to an unmodulated masker with the same long-term root-mean-square level. It has been suggested that listeners take advantage of brief periods of quiescence in a modulated masker to extract speech information. Two experiments examined the contribution of such "dip-listening" models. The first experiment estimated psychometric functions for speech intelligibility using sentences masked by sinusoidally modulated and unmodulated speech-shaped noises and the second experiment estimated detection thresholds for a tone pip added at the central dip in the masker. Modulation rates ranging from 1 to 64 Hz were tested. In experiment 1 the slopes of the psychometric functions were shallower for lower modulation rates and the pattern of speech reception thresholds as a function of modulation rate was nonmonotonic with a minimum near 16 Hz. In contrast, the detection thresholds from experiment 2 increased monotonically with modulation rate. The results suggest that the benefits of listening to speech in temporally fluctuating maskers cannot be solely ascribed to the temporal acuity of the auditory system.

A MATLAB toolbox for the efficient estimation of the psychometric function using the updated maximum-likelihood adaptive procedure.

A MATLAB toolbox for the efficient estimation of the threshold, slope, and lapse rate of the psychometric function is described. The toolbox enables the efficient implementation of the updated maximum-likelihood (UML) procedure. The toolbox uses an object-oriented architecture for organizing the experimental variables and computational algorithms, which provides experimenters with flexibility in experimental design and data management. Descriptions of the UML procedure and the UML Toolbox are provided, followed by toolbox use examples. Finally, guidelines and recommendations of parameter configurations are given.

Rapid estimation of high-parameter auditory-filter shapes.

A Bayesian adaptive procedure, the quick-auditory-filter (qAF) procedure, was used to estimate auditory-filter shapes that were asymmetric about their peaks. In three experiments, listeners who were naive to psychoacoustic experiments detected a fixed-level, pure-tone target presented with a spectrally notched noise masker. The qAF procedure adaptively manipulated the masker spectrum level and the position of the masker notch, which was optimized for the efficient estimation of the five parameters of an auditory-filter model. Experiment I demonstrated that the qAF procedure provided a convergent estimate of the auditory-filter shape at 2 kHz within 150 to 200 trials (approximately 15 min to complete) and, for a majority of listeners, excellent test-retest reliability. In experiment II, asymmetric auditory filters were estimated for target frequencies of 1 and 4 kHz and target levels of 30 and 50 dB sound pressure level. The estimated filter shapes were generally consistent with published norms, especially at the low target level. It is known that the auditory-filter estimates are narrower for forward masking than simultaneous masking due to peripheral suppression, a result replicated in experiment III using fewer than 200 qAF trials.

Level dominance for the detection of changes in level distribution in sound streams.

Sound streams were generated by randomly choosing the levels of tone pips from two different distributions, A and B. Of the 18 tone pips, the first nine were drawn from distribution A and the second nine from distribution B, or the opposite. The listeners' task was to indicate order, A-B or B-A. In two conditions the A and B distributions differed in mean (condition 1) or variance (condition 2). In contrast to an ideal observer, listeners' strategies were consistent across the two conditions. Analyses suggest that listeners relied primarily on the more intense tone pips in making their decisions.

Bayesian adaptive estimation of the auditory filter.

A Bayesian adaptive procedure for estimating the auditory-filter shape was proposed and evaluated using young, normal-hearing listeners at moderate stimulus levels. The resulting quick-auditory-filter (qAF) procedure assumed the power spectrum model of masking with the auditory-filter shape being modeled using a spectrally symmetric, two-parameter rounded-exponential (roex) function. During data collection using the qAF procedure, listeners detected the presence of a pure-tone signal presented in the spectral notch of a noise masker. Dependent on the listener's response on each trial, the posterior probability distributions of the model parameters were updated, and the resulting parameter estimates were then used to optimize the choice of stimulus parameters for the subsequent trials. Results showed that the qAF procedure gave similar parameter estimates to the traditional threshold-based procedure in many cases and was able to reasonably predict the masked signal thresholds. Additional measurements suggested that occasional failures of the qAF procedure to reliably converge could be a consequence of incorrect responses early in a qAF track. The addition of a parameter describing lapses of attention reduced the likelihood of such failures.

Temporal modulation transfer function for efficient assessment of auditory temporal resolution.

Two common measures of auditory temporal resolution are the temporal modulation transfer function (TMTF) and the gap detection threshold (GDT). The current study addresses the lack of efficient psychophysical procedures for collecting TMTFs and the lack of literature on the comparisons of TMTF and GDT. Two procedures for efficient measurements of the TMTF are proposed: (1) A Bayesian procedure that adaptively chooses the stimulus modulation rate and depth to maximize the information gain from each trial and (2) a procedure that reduces the data collection to two adaptive staircase tracks. Results from experiments I and II showed that, for broadband carriers, these approaches provided similar results compared to TMTFs measured using traditional methods despite taking less than 10 min for data collection. Using these efficient procedures, TMTFs were measured from a large number of naive listeners and were compared to the gap detection thresholds collected from the same ears in experiment III. Results showed that the sensitivity parameter estimated from the TMTF measurements correlated well with the GDTs, whereas the cutoff rate is either uncorrelated or positively correlated with the gap detection threshold. These results suggest caution in interpreting a lower GDT as evidence for less sluggish temporal processing.

Investigating the auditory enhancement phenomenon using behavioral temporal masking patterns.

A narrowband signal is subjected to less masking from a simultaneously presented notched masker if it is preceded by a precursor that occupies the same spectral region as the masker, a phenomenon referred to as enhancement. The present study investigated (i) the amount of enhancement for the detection of a narrowband noise added to a notched masker, and (ii) masking patterns associated with the detection of tone pips added to the narrowband signal. The resulting psychophysical data were compared to predictions generated using a model similar to the neural adaptation-of-inhibition model proposed by Nelson and Young [(2010b). J. Neurosci. 30, 6577-6587]. The amount of enhancement was measured as a function of the temporal separation between the precursor and masker in Experiment I, and as a function of precursor level in Experiment II. The model captured the temporal dynamics of psychophysical enhancement reasonably well for both the long-duration noise signals and the masking patterns. However, in contrast to psychophysical data which indicated reliable enhancement only when the precursor and masker shared the same levels, the model predicated enhancement at all precursor levels.

A maximum-likelihood procedure for estimating psychometric functions: thresholds, slopes, and lapses of attention.

Green [J. Acoust. Soc. Am. 87, 2662-2674 (1990)] suggested an efficient, maximum-likelihood-based approach for adaptively estimating thresholds. Such procedures determine the signal strength on each trial by first identifying the most likely psychometric functions among the pre-proposed alternatives based on responses from previous trials, and then finding the signal strength at the "sweet point" on that most likely function. The sweet point is the point on the psychometric function that is associated with the minimum expected variance. Here, that procedure is extended to reduce poor estimates that result from lapses in attention. The sweet points for the threshold, slope, and lapse parameters of a transformed logistic psychometric function are derived. In addition, alternative stimulus placement algorithms are considered. The result is a relatively fast and robust estimation of a three-parameter psychometric function.