Factors influencing the minimum audible change in talker head orientation cues using diotic stimuli.

The perception of a talker's head orientation is an ecologically relevant task. Humans are able to discriminate changes in talker head orientation using acoustic cues. Factors that may influence measures of this ability have not been well characterized. Here, we examined the minimum audible change in head orientation cues (MACHO) using diotic stimuli. The effects of several factors were tested: talker and gender, stimulus bandwidth (full-band vs low-pass filtered at 8 or 10 kHz), transducer (loudspeaker vs headphone), stimulus uncertainty (interleaved vs blocked presentation of four talkers), and vocal production mode (speech vs singing). The best performance of ∼41° was achieved for full-band, blocked presentation of speech over a loudspeaker. Greater stimulus uncertainty (interleaved presentation) worsened the MACHO by 26%. Bandlimiting at 8 and 10 kHz worsened performance by an additional 22% and 14%, respectively. At equivalent overall sound levels, performance was better for speech than for singing. There was some limited evidence for the transducer influencing the MACHO. These findings suggest the MACHO relies on multiple factors manipulated here. One of the largest, consistent effects was that of talker, suggesting head orientation cues are highly dependent on individual talker characteristics. This may be due to individual variability in speech directivity patterns.

Effects of Stimulus Type on 16-kHz Detection Thresholds.

OBJECTIVES: Audiometric testing typically does not include frequencies above 8 kHz. However, recent research suggests that extended high-frequency (EHF) sensitivity could affect hearing in natural communication environments. Clinical assessment of hearing often employs pure tones and frequency-modulated (FM) tones interchangeably regardless of frequency. The present study was designed to evaluate how the stimulus chosen to measure EHF thresholds affects estimates of hearing sensitivity. DESIGN: The first experiment used standard audiometric procedures to measure 8- and 16-kHz thresholds for 5- to 28-year olds with normal hearing in the standard audiometric range (250 to 8000 Hz). Stimuli were steady tones, pulsed tones, and FM tones. The second experiment tested 18- to 28-year olds with normal hearing in the standard audiometric range using psychophysical procedures to evaluate how changes in sensitivity as a function of frequency affect detection of stimuli that differ with respect to bandwidth, including bands of noise. Thresholds were measured using steady tones, pulsed tones, FM tones, narrow bands of noise, and one-third-octave bands of noise at a range of center frequencies in one ear. RESULTS: In experiment 1, thresholds improved with increasing age at 8 kHz and worsened with increasing age at 16 kHz. Thresholds for individual participants were relatively similar for steady, pulsed, and FM tones at 8 kHz. At 16 kHz, mean thresholds were approximately 5 dB lower for FM tones than for steady or pulsed tones. This stimulus effect did not differ as a function of age. Experiment 2 replicated this greater stimulus effect at 16 kHz than at 8 kHz and showed that the slope of the audibility curve accounted for these effects. CONCLUSIONS: Contrary to prior expectations, there was no evidence that the choice of stimulus type affected school-age children more than adults. For individual participants, audiometric thresholds at 16 kHz were as much as 20 dB lower for FM tones than for steady tones. Threshold differences across stimuli at 16 kHz were predicted by differences in audibility across frequency, which can vary markedly between listeners. These results highlight the importance of considering spectral width of the stimulus used to evaluate EHF thresholds.

Differential benefits of unmasking extended high-frequency content of target or background speech.

Current evidence supports the contribution of extended high frequencies (EHFs; >8 kHz) to speech recognition, especially for speech-in-speech scenarios. However, it is unclear whether the benefit of EHFs is due to phonetic information in the EHF band, EHF cues to access phonetic information at lower frequencies, talker segregation cues, or some other mechanism. This study investigated the mechanisms of benefit derived from a mismatch in EHF content between target and masker talkers for speech-in-speech recognition. EHF mismatches were generated using full band (FB) speech and speech low-pass filtered at 8 kHz. Four filtering combinations with independently filtered target and masker speech were used to create two EHF-matched and two EHF-mismatched conditions for one- and two-talker maskers. Performance was best with the FB target and the low-pass masker in both one- and two-talker masker conditions, but the effect was larger for the two-talker masker. No benefit of an EHF mismatch was observed for the low-pass filtered target. A word-by-word analysis indicated higher recognition odds with increasing EHF energy level in the target word. These findings suggest that the audibility of target EHFs provides target phonetic information or target segregation and selective attention cues, but that the audibility of masker EHFs does not confer any segregation benefit.

Extending the High-Frequency Bandwidth and Predicting Speech-in-Noise Recognition: Building on the Work of Pat Stelmachowicz.

Recent work has demonstrated that high-frequency (>6 kHz) and extended high-frequency (EHF; >8 kHz) hearing is valuable for speech-in-noise recognition. Several studies also indicate that EHF pure-tone thresholds predict speech-in-noise performance. These findings contradict the broadly accepted "speech bandwidth" that has historically been limited to below 8 kHz. This growing body of work is a tribute to the work of Pat Stelmachowicz, whose research was instrumental in revealing the limitations of the prior speech bandwidth work, particularly for female talkers and child listeners. Here, we provide a historical review that demonstrates how the work of Stelmachowicz and her colleagues paved the way for subsequent research to measure effects of extended bandwidths and EHF hearing. We also present a reanalysis of previous data collected in our lab, the results of which suggest that 16-kHz pure-tone thresholds are consistent predictors of speech-in-noise performance, regardless of whether EHF cues are present in the speech signal. Based on the work of Stelmachowicz, her colleagues, and those who have come afterward, we argue that it is time to retire the notion of a limited speech bandwidth for speech perception for both children and adults.

Language Exposure for Preterm Infants is Reduced Relative to Fetuses.

OBJECTIVE: To assess changes and deficits in language and auditory exposures consequent to preterm birth and neonatal intensive care unit stay compared with exposures in utero among typically developing fetuses. STUDY DESIGN: We analyzed over 23 000 hours of auditory exposure data in a cohort study of 27 typically-developing fetuses and 24 preterm infants. Extrauterine exposures for fetuses were captured by having pregnant women wear 24-hour audio recording devices. For preterm infants, recording devices were placed in the infant's crib. Multilevel linear regressions were conducted to test for group differences and effects of infant sex, maternal education, and mother' occupation. A linear mixed-effects model was used to test for an effect of speaker gender. RESULTS: Fetuses were exposed to an estimated 2.6 ± 1.8 hours/day of nearby, predominantly female language, nearly 5 times greater than 32 ± 12 minutes/day estimated for preterm infants (P < .001). Preterm infants had greater daily exposure to electronic sounds (5.1 ± 2.5 vs 1.3 ± 0.6 hours; P < .001) and noise (4.4 ± 2.1 vs 2.9 ± 2.8 hours; P < .05), with 4.7 ± 3.9 hours/day of silence. Language and extrauterine sound exposure for fetuses showed a marked day/night cyclical pattern, with low exposure during nighttime hours, but preterm infants' exposures showed significantly less change across the 24-hour cycle (P < .001). Maternal occupation requiring frequent communication predicted greater language exposure (P < .05). CONCLUSIONS: Our findings provide the first comparison of preterm infant auditory exposures to typically-developing fetuses. Some preterm infants may incur deficits of over 150 hours of language exposure over the preterm period. Given known effects of prenatal/preterm language exposure on neurobehavioral outcomes, this magnitude of deficit is alarming.

On the use of the TIMIT, QuickSIN, NU-6, and other widely used bandlimited speech materials for speech perception experiments.

The use of spectrally degraded speech signals deprives listeners of acoustic information that is useful for speech perception. Several popular speech corpora, recorded decades ago, have spectral degradations, including limited extended high-frequency (EHF) (>8 kHz) content. Although frequency content above 8 kHz is often assumed to play little or no role in speech perception, recent research suggests that EHF content in speech can have a significant beneficial impact on speech perception under a wide range of natural listening conditions. This paper provides an analysis of the spectral content of popular speech corpora used for speech perception research to highlight the potential shortcomings of using bandlimited speech materials. Two corpora analyzed here, the TIMIT and NU-6, have substantial low-frequency spectral degradation (<500 Hz) in addition to EHF degradation. We provide an overview of the phenomena potentially missed by using bandlimited speech signals, and the factors to consider when selecting stimuli that are sensitive to these effects.

Effect of Masker Head Orientation, Listener Age, and Extended High-Frequency Sensitivity on Speech Recognition in Spatially Separated Speech.

OBJECTIVES: Masked speech recognition is typically assessed as though the target and background talkers are all directly facing the listener. However, background speech in natural environments is often produced by talkers facing other directions, and talker head orientation affects the spectral content of speech, particularly at the extended high frequencies (EHFs; >8 kHz). This study investigated the effect of masker head orientation and listeners' EHF sensitivity on speech-in-speech recognition and spatial release from masking in children and adults. DESIGN: Participants were 5- to 7-year-olds (n = 15) and adults (n = 34), all with normal hearing up to 8 kHz and a range of EHF hearing thresholds. Speech reception thresholds (SRTs) were measured for target sentences recorded from a microphone directly in front of the talker's mouth and presented from a loudspeaker directly in front of the listener, simulating a target directly in front of and facing the listener. The maskers were two streams of concatenated words recorded from a microphone located at either 0° or 60° azimuth, simulating masker talkers facing the listener or facing away from the listener, respectively. Maskers were presented in one of three spatial conditions: co-located with the target, symmetrically separated on either side of the target (+54° and -54° on the horizontal plane), or asymmetrically separated to the right of the target (both +54° on the horizontal plane). RESULTS: Performance was poorer for the facing than for the nonfacing masker head orientation. This benefit of the nonfacing masker head orientation, or head orientation release from masking (HORM), was largest under the co-located condition, but it was also observed for the symmetric and asymmetric masker spatial separation conditions. SRTs were positively correlated with the mean 16-kHz threshold across ears in adults for the nonfacing conditions but not for the facing masker conditions. In adults with normal EHF thresholds, the HORM was comparable in magnitude to the benefit of a symmetric spatial separation of the target and maskers. Although children benefited from the nonfacing masker head orientation, their HORM was reduced compared to adults with normal EHF thresholds. Spatial release from masking was comparable across age groups for symmetric masker placement, but it was larger in adults than children for the asymmetric masker. CONCLUSIONS: Masker head orientation affects speech-in-speech recognition in children and adults, particularly those with normal EHF thresholds. This is important because masker talkers do not all face the listener under most natural listening conditions, and assuming a midline orientation would tend to overestimate the effect of spatial separation. The benefits associated with EHF audibility for speech-in-speech recognition may warrant clinical evaluation of thresholds above 8 kHz.

Extended high-frequency hearing and head orientation cues benefit children during speech-in-speech recognition.

While the audible frequency range for humans spans approximately 20 Hz to 20 kHz, children display enhanced sensitivity relative to adults when detecting extended high frequencies (frequencies above 8 kHz; EHFs), as indicated by better pure tone thresholds. The impact that this increased hearing sensitivity to EHFs may have on children's speech recognition has not been established. One context in which EHF hearing may be particularly important for children is when recognizing speech in the presence of competing talkers. In the present study, we examined the extent to which school-age children (ages 5-17 years) with normal hearing were able to benefit from EHF cues when recognizing sentences in a two-talker speech masker. Two filtering conditions were tested: all stimuli were either full band or were low-pass filtered at 8 kHz to remove EHFs. Given that EHF energy emission in speech is highly dependent on head orientation of the talker (i.e., radiation becomes more directional with increasing frequency), two masker head angle conditions were tested: both co-located maskers were facing 45°, or both were facing 60° relative to the listener. The results demonstrated that regardless of age, children performed better when EHFs were present. In addition, a small change in masker head orientation also impacted performance, with better recognition at 60° compared to 45°. These findings suggest that EHF energy in the speech signal above 8 kHz is beneficial for children in complex listening situations. The magnitude of benefit from EHF cues and talker head orientation cues did not differ between children and adults. Therefore, while EHFs were beneficial for children as young as 5 years of age, children's generally better EHF hearing relative to adults did not provide any additional benefit.

Extended High Frequencies Provide Both Spectral and Temporal Information to Improve Speech-in-Speech Recognition.

Several studies have demonstrated that extended high frequencies (EHFs; >8 kHz) in speech are not only audible but also have some utility for speech recognition, including for speech-in-speech recognition when maskers are facing away from the listener. However, the contribution of EHF spectral versus temporal information to speech recognition is unknown. Here, we show that access to EHF temporal information improved speech-in-speech recognition relative to speech bandlimited at 8 kHz but that additional access to EHF spectral detail provided an additional small but significant benefit. Results suggest that both EHF spectral structure and the temporal envelope contribute to the observed EHF benefit. Speech recognition performance was quite sensitive to masker head orientation, with a rotation of only 15° providing a highly significant benefit. An exploratory analysis indicated that pure-tone thresholds at EHFs are better predictors of speech recognition performance than low-frequency pure-tone thresholds.

Extended high frequency hearing and speech perception implications in adults and children.

Extended high frequencies (EHF), above 8 kHz, represent a region of the human hearing spectrum that is generally ignored by clinicians and researchers alike. This article is a compilation of contributions that, together, make the case for an essential role of EHF in both normal hearing and auditory dysfunction. We start with the fundamentals of biological and acoustic determinism - humans have EHF hearing for a purpose, for example, the detection of prey, predators, and mates. EHF hearing may also provide a boost to speech perception in challenging conditions and its loss, conversely, might help explain difficulty with the same task. However, it could be that EHF are a marker for damage in the conventional frequency region that is more related to speech perception difficulties. Measurement of EHF hearing in concert with otoacoustic emissions could provide an early warning of age-related hearing loss. In early life, when EHF hearing sensitivity is optimal, we can use it for enhanced phonetic identification during language learning, but we are also susceptible to diseases that can prematurely damage it. EHF audiometry techniques and standardization are reviewed, providing evidence that they are reliable to measure and provide important information for early detection, monitoring and possible prevention of hearing loss in populations at-risk. To better understand the full contribution of EHF to human hearing, clinicians and researchers can contribute by including its measurement, along with measures of speech in noise and self-report of hearing difficulties and tinnitus in clinical evaluations and studies.

Neonatal intensive care unit incubators reduce language and noise levels more than the womb.

OBJECTIVE: To assess the sound reducing characteristics of modern incubators in the neonatal intensive care unit (NICU) and to better characterize auditory and language exposures for NICU infants. STUDY DESIGN: Sound frequency spectral analysis was conducted on language and noise audio acquired simultaneously inside and outside incubators located in the NICU. RESULTS: Sound transmission into the incubators was nonuniform. Very low-frequency sounds (<100 Hz) were unattenuated or even slightly amplified inside the incubators. Maximal reduction was observed for low-to-mid frequencies (300-600 Hz) and high frequencies (>2000 Hz), which convey important language information. CONCLUSIONS: Sound reductions observed across NICU incubator walls are more severe than those reported for sound transmission into the intrauterine environment, particularly for midrange frequencies that are important for language. Although incubator walls may serve as a protection against noxious noise levels, these findings reveal a potentially detrimental effect on language exposure for infants inside a NICU incubator.

Ecological cocktail party listening reveals the utility of extended high-frequency hearing.

A fundamental principle of neuroscience is that each species' and individual's sensory systems are tailored to meet the demands placed upon them by their environments and experiences. What has driven the upper limit of the human frequency range of hearing? The traditional view is that sensitivity to the highest frequencies (i.e., beyond 8 kHz) facilitates localization of sounds in the environment. However, this has yet to be demonstrated for naturally occurring non-speech sounds. An alternative view is that, for social species such as humans, the biological relevance of conspecific vocalizations has driven the development and retention of auditory system features. Here, we provide evidence for the latter theory. We evaluated the contribution of extended high-frequency (EHF) hearing to common ecological speech perception tasks. We found that restricting access to EHFs reduced listeners' discrimination of talker head orientation by approximately 34%. Furthermore, access to EHFs significantly improved speech recognition under listening conditions in which the target talker's head was facing the listener while co-located background talkers faced away from the listener. Our findings raise the possibility that sensitivity to the highest audio frequencies fosters communication and socialization of the human species. These findings suggest that loss of sensitivity to the highest frequencies may lead to deficits in speech perception. Such EHF hearing loss typically goes undiagnosed, but is widespread among the middle-aged population.

The maximum audible low-pass cutoff frequency for speech.

Speech energy beyond 8 kHz is often audible for listeners with normal hearing. Limits to audibility in this frequency range are not well described. This study assessed the maximum audible low-pass cutoff frequency for speech, relative to full-bandwidth speech. The mean audible cutoff frequency was approximately 13 kHz, with a small but significant effect of talker sex. Better pure tone thresholds at extended high frequencies correlated with higher audible cutoff frequency. These findings demonstrate that bandlimiting speech even at 13 kHz results in a detectable loss for the average normal-hearing listener, suggesting there is information regarding the speech signal beyond 13 kHz.

Horizontal directivity patterns differ between vowels extracted from running speech.

Directivity patterns for vocalizations radiating from the human mouth have been examined regularly, but phoneme-specific changes in radiation have rarely been identified. This study reports half-plane horizontal directivity up to 20 kHz with 15° angular resolution for /ɑ/, /e/, /i/, /o/, and /u/ extracted from running speech, compared with long-term averaged speech. An effect of vowel category on the directivity index was observed, with /ɑ/ being most directional. Angle-dependent third-octave band weighting functions, useful for simulating real-world listening conditions, highlighted disparities in directivity between running speech and individual vowels. These findings point to rapidly changing dynamic directivity patterns during speech.

Differential Rates of Perinatal Maturation of Human Primary and Nonprimary Auditory Cortex.

Primary and nonprimary cerebral cortex mature along different timescales; however, the differences between the rates of maturation of primary and nonprimary cortex are unclear. Cortical maturation can be measured through changes in tissue microstructure detectable by diffusion magnetic resonance imaging (MRI). In this study, diffusion tensor imaging (DTI) was used to characterize the maturation of Heschl's gyrus (HG), which contains both primary auditory cortex (pAC) and nonprimary auditory cortex (nAC), in 90 preterm infants between 26 and 42 weeks postmenstrual age (PMA). The preterm infants were in different acoustical environments during their hospitalization: 46 in open ward beds and 44 in single rooms. A control group consisted of 15 term-born infants. Diffusion parameters revealed that (1) changes in cortical microstructure that accompany cortical maturation had largely already occurred in pAC by 28 weeks PMA, and (2) rapid changes were taking place in nAC between 26 and 42 weeks PMA. At term equivalent PMA, diffusion parameters for auditory cortex were different between preterm infants and term control infants, reflecting either delayed maturation or injury. No effect of room type was observed. For the preterm group, disturbed maturation of nonprimary (but not primary) auditory cortex was associated with poorer language performance at age two years.

Examination of the Pattern of Growth of Cerebral Tissue Volumes From Hospital Discharge to Early Childhood in Very Preterm Infants.

IMPORTANCE: Smaller cerebral volumes at hospital discharge in very preterm (VPT) infants are associated with poor neurobehavioral outcomes. Brain growth from the newborn period to middle childhood has not been explored because longitudinal data have been lacking. OBJECTIVES: To examine the pattern of growth of cerebral tissue volumes from hospital discharge to childhood in VPT infants and to determine perinatal risk factors for impaired brain growth and associations with neurobehavioral outcomes at 7 years. DESIGN, SETTING, AND PARTICIPANTS: Prospective cohort study of VPT infants (<30 weeks' gestation or <1250 g) born between April 11, 2001, and April 26, 2004, and followed up at 7 years' corrected age. The setting was The Royal Women's Hospital and The Royal Children's Hospital, Melbourne, Australia. Of 224 VPT infants and 46 full-term (FT) infants, usable magnetic resonance imaging data at either infancy or 7 years were collected for 214 VPT children (95.5%) and 46 FT children (100%), while 126 VPT children (56.3%) and 31 FT children (67.4%) had usable magnetic resonance imaging data at both time points. Follow-up was conducted from April 28, 2008, to August 9, 2011. Our final analysis was on March 3, 2016. EXPOSURE: Prematurity. MAIN OUTCOMES AND MEASURES: Absolute tissue growth, defined as change in absolute tissue volume, between infancy and 7 years was calculated for cortical gray matter volume (GMV), white matter volume (WMV), and subcortical GMV. IQ, language, and motor function were measured at 7 years. RESULTS: The study cohort comprised 260 participants. Their mean (SD) age was 7.5 (0.2) years, and 49.2% (128 of 260) were female. Early GMV deficits in VPT infants were magnified by 7 years, with less growth than FT controls. Growth differences were 31.4 (95% CI, 14.8-48.1) cm3 for cortical GMV and 1.7 (95% CI, 0.5-2.8) cm3 for subcortical GMV. Within the VPT group, greater growth was observed in boys for cortical GMV (31.9; 95% CI, 16.8-46.9 cm3), WMV (31.7; 95% CI, 19.7-43.7 cm3), and subcortical GMV (1.8; 95% CI, 0.8-2.8 cm3). After controlling for sex and maternal education, all tissue volumes in infancy correlated with IQ (r ≥ 0.35, P < .05) and language (r ≥ 0.29, P < .05). Seven-year volumes correlated with IQ (r = 0.28, P = .04 for cortical GMV), language (r = 0.29, P = .04 for cortical GMV), and motor functioning (r ≥ 0.29, P < .05 for all tissues). There was no evidence of any association between brain growth during childhood and outcomes in VPT infants. CONCLUSIONS AND RELEVANCE: Low brain volumes observed in VPT infants are exaggerated at 7 years. Low brain volume in infancy is associated with long-term functional outcomes, emphasizing the persisting influence of early brain development on subsequent growth and outcomes.

Phoneme categorization relying solely on high-frequency energy.

Speech perception studies generally focus on the acoustic information present in the frequency regions below 6 kHz. Recent evidence suggests that there is perceptually relevant information in the higher frequencies, including information affecting speech intelligibility. This experiment examined whether listeners are able to accurately identify a subset of vowels and consonants in CV-context when only high-frequency (above 5 kHz) acoustic information is available (through high-pass filtering and masking of lower frequency energy). The findings reveal that listeners are capable of extracting information from these higher frequency regions to accurately identify certain consonants and vowels.

Properties of artificial neurons that report lightness based on accumulated experience with luminance.

The responses of visual neurons in experimental animals have been extensively characterized. To ask whether these responses are consistent with a wholly empirical concept of visual perception, we optimized simple neural networks that responded according to the cumulative frequency of occurrence of local luminance patterns in retinal images. Based on this estimation of accumulated experience, the neuron responses showed classical center-surround receptive fields, luminance gain control and contrast gain control, the key properties of early level visual neurons determined in animal experiments. These results imply that a major purpose of pre-cortical neuronal circuitry is to contend with the inherently uncertain significance of luminance values in natural stimuli.

Gender and vocal production mode discrimination using the high frequencies for speech and singing.

Humans routinely produce acoustical energy at frequencies above 6 kHz during vocalization, but this frequency range is often not represented in communication devices and speech perception research. Recent advancements toward high-definition (HD) voice and extended bandwidth hearing aids have increased the interest in the high frequencies. The potential perceptual information provided by high-frequency energy (HFE) is not well characterized. We found that humans can accomplish tasks of gender discrimination and vocal production mode discrimination (speech vs. singing) when presented with acoustic stimuli containing only HFE at both amplified and normal levels. Performance in these tasks was robust in the presence of low-frequency masking noise. No substantial learning effect was observed. Listeners also were able to identify the sung and spoken text (excerpts from "The Star-Spangled Banner") with very few exposures. These results add to the increasing evidence that the high frequencies provide at least redundant information about the vocal signal, suggesting that its representation in communication devices (e.g., cell phones, hearing aids, and cochlear implants) and speech/voice synthesizers could improve these devices and benefit normal-hearing and hearing-impaired listeners.

The perceptual significance of high-frequency energy in the human voice.

While human vocalizations generate acoustical energy at frequencies up to (and beyond) 20 kHz, the energy at frequencies above about 5 kHz has traditionally been neglected in speech perception research. The intent of this paper is to review (1) the historical reasons for this research trend and (2) the work that continues to elucidate the perceptual significance of high-frequency energy (HFE) in speech and singing. The historical and physical factors reveal that, while HFE was believed to be unnecessary and/or impractical for applications of interest, it was never shown to be perceptually insignificant. Rather, the main causes for focus on low-frequency energy appear to be because the low-frequency portion of the speech spectrum was seen to be sufficient (from a perceptual standpoint), or the difficulty of HFE research was too great to be justifiable (from a technological standpoint). The advancement of technology continues to overcome concerns stemming from the latter reason. Likewise, advances in our understanding of the perceptual effects of HFE now cast doubt on the first cause. Emerging evidence indicates that HFE plays a more significant role than previously believed, and should thus be considered in speech and voice perception research, especially in research involving children and the hearing impaired.