Spectrotemporal Modulation Discrimination in Infants With Normal Hearing.

OBJECTIVES: Spectral resolution correlates with speech understanding in post-lingually deafened adults with cochlear implants (CIs) and is proposed as a non-linguistic measure of device efficacy in implanted infants. However, spectral resolution develops gradually through adolescence regardless of hearing status. Spectral resolution relies on two different factors that mature at markedly different rates: Resolution of ripple peaks (frequency resolution) matures during infancy whereas sensitivity to across-spectrum intensity modulation (spectral modulation sensitivity) matures by age 12. Investigation of spectral resolution as a clinical measure for implanted infants requires understanding how each factor develops and constrains speech understanding with a CI. This study addresses the limitations of the present literature. First, the paucity of relevant data requires replication and generalization across measures of spectral resolution. Second, criticism that previously used measures of spectral resolution may reflect non-spectral cues needs to be addressed. Third, rigorous behavioral measurement of spectral resolution in individual infants is limited by attrition. To address these limitations, we measured discrimination of spectrally modulated, or rippled, sounds at two modulation depths in normal hearing (NH) infants and adults. Non-spectral cues were limited by constructing stimuli with spectral envelopes that change in phase across time. Pilot testing suggested that dynamic spectral envelope stimuli appeared to hold infants' attention and lengthen habituation time relative to previously used static ripple stimuli. A post-hoc condition was added to ensure that the stimulus noise carrier was not obscuring age differences in spectral resolution. The degree of improvement in discrimination at higher ripple depth represents spectral frequency resolution independent of the overall threshold. It was hypothesized that adults would have better thresholds than infants but both groups would show similar effects of modulation depth. DESIGN: Participants were 53 6- to 7-month-old infants and 23 adults with NH with no risk factors for hearing loss who passed bilateral otoacoustic emissions screening. Stimuli were created from complexes with 33- or 100-tones per octave, amplitude-modulated across frequency and time with constant 5 Hz envelope phase-drift and spectral ripple density from 1 to 20 ripples per octave (RPO). An observer-based, single-interval procedure measured the highest RPO (1 to 19) a listener could discriminate from a 20 RPO stimulus. Age-group and stimulus pure-tone complex were between-subjects variables whereas modulation depth (10 or 20 dB) was within-subjects. Linear-mixed model analysis was used to test for the significance of the main effects and interactions. RESULTS: All adults and 94% of infants provided ripple density thresholds at both modulation depths. The upper range of threshold approached 17 RPO with the 100-tones/octave carrier and 20 dB depth condition. As expected, mean threshold was significantly better with the 100-tones/octave compared with the 33-tones/octave complex, better in adults than in infants, and better at 20 dB than 10 dB modulation depth. None of the interactions reached significance, suggesting that the effect of modulation depth on the threshold was not different for infants or adults. CONCLUSIONS: Spectral ripple discrimination can be measured in infants with minimal listener attrition using dynamic ripple stimuli. Results are consistent with previous findings that spectral resolution is immature in infancy due to immature spectral modulation sensitivity rather than frequency resolution.

Infant Pitch and Timbre Discrimination in the Presence of Variation in the Other Dimension.

Adult listeners perceive pitch with fine precision, with many adults capable of discriminating less than a 1 % change in fundamental frequency (F0). Although there is variability across individuals, this precise pitch perception is an ability ascribed to cortical functions that are also important for speech and music perception. Infants display neural immaturity in the auditory cortex, suggesting that pitch discrimination may improve throughout infancy. In two experiments, we tested the limits of F0 (pitch) and spectral centroid (timbre) perception in 66 infants and 31 adults. Contrary to expectations, we found that infants at both 3 and 7 months were able to reliably detect small changes in F0 in the presence of random variations in spectral content, and vice versa, to the extent that their performance matched that of adults with musical training and exceeded that of adults without musical training. The results indicate high fidelity of F0 and spectral-envelope coding in infants, implying that fully mature cortical processing is not necessary for accurate discrimination of these features. The surprising difference in performance between infants and musically untrained adults may reflect a developmental trajectory for learning natural statistical covariations between pitch and timbre that improves coding efficiency but results in degraded performance in adults without musical training when expectations for such covariations are violated.

Development of the Mechanisms Underlying Audiovisual Speech Perception Benefit.

The natural environments in which infants and children learn speech and language are noisy and multimodal. Adults rely on the multimodal nature of speech to compensate for noisy environments during speech communication. Multiple mechanisms underlie mature audiovisual benefit to speech perception, including reduced uncertainty as to when auditory speech will occur, use of correlations between the amplitude envelope of auditory and visual signals in fluent speech, and use of visual phonetic knowledge for lexical access. This paper reviews evidence regarding infants' and children's use of temporal and phonetic mechanisms in audiovisual speech perception benefit. The ability to use temporal cues for audiovisual speech perception benefit emerges in infancy. Although infants are sensitive to the correspondence between auditory and visual phonetic cues, the ability to use this correspondence for audiovisual benefit may not emerge until age four. A more cohesive account of the development of audiovisual speech perception may follow from a more thorough understanding of the development of sensitivity to and use of various temporal and phonetic cues.

Infants' use of isolated and combined temporal cues in speech sound segregation.

This paper investigates infants' and adults' use of envelope cues and combined onset asynchrony and envelope cues in the segregation of concurrent vowels. Listeners heard superimposed vowel pairs consisting of two different vowels spoken by a male and a female talker and were trained to respond to one specific target vowel, either the male /u:/ or male /i:/. Vowel detection was measured in three conditions. In the baseline condition the two superimposed vowels had similar amplitude envelopes and synchronous onset. In the envelope cue condition, the amplitude envelopes of the two vowels differed. In the combined cue condition, both the onset time and amplitude envelopes of the two vowels differed. Seven-month-old infants' concurrent vowel segregation improved both with envelope and with combined onset asynchrony and envelope cues to the same extent as adults'. A preliminary investigation with 3-month-old infants suggested that neither envelope cues nor combined asynchrony and envelope cues improved their ability to detect the target vowel. Taken together, these results suggest that envelope and combined onset-asynchrony cues are available to infants as they attempt to process competing speech sounds, at least after 7 months of age.

Infants and Adults Use Visual Cues to Improve Detection and Discrimination of Speech in Noise.

Purpose This study assessed the extent to which 6- to 8.5-month-old infants and 18- to 30-year-old adults detect and discriminate auditory syllables in noise better in the presence of visual speech than in auditory-only conditions. In addition, we examined whether visual cues to the onset and offset of the auditory signal account for this benefit. Method Sixty infants and 24 adults were randomly assigned to speech detection or discrimination tasks and were tested using a modified observer-based psychoacoustic procedure. Each participant completed 1-3 conditions: auditory-only, with visual speech, and with a visual signal that only cued the onset and offset of the auditory syllable. Results Mixed linear modeling indicated that infants and adults benefited from visual speech on both tasks. Adults relied on the onset-offset cue for detection, but the same cue did not improve their discrimination. The onset-offset cue benefited infants for both detection and discrimination. Whereas the onset-offset cue improved detection similarly for infants and adults, the full visual speech signal benefited infants to a lesser extent than adults on the discrimination task. Conclusions These results suggest that infants' use of visual onset-offset cues is mature, but their ability to use more complex visual speech cues is still developing. Additional research is needed to explore differences in audiovisual enhancement (a) of speech discrimination across speech targets and (b) with increasingly complex tasks and stimuli.

Amplitude modulation detection and temporal modulation cutoff frequency in normal hearing infants.

The goal of this study was to determine if temporal modulation cutoff frequency was mature in three-month-old infants. Normal-hearing infants and young adults were tested in a single-interval forced-choice observer-based psychoacoustic procedure. Two parameters of the temporal modulation transfer function (TMTF) were estimated to separate temporal resolution from amplitude modulation sensitivity. The modulation detection threshold (MDT) of a broadband noise amplitude modulated at 10 Hz estimated the y-intercept of the TMTF. The cutoff frequency of the TMTF, measured at a modulation depth 4 dB greater than the MDT, provided an estimate of temporal resolution. MDT was obtained in 27 of 33 infants while both MDT and cutoff frequency was obtained in 15 infants and in 16 of 16 adults. Mean MDT was approximately 10 dB poorer in infants compared to adults. In contrast, mean temporal modulation cutoff frequency did not differ significantly between age groups. These results suggest that temporal resolution is mature, on average, by three months of age in normal hearing children despite immature sensitivity to amplitude modulation. The temporal modulation cutoff frequency approach used here may be a feasible way to examine development of temporal resolution in young listeners with markedly immature sensitivity to amplitude modulation.

Perception of incongruent audiovisual English consonants.

Causal inference-the process of deciding whether two incoming signals come from the same source-is an important step in audiovisual (AV) speech perception. This research explored causal inference and perception of incongruent AV English consonants. Nine adults were presented auditory, visual, congruent AV, and incongruent AV consonant-vowel syllables. Incongruent AV stimuli included auditory and visual syllables with matched vowels, but mismatched consonants. Open-set responses were collected. For most incongruent syllables, participants were aware of the mismatch between auditory and visual signals (59.04%) or reported the auditory syllable (33.73%). Otherwise, participants reported the visual syllable (1.13%) or some other syllable (6.11%). Statistical analyses were used to assess whether visual distinctiveness and place, voice, and manner features predicted responses. Mismatch responses occurred more when the auditory and visual consonants were visually distinct, when place and manner differed across auditory and visual consonants, and for consonants with high visual accuracy. Auditory responses occurred more when the auditory and visual consonants were visually similar, when place and manner were the same across auditory and visual stimuli, and with consonants produced further back in the mouth. Visual responses occurred more when voicing and manner were the same across auditory and visual stimuli, and for front and middle consonants. Other responses were variable, but typically matched the visual place, auditory voice, and auditory manner of the input. Overall, results indicate that causal inference and incongruent AV consonant perception depend on salience and reliability of auditory and visual inputs and degree of redundancy between auditory and visual inputs. A parameter-free computational model of incongruent AV speech perception based on unimodal confusions, with a causal inference rule, was applied. Data from the current study present an opportunity to test and improve the generalizability of current AV speech integration models.

Infants use onset asynchrony cues in auditory scene analysis.

This experiment investigated the effect of onset asynchrony on the segregation of concurrent vowels in infants and adults. Two vowels, randomly chosen from seven American-English vowels, were superimposed. Each vowel pair contained one vowel by a male and one by a female talker. A train of such vowel pairs was presented to listeners, who were trained to respond to the male target vowel /i:/ or /u:/. The ability to identify the target vowel was compared among three conditions: synchronous onset, 100-, and 200-ms onset asynchrony. Experiment 1 measured performance, in d', in 7-month-old infants and adults. Infants and adults performed better with asynchronous than synchronous vowel onset, regardless of asynchrony duration. Experiment 2 compared the proportion of 3-month-old infants achieving an 80% correct criterion with and without onset asynchrony. Significantly more infants reached criterion with asynchronous than with synchronous vowel onset. Asynchrony duration did not influence performance. These experiments show that infants, as young as 3 months old, benefit from onset asynchrony.

The Influence of Target and Masker Characteristics on Infants' and Adults' Detection of Speech.

Purpose: Several investigators have compared infants' detection of speech in speech and nonspeech maskers to evaluate developmental differences in masking. Such comparisons have produced contradictory results, possibly because each investigation used different stimuli. The current study examined target and masker effects on infants' and adults' detection of speech. Method: An observer-based procedure was used to compare infants' and adults' detection of the vowel /ʌ/ and the word "baby" in a 2-talker speech masker and matched speech-spectrum noise. The measure of performance was d'. A total of 43 7-month-old infants and 41 young adults were randomly assigned to 1 target-masker combination condition, and mean performance was compared across conditions at each age. Results: Adults' detection was influenced by an interaction between the target and the masker: Adults detected the vowel better in the 2-talker masker than in speech-spectrum noise but detected the word equally well in the 2 maskers. In contrast, infants detected both targets better in speech-spectrum noise than in the 2-talker masker. Conclusions: The relative effects of the masker on target detection by infants and adults depend on the target to be detected. Thus, conclusions drawn about differences between infants and adults in the mechanisms responsible for masking will depend on the stimuli. Standardization of speech stimuli in developmental research would help clarify the nature of infants' segregation difficulties. Supplemental Material: https://doi.org/10.23641/asha.5613139.

Effects of age and hearing mechanism on spectral resolution in normal hearing and cochlear-implanted listeners.

Spectral resolution limits speech perception with a cochlear implant (CI) in post-lingually deaf adults. However, the development of spectral resolution in pre-lingually deaf implanted children is not well understood. Acoustic spectral resolution was measured as a function of age (school-age versus adult) in CI and normal-hearing (NH) participants using spectral ripple discrimination (SRD). A 3-alternative forced-choice task was used to obtain SRD thresholds at five ripple depths. Effects of age and hearing method on SRD and spectral modulation transfer function (SMTF) slope (reflecting frequency resolution) and x-intercept (reflecting across-channel intensity resolution) were examined. Correlations between SRD, SMTF parameters, age, and speech perception in noise were studied. Better SRD in NH than CI participants was observed at all depths. SRD thresholds and SMTF slope correlated with speech perception in CI users. When adjusted for floor performance, x-intercept did not correlate with SMTF slope or speech perception. Age and x-intercept correlations were positive and significant in NH but not CI children suggesting that across-channel intensity resolution matures during school-age in NH children. No evidence for maturation of spectral resolution beyond early school-age in pre-lingually deaf implanted CI users was found in the present study.

Infant pitch perception: Missing fundamental melody discrimination.

Although recent results show that 3-month-olds can discriminate complex tones by their missing fundamental, it is arguable whether they are discriminating on the basis of a perceived pitch. A defining characteristic of pitch is that it carries melodic information. This study investigated whether 3-month-olds, 7-month-olds, and adults can detect a change in a melody composed of missing fundamental complexes. Participants heard a seven-note melody and learned to respond to a change that violated the melodic contour. To ensure that participants were responding on the basis of pitch, the notes in the melody had missing fundamentals and varied in spectral content on each presentation. In experiment I, all melodies had the same absolute pitch, while in experiment II, the melodies were randomly transposed into one of three different keys on each presentation. Almost all participants learned to ignore the spectral changes and respond to the changed note of the melody in both experiments, strengthening the argument that complex tones elicit a sense of musical pitch in infants. These results provide evidence that complex pitch perception is functional by 3 months of age.

Spectral Ripple Discrimination in Normal-Hearing Infants.

OBJECTIVES: Spectral resolution is a correlate of open-set speech understanding in postlingually deaf adults and prelingually deaf children who use cochlear implants (CIs). To apply measures of spectral resolution to assess device efficacy in younger CI users, it is necessary to understand how spectral resolution develops in normal-hearing children. In this study, spectral ripple discrimination (SRD) was used to measure listeners' sensitivity to a shift in phase of the spectral envelope of a broadband noise. Both resolution of peak to peak location (frequency resolution) and peak to trough intensity (across-channel intensity resolution) are required for SRD. DESIGN: SRD was measured as the highest ripple density (in ripples per octave) for which a listener could discriminate a 90° shift in phase of the sinusoidally-modulated amplitude spectrum. A 2 × 3 between-subjects design was used to assess the effects of age (7-month-old infants versus adults) and ripple peak/trough "depth" (10, 13, and 20 dB) on SRD in normal-hearing listeners (experiment 1). In experiment 2, SRD thresholds in the same age groups were compared using a task in which ripple starting phases were randomized across trials to obscure within-channel intensity cues. In experiment 3, the randomized starting phase method was used to measure SRD as a function of age (3-month-old infants, 7-month-old infants, and young adults) and ripple depth (10 and 20 dB in repeated measures design). RESULTS: In experiment 1, there was a significant interaction between age and ripple depth. The infant SRDs were significantly poorer than the adult SRDs at 10 and 13 dB ripple depths but adult-like at 20 dB depth. This result is consistent with immature across-channel intensity resolution. In contrast, the trajectory of SRD as a function of depth was steeper for infants than adults suggesting that frequency resolution was better in infants than adults. However, in experiment 2 infant performance was significantly poorer than adults at 20 dB depth suggesting that variability of infants' use of within-channel intensity cues, rather than better frequency resolution, explained the results of experiment 1. In experiment 3, age effects were seen with both groups of infants showing poorer SRD than adults but, unlike experiment 1, no significant interaction between age and depth was seen. CONCLUSIONS: Measurement of SRD thresholds in individual 3 to 7-month-old infants is feasible. Performance of normal-hearing infants on SRD may be limited by across-channel intensity resolution despite mature frequency resolution. These findings have significant implications for design and stimulus choice for applying SRD for testing infants with CIs. The high degree of variability in infant SRD can be somewhat reduced by obscuring within-channel cues.

Perception of the pitch of unresolved harmonics by 3- and 7-month-old human infants.

Three-month-olds discriminate resolved harmonic complexes on the basis of missing fundamental (MF) pitch. In view of reported difficulty in discriminating unresolved complexes at 7 months and striking changes in the organization of the auditory system during early infancy, infants' ability to discriminate unresolved complexes is of some interest. This study investigated the ability of 3-month-olds, 7-month-olds, and adults to discriminate the pitch of unresolved harmonic complexes using an observer-based method. Stimuli were MF complexes bandpass filtered with a -12 dB/octave slope, combined in random phase, presented at 70 dB sound pressure level (SPL) for 650 ms with a 50 ms rise/fall with a pink noise at 65 dB SPL. The conditions were (1) "LOW" unresolved harmonics (2500-4500 Hz) based on MFs of 160 and 200 Hz and (2) "HIGH" unresolved harmonics (4000-6000 Hz) based on MFs of 190 and 200 Hz. To demonstrate MF discrimination, participants had to ignore spectral changes in complexes with the same fundamental and respond only when the fundamental changed. Nearly all infants tested categorized complexes by MF pitch suggesting discrimination of pitch extracted from unresolved harmonics by 3 months. Adults also categorized the complexes by MF pitch, although musically trained adults were more successful than musically untrained adults.

Infants' detection and discrimination of sounds in modulated maskers.

Adults and 7-month-old infants were compared in detection and discrimination of sounds in modulated maskers. In two experiments, the level of a target sound was varied to equate listeners' performance in unmodulated noise, and performance was assessed at that level in a noise modulated with the envelope of single-talker speech. While adults' vowel discrimination and tone detection were better in the modulated than in the unmodulated masker, infants' vowel discrimination was poorer in the modulated than in the unmodulated masker. Infants' tone detection was the same in the two maskers. In two additional experiments, each age group was tested at one level with order of testing in modulated and unmodulated maskers counterbalanced across subjects. Both infants and adults discriminated between vowels better in single-talker modulated and sinusoidally amplitude modulated (SAM) maskers than in an unmodulated masker, but infants' modulated-unmodulated difference was smaller than than that of adults. Increasing the modulation depth of the SAM masker did not affect the size of infants' modulated-unmodulated difference. However, infants' asymptotic performance in a modulated masker limits the extent to which their performance could improve. Infants can make use of information in masker dips, but masker modulation may also interfere with their ability to process the target.

Perception of missing fundamental pitch by 3- and 4-month-old human infants.

A hallmark of complex pitch perception is that the pitch of a harmonic complex is the same whether or not the fundamental frequency is present. By 7 months, infants appear to discriminate on the basis of the pitch of the missing fundamental (MF). Although electrophysiological cortical responses to MF pitch changes have been recorded in infants younger than 7 months, no psychophysical studies have been published. This study investigated the ability of 3- and 4-month-olds to perceive the pitch of MF harmonic complexes based on fundamentals of 160 Hz and 200 Hz using an observer-based method. In experiment I, to demonstrate MF pitch discrimination, 3- and 4-month-olds were required to ignore spectral changes in complexes with the same fundamental and to respond only when the fundamental changed. In experiment II, a 60-260 Hz noise was presented with complexes to mask combination tones at the fundamental frequency. In experiment III, complexes were bandpass filtered with a -12 dB/octave slope to limit use of spectral edge cues and presented with a pink noise to mask all distortion products. Nearly all infants tested categorized complexes by MF pitch in these experiments, suggesting perception of the missing fundamental at 3 months.

Ear-canal wideband acoustic transfer functions of adults and two- to nine-month-old infants.

OBJECTIVES: Wideband acoustic transfer functions (WATF) measured in the ear canal have been shown to be effective in the diagnosis of middle ear dysfunction in adults and in newborn infants. Although these measures would be diagnostically useful in older infants, normative data on a large number of older infants are lacking. The goal of this study was to provide such normative data. DESIGN: The WATF of 458 infants aged 2 to 9 mos and of 210 adults were obtained. Wideband reactance (X), resistance (R), and energy reflectance (ER) were measured in third-octave bands between 250 and 8000 Hz. The effects of age and gender on the WATF were examined, and the WATF in the left and right ears were compared. Test-retest reliability was assessed, and the relationship between the 226-Hz tympanogram and the WATF was examined. RESULTS: The results agreed well with previous reports testing fewer subjects, which documented age-related change in these measures during infancy and between infancy and adulthood. Test-retest correlations within third octaves were 0.5 to 0.7 at best, but did not vary systematically with age. Infants' test-retest absolute differences within third octaves for R and ER were similar to those of adults. The shape of the WATF on retest was highly repeatable, and the shapes of the WATF in the ears of the same individual were qualitatively similar. The wideband impedance results were not different in the left and right ears, but ER was slightly, but significantly, lower in the left ear than that in the right ear. Resistance and reactance magnitude were greater for females than males, but there was no effect of gender on ER. Infants whose 226-Hz tympanogram indicated reduced peak admittance (Types As and B) had greater resistance and reactance magnitude than those with normal peak admittance (Types A and C), but no tympanometry group differences were evident in ER. CONCLUSIONS: Age-graded norms are essential to the successful clinical application of WATF. However, the effects of gender and laterality on the WATF are small.

Measuring sound detection and reaction time in infant and toddler cochlear implant recipients using an observer-based procedure: a first report.

OBJECTIVES: First, to establish the feasibility of the observer-based psychophysical procedure (OPP) in measuring sound detection in infant and toddler cochlear implant (CI) recipients. Second, to measure the psychometric function for detection (PFD) from individual subjects. Third, to determine whether reaction time (RT) provides information about the auditory sensitivity of young CI users. DESIGN: Twelve CI recipients, 11 to 32 mo old, participated in our study. Initially, tones were presented in sound field, and children learned to respond when they heard tones but not at other times. Once an 80% correct criterion was met in sound field, a novel stimulation paradigm was used to present stimuli to a single electrode while the child listened to acoustic input on most other electrodes using their usual map. The PFD and RT were measured using this single-electrode stimulation paradigm. RESULTS: Eleven subjects met criterion, 6 within the minimum possible number of trials. For eight subjects, the asymptotic level of detecting single-electrode stimuli averaged 86% correct, similar to levels achieved by normal-hearing infants and toddlers detecting pure tones. The PFD slope of infant and toddler CI recipients was less than or equal to the slope for adult CI users reported in previous studies. RT decreased significantly with stimulus level in four children. CONCLUSIONS: These preliminary results suggest that psychophysical detection data can be obtained from infant and toddler CI recipients using OPP. The PFD of young CI users may be shallower than that of adult CI users. Relatively good asymptotic detection performance implies that young CI users are more attentive to sound than has been suggested in previous studies. RT tended to be a less reliable measure of detection, but methodological changes could improve its utility.

Effects of temporal uncertainty and temporal expectancy on infants' auditory sensitivity.

Adults are more sensitive to a sound if they know when the sound will occur. In the present experiment, the effects of temporal uncertainty and temporal expectancy on infants' and adults' detection of a 1 kHz tone in a broadband noise were examined. In one experiment, masked sensitivity was measured with an acoustic cue and without an acoustic cue to possible tone presentation times. Adults' sensitivity was greater for the cue than for the no-cue condition, while infants' sensitivity did not differ significantly between the cue and no-cue conditions. In a second experiment, the effect of temporal expectancy was investigated. The detection advantage for sounds occurring at an expected (most frequent) time, over sounds occurring at unexpected (less frequent) times, was examined. Both infants and adults detected a tone better when it occurred before or at an expected time following a cue than when it occurred at a later time. Thus, despite the fact that the auditory cue did not improve infants' sensitivity, it nonetheless provided the basis for temporal expectancies. Infants, like adults, are more sensitive to sounds that are consistent with temporal expectancy.