Attention modulates the use of spectral attributes in vowel discrimination: behavioral and event-related potential evidence.

Speech contains a variety of acoustic cues to auditory and phonetic contrasts that are exploited by the listener in decoding the acoustic signal. In three experiments, we tried to elucidate whether listeners rely on formant peak frequencies or whole spectrum attributes in vowel discrimination. We created two vowel continua in which the acoustic distance in formant frequencies was constant but the continua differed in spectral moments (i.e., the whole spectrum modeled as a probability density function). In Experiment 1, we measured reaction times and response accuracy while listeners performed a go/no-go discrimination task. The results indicated that the performance of the listeners was based on the spectral moments (especially the first and second moments), and not on formant peaks. Behavioral results in Experiment 2 showed that, when the stimuli were presented in noise eliminating differences in spectral moments between the two continua, listeners employed formant peak frequencies. In Experiment 3, using the same listeners and stimuli as in Experiment 1, we measured an automatic brain potential, the mismatch negativity (MMN), when listeners did not attend to the auditory stimuli. Results showed that the MMN reflects sensitivity only to the formant structure of the vowels. We suggest that the auditory cortex automatically and pre-attentively encodes formant peak frequencies, whereas attention can be deployed for processing additional spectral information, such as spectral moments, to enhance vowel discrimination.

Acoustic and neurophysiologic observations related to lingual nerve impairment.

The purpose of this study was to determine the acoustic effects of lingual nerve impairment on speech. Neurophysiologic examination and thermal quantitative sensory testing (QST) were carried out to determine if the profile, type or severity of sensory nerve impairment had effects on the degree of speech changes. The study group consisted of 5 women and 5 men with lingual nerve damage following an oral and maxillofacial surgery procedure. Time interval between the examination and the nerve damage ranged from 1 month to 20 years. Formants and fundamental frequency and duration of vowel sounds were analyzed. The patients underwent sensory tests, blink reflex and thermal QST of the lingual nerve area. The lingual nerve impairment had effects on the central acoustic features of vowel sounds. A relationship was observed between warm detection threshold values and the magnitude of second formant changes in men. It is concluded that lingual nerve impairment has gender-specific effects on speech. The variability in the acoustic changes of vowel sounds between different patients indicates individual compensatory manners of speech production following lingual nerve impairment.

Effects of transitory lingual nerve impairment on speech: an acoustic study of sibilant sound /s/.

By measuring spectral characteristics of the sibilant /s/ this study investigated whether the reduced orosensory feedback caused by lingual nerve impairment affects the acoustics and articulation of sibilants. A further goal was to examine speakers' capability to compensate for the deviant control of the delicate movements required for the proper production of /s/ by experimentally modifying the function of the tongue in a way that reduces the necessary somatosensory information in articulation. Five healthy men with no speech, language or hearing abnormalities were enrolled. They produced the sibilant /s/ in a variety of phonetic contexts in two sessions: first in normal conditions and then with local anaesthesia of the right lingual nerve. From the speech samples, the spectral characteristics of the sibilant sound (i.e. the centre of gravity, standard deviation, skewness and kurtosis) were analysed acoustically. The results showed that the reduced tactile sensation has effects on the tongue function resulting in individual and variable spectral alterations. The variation between different speakers indicates individual ability to compensate for the effects caused by the sensory dysfunction of the tongue. It seems, therefore, that the compensatory mechanisms for speech production are highly speaker-dependent.

Speech sounds learned by sleeping newborns.

It is not yet clear whether humans are able to learn while they are sleeping. Here we show that full-term human newborns can be taught to discriminate between similar vowel sounds when they are fast asleep. It is possible that such sleep training soon after birth could find application in clinical or educational situations.

Automatic detection of frequency changes depends on auditory stimulus intensity.

OBJECTIVE: A cortical cognitive auditory evoked potential, mismatch negativity (MMN), reflects automatic discrimination and echoic memory functions of the auditory system. For this study, we examined whether this potential is dependent on the stimulus intensity. DESIGN: The MMN potentials were recorded from 10 subjects with normal hearing using a sine tone of 1000 Hz as the standard stimulus and a sine tone of 1141 Hz as the deviant stimulus, with probabilities of 90% and 10%, respectively. The intensities were 40, 50, 60, 70, and 80 dB HL for both standard and deviant stimuli in separate blocks. RESULTS: Stimulus intensity had a statistically significant effect on the mean amplitude, rise time parameter, and onset latency of the MMN. CONCLUSION: Automatic auditory discrimination seems to be dependent on the sound pressure level of the stimuli.

Pre-attentive detection of vowel contrasts utilizes both phonetic and auditory memory representations.

Event-related brain potentials (ERP) were recorded to infrequent changes of a synthesized vowel (standard) to another vowel (deviant) in speakers of Hungarian and Finnish language, which are remotely related to each other with rather similar vowel systems. Both language groups were presented with identical stimuli. One standard-deviant pair represented an across-vowel category contrast in Hungarian, but a within-category contrast in Finnish, with the other pair having the reversed role in the two languages. Both within- and across-category contrasts elicited the mismatch negativity (MMN) ERP component in the native speakers of either language. The MMN amplitude was larger in across- than within-category contrasts in both language groups. These results suggest that the pre-attentive change-detection process generating the MMN utilized both auditory (sensory) and phonetic (categorical) representations of the test vowels.

Maturation of mismatch negativity in infants.

The mismatch negativity (MMN) is a pre-attentive change-specific component of the event-related brain potentials (ERPs). During the last decade this response has been intensively studied in adults, but investigations in children and especially in infants are still rare. Recent studies, however, have shown that MMN is also elicited in infants in response to changes in pure tones as well as in phonemes. The present study compared MMN in pre-term infants (conceptional age at the time of recording, 30-35 weeks), full-term newborns and full-term 3-month-old infants. Stimuli were Klatt-synthesized Finnish vowels /y/ and /i/. Previous studies have reported larger MMN amplitudes in school-age children compared with those obtained in adults. According to the results, however, the infant MMN amplitude seems to resemble that of adults. No significant differences in MMN amplitudes were found between the three age groups either. The mean MMN latency, however, decreased significantly with age, although in 3-month-old infants it was not much longer than in a previous study conducted in adults with the same stimuli.

Perceptual magnet effect in the light of behavioral and psychophysiological data.

Finnish speaking adults categorized synthetic vowels, varying in the frequency of the second formant (F2), as either /y/ or /i/. Two subject groups emerged: "good" and "poor" categorizers. In a /i/ rating experiment, only the good categorizers could consistently label their best /i/ (the prototype, P), being low in the F2 continuum. Poor categorizers rated /i/'s with high F2 values as Ps. In a same/different (AX) discrimination experiment, using the individual Ps and nonprototypes (NPs), it was more difficult for good categorizers to detect small F2 deviations from the P than from an NP (the "perceptual magnet effect"). For poor categorizers, the opposite effect was found. The same stimuli were used to record the mismatch negativity (MMN), an ERP component reflecting preattentive detection of deviations from a standard sound. For the good categorizers the MMNs were lower for Ps than for NPs; for the poor categorizers the MMNs for Ps and NPs did not differ significantly. The results show that individual listeners behaved differently in categorization and goodness rating but in the same way in attentive (AX) discrimination, being the poorest at about the same F2 location. The perceptual magnet effect was indicated in the good categorizers both by behavioral and psychophysiological (MMN) discrimination data.

The ontogenetically earliest discriminative response of the human brain.

Speech sounds elicited electric brain responses in healthy premature infants born 30-35 weeks after conception, demonstrating that the human brain is able to discriminate speech sounds even at this early age, well before term, and supporting previous results suggesting that the human fetus may learn to discriminate sounds while still in the womb. We presented preterm infants with stimulus sequences consisting of a repetitive vowel that was occasionally replaced by a different vowel. This infrequent vowel elicited a response resembling the adult mismatch negativity, which is known to reflect the brain's automatic detection of stimulus change. The present results constitute the ontogenetically earliest discriminative response of the human brain ever recorded.

Practical issues in the clinical application of mismatch negativity.

The mismatch negativity (MMN) recordings provide an objective measure of the preattentive, automatic auditory discrimination function. This article deals with issues central to the recording of the MMN and the interpretation of the results for clinical and electrodiagnostic purposes. The methods of acquiring as pure an MMN response as possible, i.e., one not contaminated by auditory cortical responses reflecting other functions, are discussed first. Second, other technical questions associated with the recording are reported on, e.g., what MMN parameters should be recorded and how, what is the smallest recordable MMN response, and what is the repeatability of the MMN recordings. Then, the effect of various physiological factors on the MMN (age, alertness, gender, topographic distribution of the MMN) is considered. The correlation between auditory discrimination performance and the MMN amplitude, observed in normal population, is dealt with. Finally, there is a short concluding overview on clinical findings of MMN recordings and discussion on their electrodiagnostic applications.

Mismatch negativity indicates vowel discrimination in newborns.

The present study shows that an infrequent vowel ('deviant') presented among frequent vowels ('standard') elicits in sleeping human newborns a negativity in the auditory event-related potential (ERP) resembling the mismatch negativity (MMN) recorded in adults. Thus, the MMN appears to provide means to investigate brain mechanisms of vowel perception in infants.

Automatic discrimination of phonetically relevant and irrelevant vowel parameters as reflected by mismatch negativity.

An auditory event-related brain potential called mismatch negativity (MMN) was measured to study the perception of vowel pitch and formant frequency. In the MMN paradigm, deviant vowels differed from the standards either in F0 or F2 with equal relative steps. Pure tones of corresponding frequencies were used as control stimuli. The results indicate that the changes in F0 or F2 of vowels significantly affected the MMN amplitudes. The only variable significantly affecting the MMN latencies was sex which, however, did not have any effect on the amplitudes of the MMN. As expected, the MMN amplitudes increased with an increase in the acoustical difference between the standards and the deviants in all cases. On the average, the amplitudes were lower for the vowels than for the pure tones of equal loudness. However, in vowels, minor frequency changes in F0 produced higher MMN amplitudes than similar relative changes in F2. It was also noted that even the smallest and phonetically irrelevant change in F2 was detected by the MMN process. In overall, the results demonstrate that the MMN can be measured separately for F0 and F2 of vowels, although the MMN responses show large interindividual differences.

Cortical differences in tonal versus vowel processing as revealed by an ERP component called mismatch negativity (MMN).

Event-related potentials were recorded from four aphasic subjects in order to study if discrimination of synthetic vowels is impaired by left posterior brain damage. A component called the mismatch negativity (MMN) which is assumed to reflect basic discriminatory processes of auditory stimuli was measured. In accordance with the hypothesis, two patients with posterior lesions failed to show any MMN response to synthetic vowels, whereas two patients with predominantly anterior lesions produced the response. The fact that all four patients produced an MMN response to sine wave stimuli indicates that the result does not reflect an across-the-board effect.

Event-related potentials to infrequent changes in synthesized phonetic stimuli.

Event-related potentials (ERPs) to synthetic consonant-vowel syllables were recorded. Infrequent changes in such a syllable elicited a "mismatch negativity" as well as an enhanced N100 component of the ERP even when subjects did not pay attention to the stimuli. Both components are probably generated in the supratemporal auditory cortex suggesting that in these areas there are neural networks that are automatically activated by speech-specific auditory stimulus features such as formant transitions.

Event-related brain potentials and the perception of a phonetic continuum.

Competing predictions concerning phoneme discrimination were tested by means of event-related potentials. In research on speech perception, one tradition stems from the physiology of the auditory system whereas another emphasizes categorical perception which involves a marked psychological component. The stimuli were the end points of the Finnish (i)-(y) continuum together with the intermediate boundary sound. Two of these stimuli were presented in each block of trials. One (the 'standard') had a high probability while the other (the 'deviant') was rare. The so-called mismatch negativity (MMN) component of the ERP in response to deviant stimuli showed a large amplitude and short latency when these two stimuli were pure vowels (i) and (y). When the boundary stimulus and one of the pure vowels comprised the stimulus pair, a smaller and more delayed MMN occurred. This result may be taken as support that the discrimination occurs at a basic physiological level. On the other hand, cognitive perception was reflected in the different latencies of the P3 component to (i) and (y). In sum, the results lend support to multilevel hybrid models in the explanation of vowel perception.

Computerized two-dimensional model for Finnish vowel identifications.

511 different vowel-like stimuli were produced using a computer and speech synthesizer OVE III B. Their first formant varied from 250 to 800 Hz and their second formant from 800 to 2 400 Hz, covering thus the formant frequencies of the eight Finnish vowels. The randomized stimuli were listened to by 32 young adults with normal hearing. The identifications were analyzed automatically with the computer and plotted on a two-dimensional plane as a function of F1 and F2. The resulting basic vowel identification chart demonstrates the areas where the stimuli were identified as a certain vowel. The chart offers the practical means for presentation and follow-up of individual articulatory and auditory capacities.

The validity of real-time spectrum analysis of Finnish vowel formants in profoundly hearing-impaired children.

A two-dimensional vowel chart has been used in the presentation of the articulatory positions of eight Finnish vowels produced by deaf subjects. The method and its evaluation is presented, showing individual analyses of a 13-year-old deaf boy. The values of the two lowest formants were determined from the real-time spectral analyses of each Finnish vowel and their positions on the vowel diagram, and these are compared with the identifications by listeners with normal hearing. Although the distortion and fuzziness of vowel spectra caused some difficulties in the exact determination of formant values, the comparison showed a fairly high validity for the method. This kind of vowel chart can be used for the estimation of individual articulatory capacity of deaf subjects.