Fusion of dichotic consonants in normal-hearing and hearing-impaired listenersa).

Hearing-impaired (HI) listeners have been shown to exhibit increased fusion of dichotic vowels, even with different fundamental frequency (F0), leading to binaural spectral averaging and interference. To determine if similar fusion and averaging occurs for consonants, four natural and synthesized stop consonants (/pa/, /ba/, /ka/, /ga/) at three F0s of 74, 106, and 185 Hz were presented dichotically-with ΔF0 varied-to normal-hearing (NH) and HI listeners. Listeners identified the one or two consonants perceived, and response options included /ta/ and /da/ as fused percepts. As ΔF0 increased, both groups showed decreases in fusion and increases in percent correct identification of both consonants, with HI listeners displaying similar fusion but poorer identification. Both groups exhibited spectral averaging (psychoacoustic fusion) of place of articulation but phonetic feature fusion for differences in voicing. With synthetic consonants, NH subjects showed increased fusion and decreased identification. Most HI listeners were unable to discriminate the synthetic consonants. The findings suggest smaller differences between groups in consonant fusion than vowel fusion, possibly due to the presence of more cues for segregation in natural speech or reduced reliance on spectral cues for consonant perception. The inability of HI listeners to discriminate synthetic consonants suggests a reliance on cues other than formant transitions for consonant discrimination.

Extreme Sawtooth-Sign in Motor Neuron Disease (MND) suggests Laryngeal Resistance to Forced Expiratory Airflow.

OBJECTIVE: The impact of laryngeal dysfunction on airflow has not been well characterized in motor neuron disease (MND). This study aimed to detect and characterize extreme airflow oscillations informally observed during volitional cough and forced vital capacity (FVC) tasks in individuals with MND who demonstrated neurolaryngeal impairments including reduced speed and extent of vocal fold abduction compared to healthy controls during volitional cough expulsion. The extreme airflow oscillations in the MND group, when viewed as a flow-volume loop, appeared similar to the "sawtooth-sign." If the airflow oscillations are periodic in a range similar to phonation, they may reflect reduced laryngeal patency. METHODS: Volitional cough and FVC airflow data (3 trials each) from 12 participants with MND with bulbar/laryngeal involvement (3 F; ages 45-76) and 12 healthy controls (6 F; ages 41-68) were analyzed for periodicity. Percent and absolute durations of periodicity of the flow oscillations were calculated by an algorithm applied to the airflow signals. In addition, the frequency, magnitude, and kurtosis of the periodic airflow oscillations were described and compared between groups. RESULTS: In both volitional cough and FVC trials, the percent of airflow periodicity during forced expiration was significantly higher (z = 3.54) in individuals with MND, adjusted for age and sex. Periodic airflow accounted for on average 28% of the total time in participants with MND and was within a frequency range similar to phonation. Magnitude of the airflow oscillations was also larger for participants with MND (z = 3.46), and kurtosis of airflow was smaller (z = -4.70) during forced expiration, indicating persistent airflow oscillations throughout exhalation. CONCLUSIONS: The significantly larger-magnitude, lower-kurtosis, and more prominent presence of sawtooth-like airflow periodicity within a frequency range similar to phonation observed in individuals with MND with neurolaryngeal impairments suggests glottic airflow resistance during forced expiration.

Clear Speech Variants: An Investigation of Intelligibility and Speaker Effort in Speakers With Parkinson's Disease.

PURPOSE: This study investigated the effects of three clear speech variants on sentence intelligibility and speaking effort for speakers with Parkinson's disease (PD) and age- and sex-matched neurologically healthy controls. METHOD: Fourteen speakers with PD and 14 neurologically healthy speakers participated. Each speaker was recorded reading 18 sentences from the Speech Intelligibility Test in their habitual speaking style and for three clear speech variants: clear (SC; given instructions to speak clearly), hearing impaired (HI; given instructions to speak with someone with a hearing impairment), and overenunciate (OE; given instructions to overenunciate each word). Speakers rated the amount of physical and mental effort exerted during each speaking condition using visual analog scales (averaged to yield a metric of overall speaking effort). Sentence productions were orthographically transcribed by 50 naive listeners. Linear mixed-effects models were used to compare intelligibility and speaking effort across the clear speech variants. RESULTS: Intelligibility was reduced for the PD group in comparison to the control group only in the habitual condition. All clear speech variants significantly improved intelligibility above habitual levels for the PD group, with OE maximizing intelligibility, followed by the SC and HI conditions. Both groups rated speaking effort to be significantly higher for both the OE and HI conditions versus the SC and habitual conditions. DISCUSSION: For speakers with PD, all clear speech variants increased intelligibility to a level comparable to that of healthy controls. All clear speech variants were also associated with higher levels of speaking effort than habitual speech for the speakers with PD. Clinically, findings suggest that clear speech training programs consider using the instruction "overenunciate" for maximizing intelligibility. Future research is needed to identify if high levels of speaking effort elicited by the clear speech variants affect long-term sustainability of the intelligibility benefit.

Intelligibility Across a Reading Passage: The Effect of Dysarthria and Cued Speaking Styles.

OBJECTIVE: Reading a passage out loud is a commonly used task in the perceptual assessment of dysarthria. The extent to which perceptual characteristics remain unchanged or stable over the time course of a passage is largely unknown. This study investigated crowdsourced visual analogue scale (VAS) judgments of intelligibility across a reading passage as a function of cued speaking styles commonly used in treatment to maximize intelligibility. PATIENTS AND METHOD: The Hunter passage was read aloud in habitual, slow, loud, and clear speaking styles by 16 speakers with Parkinson's disease (PD), 30 speakers with multiple sclerosis (MS), and 32 control speakers. VAS judgments of intelligibility from three fragments representing the beginning, middle, and end of the reading passage were obtained from 540 crowdsourced online listeners. RESULTS: Overall passage intelligibility was reduced for the two clinical groups relative to the control group. All speaker groups exhibited intelligibility variation across the reading passage, with trends of increased intelligibility toward the end of the reading passage. For control speakers and speakers with PD, patterns of intelligibility variation across passage reading did not differ with speaking style. For the MS group, intelligibility variation across the passage was dependent on speaking style. CONCLUSIONS: The presence of intelligibility variation within a reading passage warrants careful selection of speech materials in research and clinical practice. Results further indicate that the crowdsourced VAS rating paradigm is useful to document intelligibility in a reading passage for different cued speaking styles commonly used in treatment for dysarthria.

Investigating Acoustic Correlates of Intelligibility Gains and Losses During Slowed Speech: A Hybridization Approach.

Purpose This exploratory study sought to identify acoustic variables explaining rate-related variation in intelligibility for speakers with dysarthria secondary to multiple sclerosis. Method Seven speakers with dysarthria due to multiple sclerosis produced the same set of Harvard sentences at habitual and slow rates. Speakers were selected from a larger corpus on the basis of rate-related intelligibility characteristics. Four speakers demonstrated improved intelligibility and three speakers demonstrated reduced intelligibility when rate was slowed. A speech analysis resynthesis paradigm termed hybridization was used to create stimuli in which segmental (i.e., short-term spectral) and suprasegmental variables (i.e., sentence-level fundamental frequency, energy characteristics, and duration) of sentences produced at the slow rate were donated individually or in combination to habitually produced sentences. Online crowdsourced orthographic transcription was used to quantify intelligibility for six hybridized sentence types and the original habitual and slow productions. Results Sentence duration alone was not a contributing factor to improved intelligibility associated with slowed rate. Speakers whose intelligibility improved with slowed rate showed higher intelligibility scores for duration spectrum hybrids and energy hybrids compared to the original habitual rate sentences, suggesting these acoustic cues contributed to improved intelligibility for sentences produced with a slowed rate. Energy contour characteristics were also found to play a role in intelligibility losses for speakers with decreased intelligibility at slowed rate. The relative contribution of speech acoustic variables to intelligibility gains and losses varied considerably between speakers. Conclusions Hybridization can be used to identify acoustic correlates of intelligibility variation associated with slowed rate. This approach has further elucidated speaker-specific and individualized speech production adjustments when slowing rate.

DIACRITIC-LEVEL PRONUNCIATION ANALYSIS USING PHONOLOGICAL FEATURES.

Speech sound disorders affect 10% of preschool and school-age children, adversely affecting their communication, academic performance, and interaction level. Effective pronunciation training requires prolonged supervised practice and interaction. Unfortunately, many children have limited or no access to a speech-language pathologist. Computer-assisted pronunciation training has the potential for being a highly effective teaching aid; however, to-date such systems remain incapable of identifying pronunciation errors with sufficient accuracy. We propose a system that combines a multi-target architecture with weighted finite-state transducers to first segment and then analyze an utterance in terms of its phonological features. We analyze a corpus of 90 children aged 4-7 and find differences between the typically developing and the speech disordered groups.

Automatic Analysis of Pronunciations for Children with Speech Sound Disorders.

Computer-Assisted Pronunciation Training (CAPT) systems aim to help a child learn the correct pronunciations of words. However, while there are many online commercial CAPT apps, there is no consensus among Speech Language Therapists (SLPs) or non-professionals about which CAPT systems, if any, work well. The prevailing assumption is that practicing with such programs is less reliable and thus does not provide the feedback necessary to allow children to improve their performance. The most common method for assessing pronunciation performance is the Goodness of Pronunciation (GOP) technique. Our paper proposes two new GOP techniques. We have found that pronunciation models that use explicit knowledge about error pronunciation patterns can lead to more accurate classification whether a phoneme was correctly pronounced or not. We evaluate the proposed pronunciation assessment methods against a baseline state of the art GOP approach, and show that the proposed techniques lead to classification performance that is more similar to that of a human expert.

Pronunciation analysis for children with speech sound disorders.

Phonological disorders affect 10% of preschool and school-age children, adversely affecting their communication, academic performance, and interaction level. Effective pronunciation training requires prolonged supervised practice and interaction. Unfortunately, many children do not have access or only limited access to a speech-language pathologist. Computer-assisted pronunciation training has the potential for being a highly effective teaching aid; however, to-date such systems remain incapable of identifying pronunciation errors with sufficient accuracy. In this paper, we propose to improve accuracy by (1) learning acoustic models from a large children's speech database, (2) using an explicit model of typical pronunciation errors of children in the target age range, and (3) explicit modeling of the acoustics of distorted phonemes.

Determining the relevance of different aspects of formant contours to intelligibility.

Previous studies have shown that "clear" speech, where the speaker intentionally tries to enunciate, has better intelligibility than "conversational" speech, which is produced in regular conversation. However, conversational and clear speech vary along a number of acoustic dimensions and it is unclear what aspects of clear speech lead to better intelligibility. Previously, Kain et al. [J. Acoust. Soc. Am. 124 (4), 2308-2319 (2008)] showed that a combination of short-term spectra and duration was responsible for the improved intelligibility of one speaker. This study investigates subsets of specific features of short-term spectra including temporal aspects. Similar to Kain's study, hybrid stimuli were synthesized with a combination of features from clear speech and complementary features from conversational speech to determine which acoustic features cause the improved intelligibility of clear speech. Our results indicate that, although steady-state formant values of tense vowels contributed to the intelligibility of clear speech, neither the steady-state portion nor the formant transition was sufficient to yield comparable intelligibility to that of clear speech. In contrast, when the entire formant contour of conversational speech including the phoneme duration was replaced by that of clear speech, intelligibility was comparable to that of clear speech. It indicated that the combination of formant contour and duration information was relevant to the improved intelligibility of clear speech. The study provides a better understanding of the relevance of different aspects of formant contours to the improved intelligibility of clear speech.

Hybridizing conversational and clear speech to investigate the source of increased intelligibility in speakers with Parkinson's disease.

PURPOSE: A speech analysis-resynthesis paradigm was used to investigate segmental and suprasegmental acoustic variables explaining intelligibility variation for 2 speakers with Parkinson's disease (PD). METHOD: Sentences were read in conversational and clear styles. Acoustic characteristics from clear sentences were extracted and applied to conversational sentences, yielding 6 hybridized versions of sentences in which segment durations, short-term spectrum, energy characteristics, or fundamental frequency characteristics for clear productions were applied individually or in combination to conversational productions. Listeners (N = 20) judged intelligibility in transcription and scaling tasks. RESULTS: Intelligibility increases above conversation were more robust for transcription, but the pattern of intelligibility improvement was similar across tasks. For 1 speaker, hybridization involving only clear energy characteristics yielded an 8.7% improvement in transcription intelligibility above conversation. For the other speaker, hybridization involving clear spectrum yielded an 18% intelligibility improvement, whereas hybridization involving both clear spectrum and duration yielded a 13.4% improvement. CONCLUSIONS: Not all production changes accompanying clear speech explain its improved intelligibility. Suprasegmental adjustments contributed to intelligibility improvements when segmental adjustments, as inferred from vowel space area, were not robust. Hybridization can be used to identify acoustic variables explaining intelligibility variation in mild dysarthria secondary to PD.

Hybridizing conversational and clear speech to determine the degree of contribution of acoustic features to intelligibility.

Speakers naturally adopt a special "clear" (CLR) speaking style in order to be better understood by listeners who are moderately impaired in their ability to understand speech due to a hearing impairment, the presence of background noise, or both. In contrast, speech intended for nonimpaired listeners in quiet environments is referred to as "conversational" (CNV). Studies have shown that the intelligibility of CLR speech is usually higher than that of CNV speech in adverse circumstances. It is not known which individual acoustic features or combinations of features cause the higher intelligibility of CLR speech. The objective of this study is to determine the contribution of some acoustic features to intelligibility for a single speaker. The proposed method creates "hybrid" (HYB) speech stimuli that selectively combine acoustic features of one sentence spoken in the CNV and CLR styles. The intelligibility of these stimuli is then measured in perceptual tests, using 96 phonetically balanced sentences. Results for one speaker show significant sentence-level intelligibility improvements over CNV speech when replacing certain combinations of short-term spectra, phoneme identities, and phoneme durations of CNV speech with those from CLR speech, but no improvements for combinations involving fundamental frequency, energy, or nonspeech events (pauses).