Advancing Auditory Processing by Detecting Frequency-Following Responses Through a Specialized Machine Learning Model.

In this study, we explore the feasibility and performance of detecting scalp-recorded frequency-following responses (FFRs) with a specialized machine learning (ML) model. By leveraging the strengths of feature extraction of the source separation non-negative matrix factorization (SSNMF) algorithm and its adeptness in handling limited training data, we adapted the SSNMF algorithm into a specialized ML model with a hybrid architecture to enhance FFR detection amidst background noise. We recruited 40 adults with normal hearing and evoked their scalp recorded FFRs using the English vowel/i/with a rising pitch contour. The model was trained on FFR-present and FFR-absent conditions, and its performance was evaluated using sensitivity, specificity, efficiency, false-positive rate, and false-negative rate metrics. This study revealed that the specialized SSNMF model achieved heightened sensitivity, specificity, and efficiency in detecting FFRs as the number of recording sweeps increased. Sensitivity exceeded 80% at 500 sweeps and maintained over 89% from 1000 sweeps onwards. Similarly, specificity and efficiency also improved rapidly with increasing sweeps. The progressively enhanced sensitivity, specificity, and efficiency of this specialized ML model underscore its practicality and potential for broader applications. These findings have immediate implications for FFR research and clinical use, while paving the way for further advancements in the assessment of auditory processing.

Subcortical frequency-coding errors are linked to speaker-variability intolerance in normal-hearing adults.

Processing speaker-specific information is an important task in daily communication. This study examined how fundamental frequency (F0) cues were encoded at the subcortical level, as reflected by scalp-recorded frequency-following responses, and their relationship with the listener's ability in processing speech stimuli produced by multiple speakers. By using Mandarin tones with distinctive F0 contours, the results indicated that subcortical frequency-coding errors were significantly correlated with the listener's speaker-variability intolerance for both percent correct and reaction time measures. These findings lay a foundation to help improve the understanding of how speaker information is processed in individuals with normal and impaired auditory systems.

Subcortical neural representation to Mandarin pitch contours in American and Chinese newborns.

Voice pitch carries important information for speech understanding. This study examines the neural representation of voice pitch at the subcortical level, as reflected by the scalp-recorded frequency-following responses from ten American and ten Chinese newborns. By utilizing a set of four distinctive Mandarin pitch contours that mimic the English vowel /yi/, the results indicate that the rising and dipping pitch contours produce significantly better tracking accuracy and larger response amplitudes than the falling pitch contour. This finding suggests a hierarchy of potential stimuli when testing neonates who are born in a tonal or non-tonal linguistic environment.

Pitch perception and frequency-following responses elicited by lexical-tone chimeras.

OBJECTIVE: Previous research has shown the usefulness of utilizing auditory chimeras in assessing a listener's perception of the envelope and fine structure for an acoustic stimulus. However, research comparing and contrasting behavioral and electrophysiological responses to this stimulus type is scarce. DESIGN: Two sets of chimeric stimuli were constructed by interchanging the envelopes and fine-structures of the rising/yi(2)/and falling/yi(4)/Mandarin pitch contours that were filtered through 1, 2, 4, 8, 16, 32, and 64 frequency banks. Behavioral pitch-perception tasks were administered through a two-alternative, forced-choice paradigm. Electrophysiological responses were measured through scalp-recorded frequency-following responses (FFRs) to the lexical-tone chimeras. STUDY SAMPLE: Twenty American and twenty Chinese adults were recruited. RESULTS: A two-way analysis of variance showed significance (p < 0.05) within and across the filter bank and language background factors for the behavioral measurements, while the frequency-following response demonstrated a significance only across the filter banks. CONCLUSIONS: Perceptual importance of envelope cues increases starting from 16 filter banks, while the FFR accuracy and magnitude decreases with increasing number of filter banks. These results can be useful in assessing experience-dependent neuroplasticity and in designing speech processing strategies for cochlear-implant users who speak tonal or non-tonal languages around the globe.

Noise tolerance in human frequency-following responses to voice pitch.

Speech communication usually occurs in the presence of background noise. This study examined noise tolerance in the brainstem's processing of voice pitch, as reflected by the scalp-recorded frequency-following response (FFR) from 12 normal-hearing adults. By systematically manipulating signal-to-noise ratio (SNR) across three different stimulus intensities, the results indicated that Frequency Error, Slope Error, and Tracking Accuracy remained relatively stable until SNR was degraded to 0 dB or lower (i.e., a turning point). This turning point not only provided physiological evidence supporting pitch tolerance of noise but also allowed recommendation of a minimal SNR when evaluating pitch processing in difficult-to-test patients.

Evaluation of two algorithms for detecting human frequency-following responses to voice pitch.

OBJECTIVE: Voice pitch carries important cues for speech perception in humans. Recent studies have shown the feasibility of recording the frequency-following response (FFR) to voice pitch in normal-hearing listeners. The presence of such a response, however, has been dependent on subjective interpretation of experimenters. The purpose of this study was to develop and test an automated procedure including a control-experimental protocol and response-threshold criteria suitable for extracting FFRs to voice pitch, and compare the results to human judgments. DESIGN: A set of four Mandarin tones (Tone 1 flat; Tone 2 rising; Tone 3 dipping; and Tone 4 falling) were prepared to reflect the four contrastive pitch contours. Two distinctive algorithms, short-term autocorrelation in the time domain and narrow-band spectrogram in the frequency domain, were used to estimate the Frequency Error, Slope Error, Tracking Accuracy, Pitch Strength and Pitch-Noise Ratio of the recordings from individual listeners as well as the power and false-positive rates of each algorithm. STUDY SAMPLE: Eleven native speakers (five males; age: mean ± SD = 31.4 ± 4.7 years) of Mandarin Chinese were recruited. RESULTS: The results demonstrated that both algorithms were suitable for extracting FFRs and the objective measures showed comparable results to human judgments. CONCLUSIONS: The automated procedure used in this study, including the use of the control-experimental protocol and response thresholds used for each of the five objective indices, can be used for difficult-to-test patients and may prove to be useful as an assessment and diagnostic method in both clinical and basic research efforts.

Electrically evoked auditory steady-state responses in Guinea pigs.

Most cochlear implant systems available today provide the user with information about the envelope of the speech signal. The goal of this study was to explore the feasibility of recording electrically evoked auditory steady-state response (ESSR) and in particular to evaluate the degree to which the response recorded using electrical stimulation could be separated from stimulus artifact. Sinusoidally amplitude-modulated electrical stimuli with alternating polarities were used to elicit the response in adult guinea pigs. Separation of the stimulus artifact from evoked neural responses was achieved by summing alternating polarity responses or by using spectral analysis techniques. The recorded response exhibited physiological response properties including a pattern of nonlinear growth and their abolishment following euthanasia or administration of tetrodotoxin. These findings demonstrate that the ESSR is a response generated by the auditory system and can be separated from electrical stimulus artifact. As it is evoked by a stimulus that shares important features of cochlear implant stimulation, this evoked potential may be useful in either clinical or basic research efforts.