Characteristics of Frequency Resolution and Speech Perception Using Bone Conduction on Different Human Facial Parts.

In conventional bone-conduction (BC) devices, a vibrator is typically attached to the mastoid process of the temporal bone or the condyle process of the mandible. However, BC-sound presentations to facial parts such as the nose and cheek have also been investigated recently. As the face is the among the most complex structures of the human body, transmission of sounds using BC on different facial parts are likely to show different perception and propagation characteristics than those presented to conventional parts. However, the characteristics of BC sound presented to different part of the face have not yet been studied in detail. To test the frequency discrimination ability, we measured difference limens for frequency (DLFs). We also conducted monosyllable articulation tests in Japanese to assess the speech-perception characteristics when BC sounds are presented to various facial (nasal, infraorbital region, zygomatic, jaw angle, and chin) and conventional (mastoid and condyle process) parts of a normal-hearing subject. The results suggest that, at least in the parts investigated in the current study, the frequency resolution and intelligibility of the facial parts were about the same as those of the conventional parts. These results indicate that practical frequency information and speech perception are possible with BC devices attached to different facial parts.

Characteristics of speech perception by distantly-presented bone-conducted ultrasound assessed by word intelligibility and monosyllable articulation tests.

High-frequency sounds above 20 kHz presented via bone conduction can be heard clearly and transmit speech information using amplitude modulation. Additionally, bone-conducted ultrasound (BCU) can be perceived even when the vibrator is presented to body parts distant from the head, such as the neck, arm, and trunk. To evaluate this previously presented BCU hearing, word intelligibility and monosyllable articulation tests were conducted in Japanese. The results suggested that a practical speech transmission, comparable to ordinary BCUs presented onto the head, can be obtained by distantly presented BCU.

Expectations of the timing and intensity of a stimulus propagate to the auditory periphery through the medial olivocochlear reflex.

Expectations concerning the timing of a stimulus enhance attention at the time at which the event occurs, which confers significant sensory and behavioral benefits. Herein, we show that temporal expectations modulate even the sensory transduction in the auditory periphery via the descending pathway. We measured the medial olivocochlear reflex (MOCR), a sound-activated efferent feedback that controls outer hair cell motility and optimizes the dynamic range of the sensory system. MOCR was noninvasively assessed using otoacoustic emissions. We found that the MOCR was enhanced by a visual cue presented at a fixed interval before a sound but was unaffected if the interval was changing between trials. The MOCR was also observed to be stronger when the learned timing expectation matched with the timing of the sound but remained unvaried when these two factors did not match. This implies that the MOCR can be voluntarily controlled in a stimulus- and goal-directed manner. Moreover, we found that the MOCR was enhanced by the expectation of a strong but not a weak, sound intensity. This asymmetrical enhancement could facilitate antimasking and noise protective effects without disrupting the detection of faint signals. Therefore, the descending pathway conveys temporal and intensity expectations to modulate auditory processing.

Assessment of the difference limens for frequency, monosyllable articulation and word intelligibility by distantly-presented bone-conducted ultrasound.

Ultrasound can be clearly perceived by bone-conduction, and this "bone-conducted ultrasound (BCU)" can transmit speech information by using amplitude modulation (AM). Further, BCU can be perceived not only on the head but also on the distal parts of the body like the neck, trunk and arms. This "distantly-presented BCU" can be applied to the novel interface that can transmit sound information selectively to specific users who touches the vibrator. However, the ability to transmit sound information of distantly-presented BCU is unclear. First, to assess frequency discrimination ability, difference limens for frequency (DLFs) of the distantly-presented AM-BCU were measured with/without a low-pass masking noise that masked the self-demodulated components generated by the nonlinearity of biological tissues. DLFs comparable to that of air-conducted sounds were observed, whereas DLFs significantly increased above 1 kHz under the masking condition. These results suggest that practical frequency discrimination ability can be obtained even when BCUs were presented to distal body parts. Additionally, it is indicated that the demodulated components may contribute to transmitting frequency information above 1 kHz. Second, monosyllable articulation and word intelligibility tests were conducted in Japanese. The intelligibility and articulation at the neck were 55% and 38% respectively, whereas they decreased as the stimulus placement gets farther from the head. The results suggest the distantly-presented BCU device can be applied to transmission of speech information.

Effect of interlateral time and intensity differences of distantly-presented bone-conducted ultrasound on lateralization.

Bone-conducted ultrasound (BCU) is perceived even by the profoundly sensorineural deaf and has been applied to the development of a novel hearing aid. In the BCU hearing aid, the vibrator is pressed onto the mastoid process of the temporal bone (the osseous bulge behind the ear). However, BCU can be heard on distal parts of the body; e.g., the muscle of the neck, the clavicle and the upper limbs. Some studies have been carried out to develop other BCU hearing devices using this "distant presentation". However, the possibility of the localization of distantly-presented BCU has not been verified. In this study, we investigated whether listeners could use the interaural time differences (ITDs) and intensity differences (IIDs) as cues for lateralization (left/right discrimination) of distantly-presented BCU. The results showed that lateralization based on ITDs and IIDs is possible to some extent, even for the distant presentation, whereas lateralization become difficult as the stimulus placement gets further from the head. Lateralization based on IIDs was more accurate than that based on ITDs. IIDs seem to give more effective cues than ITDs in the lateralization of BCU.

Relationship between cochlear mechanics and speech-in-noise reception performance.

Some normal-hearing listeners report difficulties in speech perception in noisy environments, and the cause is not well understood. The present study explores the correlation between speech-in-noise reception performance and cochlear mechanical characteristics, which were evaluated using a principal component analysis of the otoacoustic emission (OAE) spectra. A principal component, specifically a characteristic dip at around 2-2.5 kHz in OAE spectra, correlated with speech reception thresholds in noise but not in quiet. The results suggest that subclinical cochlear dysfunction specifically contributes to difficulties in speech perception in noisy environments, which is possibly a new form of "hidden hearing deficits."

Temporal window of integration estimated by omission in bone-conducted ultrasound.

Bone-conducted ultrasound (BCU) can be heard for both normal-hearing and some profoundly deaf individuals. Moreover, amplitude-modulated BCU can transmit the speech signal. These characteristics of BCU provide the possibility of the developing a bone-conducted ultrasonic hearing aid. Previous studies on the perception mechanism of speech-modulated BCU have pointed to the importance of temporal rather than frequency information. In order to elucidate the perception of speech-modulated BCU, further investigation is need concerning the processing of temporal information. The temporal processing of air-conducted audible sounds (ACASs) involves the integration of closely presented sounds into a single information unit. The long-temporal window of integration was estimated approximately 150-200 ms, which contribute to the discrimination of speech sound. The present study investigated the long-temporal integration system for BCU evaluated by stimulus omission using magnetoencephalography. Eight participants with normal hearing took part in this study. Ultrasonic tone burst with the duration of 50 ms and frequency of 30 kHz was used as the standard stimulus and presented with steady onset-to-onset times or stimulus-onset asynchronies (SOAs). In each sequence, the duration of the SOAs were set to 100, 125, 150, 175, 200, or 350 ms. For deviant, tones were randomly omitted from the stimulus train. Definite mismatch fields were elicited by sound omission in the stimulus train with an SOA of 100-150 ms, but weren't with an SOA of 200 and 350 ms for all participants. We found that stimulus train for BCUs can be integrated within a temporal window of integration with an SOA of 100-150 ms, but are regarded as a separate event when the SOA is 200 or 350 ms in duration. Therefore, we demonstrated that the long-temporal window of integration for BCUs estimated by omission was 150-200 ms, which was similar to that for ACAS (Yabe et al. NeuroReport 8 (1997) 1971-1974 and Psychophysiology. 35 (1998) 615-619). These findings contribute to the elucidation and improvement of the perception of speech-modulated BCU.

Assessments of basic properties of distal-presented bone-conducted ultrasonic hearing.

Bone-conducted ultrasound (BCU) is perceived even by the profoundly sensorineural deaf and a novel hearing aid using the perception of amplitude-modulated BCU (BCU hearing aid) has been developed. In the BCU hearing aid, the vibrator is pressed onto a part of the cranial bone behind the ear (mastoid process). However, BCU can be heard on distal parts of the body; i. e., the muscle of the neck, the clavicle, and the upper limb. In this study, to assess basic properties of such distal-presented BCU hearing, hearing thresholds were measured when 30-kHz tone bursts were presented to the neck and the upper and lower arms in normal hearing participants. Further, to assess the basic capability of transferring information by the distal-presented BCU hearing, temporal modulation transfer functions (TMTFs), that reflect the temporal resolution of the hearing, were estimated for 30-kHz carrier. The results showed that BCUs presented to the distal parts, including the lower arm, can be perceived at least in the normal hearing, whereas threshold increased depending on the distance from the head. Also, the temporal resolutions of the distal-presented BCU hearing at the neck, and the upper and lower arms were comparable to that of the mastoid process of the temporal bone. These results provide useful information not only for the improvement of the existing BCU hearing aid, but also for the development of novel distal-presented BCU devices that can provide sound information selectively to the specific person who touches the device by the arms or so.

Spatiotemporal properties of magnetic fields induced by auditory speech sound imagery and perception.

Brain computer interface (BCI) technologies, which enable direct communication between the brain and external devices, have been developed. BCI technology can be utilized in neural prosthetics to restore impaired movement, including speech production. However, most of the BCI systems that have been developed are the "P300-speller" type, which can only detect objects that users direct his/her attention at. To develop more versatile BCI systems that can detect a user's intention or thoughts, the brain responses associated with verbal imagery need to be clarified. In this study, the brain magnetic fields associated with auditory verbal imagery and speech hearing were recorded using magnetoencephalography (MEG) carried out on 8 healthy adults. Although the magnetic fields lagged slightly and were long-lasting, significant deflections were observed even for verbal imagery, in the temporal regions, as well as for actual speech hearing. Also, sources for the deflections were localized in the association auditory cortices. Cross-correlations were calculated between envelopes of the imagined/presented speech sound and the evoked brain responses in the temporal areas. Measurable correlations were obtained for the presented speech sound; however, no significant correlations were observed for the imagined speech sound. These results indicate that auditory verbal imagery undoubtedly activates the auditory cortex, at least, and generates some observable neural responses.

Effects of light wavelength on MEG ERD/ERS during a working memory task.

We investigated the effects of light wavelengths on cortical oscillatory activity associated with working memory processes. Cortical activity responses were measured using magnetoencephalography (MEG) while participants performed an auditory Sternberg memory task during exposure to light of different wavelength. Each trial of the memory task consisted of four words presented as a memory set and one word presented as a probe. All words were presented audibly. Participants were instructed to indicate whether the probe word was or was not presented within the memory set. A total of 90 trials were conducted under the light exposure. Event-related synchronization (ERS) and event-related desynchronization responses in the alpha frequency range during the task were analyzed. Results showed that, during memory encoding, ERS responses were significantly greater in the short-wavelength (blue) light condition than in the middle-wavelength (green) light condition, approximately 20-30min after the onset of light exposure. Behavioral performance was very high throughout the experiment and there was no difference between the light conditions. Although the light effects were not observed in behavior, the result of ERS suggests that 20-30min of exposure to blue light enhances cortical activity related to active memory maintenance and/or attention to auditory stimuli.

Frequency characteristics of neuromagnetic auditory steady-state responses to sinusoidally amplitude-modulated sweep tones.

OBJECTIVE: This study aimed to capture the neuronal frequency characteristics, as indexed by the auditory steady-state response (ASSR), relative to physical characteristics of constant sound pressure levels (SPLs). Relationship with perceptual characteristics (loudness model) was also examined. METHODS: Neuromagnetic 40-Hz ASSR was recorded in response to sinusoidally amplitude-modulated sweep tones with carrier frequency covering the frequency range of 0.1-12.5kHz. Sound intensity was equalized at 50-, 60-, and 70-dB SPL with an accuracy of ±0.5-dB SPL at the phasic peak of the modulation frequency. Corresponding loudness characteristics were modeled by substituting the detected individual hearing thresholds into a standard formula (ISO226:2003(E)). RESULTS: The strength of the ASSR component was maximum at 0.5kHz, and it decreased linearly on logarithmic scale toward lower and higher frequencies. Loudness model was plateaued between 0.5 and 4kHz. CONCLUSIONS: Frequency characteristics of the ASSR were not equivalent to those of SPL and loudness model. Factors other than physical and perceptual frequency characteristics may contribute to characterizing the ASSR. SIGNIFICANCE: The results contribute to the discussion of the most efficient signal summation for the generation of the ASSR at 0.5kHz and efficient neuronal processing at higher frequencies, which require less energy to retain equal perception.

Evaluation of prosodic and segmental change in speech-modulated bone-conducted ultrasound by mismatch fields.

Speech-modulated bone-conducted ultrasound (BCU) can transmit speech sounds for some profoundly deaf individuals. Hearing aids using BCU are considered to be a novel hearing system for such individuals. In our previous study, the speech discrimination for speech-modulated BCU was objectively confirmed using a magnetoencephalography. Moreover, in our previous behavioral study, prosodic information for speech-modulated BCU could also be discriminated in the normal hearing. However, the prosodic discrimination for speech-modulated BCU has not objectively been studied. In order to evaluate the prosodic discrimination for speech-modulated BCU, mismatch fields (MMFs) elicited by prosodic and segmental change were measured for speech-modulated BCU and air-conducted speech. Ten Japanese participants with normal hearing took part in this study. Stimuli re-synthesized from the speech of a native Japanese female adult were used. Standard stimulus was /itta/ with a flat pitch pattern, and two deviant stimuli were /itta?/ with a rising pitch pattern and /itte/ with a flat pitch pattern. All and nine participants elicited the prominent MMF elicited by the prosodic and segmental change for the speech-modulated BCU, respectively. The moment of MMF components for speech-modulated BCU was significantly smaller than those for air-conducted speech, while no difference in the MMF latency elicited by the prosodic and segmental change were observed between both stimulus conditions. Comparing the MMFs elicited by prosodic and segmental change, no significant differences were observed for both stimulus conditions. Thus, it is suggested that the prosodic change can be discriminate to the same degree as segmental change even for speech-modulated BCU. However, discrimination capability for speech-modulated BCU is slightly inferior to that for air-conducted speech.

Transient acceleration response of a bone-conducted ultrasonic pulse in living human head.

Ultrasonic hearing through bone-conduction is referred to as bone-conducted ultrasound (BCU). Because the perceptual mechanisms of ultrasonic hearing are still unclear, it is necessary to approach the subject from various aspects to clarify such mechanisms; the propagation process of ultrasonic vibration in the head is one of them. To estimate propagation pathways and modes of BCU in living human head, we measured the transient acceleration responses for ultrasonic pulses. The acceleration responses were obtained at the left and right ears simultaneously for left-side, right-side and forehead excitations. Transient responses show that there are several transmission pathways or modes, and the dominant pathways of BCU were identified.

Auditory evoked responses in human auditory cortex to the variation of sound intensity in an ongoing tone.

In daily life, variations of sound intensity, frequency, and other auditory parameters, can be perceived as transitions from one sound to another. The neural mechanisms underlying the processing of intensity change are currently unclear. The present study sought to clarify the effects of frequency and initial sound pressure level (SPL) on the auditory evoked response elicited by sounds of different SPL. We examined responses approximately 100 ms after an SPL change (the N1m'). Experiment 1 examined the effects of frequency on the N1m'. Experiment 2 examined the effects of initial SPL on the N1m'. The results revealed that N1m' amplitude increased with greater SPL changes. The increase in N1m' amplitude with increasing SPL was almost constant for low frequency sounds (250 and 1000 Hz); however, this increase was reduced for high frequency sounds (4000 Hz). The increase in N1m' amplitude was reduced with high initial SPL. The pattern of amplitude change may reflect a difference in activation in the auditory nerve and/or primary auditory cortex.

Modulation detection for amplitude-modulated bone-conducted sounds with sinusoidal carriers in the high- and ultrasonic-frequency range.

Ultrasonic vibration generates a sensation of sound via bone-conduction. This phenomenon is called bone-conducted ultrasonic (BCU) hearing. Complex sounds can also be perceived by amplitude-modulating a BCU stimulus (AM-BCU). The influence of the modulation frequency on the sensitivity to detecting amplitude modulation of sinusoidal carriers of 10, 20, and 30 kHz was examined to clarify the characteristics of the perception of amplitude modulation over the sonic or audio-frequency range and the ultrasonic range. In addition, the detection sensitivity for single-sideband modulation for a 20 kHz carrier was measured. Temporal modulation transfer functions (TMTFs) obtained at each carrier frequency suggest that the auditory system has the ability to process timing information in the envelopes of AM-BCUs at lower modulation frequencies, as is the case with audio-frequency sounds. The possible influence of peripheral filtering on the shape of the TMTF at higher frequencies was examined.

Temporal integration affects intensity change detection in human auditory cortex.

The aim of this paper was to clarify the effects of temporal integration on the auditory evoked response elicited by sounds of varying intensity. We measured auditory evoked fields in response to tones with different intervals of intensity change. The amplitude of the N1m', occurring approximately 100 ms after the intensity change, remained constant when the interval was longer than 250 ms. The recovery function we observed suggests that the neural populations underlying the N1m' are close to those underlying the late anterior N1m component. The N1m' amplitude decreased with decreasing intervals of intensity change at intervals less than 250 ms. This finding supports the notion that a disinhibitory process is caused by the offset of the sound.

N1m amplitude growth function for bone-conducted ultrasound.

CONCLUSION: N1m growth indicates the differences in central auditory processing between bone-conducted ultrasound and air-conducted audible sound. OBJECTIVES: Bone conduction enables ultrasound to be heard by the human ear. Despite many studies, the perceptual mechanism of bone-conducted ultrasound has not yet been clarified completely. Therefore, this study investigated the ultrasonic perception of humans, especially as regards the effects of stimulus intensity or loudness. SUBJECTS AND METHODS: The effect of the stimulus level on N1m amplitude was measured over the psycho-acoustical dynamic range. RESULTS: The dynamic range for 30 kHz bone-conducted ultrasound (18.2 +/- 3.3 dB) was found to be significantly narrower than that for 1 kHz air-conducted sound (85.9 +/- 11.9 dB). As the stimulus level increased, the N1m amplitude in response to bone-conducted ultrasound grew faster than that to air-conducted sound. Although the growth of the N1m amplitude for air-conducted sound saturated below the uncomfortable loudness level (UCL), that for bone-conducted ultrasound continued to grow above the UCL.

Sound level-dependent growth of N1m amplitude with low and high-frequency tones.

The aim of this study was to determine whether the amplitude and/or latency of the N1m deflection of auditory-evoked magnetic fields are influenced by the level and frequency of sound. The results indicated that the amplitude of the N1m increased with sound level. The growth in amplitude with increasing sound level was almost constant with low frequencies (250-1000 Hz); however, this growth decreased with high frequencies (>2000 Hz). The behavior of the amplitude may reflect a difference in the increase in the activation of the peripheral and/or central auditory systems.

Effects of center frequency on binaural auditory filter bandwidth in the human brain.

Effects of center frequency on the binaural auditory filter in the human auditory cortex were examined using auditory-evoked magnetic fields. Two tones with different frequency separations, which were presented dichotically to the left and right ears, were used as the sound stimuli. Eight normal-hearing participants took part in the study. The amplitudes of the N1m components of auditory-evoked magnetic fields were approximately constant when the frequency separation was less than 10-20% of the center frequency; however, the N1m amplitudes increased with increasing frequency separation when the frequency separation was greater than 10-20% of the center frequency. This indicates that binaural auditory filter bandwidth is approximately 10-20% of the center frequency.

Assessment of ability to discriminate frequency of bone-conducted ultrasound by mismatch fields.

According to previous studies, ultrasound can be perceived through bone conduction and ultrasound amplitude modulated by different speech sounds can be discriminated by some profoundly deaf subjects as well as the normal-hearing. These findings suggest the usefulness of development of a bone-conducted ultrasonic hearing aid (BCUHA) for profoundly deaf subjects. In this study, with a view to developing a frequency modulation system in a BCUHA, the capability to discriminate the frequency of sinusoidal bone-conducted ultrasound (BCU) was evaluated by measuring mismatch fields (MMF). We compared MMFs between BCU (standard stimuli were 30 kHz, and deviant stimuli were 27 and 33 kHz) and air-conducted audible sound (ACAS; standard stimuli were 1 kHz, and deviant stimuli were 900 and 1100 Hz). MMFs were observed in all subjects for ACAS, however, not observed in a few subjects for BCU. Further, the mean peak amplitudes of MMF for BCU were significantly less than those for ACAS. These findings indicate that the discrimination capability of frequency of sinusoidal BCU is inferior to that of ACAS. It was also demonstrated that normal hearing could to some extent discriminate differences in frequency in sinusoidal BCU. The results indicate a possibility of transmission system for language information making use of frequency discrimination.