A longitudinal study of auditory evoked field and language development in young children.

The relationship between language development in early childhood and the maturation of brain functions related to the human voice remains unclear. Because the development of the auditory system likely correlates with language development in young children, we investigated the relationship between the auditory evoked field (AEF) and language development using non-invasive child-customized magnetoencephalography (MEG) in a longitudinal design. Twenty typically developing children were recruited (aged 36-75 months old at the first measurement). These children were re-investigated 11-25 months after the first measurement. The AEF component P1m was examined to investigate the developmental changes in each participant's neural brain response to vocal stimuli. In addition, we examined the relationships between brain responses and language performance. P1m peak amplitude in response to vocal stimuli significantly increased in both hemispheres in the second measurement compared to the first measurement. However, no differences were observed in P1m latency. Notably, our results reveal that children with greater increases in P1m amplitude in the left hemisphere performed better on linguistic tests. Thus, our results indicate that P1m evoked by vocal stimuli is a neurophysiological marker for language development in young children. Additionally, MEG is a technique that can be used to investigate the maturation of the auditory cortex based on auditory evoked fields in young children. This study is the first to demonstrate a significant relationship between the development of the auditory processing system and the development of language abilities in young children.

Lateralized theta wave connectivity and language performance in 2- to 5-year-old children.

Recent neuroimaging studies support the view that a left-lateralized brain network is crucial for language development in children. However, no previous studies have demonstrated a clear link between lateralized brain functional network and language performance in preschool children. Magnetoencephalography (MEG) is a noninvasive brain imaging technique and is a practical neuroimaging method for use in young children. MEG produces a reference-free signal, and is therefore an ideal tool to compute coherence between two distant cortical rhythms. In the present study, using a custom child-sized MEG system, we investigated brain networks while 78 right-handed preschool human children (32-64 months; 96% were 3-4 years old) listened to stories with moving images. The results indicated that left dominance of parietotemporal coherence in theta band activity (6-8 Hz) was specifically correlated with higher performance of language-related tasks, whereas this laterality was not correlated with nonverbal cognitive performance, chronological age, or head circumference. Power analyses did not reveal any specific frequencies that contributed to higher language performance. Our results suggest that it is not the left dominance in theta oscillation per se, but the left-dominant phase-locked connectivity via theta oscillation that contributes to the development of language ability in young children.

Language performance and auditory evoked fields in 2- to 5-year-old children.

Language development progresses at a dramatic rate in preschool children. As rapid temporal processing of speech signals is important in daily colloquial environments, we performed magnetoencephalography (MEG) to investigate the linkage between speech-evoked responses during rapid-rate stimulus presentation (interstimulus interval < 1 s) and language performance in 2- to 5-year-old children (n = 59). Our results indicated that syllables with this short stimulus interval evoked detectable P50m, but not N100m, in most participants, indicating a marked influence of longer neuronal refractory period for stimulation. The results of equivalent dipole estimation showed that the intensity of the P50m component in the left hemisphere was positively correlated with language performance (conceptual inference ability). The observed positive correlations were suggested to reflect the maturation of synaptic organisation or axonal maturation and myelination underlying the acquisition of linguistic abilities. The present study is among the first to use MEG to study brain maturation pertaining to language abilities in preschool children.

Roles of temporal proximity between sound edges in the perceptual organization of veridical and illusory auditory events.

The gap transfer illusion is an auditory illusion in which a temporal gap in a long glide is perceived as if it had transferred to a physically continuous shorter glide. The illusion typically occurs when the long and the shorter glide cross each other at their temporal midpoints, where the long glide is physically divided by the gap. The occurrence of the gap transfer illusion was investigated in stimuli in which the duration and the slope of the long glide were 5000 ms and ∼0.8 oct/s. The shorter glide was given different frequency ranges and different temporal ranges, and thus its time-frequency slope was also varied. The overlap configuration of these crossing glides was varied as well. As control stimuli, we used stimuli in which a continuous long glide crossed a shorter glide with a gap, i.e., the opposite configuration of the gap-transfer stimuli as above, as well as stimuli in which both crossing glides were continuous. The perception of two crossing tones tended to be facilitated when the glides differed in duration and/or slope. When the glides were relatively similar in duration and slope, however, bouncing percepts appeared more often. Similarity between the crossing tones thus promoted auditory bouncing, while dissimilarity between them facilitated the crossing percept. If the crossing percept dominated in gap-transfer stimuli, the gap transfer illusion took place in a typical manner, but the illusory transfer of the gap could occur even when the crossing percept was not dominant. When the shorter glide was as short as 500 ms, the crossing percept and the gap transfer illusion were robust. The mechanism of the illusion was examined in terms of factors that can influence the perceptual integration of auditory stimulus edges, i.e., onsets and offsets, of physically different sounds. Much like the perceptual construction of speech units, we suggest that the auditory system utilizes a rough time window of several hundreds of milliseconds to construct an initial skeleton percept of auditory events. The present data indicated the importance of the temporal proximity, rather than the frequency proximity, between sound edges in the illusory tone construction.

The common limitations in auditory temporal processing for Mandarin Chinese and Japanese.

The present investigation focused on how temporal degradation affected intelligibility in two types of languages, i.e., a tonal language (Mandarin Chinese) and a non-tonal language (Japanese). The temporal resolution of common daily-life sentences spoken by native speakers was systematically degraded with mosaicking (mosaicising), in which the power of original speech in each of regularly spaced time-frequency unit was averaged and temporal fine structure was removed. The results showed very similar patterns of variations in intelligibility for these two languages over a wide range of temporal resolution, implying that temporal degradation crucially affected speech cues other than tonal cues in degraded speech without temporal fine structure. Specifically, the intelligibility of both languages maintained a ceiling up to about the 40-ms segment duration, then the performance gradually declined with increasing segment duration, and reached a floor at about the 150-ms segment duration or longer. The same limitations for the ceiling performance up to 40 ms appeared for the other method of degradation, i.e., local time-reversal, implying that a common temporal processing mechanism was related to the limitations. The general tendency fitted to a dual time-window model of speech processing, in which a short (~ 20-30 ms) and a long (~ 200 ms) time-window run in parallel.

How Pause Duration Influences Impressions of English Speech: Comparison Between Native and Non-native Speakers.

The purpose of this study was to investigate how the subjective impression of English speech would change when pause duration at punctuation marks was varied. Two listening experiments were performed in which written English speech segments were rated on a variety of evaluation items by both native-English speakers and non-native speakers (native-Chinese speakers and native-Japanese speakers). The ratings were then subjected to factor analysis. In the first experiment, the pauses in three segments were made into the same durations, from 0.075 to 4.8 s. Participants rated the segments on 23 evaluation items on a rating scale from 1 to 10. A varimax rotation after PCA (principal component analysis) led to two factors that were related to speech style. These two factors could be interpreted as representing speech naturalness and speech rate. Speech segments with a pause duration of 0.6 s received the highest naturalness evaluation, while perceived speech rate decreased as the physical pause duration increased, without any changes in utterance segments. In the second experiment, a full-factorial design of pause durations (0.15, 0.3, 0.6, 1.2, and 2.4 s) within and between sentences, i.e., for commas and for periods, was implemented in two speech segments. The original speech segments and speech segments without any pauses were also included as control conditions. From ratings on 12 evaluation items, similar to Experiment 1, two factors representing speech naturalness and speech rate were obtained. The results showed again that the perceived speech rate decreased with an increase only in pause duration. As for speech naturalness, the highest evaluations occurred when pause durations were 0.6 s within sentences, and either 0.6 or 1.2 s between sentences. This recommends fixing all pause durations to 0.6 s as a practical way to train non-native speakers to make their spoken English appear more natural.

Perceived Congruency in Audiovisual Stimuli Consisting of Gabor Patches and AM and FM Tones.

Experiments that focus on how humans perceive temporal, spatial or synaesthetic congruency in audiovisual sensory information have often employed stimuli consisting of a Gabor patch and an amplitude (AM) or frequency (FM)-modulated sound. Introducing similarity between the static and dynamic features of the Gabor patch and the (carrier) frequency or modulation frequency of the sound is often assumed to be effective enough to induce congruency. However, comparative empirical data on perceived congruency of various stimulus parameters are not readily available, and in particular with respect to sound modulation, it is still not clear which type (AM or FM) induces perceived congruency best in tandem with various patch parameters. In two experiments, we examined Gabor patches of various spatial frequencies with flickering (2, 3 and 4 flickers/s) or drifting (0.5, 1.0 and 1.5 degrees/s) gratings in combinations with AM or FM tones of 2-, 3- and 4-Hz modulation and 500-, 1000- and 2000-Hz carrier frequencies. Perceived congruency ratings were obtained by asking participants to rate stimulus (in)congruency from 1 (incongruent) to 7 (congruent). The data showed that varying the spatial frequency of the Gabor patch and the carrier frequency of the modulated tone had comparatively little impact on perceived congruency. Similar to previous findings, similarity between the temporal frequency of the Gabor patch and the modulated tone effectively promoted perceived congruency. Furthermore, direct comparisons convincingly showed that AM tones in combination with flickering Gabor patches received significantly higher audiovisual congruency ratings compared to FM tones.

Differences in Three Vection Indices (Latency, Duration, and Magnitude) Induced by "Camera-Moving" and "Object-Moving" in a Virtual Computer Graphics World, Despite Similarity in the Retinal Images.

To create a self-motion (vection) situation in three-dimensional computer graphics (CG), there are mainly two ways: moving a camera toward an object ("camera moving") or by moving the object and its surrounding environment toward the camera ("object moving"). As both methods vary considerably in the amount of computer calculations involved in generating CG, knowing how each method affects self-motion perception should be important to CG-creators and psychologists. Here, we simulated self-motion in a virtual three-dimensional CG-world, without stereoscopic disparity, which correctly reflected the lighting and glare. Self-motion was induced by "camera moving" or by "object moving," which in the present experiments was done by moving a tunnel surrounding the camera toward the camera. This produced two retinal images that were virtually identical in Experiment 1 and very similar in Experiments 2 and 3. The stimuli were presented on a large plasma display to 15 naive participants and induced substantial vection. Three experiments comparing vection strength between the two methods found weak but significant differences. The results suggest that when creating CG visual experiences, "camera-moving" induces stronger vection.

Frequency modulation facilitates (modal) auditory restoration of a gap.

In this study we further investigated processes of auditory restoration (AR) in recently described stimulus types: the so-called gap-transfer stimulus, the shared-gap stimulus and the pseudo-continuous stimulus. The stimuli typically consist of two crossing sounds of unequal duration. In the shared-gap and pseudo-continuous stimuli, the two crossing sounds share a gap (<45 ms) at their crossing point. In the gap-transfer stimulus, only the long sound contains a gap (100 ms), whereas the short sound is physically continuous. Earlier research has shown that in these stimuli the long sound is subject to AR, in spite of the gap it contains, whereas the gap is perceived in the short sound. Experiment 1 of the present study showed that AR of the stimuli's long sound was facilitated when its slope increased from 0 to 1 oct/s. Experiment 2 showed that the effect of slope on AR of the long sound also occurred when the slope relationship between the long and short sound was fixed. Implications for a tentative sound edge-binding explanation of AR as well as alternative explanations for the effect of slope on AR are discussed.

Streaming, Bouncing, and Rotation: The Polka Dance Stimulus.

When the objects in a typical stream-bounce stimulus are made to rotate on a circular trajectory, not two but four percepts can be observed: streaming, bouncing, clockwise rotation, and counterclockwise rotation, often with spontaneous reversals between them. When streaming or bouncing is perceived, the objects seem to move on individual, opposite trajectories. When rotation is perceived, however, the objects seem to move in unison on the same circular trajectory, as if constituting the edges of a virtual pane that pivots around its axis. We called this stimulus the Polka Dance stimulus. Experiments showed that with some viewing experience, the viewer can "hold" the rotation percepts. Yet even when doing so, a short sound at the objects' point of coincidence can induce a bouncing percept. Besides this fast percept switching from rotation to bouncing, an external stimulus might also induce slower rotation direction switches, from clockwise to counterclockwise, or vice versa.

Temporal Resolution Needed for Auditory Communication: Measurement With Mosaic Speech.

Temporal resolution needed for Japanese speech communication was measured. A new experimental paradigm that can reflect the spectro-temporal resolution necessary for healthy listeners to perceive speech is introduced. As a first step, we report listeners' intelligibility scores of Japanese speech with a systematically degraded temporal resolution, so-called "mosaic speech": speech mosaicized in the coordinates of time and frequency. The results of two experiments show that mosaic speech cut into short static segments was almost perfectly intelligible with a temporal resolution of 40 ms or finer. Intelligibility dropped for a temporal resolution of 80 ms, but was still around 50%-correct level. The data are in line with previous results showing that speech signals separated into short temporal segments of <100 ms can be remarkably robust in terms of linguistic-content perception against drastic manipulations in each segment, such as partial signal omission or temporal reversal. The human perceptual system thus can extract meaning from unexpectedly rough temporal information in speech. The process resembles that of the visual system stringing together static movie frames of ~40 ms into vivid motion.

Perceptual completion in a dynamic scene: an investigation with an ambiguous motion paradigm.

In this study we employed the streaming-bouncing stimulus to investigate aspects of dynamic occlusion, e.g., of objects that temporarily move under occlusion while covertly being tracked. Two occluders, both either luminance-defined or invisible (virtual), were placed on the trajectories of the moving objects in the streaming-bouncing stimulus. We found that the bouncing percept was dominant when the objects moved under luminance-defined occluders but not when they moved under virtual occluders. Perceived motion direction thus varied with occluder visibility. The results seem to suggest that perceptual completion of a moving object interferes with constant motion processing of the same object.

Altered human voice processing in the frontal cortex and a developmental language delay in 3- to 5-year-old children with autism spectrum disorder.

The inferior frontal and superior temporal areas in the left hemisphere are crucial for human language processing. In the present study, we investigated the magnetic mismatch field (MMF) evoked by voice stimuli in 3- to 5-year-old typically developing (TD) children and children with autism spectrum disorder (ASD) using child-customized magnetoencephalography (MEG). The children with ASD exhibited significantly decreased activation in the left superior temporal gyrus compared with the TD children for the MMF amplitude. If we classified the children with ASD according to the presence of a speech onset delay (ASD - SOD and ASD - NoSOD, respectively) and compared them with the TD children, both ASD groups exhibited decreased activation in the left superior temporal gyrus compared with the TD children. In contrast, the ASD - SOD group exhibited increased activity in the left frontal cortex (i.e., pars orbitalis) compared with the other groups. For all children with ASD, there was a significant negative correlation between the MMF amplitude in the left pars orbitalis and language performance. This investigation is the first to show a significant difference in two distinct MMF regions in ASD - SOD children compared with TD children.

A Near-Infrared Spectroscopy Study on Cortical Hemodynamic Responses to Normal and Whispered Speech in 3- to 7-Year-Old Children.

Purpose: The purpose of this study was to assess cortical hemodynamic response patterns in 3- to 7-year-old children listening to two speech modes: normally vocalized and whispered speech. Understanding whispered speech requires processing of the relatively weak, noisy signal, as well as the cognitive ability to understand the speaker's reason for whispering. Method: Near-infrared spectroscopy (NIRS) was used to assess changes in cortical oxygenated hemoglobin from 16 typically developing children. Results: A profound difference in oxygenated hemoglobin levels between the speech modes was found over left ventral sensorimotor cortex. In particular, over areas that represent speech articulatory body parts and motion, such as the larynx, lips, and jaw, oxygenated hemoglobin was higher for whisper than for normal speech. The weaker stimulus, in terms of sound energy, thus induced the more profound hemodynamic response. This, moreover, occurred over areas involved in speech articulation, even though the children did not overtly articulate speech during measurements. Conclusion: Because whisper is a special form of communication not often used in daily life, we suggest that the hemodynamic response difference over left ventral sensorimotor cortex resulted from inner (covert) practice or imagination of the different articulatory actions necessary to produce whisper as opposed to normal speech.

Computational-Model-Based Analysis of Context Effects on Harmonic Expectancy.

Expectancy for an upcoming musical chord, harmonic expectancy, is supposedly based on automatic activation of tonal knowledge. Since previous studies implicitly relied on interpretations based on Western music theory, the underlying computational processes involved in harmonic expectancy and how it relates to tonality need further clarification. In particular, short chord sequences which cannot lead to unique keys are difficult to interpret in music theory. In this study, we examined effects of preceding chords on harmonic expectancy from a computational perspective, using stochastic modeling. We conducted a behavioral experiment, in which participants listened to short chord sequences and evaluated the subjective relatedness of the last chord to the preceding ones. Based on these judgments, we built stochastic models of the computational process underlying harmonic expectancy. Following this, we compared the explanatory power of the models. Our results imply that, even when listening to short chord sequences, internally constructed and updated tonal assumptions determine the expectancy of the upcoming chord.

Three Factors Are Critical in Order to Synthesize Intelligible Noise-Vocoded Japanese Speech.

Factor analysis (principal component analysis followed by varimax rotation) had shown that 3 common factors appear across 20 critical-band power fluctuations derived from spoken sentences of eight different languages [Ueda et al. (2010). Fechner Day 2010, Padua]. The present study investigated the contributions of such power-fluctuation factors to speech intelligibility. The method of factor analysis was modified to obtain factors suitable for resynthesizing speech sounds as 20-critical-band noise-vocoded speech. The resynthesized speech sounds were used for an intelligibility test. The modification of factor analysis ensured that the resynthesized speech sounds were not accompanied by a steady background noise caused by the data reduction procedure. Spoken sentences of British English, Japanese, and Mandarin Chinese were subjected to this modified analysis. Confirming the earlier analysis, indeed 3-4 factors were common to these languages. The number of power-fluctuation factors needed to make noise-vocoded speech intelligible was then examined. Critical-band power fluctuations of the Japanese spoken sentences were resynthesized from the obtained factors, resulting in noise-vocoded-speech stimuli, and the intelligibility of these speech stimuli was tested by 12 native Japanese speakers. Japanese mora (syllable-like phonological unit) identification performances were measured when the number of factors was 1-9. Statistically significant improvement in intelligibility was observed when the number of factors was increased stepwise up to 6. The 12 listeners identified 92.1% of the morae correctly on average in the 6-factor condition. The intelligibility improved sharply when the number of factors changed from 2 to 3. In this step, the cumulative contribution ratio of factors improved only by 10.6%, from 37.3 to 47.9%, but the average mora identification leaped from 6.9 to 69.2%. The results indicated that, if the number of factors is 3 or more, elementary linguistic information is preserved in such noise-vocoded speech.

Atypical development of the central auditory system in young children with Autism spectrum disorder.

The P1m component of the auditory evoked magnetic field is the earliest cortical response associated with language acquisition. However, the growth curve of the P1m component is unknown in both typically developing (TD) and atypically developing children. The aim of this study is to clarify the developmental pattern of this component when evoked by binaural human voice stimulation using child-customized magnetoencephalography. A total of 35 young TD children (32-121 months of age) and 35 children with autism spectrum disorder (ASD) (38-111 months of age) participated in this study. This is the first report to demonstrate an inverted U-shaped growth curve for the P1m dipole intensity in the left hemisphere in TD children. In addition, our results revealed a more diversified age-related distribution of auditory brain responses in 3- to 9-year-old children with ASD. These results demonstrate the diversified growth curve of the P1m component in ASD during young childhood, which is a crucial period for first language acquisition. Autism Res 2016, 9: 1216-1226. © 2016 International Society for Autism Research, Wiley Periodicals, Inc.

Synchrony of auditory brain responses predicts behavioral ability to keep still in children with autism spectrum disorder: Auditory-evoked response in children with autism spectrum disorder.

The auditory-evoked P1m, recorded by magnetoencephalography, reflects a central auditory processing ability in human children. One recent study revealed that asynchrony of P1m between the right and left hemispheres reflected a central auditory processing disorder (i.e., attention deficit hyperactivity disorder, ADHD) in children. However, to date, the relationship between auditory P1m right-left hemispheric synchronization and the comorbidity of hyperactivity in children with autism spectrum disorder (ASD) is unknown. In this study, based on a previous report of an asynchrony of P1m in children with ADHD, to clarify whether the P1m right-left hemispheric synchronization is related to the symptom of hyperactivity in children with ASD, we investigated the relationship between voice-evoked P1m right-left hemispheric synchronization and hyperactivity in children with ASD. In addition to synchronization, we investigated the right-left hemispheric lateralization. Our findings failed to demonstrate significant differences in these values between ASD children with and without the symptom of hyperactivity, which was evaluated using the Autism Diagnostic Observational Schedule, Generic (ADOS-G) subscale. However, there was a significant correlation between the degrees of hemispheric synchronization and the ability to keep still during 12-minute MEG recording periods. Our results also suggested that asynchrony in the bilateral brain auditory processing system is associated with ADHD-like symptoms in children with ASD.

The perceptual integration of auditory stimulus edges: an illusory short tone in stimulus patterns consisting of two partly overlapping glides.

Two partly overlapping frequency glides can be perceived as consisting of a long pitch trajectory accompanied by a short tone in the temporal middle. It was found that the appearance of this middle tone could not be related to peripheral processes concerned with spectral splatter or combination tones that could have emerged during the overlap of the glides. Furthermore, it was found that the middle tone was perceived even when components of the 2 glides were separated by more than an equivalent rectangular bandwidth at any time during the overlap. The appearance of the middle tone indicates that auditory events can result from the perceptual integration of component parts-that is, stimulus edges-of acoustically different sounds.

Somatosensory evoked field in response to visuotactile stimulation in 3- to 4-year-old children.

A child-customized magnetoencephalography system was used to investigate somatosensory evoked field (SEF) in 3- to 4-year-old children. Three stimulus conditions were used in which the children received tactile-only stimulation to their left index finger or visuotactile stimulation. In the two visuotactile conditions, the children received tactile stimulation to their finger while they watched a video of tactile stimulation applied either to someone else's finger (the finger-touch condition) or to someone else's toe (the toe-touch condition). The latencies and source strengths of equivalent current dipoles (ECDs) over contralateral (right) somatosensory cortex were analyzed. In the preschoolers who provided valid ECDs, the stimulus conditions induced an early-latency ECD occurring between 60 and 68 ms mainly with an anterior direction. We further identified a middle-latency ECD between 97 and 104 ms, which predominantly had a posterior direction. Finally, initial evidence was found for a late-latency ECD at about 139-151 ms again more often with an anterior direction. Differences were found in the source strengths of the middle-latency ECDs among the stimulus conditions. For the paired comparisons that could be formed, ECD source strength was more pronounced in the finger-touch condition than in the tactile-only and the toe-touch conditions. Although more research is necessary to expand the data set, this suggests that visual information modulated preschool SEF. The finding that ECD source strength was higher when seen and felt touch occurred to the same body part, as compared to a different body part, might further indicate that connectivity between visual and tactile information is indexed in preschool somatosensory cortical activity, already in a somatotopic way.