Neural speech tracking shifts from the syllabic to the modulation rate of speech as intelligibility decreases.

The most prominent acoustic features in speech are intensity modulations, represented by the amplitude envelope of speech. Synchronization of neural activity with these modulations supports speech comprehension. As the acoustic modulation of speech is related to the production of syllables, investigations of neural speech tracking commonly do not distinguish between lower-level acoustic (envelope modulation) and higher-level linguistic (syllable rate) information. Here we manipulated speech intelligibility using noise-vocoded speech and investigated the spectral dynamics of neural speech processing, across two studies at cortical and subcortical levels of the auditory hierarchy, using magnetoencephalography. Overall, cortical regions mostly track the syllable rate, whereas subcortical regions track the acoustic envelope. Furthermore, with less intelligible speech, tracking of the modulation rate becomes more dominant. Our study highlights the importance of distinguishing between envelope modulation and syllable rate and provides novel possibilities to better understand differences between auditory processing and speech/language processing disorders.

A Visual Cortical Network for Deriving Phonological Information from Intelligible Lip Movements.

Successful lip-reading requires a mapping from visual to phonological information [1]. Recently, visual and motor cortices have been implicated in tracking lip movements (e.g., [2]). It remains unclear, however, whether visuo-phonological mapping occurs already at the level of the visual cortex-that is, whether this structure tracks the acoustic signal in a functionally relevant manner. To elucidate this, we investigated how the cortex tracks (i.e., entrains to) absent acoustic speech signals carried by silent lip movements. Crucially, we contrasted the entrainment to unheard forward (intelligible) and backward (unintelligible) acoustic speech. We observed that the visual cortex exhibited stronger entrainment to the unheard forward acoustic speech envelope compared to the unheard backward acoustic speech envelope. Supporting the notion of a visuo-phonological mapping process, this forward-backward difference of occipital entrainment was not present for actually observed lip movements. Importantly, the respective occipital region received more top-down input, especially from left premotor, primary motor, and somatosensory regions and, to a lesser extent, also from posterior temporal cortex. Strikingly, across participants, the extent of top-down modulation of the visual cortex stemming from these regions partially correlated with the strength of entrainment to absent acoustic forward speech envelope, but not to present forward lip movements. Our findings demonstrate that a distributed cortical network, including key dorsal stream auditory regions [3-5], influences how the visual cortex shows sensitivity to the intelligibility of speech while tracking silent lip movements.

What it means to be Zen: marked modulations of local and interareal synchronization during open monitoring meditation.

Experienced meditators are able to voluntarily modulate their state of consciousness and attention. In the present study, we took advantage of this ability and studied brain activity related to the shift of mental state. Electrophysiological activity, i.e. EEG, was recorded from 11 subjects with varying degrees of meditation experience during Zen meditation (a form of open monitoring meditation) and during non-meditation rest. On a behavioral level, mindfulness scores were assessed using the Mindfulness Attention and Awareness Scale (MAAS). Analysis of EEG source power revealed the so far unreported finding that MAAS scores significantly correlated with gamma power (30-250Hz), particularly high-frequency gamma (100-245Hz), during meditation. High levels of mindfulness were related to increased high-frequency gamma, for example, in the cingulate cortex and somatosensory cortices. Further, we analyzed the relationship between connectivity during meditation and self-reported mindfulness (MAAS). We found a correlation between graph measures in the 160-170Hz range and MAAS scores. Higher levels of mindfulness were related to lower small worldedness as well as global and local clustering in paracentral, insular, and thalamic regions during meditation. In sum, the present study shows significant relationships of mindfulness and brain activity during meditation indicated by measures of oscillatory power and graph theoretical measures. The most prominent effects occur in brain structures crucially involved in processes of awareness and attention, which also show structural changes in short- and long-term meditators, suggesting continuative alterations in the meditating brain. Overall, our study reveals strong changes in ongoing oscillatory activity as well as connectivity patterns that appear to be sensitive to the psychological state changes induced by Zen meditation.