Crossmodal hierarchical predictive coding for audiovisual sequences in the human brain.

Predictive coding theory suggests the brain anticipates sensory information using prior knowledge. While this theory has been extensively researched within individual sensory modalities, evidence for predictive processing across sensory modalities is limited. Here, we examine how crossmodal knowledge is represented and learned in the brain, by identifying the hierarchical networks underlying crossmodal predictions when information of one sensory modality leads to a prediction in another modality. We record electroencephalogram (EEG) during a crossmodal audiovisual local-global oddball paradigm, in which the predictability of transitions between tones and images are manipulated at both the stimulus and sequence levels. To dissect the complex predictive signals in our EEG data, we employed a model-fitting approach to untangle neural interactions across modalities and hierarchies. The model-fitting result demonstrates that audiovisual integration occurs at both the levels of individual stimulus interactions and multi-stimulus sequences. Furthermore, we identify the spatio-spectro-temporal signatures of prediction-error signals across hierarchies and modalities, and reveal that auditory and visual prediction errors are rapidly redirected to the central-parietal electrodes during learning through alpha-band interactions. Our study suggests a crossmodal predictive coding mechanism where unimodal predictions are processed by distributed brain networks to form crossmodal knowledge.

A mediation approach in resting-state connectivity between the medial prefrontal cortex and anterior cingulate in mild cognitive impairment.

Mild cognitive impairment (MCI) is recognized as the prodromal phase of dementia, a condition that can be either maintained or reversed through timely medical interventions to prevent cognitive decline. Considerable studies using functional magnetic resonance imaging (fMRI) have indicated that altered activity in the medial prefrontal cortex (mPFC) serves as an indicator of various cognitive stages of aging. However, the impacts of intrinsic functional connectivity in the mPFC as a mediator on cognitive performance in individuals with and without MCI have not been fully understood. In this study, we recruited 42 MCI patients and 57 healthy controls, assessing their cognitive abilities and functional brain connectivity patterns through neuropsychological evaluations and resting-state fMRI, respectively. The MCI patients exhibited poorer performance on multiple neuropsychological tests compared to the healthy controls. At the neural level, functional connectivity between the mPFC and the anterior cingulate cortex (ACC) was significantly weaker in the MCI group and correlated with multiple neuropsychological test scores. The result of the mediation analysis further demonstrated that functional connectivity between the mPFC and ACC notably mediated the relationship between the MCI and semantic fluency performance. These findings suggest that altered mPFC-ACC connectivity may have a plausible causal influence on cognitive decline and provide implications for early identifications of neurodegenerative diseases and precise monitoring of disease progression.

Dissecting Mismatch Negativity: Early and Late Subcomponents for Detecting Deviants in Local and Global Sequence Regularities.

Mismatch negativity (MMN) is commonly recognized as a neural signal of prediction error evoked by deviants from the expected patterns of sensory input. Studies show that MMN diminishes when sequence patterns become more predictable over a longer timescale. This implies that MMN is composed of multiple subcomponents, each responding to different levels of temporal regularities. To probe the hypothesized subcomponents in MMN, we record human electroencephalography during an auditory local-global oddball paradigm where the tone-to-tone transition probability (local regularity) and the overall sequence probability (global regularity) are manipulated to control temporal predictabilities at two hierarchical levels. We find that the size of MMN is correlated with both probabilities and the spatiotemporal structure of MMN can be decomposed into two distinct subcomponents. Both subcomponents appear as negative waveforms, with one peaking early in the central-frontal area and the other late in a more frontal area. With a quantitative predictive coding model, we map the early and late subcomponents to the prediction errors that are tied to local and global regularities, respectively. Our study highlights the hierarchical complexity of MMN and offers an experimental and analytical platform for developing a multitiered neural marker applicable in clinical settings.

A quantitative model reveals a frequency ordering of prediction and prediction-error signals in the human brain.

The human brain is proposed to harbor a hierarchical predictive coding neuronal network underlying perception, cognition, and action. In support of this theory, feedforward signals for prediction error have been reported. However, the identification of feedback prediction signals has been elusive due to their causal entanglement with prediction-error signals. Here, we use a quantitative model to decompose these signals in electroencephalography during an auditory task, and identify their spatio-spectral-temporal signatures across two functional hierarchies. Two prediction signals are identified in the period prior to the sensory input: a low-level signal representing the tone-to-tone transition in the high beta frequency band, and a high-level signal for the multi-tone sequence structure in the low beta band. Subsequently, prediction-error signals dependent on the prior predictions are found in the gamma band. Our findings reveal a frequency ordering of prediction signals and their hierarchical interactions with prediction-error signals supporting predictive coding theory.