Erroneous predictive coding across brain hierarchies in a non-human primate model of autism spectrum disorder.

In autism spectrum disorder (ASD), atypical sensory experiences are often associated with irregularities in predictive coding, which proposes that the brain creates hierarchical sensory models via a bidirectional process of predictions and prediction errors. However, it remains unclear how these irregularities manifest across different functional hierarchies in the brain. To address this, we study a marmoset model of ASD induced by valproic acid (VPA) treatment. We record high-density electrocorticography (ECoG) during an auditory task with two layers of temporal control, and applied a quantitative model to quantify the integrity of predictive coding across two distinct hierarchies. Our results demonstrate a persistent pattern of sensory hypersensitivity and unstable predictions across two brain hierarchies in VPA-treated animals, and reveal the associated spatio-spectro-temporal neural signatures. Despite the regular occurrence of imprecise predictions in VPA-treated animals, we observe diverse configurations of underestimation or overestimation of sensory regularities within the hierarchies. Our results demonstrate the coexistence of the two primary Bayesian accounts of ASD: overly-precise sensory observations and weak prior beliefs, and offer a potential multi-layered biomarker for ASD, which could enhance our understanding of its diverse symptoms.

Distributed representations of prediction error signals across the cortical hierarchy are synergistic.

A relevant question concerning inter-areal communication in the cortex is whether these interactions are synergistic. Synergy refers to the complementary effect of multiple brain signals conveying more information than the sum of each isolated signal. Redundancy, on the other hand, refers to the common information shared between brain signals. Here, we dissociated cortical interactions encoding complementary information (synergy) from those sharing common information (redundancy) during prediction error (PE) processing. We analyzed auditory and frontal electrocorticography (ECoG) signals in five common awake marmosets performing two distinct auditory oddball tasks and investigated to what extent event-related potentials (ERP) and broadband (BB) dynamics encoded synergistic and redundant information about PE processing. The information conveyed by ERPs and BB signals was synergistic even at lower stages of the hierarchy in the auditory cortex and between auditory and frontal regions. Using a brain-constrained neural network, we simulated the synergy and redundancy observed in the experimental results and demonstrated that the emergence of synergy between auditory and frontal regions requires the presence of strong, long-distance, feedback, and feedforward connections. These results indicate that distributed representations of PE signals across the cortical hierarchy can be highly synergistic.

Auditory prediction errors in sound frequency and duration generated different cortical activation patterns in the human brain: an ECoG study.

Sound frequency and duration are essential auditory components. The brain perceives deviations from the preceding sound context as prediction errors, allowing efficient reactions to the environment. Additionally, prediction error response to duration change is reduced in the initial stages of psychotic disorders. To compare the spatiotemporal profiles of responses to prediction errors, we conducted a human electrocorticography study with special attention to high gamma power in 13 participants who completed both frequency and duration oddball tasks. Remarkable activation in the bilateral superior temporal gyri in both the frequency and duration oddball tasks were observed, suggesting their association with prediction errors. However, the response to deviant stimuli in duration oddball task exhibited a second peak, which resulted in a bimodal response. Furthermore, deviant stimuli in frequency oddball task elicited a significant response in the inferior frontal gyrus that was not observed in duration oddball task. These spatiotemporal differences within the Parasylvian cortical network could account for our efficient reactions to changes in sound properties. The findings of this study may contribute to unveiling auditory processing and elucidating the pathophysiology of psychiatric disorders.

Auditory prediction and prediction error responses evoked through a novel cascade roving paradigm: a human ECoG study.

Auditory sensory processing is assumed to occur in a hierarchical structure including the primary auditory cortex (A1), superior temporal gyrus, and frontal areas. These areas are postulated to generate predictions for incoming stimuli, creating an internal model of the surrounding environment. Previous studies on mismatch negativity have indicated the involvement of the superior temporal gyrus in this processing, whereas reports have been mixed regarding the contribution of the frontal cortex. We designed a novel auditory paradigm, the "cascade roving" paradigm, which incorporated complex structures (cascade sequences) into a roving paradigm. We analyzed electrocorticography data from six patients with refractory epilepsy who passively listened to this novel auditory paradigm and detected responses to deviants mainly in the superior temporal gyrus and inferior frontal gyrus. Notably, the inferior frontal gyrus exhibited broader distribution and sustained duration of deviant-elicited responses, seemingly differing in spatio-temporal characteristics from the prediction error responses observed in the superior temporal gyrus, compared with conventional oddball paradigms performed on the same participants. Moreover, we observed that the deviant responses were enhanced through stimulus repetition in the high-gamma range mainly in the superior temporal gyrus. These features of the novel paradigm may aid in our understanding of auditory predictive coding.

Change detection in the primate auditory cortex through feedback of prediction error signals.

Although cortical feedback signals are essential for modulating feedforward processing, no feedback error signal across hierarchical cortical areas has been reported. Here, we observed such a signal in the auditory cortex of awake common marmoset during an oddball paradigm to induce auditory duration mismatch negativity. Prediction errors to a deviant tone presentation were generated as offset calcium responses of layer 2/3 neurons in the rostral parabelt (RPB) of higher-order auditory cortex, while responses to non-deviant tones were strongly suppressed. Within several hundred milliseconds, the error signals propagated broadly into layer 1 of the primary auditory cortex (A1) and accumulated locally on top of incoming auditory signals. Blockade of RPB activity prevented deviance detection in A1. Optogenetic activation of RPB following tone presentation nonlinearly enhanced A1 tone response. Thus, the feedback error signal is critical for automatic detection of unpredicted stimuli in physiological auditory processing and may serve as backpropagation-like learning.

Constructing the hierarchy of predictive auditory sequences in the marmoset brain.

Our brains constantly generate predictions of sensory input that are compared with actual inputs, propagate the prediction-errors through a hierarchy of brain regions, and subsequently update the internal predictions of the world. However, the essential feature of predictive coding, the notion of hierarchical depth and its neural mechanisms, remains largely unexplored. Here, we investigated the hierarchical depth of predictive auditory processing by combining functional magnetic resonance imaging (fMRI) and high-density whole-brain electrocorticography (ECoG) in marmoset monkeys during an auditory local-global paradigm in which the temporal regularities of the stimuli were designed at two hierarchical levels. The prediction-errors and prediction updates were examined as neural responses to auditory mismatches and omissions. Using fMRI, we identified a hierarchical gradient along the auditory pathway: midbrain and sensory regions represented local, shorter-time-scale predictive processing followed by associative auditory regions, whereas anterior temporal and prefrontal areas represented global, longer-time-scale sequence processing. The complementary ECoG recordings confirmed the activations at cortical surface areas and further differentiated the signals of prediction-error and update, which were transmitted via putative bottom-up γ and top-down ß oscillations, respectively. Furthermore, omission responses caused by absence of input, reflecting solely the two levels of prediction signals that are unique to the hierarchical predictive coding framework, demonstrated the hierarchical top-down process of predictions in the auditory, temporal, and prefrontal areas. Thus, our findings support the hierarchical predictive coding framework, and outline how neural networks and spatiotemporal dynamics are used to represent and arrange a hierarchical structure of auditory sequences in the marmoset brain.

Cortical neural dynamics unveil the rhythm of natural visual behavior in marmosets.

Numerous studies have shown that the visual system consists of functionally distinct ventral and dorsal streams; however, its exact spatial-temporal dynamics during natural visual behavior remain to be investigated. Here, we report cerebral neural dynamics during active visual exploration recorded by an electrocorticographic array covering the entire lateral surface of the marmoset cortex. We found that the dorsal stream was activated before the primary visual cortex with saccades and followed by the alteration of suppression and activation signals along the ventral stream. Similarly, the signal that propagated from the dorsal to ventral visual areas was accompanied by a travelling wave of low frequency oscillations. Such signal dynamics occurred at an average of 220 ms after saccades, which corresponded to the timing when whole-brain activation returned to background levels. We also demonstrated that saccades could occur at any point of signal flow, indicating the parallel computation of motor commands. Overall, this study reveals the neural dynamics of active vision, which are efficiently linked to the natural rhythms of visual exploration.

Broadband Dynamics Rather than Frequency-Specific Rhythms Underlie Prediction Error in the Primate Auditory Cortex.

Detection of statistical irregularities, measured as a prediction error response, is fundamental to the perceptual monitoring of the environment. We studied whether prediction error response is associated with neural oscillations or asynchronous broadband activity. Electrocorticography was conducted in three male monkeys, who passively listened to the auditory roving oddball stimuli. Local field potentials (LFPs) recorded over the auditory cortex underwent spectral principal component analysis, which decoupled broadband and rhythmic components of the LFP signal. We found that the broadband component captured the prediction error response, whereas none of the rhythmic components were associated with statistical irregularities of sounds. The broadband component displayed more stochastic, asymmetrical multifractal properties than the rhythmic components, which revealed more self-similar dynamics. We thus conclude that the prediction error response is captured by neuronal populations generating asynchronous broadband activity, defined by irregular dynamic states, which, unlike oscillatory rhythms, appear to enable the neural representation of auditory prediction error response.SIGNIFICANCE STATEMENT This study aimed to examine the contribution of oscillatory and asynchronous components of auditory local field potentials in the generation of prediction error responses to sensory irregularities, as this has not been directly addressed in the previous studies. Here, we show that mismatch negativity-an auditory prediction error response-is driven by the asynchronous broadband component of potentials recorded in the auditory cortex. This finding highlights the importance of nonoscillatory neural processes in the predictive monitoring of the environment. At a more general level, the study demonstrates that stochastic neural processes, which are often disregarded as neural noise, do have a functional role in the processing of sensory information.

Effects of Ketamine Administration on Auditory Information Processing in the Neocortex of Nonhuman Primates.

Ketamine, an N-methyl-D-aspartate (NMDA) receptor antagonist, exerts broad effects on consciousness and perception. Since NMDA receptor antagonists induce cognitive impairments, ketamine has been used for translational research on several psychiatric diseases, such as schizophrenia. Whereas the effects of ketamine on cognitive functions have been extensively studied, studies on the effects of ketamine on simple sensory information processing remain limited. In this study, we investigated the cortex-wide effects of ketamine administration on auditory information processing in nonhuman primates using whole-cortical electrocorticography (ECoG). We first recorded ECoG from awake monkeys on presenting auditory stimuli of different frequencies or different durations. We observed auditory evoked responses (AERs) across the cortex, including in frontal, parietal, and temporal areas, while feature-specific responses were obtained around the temporal sulcus. Next, we examined the effects of ketamine on cortical auditory information processing. We conducted ECoG recordings from monkeys that had been administered anesthetic doses of ketamine from 10 to 180 min following administration. We observed significant changes in stimulus feature-specific responses. Electrodes showing a frequency preference or offset responses were altered following ketamine administration, while those of the AERs were not strongly influenced. However, the frequency preference of a selected electrode was not significantly altered by ketamine administration over time following administration, while the imbalances in the onset and offset persisted over the course of 150 min following ketamine administration in all three monkeys. These results suggest that ketamine affects the ability to distinguish between sound frequency and duration in different ways. In conclusion, future research on the NMDA sensitivity of cortical wide sensory information processing may provide a new perspective into the development of nonhuman primate models of psychiatric disorders.

Spatiotemporal Differentiation of MMN From N1 Adaptation: A Human ECoG Study.

Auditory mismatch negativity (MMN) is an electrophysiological response to a deviation from regularity. This response is considered pivotal to understanding auditory processing, particularly in the pre-attentive phase. However, previous findings suggest that MMN is a product of N1 adaptation/enhancement, which reflects lower-order auditory processing. The separability of these two components remains unclear and is considered an important issue in the field of neuroscience. The aim of the present study was to spatiotemporally differentiate MMN from N1 adaptation using human electrocorticography (ECoG). Auditory evoked potentials under the classical oddball (OD) task as well as the many standards (MS) task were recorded in three patients with epilepsy whose lateral cortices were widely covered with high-density electrodes. Close observation identified an electrode at which N1 adaptation was temporally separated from MMN, whereas N1 adaptation was partially incorporated into MMN at other electrodes. Since N1 adaptation occurs in the N1 population, we spatially compared MMN with N1 obtained from the MS task instead of N1 adaptation. As a result, N1 was observed in a limited area around the Sylvian fissure adjacent to A1, whereas MMN was noted in wider areas, including the temporal, frontal, and parietal lobes. MMN was thus considered to be differentiated from N1 adaptation. The results suggest that MMN is not merely a product of the neural adaptation of N1 and instead represents higher-order processes in auditory deviance detection. These results will contribute to strengthening the foundation of future research in this field.

Gamma-Band Auditory Steady-State Response as a Neurophysiological Marker for Excitation and Inhibition Balance: A Review for Understanding Schizophrenia and Other Neuropsychiatric Disorders.

Altered gamma oscillations have attracted considerable attention as an index of the excitation/inhibition (E/I) imbalance in schizophrenia and other neuropsychiatric disorders. The auditory steady-state response (ASSR) has been the most robust probe of abnormal gamma oscillatory dynamics in schizophrenia. Here, we review recent ASSR studies in patients with schizophrenia and other neuropsychiatric disorders. Preclinical ASSR research, which has contributed to the elucidation of the underlying pathophysiology of these diseases, is also discussed. The developmental trajectory of the ASSR has been explored and may show signs of the maturation and disruption of E/I balance in adolescence. Animal model studies have shown that synaptic interactions between parvalbumin-positive GABAergic interneurons and pyramidal neurons contribute to the regulation of E/I balance, which is related to the generation of gamma oscillation. Therefore, ASSR alteration may be a significant electrophysiological finding related to the E/I imbalance in neuropsychiatric disorders, which is a cross-disease feature and may reflect clinical staging. Future studies regarding ASSR generation, especially in nonhuman primate models, will advance our understanding of the brain circuit and the molecular mechanisms underlying neuropsychiatric disorders.

EECoG-Comp: An Open Source Platform for Concurrent EEG/ECoG Comparisons-Applications to Connectivity Studies.

Electrophysiological Source Imaging (ESI) is hampered by lack of "gold standards" for model validation. Concurrent electroencephalography (EEG) and electrocorticography (ECoG) experiments (EECoG) are useful for this purpose, especially primate models due to their flexibility and translational value for human research. Unfortunately, there is only one EECoG experiments in the public domain that we know of: the Multidimensional Recording (MDR) is based on a single monkey ( www.neurotycho.org ). The mining of this type of data is hindered by lack of specialized procedures to deal with: (1) Severe EECoG artifacts due to the experimental produces; (2) Sophisticated forward models that account for surgery induced skull defects and implanted ECoG electrode strips; (3) Reliable statistical procedures to estimate and compare source connectivity (partial correlation). We provide solutions to the processing issues just mentioned with EECoG-Comp: an open source platform ( https://github.com/Vincent-wq/EECoG-Comp ). EECoG lead fields calculated with FEM (Simbio) for MDR data are also provided and were used in other papers of this special issue. As a use case with the MDR, we show: (1) For real MDR data, 4 popular ESI methods (MNE, LCMV, eLORETA and SSBL) showed significant but moderate concordance with a usual standard, the ECoG Laplacian (standard partial [Formula: see text]); (2) In both monkey and human simulations, all ESI methods as well as Laplacian had a significant but poor correspondence with the true source connectivity. These preliminary results may stimulate the development of improved ESI connectivity estimators but require the availability of more EECoG data sets to obtain neurobiologically valid inferences.

Chronic Implantation of Whole-cortical Electrocorticographic Array in the Common Marmoset.

Electrocorticography (ECoG) allows the monitoring of electrical field potentials from the cerebral cortex with high spatiotemporal resolution. Recent development of thin, flexible ECoG electrodes has enabled conduction of stable recordings of large-scale cortical activity. We have developed a whole-cortical ECoG array for the common marmoset. The array continuously covers almost the entire lateral surface of cortical hemisphere, from the occipital pole to the temporal and frontal poles, and it captures whole-cortical neural activity in one shot. This protocol describes a chronic implantation procedure of the array in the epidural space of the marmoset brain. Marmosets have two advantages regarding ECoG recordings, one being the homologous organization of anatomical structures in humans and macaques, including frontal, parietal, and temporal complexes. The other advantage is that the marmoset brain is lissencephalic and contains a large number of complexes, which are more difficult to access in macaques with ECoG, that are exposed to the brain surface.These features allow direct access to most cortical areas beneath the surface of the brain. This system provides an opportunity to investigate global cortical information processing with high resolutions at a sub-millisecond order in time and millimeter order in space.

Information seeking mechanism of neural populations in the lateral prefrontal cortex.

In addition to primary rewards such as food and water, humans continuously seek information in daily life. Whereas the neural mechanisms for processing primary rewards have been clarified in detail in the homeostatic system, those for information seeking remain poorly understood. Although studies in psychology and economics have suggested several criteria with which information is assessed in human information seeking, the neural mechanism that assesses information remains unknown. The suggested criteria include the value of information (VOI; Hubbard, 2010), Shannon information, and the probability gain (Baron, 1985), which are defined as reduction of expected cost, reduction in expected entropy, and expected improvement of identifying correct response, respectively. We examined which criterion the nervous system uses to assess information. We recorded neuronal activity from the lateral prefrontal cortices (lPFCs) of monkeys while the animals performed information seeking tasks. We found that activity of the lPFC neurons was correlated with information that the animals expected to receive, and that more neurons encoded the VOI than did the two other criteria. Further, using principal component analysis, we found that the responses of entire neuronal populations could encode the three criteria. Finally, using a "targeted dimensionality reduction" analysis (Mante et al., 2013), we found that the population responses could encode information values assessed with the VOI longer than the probability gain, but not Shannon information. These findings suggest that the lPFC is involved in assessing information, and the assessment is primarily based on the criterion of the VOI, which captures reduction in expected cost.

A Chronically Implantable Bidirectional Neural Interface for Non-human Primates.

Optogenetics has potential applications in the study of epilepsy and neuroprostheses, and for studies on neural circuit dynamics. However, to achieve translation to clinical usage, optogenetic interfaces that are capable of chronic stimulation and monitoring with minimal brain trauma are required. We aimed to develop a chronically implantable device for photostimulation of the brain of non-human primates. We used a micro-light-emitting diode (LED) array with a flexible polyimide film. The array was combined with a whole-cortex electrocorticographic (ECoG) electrode array for simultaneous photostimulation and recording. Channelrhodopsin-2 (ChR2) was virally transduced into the cerebral cortex of common marmosets, and then the device was epidurally implanted into their brains. We recorded the neural activity during photostimulation of the awake monkeys for 4 months. The neural responses gradually increased after the virus injection for ~8 weeks and remained constant for another 8 weeks. The micro-LED and ECoG arrays allowed semi-invasive simultaneous stimulation and recording during long-term implantation in the brains of non-human primates. The development of this device represents substantial progress in the field of optogenetic applications.

Mismatch negativity in common marmosets: Whole-cortical recordings with multi-channel electrocorticograms.

Mismatch negativity (MMN) is a component of event-related potentials (ERPs) evoked by violations of regularity in sensory stimulus-series in humans. Recently, the MMN has received attention as a clinical and translatable biomarker of psychiatric disorders such as schizophrenia, and for the development animal models of these psychiatric disorders. In this study, we investigated the generation of MMN in common marmosets, which are an important non-human primate model with genetic manipulability. We recorded the electrocorticograms (ECoGs) from two common marmosets with epidurally implanted electrodes covering a wide range of cortical regions. ECoG recordings were conducted in a passive listening condition with a roving oddball paradigm. We compared the ERPs evoked by repeatedly presented standard stimuli and those evoked by the deviant stimuli. Significant differences in the ERPs were observed in several cortical areas. In particular, deviant stimuli elicited larger negative activity than standard stimuli in the temporal area. In addition, the latency and polarity of the activity were comparable to human MMNs. This is thus the first report of MMN-like activity in common marmosets. Our findings have the potential to advance future gene-manipulation studies that aim to establish non-human primate models of schizophrenia.

The physiological and psychological relaxing effects of viewing rose flowers in office workers.

BACKGROUND: In recent years, the physiological relaxing effect brought by nature is becoming clear; however, many workers find it difficult to be exposed to nature in their working environment. Exposure to fresh flowers represents an opportunity to incorporate nature into their working lives. In this study, we examined the effects of exposure to roses on physiological and psychological variables (heart rate variability, pulse rate, and subjective responses) in office workers. RESULTS: The experimental site was Mizuho Information & Research Institute, Inc., in the Tokyo metropolitan area. Thirty-one male office workers were included in the present study. The subjects were exposed to thirty unscented pink roses (Rosa, Dekora) arranged in a cylindrical glass vase for 4 min. In the control condition, the subjects were not exposed to flowers. After the experiments, the subjects completed a questionnaire. The order of exposure was counterbalanced among subjects. Among subjects exposed to roses, the high-frequency component of heart rate variability was significantly higher than in controls. Similarly, 'comfortable,' 'relaxed' and 'natural' feelings were more common in subjects exposed to roses. CONCLUSIONS: Data from this study support the presence of physiological and psychological relaxing effects of being exposed to flowers on office workers.

Influence of forest therapy on cardiovascular relaxation in young adults.

Background. Despite increasing attention toward forest therapy as an alternative medicine, very little evidence continues to be available on its therapeutic effects. Therefore, this study was focused on elucidating the health benefits of forest walking on cardiovascular reactivity. Methods. Within-group comparisons were used to examine the cardiovascular responses to walking in forest and urban environments. Forty-eight young adult males participated in the two-day field research. Changes in heart rate variability, heart rate, and blood pressure were measured to understand cardiovascular reactivity. Four different questionnaires were used to investigate the changes in psychological states after walking activities. Results. Forest walking significantly increased the values of ln(HF) and significantly decreased the values of ln(LF/HF) compared with the urban walking. Heart rate during forest walking was significantly lower than that in the control. Questionnaire results showed that negative mood states and anxiety levels decreased significantly by forest walking compared with urban walking. Conclusion. Walking in the forest environment may promote cardiovascular relaxation by facilitating the parasympathetic nervous system and by suppressing the sympathetic nervous system. In addition, forest therapy may be effective for reducing negative psychological symptoms.

An artificial network model for estimating the network structure underlying partially observed neuronal signals.

Many previous studies have proposed methods for quantifying neuronal interactions. However, these methods evaluated the interactions between recorded signals in an isolated network. In this study, we present a novel approach for estimating interactions between observed neuronal signals by theorizing that those signals are observed from only a part of the network that also includes unobserved structures. We propose a variant of the recurrent network model that consists of both observable and unobservable units. The observable units represent recorded neuronal activity, and the unobservable units are introduced to represent activity from unobserved structures in the network. The network structures are characterized by connective weights, i.e., the interaction intensities between individual units, which are estimated from recorded signals. We applied this model to multi-channel brain signals recorded from monkeys, and obtained robust network structures with physiological relevance. Furthermore, the network exhibited common features that portrayed cortical dynamics as inversely correlated interactions between excitatory and inhibitory populations of neurons, which are consistent with the previous view of cortical local circuits. Our results suggest that the novel concept of incorporating an unobserved structure into network estimations has theoretical advantages and could provide insights into brain dynamics beyond what can be directly observed.