The cognitive reality monitoring network and theories of consciousness.

Theories of consciousness abound. However, it is difficult to arbitrate reliably among competing theories because they target different levels of neural and cognitive processing or anatomical loci, and only some were developed with computational models in mind. In particular, theories of consciousness need to fully address the three levels of understanding of the brain proposed by David Marr: computational theory, algorithms and hardware. Most major theories refer to only one or two levels, often indirectly. The cognitive reality monitoring network (CRMN) model is derived from computational theories of mixture-of-experts architecture, hierarchical reinforcement learning and generative/inference computing modules, addressing all three levels of understanding. A central feature of the CRMN is the mapping of a gating network onto the prefrontal cortex, making it a prime coding circuit involved in monitoring the accuracy of one's mental states and distinguishing them from external reality. Because the CRMN builds on the hierarchical and layer structure of the cerebral cortex, it may connect research and findings across species, further enabling concrete computational models of consciousness with new, explicitly testable hypotheses. In sum, we discuss how the CRMN model can help further our understanding of the nature and function of consciousness.

Group analysis and classification of working memory task conditions using electroencephalogram cortical currents during an n-back task.

Electroencephalographic studies of working memory have demonstrated cortical activity and oscillatory representations without clarifying how the stored information is retained in the brain. To address this gap, we measured scalp electroencephalography data, while participants performed a modified n-back working memory task. We calculated the current intensities from the estimated cortical currents by introducing a statistical map generated using Neurosynth as prior information. Group analysis of the cortical current level revealed that the current amplitudes and power spectra were significantly different between the modified n-back and delayed match-to-sample conditions. Additionally, we classified information on the working memory task conditions using the amplitudes and power spectra of the currents during the encoding and retention periods. Our results indicate that the representation of executive control over memory retention may be mediated through both persistent neural activity and oscillatory representations in the beta and gamma bands over multiple cortical regions that contribute to visual working memory functions.

Dynamic organization of cerebellar climbing fiber response and synchrony in multiple functional components reduces dimensions for reinforcement learning.

Cerebellar climbing fibers convey diverse signals, but how they are organized in the compartmental structure of the cerebellar cortex during learning remains largely unclear. We analyzed a large amount of coordinate-localized two-photon imaging data from cerebellar Crus II in mice undergoing 'Go/No-go' reinforcement learning. Tensor component analysis revealed that a majority of climbing fiber inputs to Purkinje cells were reduced to only four functional components, corresponding to accurate timing control of motor initiation related to a Go cue, cognitive error-based learning, reward processing, and inhibition of erroneous behaviors after a No-go cue. Changes in neural activities during learning of the first two components were correlated with corresponding changes in timing control and error learning across animals, indirectly suggesting causal relationships. Spatial distribution of these components coincided well with boundaries of Aldolase-C/zebrin II expression in Purkinje cells, whereas several components are mixed in single neurons. Synchronization within individual components was bidirectionally regulated according to specific task contexts and learning stages. These findings suggest that, in close collaborations with other brain regions including the inferior olive nucleus, the cerebellum, based on anatomical compartments, reduces dimensions of the learning space by dynamically organizing multiple functional components, a feature that may inspire new-generation AI designs.

Generalizable neuromarker for autism spectrum disorder across imaging sites and developmental stages: A multi-site study.

Autism spectrum disorder (ASD) is a lifelong condition, and its underlying biological mechanisms remain elusive. The complexity of various factors, including inter-site and development-related differences, makes it challenging to develop generalizable neuroimaging-based biomarkers for ASD. This study used a large-scale, multi-site dataset of 730 Japanese adults to develop a generalizable neuromarker for ASD across independent sites and different developmental stages. Our adult ASD neuromarker achieved successful generalization for the US and Belgium adults and Japanese adults. The neuromarker demonstrated significant generalization for children and adolescents. We identified 141 functional connections (FCs) important for discriminating individuals with ASD from TDCs. Finally, we mapped schizophrenia (SCZ) and major depressive disorder (MDD) onto the biological axis defined by the neuromarker and explored the biological continuity of ASD with SCZ and MDD. We observed that SCZ, but not MDD, was located proximate to ASD on the biological dimension defined by the ASD neuromarker. The successful generalization in multifarious datasets and the observed relations of ASD with SCZ on the biological dimensions provide new insights for a deeper understanding of ASD.

Generalizable neuromarker for autism spectrum disorder across imaging sites and developmental stages: A multi-site study.

Autism spectrum disorder (ASD) is a lifelong condition, and its underlying biological mechanisms remain elusive. The complexity of various factors, including inter-site and development-related differences, makes it challenging to develop generalizable neuroimaging-based biomarkers for ASD. This study used a large-scale, multi-site dataset of 730 Japanese adults to develop a generalizable neuromarker for ASD across independent sites (U.S., Belgium, and Japan) and different developmental stages (children and adolescents). Our adult ASD neuromarker achieved successful generalization for the US and Belgium adults (area under the curve [AUC] = 0.70) and Japanese adults (AUC = 0.81). The neuromarker demonstrated significant generalization for children (AUC = 0.66) and adolescents (AUC = 0.71; all P<0.05, family-wise-error corrected). We identified 141 functional connections (FCs) important for discriminating individuals with ASD from TDCs. These FCs largely centered on social brain regions such as the amygdala, hippocampus, dorsomedial and ventromedial prefrontal cortices, and temporal cortices. Finally, we mapped schizophrenia (SCZ) and major depressive disorder (MDD) onto the biological axis defined by the neuromarker and explored the biological continuity of ASD with SCZ and MDD. We observed that SCZ, but not MDD, was located proximate to ASD on the biological dimension defined by the ASD neuromarker. The successful generalization in multifarious datasets and the observed relations of ASD with SCZ on the biological dimensions provide new insights for a deeper understanding of ASD.

Resting-state functional connectivity disruption between the left and right pallidum as a biomarker for subthreshold depression.

Although the identification of late adolescents with subthreshold depression (StD) may provide a basis for developing effective interventions that could lead to a reduction in the prevalence of StD and prevent the development of major depressive disorder, knowledge about the neural basis of StD remains limited. The purpose of this study was to develop a generalizable classifier for StD and to shed light on the underlying neural mechanisms of StD in late adolescents. Resting-state functional magnetic resonance imaging data of 91 individuals (30 StD subjects, 61 healthy controls) were included to build an StD classifier, and eight functional connections were selected by using the combination of two machine learning algorithms. We applied this biomarker to an independent cohort (n = 43) and confirmed that it showed generalization performance (area under the curve = 0.84/0.75 for the training/test datasets). Moreover, the most important functional connection was between the left and right pallidum, which may be related to clinically important dysfunctions in subjects with StD such as anhedonia and hyposensitivity to rewards. Investigation of whether modulation of the identified functional connections can be an effective treatment for StD may be an important topic of future research.

Learning acquisition of consistent leader-follower relationships depends on implicit haptic interactions.

Are leaders made or born? Leader-follower roles have been well characterized in social science, but they remain somewhat obscure in sensory-motor coordination. Furthermore, it is unknown how and why leader-follower relationships are acquired, including innate versus acquired controversies. We developed a novel asymmetrical coordination task in which two participants (dyad) need to collaborate in transporting a simulated beam while maintaining its horizontal attitude. This experimental paradigm was implemented by twin robotic manipulanda, simulated beam dynamics, haptic interactions, and a projection screen. Clear leader-follower relationships were learned only when strong haptic feedback was introduced. This phenomenon occurred despite participants not being informed that they were interacting with each other and the large number of equally-valid alternative dyadic coordination strategies. We demonstrate the emergence of consistent leader-follower relationships in sensory-motor coordination, and further show that haptic interaction is essential for dyadic co-adaptation. These results provide insights into neural mechanisms responsible for the formation of leader-follower relationships in our society.

Distinctive alterations in the mesocorticolimbic circuits in various psychiatric disorders.

AIM: Increasing evidence suggests that psychiatric disorders are linked to alterations in the mesocorticolimbic dopamine-related circuits. However, the common and disease-specific alterations remain to be examined in schizophrenia (SCZ), major depressive disorder (MDD), and autism spectrum disorder (ASD). Thus, this study aimed to examine common and disease-specific features related to mesocorticolimbic circuits. METHODS: This study included 555 participants from four institutes with five scanners: 140 individuals with SCZ (45.0% female), 127 individuals with MDD (44.9%), 119 individuals with ASD (15.1%), and 169 healthy controls (HC) (34.9%). All participants underwent resting-state functional magnetic resonance imaging. A parametric empirical Bayes approach was adopted to compare estimated effective connectivity among groups. Intrinsic effective connectivity focusing on the mesocorticolimbic dopamine-related circuits including the ventral tegmental area (VTA), shell and core parts of the nucleus accumbens (NAc), and medial prefrontal cortex (mPFC) were examined using a dynamic causal modeling analysis across these psychiatric disorders. RESULTS: The excitatory shell-to-core connectivity was greater in all patients than in the HC group. The inhibitory shell-to-VTA and shell-to-mPFC connectivities were greater in the ASD group than in the HC, MDD, and SCZ groups. Furthermore, the VTA-to-core and VTA-to-shell connectivities were excitatory in the ASD group, while those connections were inhibitory in the HC, MDD, and SCZ groups. CONCLUSION: Impaired signaling in the mesocorticolimbic dopamine-related circuits could be an underlying neuropathogenesis of various psychiatric disorders. These findings will improve the understanding of unique neural alternations of each disorder and will facilitate identification of effective therapeutic targets.

Aberrant Large-Scale Network Interactions Across Psychiatric Disorders Revealed by Large-Sample Multi-Site Resting-State Functional Magnetic Resonance Imaging Datasets.

BACKGROUND AND HYPOTHESIS: Dynamics of the distributed sets of functionally synchronized brain regions, known as large-scale networks, are essential for the emotional state and cognitive processes. However, few studies were performed to elucidate the aberrant dynamics across the large-scale networks across multiple psychiatric disorders. In this paper, we aimed to investigate dynamic aspects of the aberrancy of the causal connections among the large-scale networks of the multiple psychiatric disorders. STUDY DESIGN: We applied dynamic causal modeling (DCM) to the large-sample multi-site dataset with 739 participants from 4 imaging sites including 4 different groups, healthy controls, schizophrenia (SCZ), major depressive disorder (MDD), and bipolar disorder (BD), to compare the causal relationships among the large-scale networks, including visual network, somatomotor network (SMN), dorsal attention network (DAN), salience network (SAN), limbic network (LIN), frontoparietal network, and default mode network. STUDY RESULTS: DCM showed that the decreased self-inhibitory connection of LIN was the common aberrant connection pattern across psychiatry disorders. Furthermore, increased causal connections from LIN to multiple networks, aberrant self-inhibitory connections of DAN and SMN, and increased self-inhibitory connection of SAN were disorder-specific patterns for SCZ, MDD, and BD, respectively. CONCLUSIONS: DCM revealed that LIN was the core abnormal network common to psychiatric disorders. Furthermore, DCM showed disorder-specific abnormal patterns of causal connections across the 7 networks. Our findings suggested that aberrant dynamics among the large-scale networks could be a key biomarker for these transdiagnostic psychiatric disorders.

Verification of the brain network marker of major depressive disorder: Test-retest reliability and anterograde generalization performance for newly acquired data.

BACKGROUND: Recently, we developed a generalizable brain network marker for the diagnosis of major depressive disorder (MDD) across multiple imaging sites using resting-state functional magnetic resonance imaging. Here, we applied this brain network marker to newly acquired data to verify its test-retest reliability and anterograde generalization performance for new patients. METHODS: We tested the sensitivity and specificity of our brain network marker of MDD using data acquired from 43 new patients with MDD as well as new data from 33 healthy controls (HCs) who participated in our previous study. To examine the test-retest reliability of our brain network marker, we evaluated the intraclass correlation coefficients (ICCs) between the brain network marker-based classifier's output (probability of MDD) in two sets of HC data obtained at an interval of approximately 1 year. RESULTS: Test-retest correlation between the two sets of the classifier's output (probability of MDD) from HCs exhibited moderate reliability with an ICC of 0.45 (95 % confidence interval,0.13-0.68). The classifier distinguished patients with MDD and HCs with an accuracy of 69.7 % (sensitivity, 72.1 %; specificity, 66.7 %). LIMITATIONS: The data of patients with MDD in this study were cross-sectional, and the clinical significance of the marker, such as whether it is a state or trait marker of MDD and its association with treatment responsiveness, remains unclear. CONCLUSIONS: The results of this study reaffirmed the test-retest reliability and generalization performance of our brain network marker for the diagnosis of MDD.

Examining the usefulness of the brain network marker program using fMRI for the diagnosis and stratification of major depressive disorder: a non-randomized study protocol.

BACKGROUND: Although many studies have reported the biological basis of major depressive disorder (MDD), none have been put into practical use. Recently, we developed a generalizable brain network marker for MDD diagnoses (diagnostic marker) across multiple imaging sites using resting-state functional magnetic resonance imaging (rs-fMRI). We have planned this clinical trial to establish evidence for the practical applicability of this diagnostic marker as a medical device. In addition, we have developed generalizable brain network markers for MDD stratification (stratification markers), and the verification of these brain network markers is a secondary endpoint of this study. METHODS: This is a non-randomized, open-label study involving patients with MDD and healthy controls (HCs). We will prospectively acquire rs-fMRI data from 50 patients with MDD and 50 HCs and anterogradely verify whether our diagnostic marker can distinguish between patients with MDD and HCs. Furthermore, we will longitudinally obtain rs-fMRI and clinical data at baseline and 6 weeks later in 80 patients with MDD treated with escitalopram and verify whether it is possible to prospectively distinguish MDD subtypes that are expected to be effectively responsive to escitalopram using our stratification markers. DISCUSSION: In this study, we will confirm that sufficient accuracy of the diagnostic marker could be reproduced for data from a prospective clinical study. Using longitudinally obtained data, we will also examine whether the "brain network marker for MDD diagnosis" reflects treatment effects in patients with MDD and whether treatment effects can be predicted by "brain network markers for MDD stratification". Data collected in this study will be extremely important for the clinical application of the brain network markers for MDD diagnosis and stratification. TRIAL REGISTRATION: Japan Registry of Clinical Trials ( jRCTs062220063 ). Registered 12/10/2022.

Development of a classifier for gambling disorder based on functional connections between brain regions.

AIM: Recently, a machine-learning (ML) technique has been used to create generalizable classifiers for psychiatric disorders based on information of functional connections (FCs) between brain regions at resting state. These classifiers predict diagnostic labels by a weighted linear sum (WLS) of the correlation values of a small number of selected FCs. We aimed to develop a generalizable classifier for gambling disorder (GD) from the information of FCs using the ML technique and examine relationships between WLS and clinical data. METHODS: As a training dataset for ML, data from 71 GD patients and 90 healthy controls (HCs) were obtained from two magnetic resonance imaging sites. We used an ML algorithm consisting of a cascade of an L1-regularized sparse canonical correlation analysis and a sparse logistic regression to create the classifier. The generalizability of the classifier was verified using an external dataset. This external dataset consisted of six GD patients and 14 HCs, and was collected at a different site from the sites of the training dataset. Correlations between WLS and South Oaks Gambling Screen (SOGS) and duration of illness were examined. RESULTS: The classifier distinguished between the GD patients and HCs with high accuracy in leave-one-out cross-validation (area under curve (AUC = 0.89)). This performance was confirmed in the external dataset (AUC = 0.81). There was no correlation between WLS, and SOGS and duration of illness in the GD patients. CONCLUSION: We developed a generalizable classifier for GD based on information of functional connections between brain regions at resting state.

Depressive symptoms reduce when dorsolateral prefrontal cortex-precuneus connectivity normalizes after functional connectivity neurofeedback.

Depressive disorders contribute heavily to global disease burden; This is possibly because patients are often treated homogeneously, despite having heterogeneous symptoms with differing underlying neural mechanisms. A novel treatment that can directly influence the neural circuit relevant to an individual patient's subset of symptoms might more precisely and thus effectively aid in the alleviation of their specific symptoms. We tested this hypothesis in a proof-of-concept study using fMRI functional connectivity neurofeedback. We targeted connectivity between the left dorsolateral prefrontal cortex/middle frontal gyrus and the left precuneus/posterior cingulate cortex, because this connection has been well-established as relating to a specific subset of depressive symptoms. Specifically, this connectivity has been shown in a data-driven manner to be less anticorrelated in patients with melancholic depression than in healthy controls. Furthermore, a posterior cingulate dominant state-which results in a loss of this anticorrelation-is expected to specifically relate to an increase in rumination symptoms such as brooding. In line with predictions, we found that, with neurofeedback training, the more a participant normalized this connectivity (restored the anticorrelation), the more related (depressive and brooding symptoms), but not unrelated (trait anxiety), symptoms were reduced. Because these results look promising, this paradigm next needs to be examined with a greater sample size and with better controls. Nonetheless, here we provide preliminary evidence for a correlation between the normalization of a neural network and a reduction in related symptoms. Showing their reproducibility, these results were found in two experiments that took place several years apart by different experimenters. Indicative of its potential clinical utility, effects of this treatment remained one-two months later.Clinical trial registration: Both experiments reported here were registered clinical trials (UMIN000015249, jRCTs052180169).

Multiple time measurements of multidimensional psychiatric states from immediately before the COVID-19 pandemic to one year later: a longitudinal online survey of the Japanese population.

The coronavirus disease 2019 (COVID-19) pandemic has profoundly affected the mental health of both infected and uninfected people. Although most psychiatric disorders have highly overlapping genetic and pathogenic backgrounds, most studies investigating the impact of the pandemic have examined only single psychiatric disorders. It is necessary to examine longitudinal trajectories of factors that modulate psychiatric states across multiple dimensions. About 2274 Japanese citizens participated in online surveys presented in December 2019 (before the pandemic), August 2020, Dec 2020, and April 2021. These surveys included nine questionnaires on psychiatric symptoms, such as depression and anxiety. Multidimensional psychiatric time-series data were then decomposed into four principal components. We used generalized linear models to identify modulating factors for the effects of the pandemic on these components. The four principal components can be interpreted as a general psychiatric burden, social withdrawal, alcohol-related problems, and depression/anxiety. Principal components associated with general psychiatric burden and depression/anxiety peaked during the initial phase of the pandemic. They were further exacerbated by the economic burden the pandemic imposed. In contrast, principal components associated with social withdrawal showed a delayed peak, with human relationships as an important risk modulating factor. In addition, being female was a risk factor shared across all components. Our results show that COVID-19 has imposed a large and varied burden on the Japanese population since the commencement of the pandemic. Although components related to the general psychiatric burden remained elevated, peak intensities differed between components related to depression/anxiety and those related to social withdrawal. These results underline the importance of using flexible monitoring and mitigation strategies for mental problems, according to the phase of the pandemic.

From internal models toward metacognitive AI.

In several papers published in Biological Cybernetics in the 1980s and 1990s, Kawato and colleagues proposed computational models explaining how internal models are acquired in the cerebellum. These models were later supported by neurophysiological experiments using monkeys and neuroimaging experiments involving humans. These early studies influenced neuroscience from basic, sensory-motor control to higher cognitive functions. One of the most perplexing enigmas related to internal models is to understand the neural mechanisms that enable animals to learn large-dimensional problems with so few trials. Consciousness and metacognition-the ability to monitor one's own thoughts, may be part of the solution to this enigma. Based on literature reviews of the past 20 years, here we propose a computational neuroscience model of metacognition. The model comprises a modular hierarchical reinforcement-learning architecture of parallel and layered, generative-inverse model pairs. In the prefrontal cortex, a distributed executive network called the "cognitive reality monitoring network" (CRMN) orchestrates conscious involvement of generative-inverse model pairs in perception and action. Based on mismatches between computations by generative and inverse models, as well as reward prediction errors, CRMN computes a "responsibility signal" that gates selection and learning of pairs in perception, action, and reinforcement learning. A high responsibility signal is given to the pairs that best capture the external world, that are competent in movements (small mismatch), and that are capable of reinforcement learning (small reward-prediction error). CRMN selects pairs with higher responsibility signals as objects of metacognition, and consciousness is determined by the entropy of responsibility signals across all pairs. This model could lead to new-generation AI, which exhibits metacognition, consciousness, dimension reduction, selection of modules and corresponding representations, and learning from small samples. It may also lead to the development of a new scientific paradigm that enables the causal study of consciousness by combining CRMN and decoded neurofeedback.

A multi-site, multi-disorder resting-state magnetic resonance image database.

Machine learning classifiers for psychiatric disorders using resting-state functional magnetic resonance imaging (rs-fMRI) have recently attracted attention as a method for directly examining relationships between neural circuits and psychiatric disorders. To develop accurate and generalizable classifiers, we compiled a large-scale, multi-site, multi-disorder neuroimaging database. The database comprises resting-state fMRI and structural images of the brain from 993 patients and 1,421 healthy individuals, as well as demographic information such as age, sex, and clinical rating scales. To harmonize the multi-site data, nine healthy participants ("traveling subjects") visited the sites from which the above datasets were obtained and underwent neuroimaging with 12 scanners. All participants consented to having their data shared and analyzed at multiple medical and research institutions participating in the project, and 706 patients and 1,122 healthy individuals consented to having their data disclosed. Finally, we have published four datasets: 1) the SRPBS Multi-disorder Connectivity Dataset 2), the SRPBS Multi-disorder MRI Dataset (restricted), 3) the SRPBS Multi-disorder MRI Dataset (unrestricted), and 4) the SRPBS Traveling Subject MRI Dataset.

Prevalence and risk factors of internet gaming disorder and problematic internet use before and during the COVID-19 pandemic: A large online survey of Japanese adults.

Internet gaming disorder (IGD) and problematic internet use (PIU) are becoming increasingly detrimental to modern society, with serious consequences for daily functioning. IGD and PIU may be exacerbated by lifestyle changes imposed by the coronavirus 2019 (COVID-19) pandemic. This study investigated changes in IGD and PIU during the pandemic and risk factors for them. This study is a part of a larger online study of problematic smartphone use in Japan, originally planned in 2019, and expanded in August 2020 to include the impact of COVID-19. 51,246 adults completed an online survey during the pandemic (August 2020), in Japan. Of these, 3,938 had also completed the survey before the onset of the pandemic (December 2019) and were used as the study population to determine how the pandemic has influenced IGD and PIU. IGD was assessed using the Internet Gaming Disorder Scale (IGDS). PIU was measured using the Compulsive Internet Use Scale (CIUS). The prevalence of probable IGD during COVID-19 was 4.1% overall [95%CI, 3.9%-4.2%] (N = 51,246), and 8.6% among younger people (age < 30), 1-2.5% higher than reported before the pandemic. Probable PIU was 7.8% overall [95%CI, 7.6%-8.1%], and 17.0% [95%CI, 15.9%-18.2%] among younger people, 3.2-3.7% higher than reported before the pandemic. Comparisons before and during the pandemic, revealed that probable IGD prevalence has increased 1.6 times, and probable PIU prevalence by 1.5 times (IGD: χ2= 619.9, p < .001, PIU: χ2= 594.2, p < .001). Youth (age < 30) and COVID-19 infection were strongly associated with IGD exacerbation (odds ratio, 2.10 [95%CI, 1.18 to 3.75] and 5.67 [95%CI, 1.33 to 24.16]). Internet gaming disorder and problematic internet use appear to be aggravated by the pandemic. In particular, younger persons and people infected with COVID-19 are at higher risk for Internet Gaming Disorder. Prevention and treatment of these problems are needed.

Visual perceptual learning of a primitive feature in human V1/V2 as a result of unconscious processing, revealed by decoded functional MRI neurofeedback (DecNef).

Although numerous studies have shown that visual perceptual learning (VPL) occurs as a result of exposure to a visual feature in a task-irrelevant manner, the underlying neural mechanism is poorly understood. In a previous psychophysical study (Watanabe et al., 2002), subjects were repeatedly exposed to a task-irrelevant Sekuler motion display that induced the perception of not only the local motions, but also a global motionmoving in the direction of the spatiotemporal average of the local motion vectors. As a result of this exposure, subjects enhanced their sensitivity only to the local moving directions, suggesting that early visual areas (V1/V2) that process local motions are involved in task-irrelevant VPL. However, this hypothesis has never been tested directly using neuronal recordings. Here, we employed a decoded neurofeedback technique (DecNef) using functional magnetic resonance imaging in human subjects to examine the involvement of early visual areas (V1/V2) in task-irrelevant VPL of local motion within a Sekuler motion display. During the DecNef training, subjects were trained to induce the activity patterns in V1/V2 that were similar to those evoked by the actual presentation of the Sekuler motion display. The DecNef training was conducted with neither the actual presentation of the display nor the subjects' awareness of the purpose of the experiment. After the experiment, subjects reported that they neither perceived nor imagined the trained motion during the DecNef training. As a result of DecNef training, subjects increased their sensitivity to the local motion directions, but not specifically to the global motion direction. Neuronal changes related to DecNef training were confined to V1/V2. These results suggest that V1/V2 are involved in exposure-based task-irrelevant VPL of local motion.

Value signals guide abstraction during learning.

The human brain excels at constructing and using abstractions, such as rules, or concepts. Here, in two fMRI experiments, we demonstrate a mechanism of abstraction built upon the valuation of sensory features. Human volunteers learned novel association rules based on simple visual features. Reinforcement-learning algorithms revealed that, with learning, high-value abstract representations increasingly guided participant behaviour, resulting in better choices and higher subjective confidence. We also found that the brain area computing value signals - the ventromedial prefrontal cortex - prioritised and selected latent task elements during abstraction, both locally and through its connection to the visual cortex. Such a coding scheme predicts a causal role for valuation. Hence, in a second experiment, we used multivoxel neural reinforcement to test for the causality of feature valuation in the sensory cortex, as a mechanism of abstraction. Tagging the neural representation of a task feature with rewards evoked abstraction-based decisions. Together, these findings provide a novel interpretation of value as a goal-dependent, key factor in forging abstract representations.