Specific connectivity optimizes learning in thalamocortical loops.

Thalamocortical loops have a central role in cognition and motor control, but precisely how they contribute to these processes is unclear. Recent studies showing evidence of plasticity in thalamocortical synapses indicate a role for the thalamus in shaping cortical dynamics through learning. Since signals undergo a compression from the cortex to the thalamus, we hypothesized that the computational role of the thalamus depends critically on the structure of corticothalamic connectivity. To test this, we identified the optimal corticothalamic structure that promotes biologically plausible learning in thalamocortical synapses. We found that corticothalamic projections specialized to communicate an efference copy of the cortical output benefit motor control, while communicating the modes of highest variance is optimal for working memory tasks. We analyzed neural recordings from mice performing grasping and delayed discrimination tasks and found corticothalamic communication consistent with these predictions. These results suggest that the thalamus orchestrates cortical dynamics in a functionally precise manner through structured connectivity.

The cognitive (lateral) hypothalamus.

Despite the physiological complexity of the hypothalamus, its role is typically restricted to initiation or cessation of innate behaviors. For example, theories of lateral hypothalamus argue that it is a switch to turn feeding 'on' and 'off' as dictated by higher-order structures that render when feeding is appropriate. However, recent data demonstrate that the lateral hypothalamus is critical for learning about food-related cues. Furthermore, the lateral hypothalamus opposes learning about information that is neutral or distal to food. This reveals the lateral hypothalamus as a unique arbitrator of learning capable of shifting behavior toward or away from important events. This has relevance for disorders characterized by changes in this balance, including addiction and schizophrenia. Generally, this suggests that hypothalamic function is more complex than increasing or decreasing innate behaviors.

Action Sequence Learning Is Impaired in Genetically Modified Mice with the Suppressed GABAergic Transmission from the Thalamic Reticular Nucleus to the Thalamus.

The thalamic reticular nucleus (TRN) is a thin sheet of GABAergic neurons surrounding the thalamus, and it regulates the activity of thalamic relay neurons. The TRN has been reported to be involved in sensory gating, attentional regulation, and some other functions. However, little is known about the contribution of the TRN to sequence learning. In the present study, we examined whether the TRN is involved in reward-based learning of action sequence with no eliciting stimuli (operant conditioning), by analyzing the performance of male and female Avp-Vgat-/- mice (Vgatflox/flox mice crossed to an Avp-Cre driver line) on tasks conducted in an operant box having three levers. Our histological and electrophysiological data demonstrated that in adult Avp-Vgat-/- mice, vesicular GABA transporter (VGAT) was absent in most TRN neurons and the GABAergic transmission from the TRN to the thalamus was largely suppressed. The performance on a task in which mice needed to press an active lever for food reward showed that simple operant learning of lever pressing and learning of win-stay and lose-shift strategies are not affected in Avp-Vgat-/- mice. In contrast, the performance on a task in which mice needed to press three levers in a correct order for food reward showed that learning of the order of lever pressing (action sequence learning) was impaired in Avp-Vgat-/- mice. These results suggest that the TRN plays an important role in action sequence learning.

Successful alpha neurofeedback training enhances working memory updating and event-related potential activity.

Neurofeedback (NF) is a promising method to self-regulate human brain activity for cognition enhancement. Due to the unclear results of alpha NF training on working memory updating as well as the impact of feedback modality on NF learning, this study aimed to understand further the underlying neural mechanism of alpha NF training effects on working memory updating, where the NF learning was also compared between visual and auditory feedback modalities. A total of 30 participants were assigned to Visual NF, Auditory NF, and Control groups. Working memory updating was evaluated by n-back (n =2,3) tasks before and after five alpha upregulation NF sessions. The result showed no significant difference in NF learning performance between the Visual and Auditory groups, indicating that the difference in feedback modality did not affect NF learning. In addition, compared to the control group, the participants who achieved successful NF learning showed a significant increase in n-back behavioral performance and P3a amplitude in 2-back and a significant decrease in P3a latency in 3-back. Our results in n-back further suggested that successful alpha NF training might improve updating performance in terms of the behavioral and related event-related potential (ERP) measures. These findings contribute to the understanding of the effect of alpha training on memory updating and the design of NF experimental protocol in terms of feedback modality selection.

Layer 5 Intratelencephalic Neurons in the Motor Cortex Stably Encode Skilled Movement.

The primary motor cortex (M1) and the dorsal striatum play a critical role in motor learning and the retention of learned behaviors. Motor representations of corticostriatal ensembles emerge during motor learning. In the coordinated reorganization of M1 and the dorsal striatum for motor learning, layer 5a (L5a) which connects M1 to the ipsilateral and contralateral dorsal striatum, should be a key layer. Although M1 L5a neurons represent movement-related activity in the late stage of learning, it is unclear whether the activity is retained as a memory engram. Here, using Tlx3-Cre male transgenic mice, we conducted two-photon calcium imaging of striatum-projecting L5a intratelencephalic (IT) neurons in forelimb M1 during late sessions of a self-initiated lever-pull task and in sessions after 6 d of nontraining following the late sessions. We found that trained male animals exhibited stable motor performance before and after the nontraining days. At the same time, we found that M1 L5a IT neurons strongly represented the well-learned forelimb movement but not uninstructed orofacial movements. A subset of M1 L5a IT neurons consistently coded the well-learned forelimb movement before and after the nontraining days. Inactivation of M1 IT neurons after learning impaired task performance when the lever was made heavier or when the target range of the pull distance was narrowed. These results suggest that a subset of M1 L5a IT neurons continuously represent skilled movement after learning and serve to fine-tune the kinematics of well-learned movement.SIGNIFICANCE STATEMENT Motor memory persists even when it is not used for a while. IT neurons in L5a of the M1 gradually come to represent skilled forelimb movements during motor learning. However, it remains to be determined whether these changes persist over a long period and how these neurons contribute to skilled movements. Here, we show that a subset of M1 L5a IT neurons retain information for skilled forelimb movements even after nontraining days. Furthermore, suppressing the activity of these neurons during skilled forelimb movements impaired behavioral stability and adaptability. Our results suggest the importance of M1 L5a IT neurons for tuning skilled forelimb movements over a long period.

Anti-Hebbian plasticity in the motor cortex promotes defensive freezing.

Regional brain activity often decreases from baseline levels in response to external events, but how neurons develop such negative responses is unclear. To study this, we leveraged the negative response that develops in the primary motor cortex (M1) after classical fear learning. We trained mice with a fear conditioning paradigm while imaging their brains with standard two-photon microscopy. This enabled monitoring changes in neuronal responses to the tone with synaptic resolution through learning. We found that M1 layer 5 pyramidal neurons (L5 PNs) developed negative tone responses within an hour after conditioning, which depended on the weakening of their dendritic spines that were active during training. Blocking this form of anti-Hebbian plasticity using an optogenetic manipulation of CaMKII activity disrupted negative tone responses and freezing. Therefore, reducing the strength of spines active at the time of memory encoding leads to negative responses of L5 PNs. In turn, these negative responses curb M1's capacity for promoting movement, thereby aiding freezing. Collectively, this work provides a mechanistic understanding of how area-specific negative responses to behaviorally relevant cues can be achieved.

LTP induction by structural rather than enzymatic functions of CaMKII.

Learning and memory are thought to require hippocampal long-term potentiation (LTP), and one of the few central dogmas of molecular neuroscience that has stood undisputed for more than three decades is that LTP induction requires enzymatic activity of the Ca2+/calmodulin-dependent protein kinase II (CaMKII)1-3. However, as we delineate here, the experimental evidence is surprisingly far from conclusive. All previous interventions inhibiting enzymatic CaMKII activity and LTP4-8 also interfere with structural CaMKII roles, in particular binding to the NMDA-type glutamate receptor subunit GluN2B9-14. Thus, we here characterized and utilized complementary sets of new opto-/pharmaco-genetic tools to distinguish between enzymatic and structural CaMKII functions. Several independent lines of evidence demonstrated LTP induction by a structural function of CaMKII rather than by its enzymatic activity. The sole contribution of kinase activity was autoregulation of this structural role via T286 autophosphorylation, which explains why this distinction has been elusive for decades. Directly initiating the structural function in a manner that circumvented this T286 role was sufficient to elicit robust LTP, even when enzymatic CaMKII activity was blocked.

Stress to inflammation and anhedonia: Mechanistic insights from preclinical and clinical models.

Anhedonia, as evidenced by impaired pleasurable response to reward, reduced reward motivation, and/or deficits in reward-related learning, is a common feature of depression. Such deficits in reward processing are also an important clinical target as a risk factor for depression onset. Unfortunately, reward-related deficits remain difficult to treat. To address this gap and inform the development of effective prevention and treatment strategies, it is critical to understand the mechanisms that drive impairments in reward function. Stress-induced inflammation is a plausible mechanism of reward deficits. The purpose of this paper is to review evidence for two components of this psychobiological pathway: 1) the effects of stress on reward function; and 2) the effects of inflammation on reward function. Within these two areas, we draw upon preclinical and clinical models, distinguish between acute and chronic effects of stress and inflammation, and address specific domains of reward dysregulation. By addressing these contextual factors, the review reveals a nuanced literature which might be targeted for additional scientific inquiry to inform the development of precise interventions.

Self-regulation of visual word form area activation with real-time fMRI neurofeedback.

The Visual Word Form Area (VWFA) is a key region of the brain's reading network and its activation has been shown to be strongly associated with reading skills. Here, for the first time, we investigated whether voluntary regulation of VWFA activation is feasible using real-time fMRI neurofeedback. 40 adults with typical reading skills were instructed to either upregulate (UP group, N = 20) or downregulate (DOWN group, N = 20) their own VWFA activation during six neurofeedback training runs. The VWFA target region was individually defined based on a functional localizer task. Before and after training, also regulation runs without feedback ("no-feedback runs") were performed. When comparing the two groups, we found stronger activation across the reading network for the UP than the DOWN group. Further, activation in the VWFA was significantly stronger in the UP group than the DOWN group. Crucially, we observed a significant interaction of group and time (pre, post) for the no-feedback runs: The two groups did not differ significantly in their VWFA activation before neurofeedback training, but the UP group showed significantly stronger activation than the DOWN group after neurofeedback training. Our results indicate that upregulation of VWFA activation is feasible and that, once learned, successful upregulation can even be performed in the absence of feedback. These results are a crucial first step toward the development of a potential therapeutic support to improve reading skills in individuals with reading impairments.

Task-specific modulation of corticospinal neuron activity during motor learning in mice.

Motor skill learning relies on the plasticity of the primary motor cortex as task acquisition drives cortical motor network remodeling. Large-scale cortical remodeling of evoked motor outputs occurs during the learning of corticospinal-dependent prehension behavior, but not simple, non-dexterous tasks. Here we determine the response of corticospinal neurons to two distinct motor training paradigms and assess the role of corticospinal neurons in the execution of a task requiring precise modulation of forelimb movement and one that does not. In vivo calcium imaging in mice revealed temporal coding of corticospinal activity coincident with the development of precise prehension movements, but not more simplistic movement patterns. Transection of the corticospinal tract and optogenetic regulation of corticospinal activity show the necessity for patterned corticospinal network activity in the execution of precise movements but not simplistic ones. Our findings reveal a critical role for corticospinal network modulation in the learning and execution of precise motor movements.

Expanding the canon: An inclusive neurobiology of thalamic and subthalamic fear circuits.

Appropriate expression of fear in the face of threats in the environment is essential for survival. The sustained expression of fear in the absence of threat signals is a central pathological feature of trauma- and anxiety-related disorders. Our understanding of the neural circuitry that controls fear inhibition coalesces around the amygdala, hippocampus, and prefrontal cortex. By discussing thalamic and sub-thalamic influences on fear-related learning and expression in this review, we suggest a more inclusive neurobiological framework that expands our canonical view of fear. First, we visit how fear-related learning and expression is influenced by the aforementioned canonical brain regions. Next, we review emerging data that shed light on new roles for thalamic and subthalamic nuclei in fear-related learning and expression. Then, we highlight how these neuroanatomical hubs can modulate fear via integration of sensory and salient stimuli, gating information flow and calibrating behavioral responses, as well as maintaining and updating memory representations. Finally, we propose that the presence of this thalamic and sub-thalamic neuroanatomy in parallel with the tripartite prefrontal cortex-amygdala-hippocampus circuit allows for dynamic modulation of information based on interoceptive and exteroceptive signals. This article is part of the Special Issue on "Fear, Anxiety and PTSD".

Facilitated extinction but impaired extinction recall by eye movement manipulation in humans - Indications for action mechanisms and the applicability of eye movement desensitization.

Eye movement desensitization and reprocessing (EMDR) therapy utilizes the manipulation of eye movements to reduce affective distress during fear-exposure. Animal research recently suggested a potential neural mechanism underlying these effects, by which increased activity of the superior colliculus (SC), mediating visual attention, increases the inhibition of the basolateral amygdala (BLA), mediating defensive plasticity. We tested such mechanism in forty healthy humans using a multiple-day single-cue fear conditioning and extinction paradigm. The activity of the SC during extinction was experimentally manipulated by eye movements, as half of the participants executed saccadic eye movements (n = 20; major SC involvement), while the other half executed smooth eye pursuits (n = 20; minor SC involvement). Amygdala-mediated fear-potentiated startle responses and fear bradycardia, as well as threat expectancy was analyzed. Saccadic eye movements facilitated the extinction of fear bradycardia and fear-potentiated startle responses. Higher saccadic accuracy and range correlated with reduced fear-potentiated startle. However, during extinction recall, fear-potentiated startle and fear bradycardia resurged and partly reached levels obtained after fear acquisition. Threat expectancy was not affected by different eye movements and was not elevated during extinction recall. Within limitations, results support an inhibitory SC-BLA pathway in humans by which eye movements may reduce low-level defensive responding, but not threat expectancy. Yet, manipulating eye movements during extinction learning seems to impair extinction recall for behavioral and physiological defensive response indices. Thus, increasing SC activity might enhance initial efficacy of exposure treatment, but additional strategies seem necessary for sustained fear attenuation.

Cortico-thalamocortical interactions for learning, memory and decision-making.

The thalamus and cortex are interconnected both functionally and anatomically and share a common developmental trajectory. Interactions between the mediodorsal thalamus (MD) and different parts of the prefrontal cortex are essential in cognitive processes, such as learning and adaptive decision-making. Cortico-thalamocortical interactions involving other dorsal thalamic nuclei, including the anterior thalamus and pulvinar, also influence these cognitive processes. Our work, and that of others, indicates a crucial influence of these interdependent cortico-thalamocortical neural networks that contributes actively to the processing of information within the cortex. Each of these thalamic nuclei also receives potent subcortical inputs that are likely to provide additional influences on their regulation of cortical activity. Here, we highlight our current neuroscientific research aimed at establishing when cortico-MD thalamocortical neural network communication is vital within the context of a rapid learning and memory discrimination task. We are collecting evidence of MD-prefrontal cortex neural network communication in awake, behaving male rhesus macaques. Given the prevailing evidence, further studies are needed to identify both broad and specific mechanisms that govern how the MD, anterior thalamus and pulvinar cortico-thalamocortical interactions support learning, memory and decision-making. Current evidence shows that the MD (and the anterior thalamus) are crucial for frontotemporal communication, and the pulvinar is crucial for frontoparietal communication. Such work is crucial to advance our understanding of the neuroanatomical and physiological bases of these brain functions in humans. In turn, this might offer avenues to develop effective treatment strategies to improve the cognitive deficits often observed in many debilitating neurological disorders and diseases and in neurodegeneration.

Optimal Training for Movement Acquisition and Transfer: Does "Externally Focused" Visual Biofeedback Promote Implicit Motor Learning?

CONTEXT: Visual biofeedback has been shown to facilitate injury-resistant movement acquisition in adolescent athletes. Visual biofeedback is typically thought to foster implicit learning by stimulating athletes to focus attention externally (on movement outcome). However, biofeedback may also induce explicit learning if the athlete uses the visual information to consciously guide movement execution (via an internal focus). OBJECTIVE: To determine the degree to which athletes reported statements indicating implicit or explicit motor learning after engaging in a visual biofeedback intervention. DESIGN: Prospective cohort study. SETTING: Three-dimensional motion-analysis laboratory. PATIENTS OR OTHER PARTICIPANTS: Twenty-five adolescent female soccer athletes (age = 15.0 ± 1.5 years, height = 165.7 ± 5.9 cm, mass = 59.4 ± 10.6 kg). INTERVENTIONS: Standard 6-week neuromuscular training intervention (three 90-minute sessions/wk), with added visual biofeedback sessions (2 sessions/wk). For the biofeedback training, participants performed squatting and jumping movements while interacting with a visual rectangular stimulus that mapped key parameters associated with injury risk. After the last biofeedback session in each week, participants answered open-ended questions to probe learning strategies. MAIN OUTCOME MEASURE(S): Responses to the open-ended questions were categorized as externally focused (ie, on movement outcome, suggestive of implicit learning), internally focused (ie, on movement itself, suggestive of explicit learning), mixed focus, or other. RESULTS: A total of 171 open-ended responses were collected. Most of the responses that could be categorized (39.2%) were externally focused (41.8%), followed by mixed (38.8%) and internally focused (19.4%). The frequency of externally focused statements increased from week 1 (18%) to week 6 (50%). CONCLUSIONS: Although most statements were externally focused (suggesting implicit learning), the relatively large proportion of internal- and mixed-focus statements suggested that many athletes also engaged in explicit motor learning, especially in early practice sessions. Therefore, biofeedback may affect motor learning through a mixture of implicit and explicit learning.

Cortical activity during naturalistic music listening reflects short-range predictions based on long-term experience.

Expectations shape our experience of music. However, the internal model upon which listeners form melodic expectations is still debated. Do expectations stem from Gestalt-like principles or statistical learning? If the latter, does long-term experience play an important role, or are short-term regularities sufficient? And finally, what length of context informs contextual expectations? To answer these questions, we presented human listeners with diverse naturalistic compositions from Western classical music, while recording neural activity using MEG. We quantified note-level melodic surprise and uncertainty using various computational models of music, including a state-of-the-art transformer neural network. A time-resolved regression analysis revealed that neural activity over fronto-temporal sensors tracked melodic surprise particularly around 200ms and 300-500ms after note onset. This neural surprise response was dissociated from sensory-acoustic and adaptation effects. Neural surprise was best predicted by computational models that incorporated long-term statistical learning-rather than by simple, Gestalt-like principles. Yet, intriguingly, the surprise reflected primarily short-range musical contexts of less than ten notes. We present a full replication of our novel MEG results in an openly available EEG dataset. Together, these results elucidate the internal model that shapes melodic predictions during naturalistic music listening.

Cortical sensory processing across motivational states during goal-directed behavior.

Behavioral states can influence performance of goal-directed sensorimotor tasks. Yet, it is unclear how altered neuronal sensory representations in these states relate to task performance and learning. We trained water-restricted mice in a two-whisker discrimination task to study cortical circuits underlying perceptual decision-making under different levels of thirst. We identified somatosensory cortices as well as the premotor cortex as part of the circuit necessary for task execution. Two-photon calcium imaging in these areas identified populations selective to sensory or motor events. Analysis of task performance during individual sessions revealed distinct behavioral states induced by decreasing levels of thirst-related motivation. Learning was better explained by improvements in motivational state control rather than sensorimotor association. Whisker sensory representations in the cortex were altered across behavioral states. In particular, whisker stimuli could be better decoded from neuronal activity during high task performance states, suggesting that state-dependent changes of sensory processing influence decision-making.

Thalamic regulation of frontal interactions in human cognitive flexibility.

Interactions across frontal cortex are critical for cognition. Animal studies suggest a role for mediodorsal thalamus (MD) in these interactions, but the computations performed and direct relevance to human decision making are unclear. Here, inspired by animal work, we extended a neural model of an executive frontal-MD network and trained it on a human decision-making task for which neuroimaging data were collected. Using a biologically-plausible learning rule, we found that the model MD thalamus compressed its cortical inputs (dorsolateral prefrontal cortex, dlPFC) underlying stimulus-response representations. Through direct feedback to dlPFC, this thalamic operation efficiently partitioned cortical activity patterns and enhanced task switching across different contingencies. To account for interactions with other frontal regions, we expanded the model to compute higher-order strategy signals outside dlPFC, and found that the MD offered a more efficient route for such signals to switch dlPFC activity patterns. Human fMRI data provided evidence that the MD engaged in feedback to dlPFC, and had a role in routing orbitofrontal cortex inputs when subjects switched behavioral strategy. Collectively, our findings contribute to the emerging evidence for thalamic regulation of frontal interactions in the human brain.

Closed-loop acoustic stimulation during an afternoon nap to modulate subsequent encoding.

Sleep is able to contribute not only to memory consolidation, but also to post-sleep learning. The notion exists that either synaptic downscaling or another process during sleep increase post-sleep learning capacity. A correlation between augmentation of the sleep slow oscillation and hippocampal activation at encoding support the contribution of sleep to encoding of declarative memories. In the present study, the effect of closed-loop acoustic stimulation during an afternoon nap on post-sleep encoding of two verbal (word pairs, verbal learning and memory test) and non-verbal (figural pairs) tasks and on electroencephalogram during sleep and learning were investigated in young healthy adults (N = 16). Closed-loop acoustic stimulation enhanced slow oscillatory and spindle activity, but did not affect encoding at the group level. Subgroup analyses and comparisons with similar studies lead us to the tentative conclusion that further parameters such as time of day and subjects' cognitive ability influenced responses to closed-loop acoustic stimulation.

cacna2d3, a voltage-gated calcium channel subunit, functions in vertebrate habituation learning and the startle sensitivity threshold.

BACKGROUND: The ability to filter sensory information into relevant versus irrelevant stimuli is a fundamental, conserved property of the central nervous system and is accomplished in part through habituation learning. Synaptic plasticity that underlies habituation learning has been described at the cellular level, yet the genetic regulators of this plasticity remain poorly understood, as do circuits that mediate sensory filtering. METHODS: To identify genes critical for plasticity, a forward genetic screen for zebrafish genes that mediate habituation learning was performed, which identified a mutant allele, doryp177, that caused reduced habituation of the acoustic startle response. In this study, we combine whole-genome sequencing with behavioral analyses to characterize and identify the gene affected in doryp177 mutants. RESULTS: Whole-genome sequencing identified the calcium voltage-gated channel auxiliary subunit alpha-2/delta-3 (cacna2d3) as a candidate gene affected in doryp177 mutants. Behavioral characterization of larvae homozygous for two additional, independently derived mutant alleles of cacna2d3, together with failure of these alleles to complement doryp177, confirmed a critical role for cacna2d3 in habituation learning. Notably, detailed analyses of the acoustic response in mutant larvae also revealed increased startle sensitivity to acoustic stimuli, suggesting a broader role for cacna2d3 in controlling innate response thresholds to acoustic stimuli. CONCLUSIONS: Taken together, our data demonstrate a critical role for cacna2d3 in sensory filtering, a process that is disrupted in human CNS disorders, e.g. ADHD, schizophrenia, and autism.

Neurofeedback through the lens of reinforcement learning.

Despite decades of experimental and clinical practice, the neuropsychological mechanisms underlying neurofeedback (NF) training remain obscure. NF is a unique form of reinforcement learning (RL) task, during which participants are provided with rewarding feedback regarding desired changes in neural patterns. However, key RL considerations - including choices during practice, prediction errors, credit-assignment problems, or the exploration-exploitation tradeoff - have infrequently been considered in the context of NF. We offer an RL-based framework for NF, describing different internal states, actions, and rewards in common NF protocols, thus fashioning new proposals for characterizing, predicting, and hastening the course of learning. In this way we hope to advance current understanding of neural regulation via NF, and ultimately to promote its effectiveness, personalization, and clinical utility.