RESUMO
Determining the structure and mechanisms of all individual functional modules of cells at high molecular detail has often been seen as equal to understanding how cells work. Recent technical advances have led to a flush of high-resolution structures of various macromolecular machines, but despite this wealth of detailed information, our understanding of cellular function remains incomplete. Here, we discuss present-day limitations of structural biology and highlight novel technologies that may enable us to analyze molecular functions directly inside cells. We predict that the progression toward structural cell biology will involve a shift toward conceptualizing a 4D virtual reality of cells using digital twins. These will capture cellular segments in a highly enriched molecular detail, include dynamic changes, and facilitate simulations of molecular processes, leading to novel and experimentally testable predictions. Transferring biological questions into algorithms that learn from the existing wealth of data and explore novel solutions may ultimately unveil how cells work.
Assuntos
Biologia , Biologia Computacional , Substâncias Macromoleculares/químicaRESUMO
Discerning the effect of pharmacological exposures on intestinal bacterial communities in cancer patients is challenging. Here, we deconvoluted the relationship between drug exposures and changes in microbial composition by developing and applying a new computational method, PARADIGM (parameters associated with dynamics of gut microbiota), to a large set of longitudinal fecal microbiome profiles with detailed medication-administration records from patients undergoing allogeneic hematopoietic cell transplantation. We observed that several non-antibiotic drugs, including laxatives, antiemetics, and opioids, are associated with increased Enterococcus relative abundance and decreased alpha diversity. Shotgun metagenomic sequencing further demonstrated subspecies competition, leading to increased dominant-strain genetic convergence during allo-HCT that is significantly associated with antibiotic exposures. We integrated drug-microbiome associations to predict clinical outcomes in two validation cohorts on the basis of drug exposures alone, suggesting that this approach can generate biologically and clinically relevant insights into how pharmacological exposures can perturb or preserve microbiota composition. The application of a computational method called PARADIGM to a large dataset of cancer patients' longitudinal fecal specimens and detailed daily medication records reveals associations between drug exposures and the intestinal microbiota that recapitulate in vitro findings and are also predictive of clinical outcomes.
Assuntos
Microbioma Gastrointestinal , Transplante de Células-Tronco Hematopoéticas , Microbiota , Neoplasias , Humanos , Microbioma Gastrointestinal/genética , Fezes/microbiologia , Metagenoma , Antibacterianos , Neoplasias/tratamento farmacológicoRESUMO
A fraction of mature T cells can be activated by peripheral self-antigens, potentially eliciting host autoimmunity. We investigated homeostatic control of self-activated T cells within unperturbed tissue environments by combining high-resolution multiplexed and volumetric imaging with computational modeling. In lymph nodes, self-activated T cells produced interleukin (IL)-2, which enhanced local regulatory T cell (Treg) proliferation and inhibitory functionality. The resulting micro-domains reciprocally constrained inputs required for damaging effector responses, including CD28 co-stimulation and IL-2 signaling, constituting a negative feedback circuit. Due to these local constraints, self-activated T cells underwent transient clonal expansion, followed by rapid death ("pruning"). Computational simulations and experimental manipulations revealed the feedback machinery's quantitative limits: modest reductions in Treg micro-domain density or functionality produced non-linear breakdowns in control, enabling self-activated T cells to subvert pruning. This fine-tuned, paracrine feedback process not only enforces immune homeostasis but also establishes a sharp boundary between autoimmune and host-protective T cell responses.
Assuntos
Retroalimentação Fisiológica , Homeostase/imunologia , Ativação Linfocitária/imunologia , Linfócitos T Reguladores/imunologia , Animais , Autoantígenos/imunologia , Linfócitos T CD4-Positivos/imunologia , Proliferação de Células , Interleucina-2/metabolismo , Microdomínios da Membrana/metabolismo , Camundongos Endogâmicos C57BL , Modelos Imunológicos , Comunicação Parácrina , Transdução de SinaisRESUMO
In allogeneic hematopoietic stem cell transplantation, donor αß T cells attack recipient tissues, causing graft-versus-host disease (GVHD), a major cause of morbidity and mortality. A central question has been how GVHD is sustained despite T cell exhaustion from chronic antigen stimulation. The current model for GVHD holds that disease is maintained through the continued recruitment of alloreactive effectors from blood into affected tissues. Here, we show, using multiple approaches including parabiosis of mice with GVHD, that GVHD is instead primarily maintained locally within diseased tissues. By tracking 1,203 alloreactive T cell clones, we fitted a mathematical model predicting that within each tissue a small number of progenitor T cells maintain a larger effector pool. Consistent with this, we identified a tissue-resident TCF-1+ subpopulation that preferentially engrafted, expanded, and differentiated into effectors upon adoptive transfer. These results suggest that therapies targeting affected tissues and progenitor T cells within them would be effective.
Assuntos
Doença Enxerto-Hospedeiro , Transplante de Células-Tronco Hematopoéticas , Camundongos , Animais , Linfócitos T , Transplante Homólogo/efeitos adversos , Doença Enxerto-Hospedeiro/etiologia , Transplante de Células-Tronco Hematopoéticas/efeitos adversos , Transplante de Células-Tronco Hematopoéticas/métodosRESUMO
Organ-specific functions of tissue-resident macrophages in the steady-state heart are unknown. Here, we show that cardiac macrophages facilitate electrical conduction through the distal atrioventricular node, where conducting cells densely intersperse with elongated macrophages expressing connexin 43. When coupled to spontaneously beating cardiomyocytes via connexin-43-containing gap junctions, cardiac macrophages have a negative resting membrane potential and depolarize in synchrony with cardiomyocytes. Conversely, macrophages render the resting membrane potential of cardiomyocytes more positive and, according to computational modeling, accelerate their repolarization. Photostimulation of channelrhodopsin-2-expressing macrophages improves atrioventricular conduction, whereas conditional deletion of connexin 43 in macrophages and congenital lack of macrophages delay atrioventricular conduction. In the Cd11bDTR mouse, macrophage ablation induces progressive atrioventricular block. These observations implicate macrophages in normal and aberrant cardiac conduction.
Assuntos
Sistema de Condução Cardíaco , Macrófagos/fisiologia , Animais , Conexina 43/metabolismo , Feminino , Átrios do Coração/citologia , Humanos , Masculino , Camundongos , Camundongos Endogâmicos C57BL , Pessoa de Meia-Idade , Miócitos Cardíacos/fisiologiaRESUMO
The complexity of cardiac electrophysiology, involving dynamic changes in numerous components across multiple spatial (from ion channel to organ) and temporal (from milliseconds to days) scales, makes an intuitive or empirical analysis of cardiac arrhythmogenesis challenging. Multiscale mechanistic computational models of cardiac electrophysiology provide precise control over individual parameters, and their reproducibility enables a thorough assessment of arrhythmia mechanisms. This review provides a comprehensive analysis of models of cardiac electrophysiology and arrhythmias, from the single cell to the organ level, and how they can be leveraged to better understand rhythm disorders in cardiac disease and to improve heart patient care. Key issues related to model development based on experimental data are discussed, and major families of human cardiomyocyte models and their applications are highlighted. An overview of organ-level computational modeling of cardiac electrophysiology and its clinical applications in personalized arrhythmia risk assessment and patient-specific therapy of atrial and ventricular arrhythmias is provided. The advancements presented here highlight how patient-specific computational models of the heart reconstructed from patient data have achieved success in predicting risk of sudden cardiac death and guiding optimal treatments of heart rhythm disorders. Finally, an outlook toward potential future advances, including the combination of mechanistic modeling and machine learning/artificial intelligence, is provided. As the field of cardiology is embarking on a journey toward precision medicine, personalized modeling of the heart is expected to become a key technology to guide pharmaceutical therapy, deployment of devices, and surgical interventions.
Assuntos
Arritmias Cardíacas , Modelos Cardiovasculares , Humanos , Arritmias Cardíacas/fisiopatologia , Animais , Simulação por Computador , Pesquisa Translacional Biomédica , Miócitos Cardíacos/fisiologia , Fenômenos Eletrofisiológicos/fisiologia , Potenciais de Ação/fisiologiaRESUMO
The neocortex is a complex neurobiological system with many interacting regions. How these regions work together to subserve flexible behavior and cognition has become increasingly amenable to rigorous research. Here, I review recent experimental and theoretical work on the modus operandi of a multiregional cortex. These studies revealed several general principles for the neocortical interareal connectivity, low-dimensional macroscopic gradients of biological properties across cortical areas, and a hierarchy of timescales for information processing. Theoretical work suggests testable predictions regarding differential excitation and inhibition along feedforward and feedback pathways in the cortical hierarchy. Furthermore, modeling of distributed working memory and simple decision-making has given rise to a novel mathematical concept, dubbed bifurcation in space, that potentially explains how different cortical areas, with a canonical circuit organization but gradients of biological heterogeneities, are able to subserve their respective (e.g., sensory coding versus executive control) functions in a modularly organized brain.
Assuntos
Neocórtex , Cognição/fisiologia , Função Executiva , Memória de Curto Prazo/fisiologia , Neocórtex/fisiologia , Rede Nervosa/fisiologiaRESUMO
Protein-mediated membrane fusion is the dynamic process where specialized protein machinery undergoes dramatic conformational changes that drive two membrane bilayers together, leading to lipid mixing and opening of a fusion pore between previously separate membrane-bound compartments. Membrane fusion is an essential stage of enveloped virus entry that results in viral genome delivery into host cells. Recent studies applying cryo-electron microscopy techniques in a time-resolved fashion provide unprecedented glimpses into the interaction of viral fusion proteins and membranes, revealing fusion intermediate states from the initiation of fusion to release of the viral genome. In combination with complementary structural, biophysical, and computation modeling approaches, these advances are shedding new light on the mechanics and dynamics of protein-mediated membrane fusion.
RESUMO
Ribosomal frameshifting during the translation of RNA is implicated in human disease and viral infection. While previous work has uncovered many details about single RNA frameshifting kinetics in vitro, little is known about how single RNA frameshift in living systems. To confront this problem, we have developed technology to quantify live-cell single RNA translation dynamics in frameshifted open reading frames. Applying this technology to RNA encoding the HIV-1 frameshift sequence reveals a small subset (â¼8%) of the translating pool robustly frameshift. Frameshifting RNA are translated at similar rates as non-frameshifting RNA (â¼3 aa/s) and can continuously frameshift for more than four rounds of translation. Fits to a bursty model of frameshifting constrain frameshifting kinetic rates and demonstrate how ribosomal traffic jams contribute to the persistence of the frameshifting state. These data provide insight into retroviral frameshifting and could lead to alternative strategies to perturb the process in living cells.
Assuntos
Mudança da Fase de Leitura do Gene Ribossômico , HIV-1/genética , Fases de Leitura Aberta , Osteoblastos/metabolismo , RNA Viral/genética , Imagem Individual de Molécula/métodos , Pareamento de Bases , Linhagem Celular Tumoral , HIV-1/metabolismo , Humanos , Modelos Genéticos , Conformação de Ácido Nucleico , Sondas de Oligonucleotídeos/síntese química , Sondas de Oligonucleotídeos/genética , Sondas de Oligonucleotídeos/metabolismo , Oligopeptídeos/genética , Oligopeptídeos/metabolismo , Osteoblastos/virologia , RNA Viral/química , RNA Viral/metabolismo , Coloração e Rotulagem/métodosRESUMO
Human working memory is a key cognitive process that engages multiple functional anatomical nodes across the brain. Despite a plethora of correlative neuroimaging evidence regarding the working memory architecture, our understanding of critical hubs causally controlling overall performance is incomplete. Causal interpretation requires cognitive testing following safe, temporal, and controllable neuromodulation of specific functional anatomical nodes. Such experiments became available in healthy humans with the advance of transcranial alternating current stimulation (tACS). Here, we synthesize findings of 28 placebo-controlled studies (in total, 1,057 participants) that applied frequency-specific noninvasive stimulation of neural oscillations and examined working memory performance in neurotypical adults. We use a computational meta-modeling method to simulate each intervention in realistic virtual brains and test reported behavioral outcomes against the stimulation-induced electric fields in different brain nodes. Our results show that stimulating anterior frontal and medial temporal theta oscillations and occipitoparietal gamma rhythms leads to significant dose-dependent improvement in working memory task performance. Conversely, prefrontal gamma modulation is detrimental to performance. Moreover, we found distinct spatial expression of theta subbands, where working memory changes followed orbitofrontal high-theta modulation and medial temporal low-theta modulation. Finally, all these results are driven by changes in working memory accuracy rather than processing time measures. These findings provide a fresh view of the working memory mechanisms, complementary to neuroimaging research, and propose hypothesis-driven targets for the clinical treatment of working memory deficits.
Assuntos
Memória de Curto Prazo , Estimulação Transcraniana por Corrente Contínua , Adulto , Humanos , Memória de Curto Prazo/fisiologia , Ritmo Gama/fisiologia , Encéfalo , Cognição/fisiologia , Transtornos da Memória , Estimulação Transcraniana por Corrente Contínua/métodosRESUMO
In many organisms, most notably Drosophila, homologous chromosomes associate in somatic cells, a phenomenon known as somatic pairing, which takes place without double strand breaks or strand invasion, thus requiring some other mechanism for homologs to recognize each other. Several studies have suggested a "specific button" model, in which a series of distinct regions in the genome, known as buttons, can associate with each other, mediated by different proteins that bind to these different regions. Here, we use computational modeling to evaluate an alternative "button barcode" model, in which there is only one type of recognition site or adhesion button, present in many copies in the genome, each of which can associate with any of the others with equal affinity. In this model, buttons are nonuniformly distributed, such that alignment of a chromosome with its correct homolog, compared with a nonhomolog, is energetically favored; since to achieve nonhomologous alignment, chromosomes would be required to mechanically deform in order to bring their buttons into mutual register. By simulating randomly generated nonuniform button distributions, many highly effective button barcodes can be easily found, some of which achieve virtually perfect pairing fidelity. This model is consistent with existing literature on the effect of translocations of different sizes on homolog pairing. We conclude that a button barcode model can attain highly specific homolog recognition, comparable to that seen in actual cells undergoing somatic homolog pairing, without the need for specific interactions. This model may have implications for how meiotic pairing is achieved.
Assuntos
Modelos Genéticos , Animais , Pareamento Cromossômico , Drosophila melanogaster/genética , Cromossomos , Drosophila/genética , Simulação por Computador , Cromossomos de Insetos/genética , Cromossomos de Insetos/metabolismoRESUMO
Perceptual decision-making is highly dependent on the momentary arousal state of the brain, which fluctuates over time on a scale of hours, minutes, and even seconds. The textbook relationship between momentary arousal and task performance is captured by an inverted U-shape, as put forward in the Yerkes-Dodson law. This law suggests optimal performance at moderate levels of arousal and impaired performance at low or high arousal levels. However, despite its popularity, the evidence for this relationship in humans is mixed at best. Here, we use pupil-indexed arousal and performance data from various perceptual decision-making tasks to provide converging evidence for the inverted U-shaped relationship between spontaneous arousal fluctuations and performance across different decision types (discrimination, detection) and sensory modalities (visual, auditory). To further understand this relationship, we built a neurobiologically plausible mechanistic model and show that it is possible to reproduce our findings by incorporating two types of interneurons that are both modulated by an arousal signal. The model architecture produces two dynamical regimes under the influence of arousal: one regime in which performance increases with arousal and another regime in which performance decreases with arousal, together forming an inverted U-shaped arousal-performance relationship. We conclude that the inverted U-shaped arousal-performance relationship is a general and robust property of sensory processing. It might be brought about by the influence of arousal on two types of interneurons that together act as a disinhibitory pathway for the neural populations that encode the available sensory evidence used for the decision.
Assuntos
Nível de Alerta , Encéfalo , Humanos , Nível de Alerta/fisiologia , Análise e Desempenho de Tarefas , Pupila/fisiologia , SensaçãoRESUMO
Disease risk prediction based on genomic sequence and transcriptional profile can improve disease screening and prevention. Despite identifying many disease-associated DNA variants, distinguishing deleterious non-coding DNA variations remains poor for most common diseases. In this study, we designed in vitro experiments to uncover the significance of occupancy and competitive binding between P53 and cMYC on common target genes. Analyzing publicly available ChIP-seq data for P53 and cMYC in embryonic stem cells showed that ~344-366 regions are co-occupied, and on average, two cis-overlapping motifs (CisOMs) per region were identified, suggesting that co-occupancy is evolutionarily conserved. Using U2OS and Raji cells untreated and treated with doxorubicin to increase P53 protein level while potentially reducing cMYC level, ChIP-seq analysis illustrated that around 16 to 922 genomic regions were co-occupied by P53 and cMYC, and substitutions of cMYC signals by P53 were detected post doxorubicin treatment. Around 187 expressed genes near co-occupied regions were altered at mRNA level according to RNA-seq data analysis. We utilized a computational motif-matching approach to illustrate that changes in predicted P53 binding affinity in CisOMs of co-occupied elements significantly correlate with alterations in reporter gene expression. We performed a similar analysis using SNPs mapped in CisOMs for P53 and cMYC from ChIP-seq data, and expression of target genes from GTEx portal. We found significant correlation between change in cMYC-motif binding affinity in CisOMs and altered expression. Our study brings us closer to developing a generally applicable approach to filter etiological non-coding variations associated with common diseases.
RESUMO
Tissue and inflammatory contexts are well appreciated to shape macrophage function to promote health or disease. However, there has been minimal progress towards understanding how these contexts modify signaling-to-transcription networks. Integration of mechanistic modeling and data-driven approaches will be crucial for investigating how cell state impacts macrophage decision-making.
Assuntos
Promoção da Saúde , Transdução de Sinais , Humanos , Macrófagos/metabolismo , Redes Reguladoras de GenesRESUMO
Development of single-component organic phosphor attracts increasing interest due to its wide applications in optoelectronic technologies. Theoretically, activating efficient intersystem crossing (ISC) via 1(π, π*) to 3(π, π*) transitions, rather than 1(n, π*) â 3(π, π*) transitions, is an alternative access to purely organic phosphors but remains challenging. Herein, we designed and successfully synthesized the sila-8-membered ring fused biaryl benzoskeleton by transition metal catalysis, which served as a new organic phosphor with efficient 1(π, π*) to 3(π, π*) ISC. We first found that such a compound exhibits a record-long phosphorescence lifetime of 6.5 s at low temperature for single-component organic systems. Then, we developed two strategies to tune their decay channels to evolve such nonemissive molecules into bright phosphors with elongated lifetimes at room temperature: 1) Physic-based design, where quantitative analyses of electron-phonon coupling led us to reveal and hinder the major nonradiative channels, thus lighted up room temperature phosphorescence (RTP) with a lifetime of 480 ms at 298 K; 2) chemical geometry-driven molecular engineering, where a geometry-based descriptor ΔΘT1-S0/ΘS0 was developed for rational screening RTP candidates and further improved the RTP lifetime to 794 ms. This study clearly shows the power of interdiscipline among synthetic methodology, physics-based rational design, and computational modeling, which represents a paradigm for the development of an organic emitter.
RESUMO
Stigmergy is a generic coordination mechanism widely used by animal societies, in which traces left by individuals in a medium guide and stimulate their subsequent actions. In humans, new forms of stigmergic processes have emerged through the development of online services that extensively use the digital traces left by their users. Here, we combine interactive experiments with faithful data-based modeling to investigate how groups of individuals exploit a simple rating system and the resulting traces in an information search task in competitive or noncompetitive conditions. We find that stigmergic interactions can help groups to collectively find the cells with the highest values in a table of hidden numbers. We show that individuals can be classified into three behavioral profiles that differ in their degree of cooperation. Moreover, the competitive situation prompts individuals to give deceptive ratings and reinforces the weight of private information versus social information in their decisions.
Assuntos
Enganação , Processos Grupais , HumanosRESUMO
Many ion channels are multisubunit complexes where oligomerization is an obligatory requirement for function as the binding axis forms the charged permeation pathway. However, the mechanisms of in-membrane assembly of thermodynamically stable channels are largely unknown. Here, we demonstrate a key advance by reporting the dimerization equilibrium reaction of an inverted-topology, homodimeric fluoride channel Fluc in lipid bilayers. While the wild-type channel is a long-lived dimer, we leverage a known mutation, N43S, that weakens Na+ binding in a buried site at the interface, thereby unlocking the complex for reversible association in lipid bilayers. Single-channel recordings show that Na+ binding is required for fluoride conduction while single-molecule microscopy experiments demonstrate that N43S Fluc exists in a dynamic monomer-dimer equilibrium in the membrane, even following removal of Na+. Quantifying the thermodynamic stability while titrating Na+ indicates that dimerization occurs first, providing a membrane-embedded binding site where Na+ binding weakly stabilizes the complex. To understand how these subunits form stable assemblies while presenting charged surfaces to the membrane, we carried out molecular dynamics simulations, which show the formation of a thinned membrane defect around the exposed dimerization interface. In simulations where subunits are permitted to encounter each other while preventing protein contacts, we observe spontaneous and selective association at the native interface, where stability is achieved by mitigation of the membrane defect. These results suggest a model wherein membrane-associated forces drive channel assembly in the native orientation while subsequent factors, such as Na+ binding, result in channel activation.
Assuntos
Fluoretos , Bicamadas Lipídicas , Dimerização , Bicamadas Lipídicas/química , Canais Iônicos/metabolismo , Sítios de LigaçãoRESUMO
Large-scale language datasets and advances in natural language processing offer opportunities for studying people's cognitions and behaviors. We show how representations derived from language can be combined with laboratory-based word norms to predict implicit attitudes for diverse concepts. Our approach achieves substantially higher correlations than existing methods. We also show that our approach is more predictive of implicit attitudes than are explicit attitudes, and that it captures variance in implicit attitudes that is largely unexplained by explicit attitudes. Overall, our results shed light on how implicit attitudes can be measured by combining standard psychological data with large-scale language data. In doing so, we pave the way for highly accurate computational modeling of what people think and feel about the world around them.
Assuntos
Cognição , Emoções , Humanos , Simulação por Computador , Laboratórios , AtitudeRESUMO
Previous studies have demonstrated that auditory cortex activity can be influenced by cross-sensory visual inputs. Intracortical laminar recordings in nonhuman primates have suggested a feedforward (FF) type profile for auditory evoked but feedback (FB) type for visual evoked activity in the auditory cortex. To test whether cross-sensory visual evoked activity in the auditory cortex is associated with FB inputs also in humans, we analyzed magnetoencephalography (MEG) responses from eight human subjects (six females) evoked by simple auditory or visual stimuli. In the estimated MEG source waveforms for auditory cortex regions of interest, auditory evoked response showed peaks at 37 and 90â ms and visual evoked response at 125â ms. The inputs to the auditory cortex were modeled through FF- and FB-type connections targeting different cortical layers using the Human Neocortical Neurosolver (HNN), which links cellular- and circuit-level mechanisms to MEG signals. HNN modeling suggested that the experimentally observed auditory response could be explained by an FF input followed by an FB input, whereas the cross-sensory visual response could be adequately explained by just an FB input. Thus, the combined MEG and HNN results support the hypothesis that cross-sensory visual input in the auditory cortex is of FB type. The results also illustrate how the dynamic patterns of the estimated MEG source activity can provide information about the characteristics of the input into a cortical area in terms of the hierarchical organization among areas.
Assuntos
Estimulação Acústica , Córtex Auditivo , Potenciais Evocados Visuais , Magnetoencefalografia , Estimulação Luminosa , Humanos , Córtex Auditivo/fisiologia , Magnetoencefalografia/métodos , Feminino , Masculino , Adulto , Estimulação Luminosa/métodos , Potenciais Evocados Visuais/fisiologia , Estimulação Acústica/métodos , Modelos Neurológicos , Adulto Jovem , Potenciais Evocados Auditivos/fisiologia , Neurônios/fisiologia , Mapeamento Encefálico/métodosRESUMO
Reinforcement learning is a theoretical framework that describes how agents learn to select options that maximize rewards and minimize punishments over time. We often make choices, however, to obtain symbolic reinforcers (e.g., money, points) that are later exchanged for primary reinforcers (e.g., food, drink). Although symbolic reinforcers are ubiquitous in our daily lives, widely used in laboratory tasks because they can be motivating, mechanisms by which they become motivating are less understood. In the present study, we examined how monkeys learn to make choices that maximize fluid rewards through reinforcement with tokens. The question addressed here is how the value of a state, which is a function of multiple task features (e.g., the current number of accumulated tokens, choice options, task epoch, trials since the last delivery of primary reinforcer, etc.), drives value and affects motivation. We constructed a Markov decision process model that computes the value of task states given task features to then correlate with the motivational state of the animal. Fixation times, choice reaction times, and abort frequency were all significantly related to values of task states during the tokens task (n = 5 monkeys, three males and two females). Furthermore, the model makes predictions for how neural responses could change on a moment-by-moment basis relative to changes in the state value. Together, this task and model allow us to capture learning and behavior related to symbolic reinforcement.