Working Memory for Spatial Sequences: Developmental and Evolutionary Factors in Encoding Ordinal and Relational Structures.

Sequence learning is a ubiquitous facet of human and animal cognition. Here, using a common sequence reproduction task, we investigated whether and how the ordinal and relational structures linking consecutive elements are acquired by human adults, children, and macaque monkeys. While children and monkeys exhibited significantly lower precision than adults for spatial location and temporal order information, only monkeys appeared to exceedingly focus on the first item. Most importantly, only humans, regardless of age, spontaneously extracted the spatial relations between consecutive items and used a chunking strategy to compress sequences in working memory. Monkeys did not detect such relational structures, even after extensive training. Monkey behavior was captured by a conjunctive coding model, whereas a chunk-based conjunctive model explained more variance in humans. These age- and species-related differences are indicative of developmental and evolutionary mechanisms of sequence encoding and may provide novel insights into the uniquely human cognitive capacities.SIGNIFICANCE STATEMENT Sequence learning, the ability to encode the order of discrete elements and their relationships presented within a sequence, is a ubiquitous facet of cognition among humans and animals. By exploring sequence-processing abilities at different human developmental stages and in nonhuman primates, we found that only humans, regardless of age, spontaneously extracted the spatial relations between consecutive items and used an internal language to compress sequences in working memory. The findings provided insights into understanding the origins of sequence capabilities in humans and how they evolve through development to identify the unique aspects of human cognitive capacity, which includes the comprehension, learning, and production of sequences, and perhaps, above all, language processing.

Imagetic and affective measures of memory reverberation diverge at sleep onset in association with theta rhythm.

The 'day residue' - the presence of waking memories into dreams - is a century-old concept that remains controversial in neuroscience. Even at the psychological level, it remains unclear how waking imagery cedes into dreams. Are visual and affective residues enhanced, modified, or erased at sleep onset? Are they linked, or dissociated? What are the neural correlates of these transformations? To address these questions we combined quantitative semantics, sleep EEG markers, visual stimulation, and multiple awakenings to investigate visual and affect residues in hypnagogic imagery at sleep onset. Healthy adults were repeatedly stimulated with an affective image, allowed to sleep and awoken seconds to minutes later, during waking (WK), N1 or N2 sleep stages. 'Image Residue' was objectively defined as the formal semantic similarity between oral reports describing the last image visualized before closing the eyes ('ground image'), and oral reports of subsequent visual imagery ('hypnagogic imagery). Similarly, 'Affect Residue' measured the proximity of affective valences between 'ground image' and 'hypnagogic imagery'. We then compared these grounded measures of two distinct aspects of the 'day residue', calculated within participants, to randomly generated values calculated across participants. The results show that Image Residue persisted throughout the transition to sleep, increasing during N1 in proportion to the time spent in this stage. In contrast, the Affect Residue was gradually neutralized as sleep progressed, decreasing in proportion to the time spent in N1 and reaching a minimum during N2. EEG power in the theta band (4.5-6.5 Hz) was inversely correlated with the Image Residue during N1. The results show that the visual and affective aspects of the 'day residue' in hypnagogic imagery diverge at sleep onset, possibly decoupling visual contents from strong negative emotions, in association with increased theta rhythm.

A theory of memory for binary sequences: Evidence for a mental compression algorithm in humans.

Working memory capacity can be improved by recoding the memorized information in a condensed form. Here, we tested the theory that human adults encode binary sequences of stimuli in memory using an abstract internal language and a recursive compression algorithm. The theory predicts that the psychological complexity of a given sequence should be proportional to the length of its shortest description in the proposed language, which can capture any nested pattern of repetitions and alternations using a limited number of instructions. Five experiments examine the capacity of the theory to predict human adults' memory for a variety of auditory and visual sequences. We probed memory using a sequence violation paradigm in which participants attempted to detect occasional violations in an otherwise fixed sequence. Both subjective complexity ratings and objective violation detection performance were well predicted by our theoretical measure of complexity, which simply reflects a weighted sum of the number of elementary instructions and digits in the shortest formula that captures the sequence in our language. While a simpler transition probability model, when tested as a single predictor in the statistical analyses, accounted for significant variance in the data, the goodness-of-fit with the data significantly improved when the language-based complexity measure was included in the statistical model, while the variance explained by the transition probability model largely decreased. Model comparison also showed that shortest description length in a recursive language provides a better fit than six alternative previously proposed models of sequence encoding. The data support the hypothesis that, beyond the extraction of statistical knowledge, human sequence coding relies on an internal compression using language-like nested structures.

Peer tutoring of computer programming increases exploratory behavior in children.

There is growing interest in teaching computer science and programming skills in schools. Here we investigated the efficacy of peer tutoring, which is known to be a useful educational resource in other domains but never before has been examined in such a core aspect of applied logical thinking in children. We compared (a) how children (N = 42, age range = 7 years 1 month to 8 years 4 months) learn computer programming from an adult versus learning from a peer and (b) the effect of teaching a peer versus simply revising what has been learned. Our results indicate that children taught by a peer showed comparable overall performance-a combination of accuracy and response times-to their classmates taught by an adult. However, there was a speed-accuracy trade-off, and peer-taught children showed more exploratory behavior, with shorter response times at the expense of lower accuracy. In contrast, no tutor effects (i.e., resulting from teaching a peer) were found. Thus, our results provide empirical evidence in support of peer tutoring as a way to help teach computer programming to children. This could contribute to the promotion of a widespread understanding of how computers operate and how to shape them, which is essential to our values of democracy, plurality, and freedom.

Statistical inference of body representation in the macaque brain.

The sense of one's own body is a pillar of self-consciousness and could be investigated by inducing human illusions of artificial objects as part of the self. Here, we present a nonhuman primate version of a rubber-hand illusion that allowed us to determine its computational and neuronal mechanisms. We implemented a video-based system in a reaching task in monkeys and combined a casual inference model to establish an objective and quantitative signature for the monkey's body representation. Similar to humans, monkeys were more likely to perceive an external object as part of the self when the dynamics (spatial disparity) and the features (shape and structure) of visual (V) input was closer to proprioceptive (P) signals. Neural signals in the monkey's premotor cortex reflected the strength of illusion and the likelihood of misattributing the illusory hand to oneself, thus, revealing a cortical representation of body ownership.

Circuits with broken fibration symmetries perform core logic computations in biological networks.

We show that logic computational circuits in gene regulatory networks arise from a fibration symmetry breaking in the network structure. From this idea we implement a constructive procedure that reveals a hierarchy of genetic circuits, ubiquitous across species, that are surprising analogues to the emblematic circuits of solid-state electronics: starting from the transistor and progressing to ring oscillators, current-mirror circuits to toggle switches and flip-flops. These canonical variants serve fundamental operations of synchronization and clocks (in their symmetric states) and memory storage (in their broken symmetry states). These conclusions introduce a theoretically principled strategy to search for computational building blocks in biological networks, and present a systematic route to design synthetic biological circuits.

The entropic tongue: Disorganization of natural language under LSD.

Serotonergic psychedelics have been suggested to mirror certain aspects of psychosis, and, more generally, elicit a state of consciousness underpinned by increased entropy of on-going neural activity. We investigated the hypothesis that language produced under the effects of lysergic acid diethylamide (LSD) should exhibit increased entropy and reduced semantic coherence. Computational analysis of interviews conducted at two different time points after 75 µg of intravenous LSD verified this prediction. Non-semantic analysis of speech organization revealed increased verbosity and a reduced lexicon, changes that are more similar to those observed during manic psychoses than in schizophrenia, which was confirmed by direct comparison with reference samples. Importantly, features related to language organization allowed machine learning classifiers to identify speech under LSD with accuracy comparable to that obtained by examining semantic content. These results constitute a quantitative and objective characterization of disorganized natural speech as a landmark feature of the psychedelic state.

Maintaining trust when agents can engage in self-deception.

The coexistence of cooperation and selfish instincts is a remarkable characteristic of humans. Psychological research has unveiled the cognitive mechanisms behind self-deception. Two important findings are that a higher ambiguity about others' social preferences leads to a higher likelihood of acting selfishly and that agents acting selfishly will increase their belief that others are also selfish. In this work, we posit a mathematical model of these mechanisms and explain their impact on the undermining of a global cooperative society. We simulate the behavior of agents playing a prisoner's dilemma game in a random network of contacts. We endow each agent with these two self-deception mechanisms which bias her toward thinking that the other agent will defect. We study behavior when a fraction of agents with the "always defect" strategy is introduced in the network. Depending on the magnitude of the biases the players could start a cascade of defection or isolate the defectors. We find that there are thresholds above which the system approaches a state of complete distrust.

Representation of spatial sequences using nested rules in human prefrontal cortex.

Memory for spatial sequences does not depend solely on the number of locations to be stored, but also on the presence of spatial regularities. Here, we show that the human brain quickly stores spatial sequences by detecting geometrical regularities at multiple time scales and encoding them in a format akin to a programming language. We measured gaze-anticipation behavior while spatial sequences of variable regularity were repeated. Participants' behavior suggested that they quickly discovered the most compact description of each sequence in a language comprising nested rules, and used these rules to compress the sequence in memory and predict the next items. Activity in dorsal inferior prefrontal cortex correlated with the amount of compression, while right dorsolateral prefrontal cortex encoded the presence of embedded structures. Sequence learning was accompanied by a progressive differentiation of multi-voxel activity patterns in these regions. We propose that humans are endowed with a simple "language of geometry" which recruits a dorsal prefrontal circuit for geometrical rules, distinct from but close to areas involved in natural language processing.

An entropic barriers diffusion theory of decision-making in multiple alternative tasks.

We present a theory of decision-making in the presence of multiple choices that departs from traditional approaches by explicitly incorporating entropic barriers in a stochastic search process. We analyze response time data from an on-line repository of 15 million blitz chess games, and show that our model fits not just the mean and variance, but the entire response time distribution (over several response-time orders of magnitude) at every stage of the game. We apply the model to show that (a) higher cognitive expertise corresponds to the exploration of more complex solution spaces, and (b) reaction times of users at an on-line buying website can be similarly explained. Our model can be seen as a synergy between diffusion models used to model simple two-choice decision-making and planning agents in complex problem solving.

Language, gesture, and judgment: Children's paths to abstract geometry.

As infants, children are sensitive to geometry when recognizing objects or navigating through rooms; however, explicit knowledge of geometry develops slowly and may be unstable even in adults. How can geometric concepts be both so accessible and so elusive? To examine how implicit and explicit geometric concepts develop, the current study assessed, in 132 children (3-8 years old) while they played a simple geometric judgment task, three distinctive channels: children's choices during the game as well as the language and gestures they used to justify and accompany their choices. Results showed that, for certain geometric properties, children chose the correct card even if they could not express with words (or gestures) why they had made this choice. Furthermore, other geometric concepts were expressed and supported by gestures prior to their articulation in either choices or speech. These findings reveal that gestures and behavioral choices may reflect implicit knowledge and serve as a foundation for the development of geometric reasoning. Altogether, our results suggest that language alone might not be enough for expressing and organizing geometric concepts and that children pursue multiple paths to overcome its limitations, a finding with potential implications for primary education in mathematics.

Parsing a mental program: Fixation-related brain signatures of unitary operations and routines in natural visual search.

Visual search involves a sequence or routine of unitary operations (i.e. fixations) embedded in a larger mental global program. The process can indeed be seen as a program based on a while loop (while the target is not found), a conditional construct (whether the target is matched or not based on specific recognition algorithms) and a decision making step to determine the position of the next searched location based on existent evidence. Recent developments in our ability to co-register brain scalp potentials (EEG) during free eye movements has allowed investigating brain responses related to fixations (fixation-Related Potentials; fERPs), including the identification of sensory and cognitive local EEG components linked to individual fixations. However, the way in which the mental program guiding the search unfolds has not yet been investigated. We performed an EEG and eye tracking co-registration experiment in which participants searched for a target face in natural images of crowds. Here we show how unitary steps of the program are encoded by specific local target detection signatures and how the positioning of each unitary operation within the global search program can be pinpointed by changes in the EEG signal amplitude as well as the signal power in different frequency bands. By simultaneously studying brain signatures of unitary operations and those occurring during the sequence of fixations, our study sheds light into how local and global properties are combined in implementing visual routines in natural tasks.

Intracranial high-γ connectivity distinguishes wakefulness from sleep.

Neural synchrony in the γ-band is considered a fundamental process in cortical computation and communication and it has also been proposed as a crucial correlate of consciousness. However, the latter claim remains inconclusive, mainly due to methodological limitations, such as the spectral constraints of scalp-level electroencephalographic recordings or volume-conduction confounds. Here, we circumvented these caveats by comparing γ-band connectivity between two global states of consciousness via intracranial electroencephalography (iEEG), which provides the most reliable measurements of high-frequency activity in the human brain. Non-REM Sleep recordings were compared to passive-wakefulness recordings of the same duration in three subjects with surgically implanted electrodes. Signals were analyzed through the weighted Phase Lag Index connectivity measure and relevant graph theory metrics. We found that connectivity in the high-γ range (90-120 Hz), as well as relevant graph theory properties, were higher during wakefulness than during sleep and discriminated between conditions better than any other canonical frequency band. Our results constitute the first report of iEEG differences between wakefulness and sleep in the high-γ range at both local and distant sites, highlighting the utility of this technique in the search for the neural correlates of global states of consciousness.

The language of geometry: Fast comprehension of geometrical primitives and rules in human adults and preschoolers.

During language processing, humans form complex embedded representations from sequential inputs. Here, we ask whether a "geometrical language" with recursive embedding also underlies the human ability to encode sequences of spatial locations. We introduce a novel paradigm in which subjects are exposed to a sequence of spatial locations on an octagon, and are asked to predict future locations. The sequences vary in complexity according to a well-defined language comprising elementary primitives and recursive rules. A detailed analysis of error patterns indicates that primitives of symmetry and rotation are spontaneously detected and used by adults, preschoolers, and adult members of an indigene group in the Amazon, the Munduruku, who have a restricted numerical and geometrical lexicon and limited access to schooling. Furthermore, subjects readily combine these geometrical primitives into hierarchically organized expressions. By evaluating a large set of such combinations, we obtained a first view of the language needed to account for the representation of visuospatial sequences in humans, and conclude that they encode visuospatial sequences by minimizing the complexity of the structured expressions that capture them.

A lesion model of envy and Schadenfreude: legal, deservingness and moral dimensions as revealed by neurodegeneration.

The study of moral emotions (i.e. Schadenfreude and envy) is critical to understand the ecological complexity of everyday interactions between cognitive, affective, and social cognition processes. Most previous studies in this area have used correlational imaging techniques and framed Schadenfreude and envy as unified and monolithic emotional domains. Here, we profit from a relevant neurodegeneration model to disentangle the brain regions engaged in three dimensions of Schadenfreude and envy: deservingness, morality, and legality. We tested a group of patients with behavioural variant frontotemporal dementia (bvFTD), patients with Alzheimer's disease, as a contrastive neurodegeneration model, and healthy controls on a novel task highlighting each of these dimensions in scenarios eliciting Schadenfreude and envy. Compared with the Alzheimer's disease and control groups, patients with bvFTD obtained significantly higher scores on all dimensions for both emotions. Correlational analyses revealed an association between envy and Schadenfreude scores and greater deficits in social cognition, inhibitory control, and behaviour disturbances in bvFTD patients. Brain anatomy findings (restricted to bvFTD and controls) confirmed the partially dissociable nature of the moral emotions' experiences and highlighted the importance of socio-moral brain areas in processing those emotions. In all subjects, an association emerged between Schadenfreude and the ventral striatum, and between envy and the anterior cingulate cortex. In addition, the results supported an association between scores for moral and legal transgression and the morphology of areas implicated in emotional appraisal, including the amygdala and the parahippocampus. By contrast, bvFTD patients exhibited a negative association between increased Schadenfreude and envy across dimensions and critical regions supporting social-value rewards and social-moral processes (dorsolateral prefrontal cortex, angular gyrus and precuneus). Together, this study provides lesion-based evidence for the multidimensional nature of the emotional experiences of envy and Schadenfreude. Our results offer new insights into the mechanisms subsuming complex emotions and moral cognition in neurodegeneration. Moreover, this study presents the exacerbation of envy and Schadenfreude as a new potential hallmark of bvFTD that could impact in diagnosis and progression.

Time drawings: Spatial representation of temporal concepts.

Time representation is a fundamental property of human cognition. Ample evidence shows that time (and numbers) are represented in space. However, how the conceptual mapping varies across individuals, scales, and temporal structures remains largely unknown. To investigate this issue, we conducted a large online study consisting in five experiments that addressed different time scales and topology: Zones of time, Seasons, Days of the week, Parts of the day and Timeline. Participants were asked to map different kinds of time events to a location in space and to determine their size and color. Results showed that time is organized in space in a hierarchical progression: some features appear to be universal (i.e. selection order), others are shaped by how time is organized in distinct cultures (i.e. location order) and, finally, some aspects vary depending on individual features such as age, gender, and chronotype (i.e. size and color).

The interplay between sharing behavior and beliefs about others in children during dictator games.

Previous studies in adults demonstrated that beliefs and sharing decisions in social scenarios are closely related. However, to date, little is known about the development of this relationship in children. By using a modified dictator game, we assessed sharing behavior and beliefs about others in children between 3 and 12 years old. We performed four studies (N = 376) aimed to assess whether decisions were related to beliefs (Studies 1 and 2) and whether information about the recipient's forced sharing behavior would shape decisions and beliefs (Studies 3 and 4). Results of Studies 1 and 2 showed that beliefs about others' generosity were related to children's sharing behavior. In Studies 3 and 4, we found that only children older than 9 years shared more pieces of candy when they knew that the recipient would be forced to share (cooperative context) than when they knew that the recipient would be forced not to share (noncooperative context). Besides, children older than 6 years did not modify their beliefs about others' generosity according to these social contexts. These results suggest that normative or preconceived beliefs about the functioning of the social world may guide social behavior in children.

Signature of consciousness in the dynamics of resting-state brain activity.

At rest, the brain is traversed by spontaneous functional connectivity patterns. Two hypotheses have been proposed for their origins: they may reflect a continuous stream of ongoing cognitive processes as well as random fluctuations shaped by a fixed anatomical connectivity matrix. Here we show that both sources contribute to the shaping of resting-state networks, yet with distinct contributions during consciousness and anesthesia. We measured dynamical functional connectivity with functional MRI during the resting state in awake and anesthetized monkeys. Under anesthesia, the more frequent functional connectivity patterns inherit the structure of anatomical connectivity, exhibit fewer small-world properties, and lack negative correlations. Conversely, wakefulness is characterized by the sequential exploration of a richer repertoire of functional configurations, often dissimilar to anatomical structure, and comprising positive and negative correlations among brain regions. These results reconcile theories of consciousness with observations of long-range correlation in the anesthetized brain and show that a rich functional dynamics might constitute a signature of consciousness, with potential clinical implications for the detection of awareness in anesthesia and brain-lesioned patients.

Variability in functional brain networks predicts expertise during action observation.

Observing an action performed by another individual activates, in the observer, similar circuits as those involved in the actual execution of that action. This activation is modulated by prior experience; indeed, sustained training in a particular motor domain leads to structural and functional changes in critical brain areas. Here, we capitalized on a novel graph-theory approach to electroencephalographic data (Fraiman et al., 2016) to test whether variability in functional brain networks implicated in Tango observation can discriminate between groups differing in their level of expertise. We found that experts and beginners significantly differed in the functional organization of task-relevant networks. Specifically, networks in expert Tango dancers exhibited less variability and a more robust functional architecture. Notably, these expertise-dependent effects were captured within networks derived from electrophysiological brain activity recorded in a very short time window (2s). In brief, variability in the organization of task-related networks seems to be a highly sensitive indicator of long-lasting training effects. This finding opens new methodological and theoretical windows to explore the impact of domain-specific expertise on brain plasticity, while highlighting variability as a fruitful measure in neuroimaging research.

Your perspective and my benefit: multiple lesion models of self-other integration strategies during social bargaining.

Recursive social decision-making requires the use of flexible, context-sensitive long-term strategies for negotiation. To succeed in social bargaining, participants' own perspectives must be dynamically integrated with those of interactors to maximize self-benefits and adapt to the other's preferences, respectively. This is a prerequisite to develop a successful long-term self-other integration strategy. While such form of strategic interaction is critical to social decision-making, little is known about its neurocognitive correlates. To bridge this gap, we analysed social bargaining behaviour in relation to its structural neural correlates, ongoing brain dynamics (oscillations and related source space), and functional connectivity signatures in healthy subjects and patients offering contrastive lesion models of neurodegeneration and focal stroke: behavioural variant frontotemporal dementia, Alzheimer's disease, and frontal lesions. All groups showed preserved basic bargaining indexes. However, impaired self-other integration strategy was found in patients with behavioural variant frontotemporal dementia and frontal lesions, suggesting that social bargaining critically depends on the integrity of prefrontal regions. Also, associations between behavioural performance and data from voxel-based morphometry and voxel-based lesion-symptom mapping revealed a critical role of prefrontal regions in value integration and strategic decisions for self-other integration strategy. Furthermore, as shown by measures of brain dynamics and related sources during the task, the self-other integration strategy was predicted by brain anticipatory activity (alpha/beta oscillations with sources in frontotemporal regions) associated with expectations about others' decisions. This pattern was reduced in all clinical groups, with greater impairments in behavioural variant frontotemporal dementia and frontal lesions than Alzheimer's disease. Finally, connectivity analysis from functional magnetic resonance imaging evidenced a fronto-temporo-parietal network involved in successful self-other integration strategy, with selective compromise of long-distance connections in frontal disorders. In sum, this work provides unprecedented evidence of convergent behavioural and neurocognitive signatures of strategic social bargaining in different lesion models. Our findings offer new insights into the critical roles of prefrontal hubs and associated temporo-parietal networks for strategic social negotiation.