Long-Horizon Associative Learning Explains Human Sensitivity to Statistical and Network Structures in Auditory Sequences.

Networks are a useful mathematical tool for capturing the complexity of the world. In a previous behavioral study, we showed that human adults were sensitive to the high-level network structure underlying auditory sequences, even when presented with incomplete information. Their performance was best explained by a mathematical model compatible with associative learning principles, based on the integration of the transition probabilities between adjacent and nonadjacent elements with a memory decay. In the present study, we explored the neural correlates of this hypothesis via magnetoencephalography (MEG). Participants (N = 23, 16 females) passively listened to sequences of tones organized in a sparse community network structure comprising two communities. An early difference (∼150 ms) was observed in the brain responses to tone transitions with similar transition probability but occurring either within or between communities. This result implies a rapid and automatic encoding of the sequence structure. Using time-resolved decoding, we estimated the duration and overlap of the representation of each tone. The decoding performance exhibited exponential decay, resulting in a significant overlap between the representations of successive tones. Based on this extended decay profile, we estimated a long-horizon associative learning novelty index for each transition and found a correlation of this measure with the MEG signal. Overall, our study sheds light on the neural mechanisms underlying human sensitivity to network structures and highlights the potential role of Hebbian-like mechanisms in supporting learning at various temporal scales.

Perceptual Awareness in Human Infants: What is the Evidence?

Perceptual awareness in infants during the first year of life is understudied, despite the philosophical, scientific, and clinical importance of understanding how and when consciousness emerges during human brain development. Although parents are undoubtedly convinced that their infant is conscious, the lack of adequate experimental paradigms to address this question in preverbal infants has been a hindrance to research on this topic. However, recent behavioral and brain imaging studies have shown that infants are engaged in complex learning from an early age and that their brains are more structured than traditionally thought. I will present a rapid overview of these results, which might provide indirect evidence of early perceptual awareness and then describe how a more systematic approach to this question could stand within the framework of global workspace theory, which identifies specific signatures of conscious perception in adults. Relying on these brain signatures as a benchmark for conscious perception, we can deduce that it exists in the second half of the first year, whereas the evidence before the age of 5 months is less solid, mainly because of the paucity of studies. The question of conscious perception before term remains open, with the possibility of short periods of conscious perception, which would facilitate early learning. Advances in brain imaging and growing interest in this subject should enable us to gain a better understanding of this important issue in the years to come.

Orthogonal neural codes for speech in the infant brain.

Creating invariant representations from an everchanging speech signal is a major challenge for the human brain. Such an ability is particularly crucial for preverbal infants who must discover the phonological, lexical, and syntactic regularities of an extremely inconsistent signal in order to acquire language. Within the visual domain, an efficient neural solution to overcome variability consists in factorizing the input into a reduced set of orthogonal components. Here, we asked whether a similar decomposition strategy is used in early speech perception. Using a 256-channel electroencephalographic system, we recorded the neural responses of 3-mo-old infants to 120 natural consonant-vowel syllables with varying acoustic and phonetic profiles. Using multivariate pattern analyses, we show that syllables are factorized into distinct and orthogonal neural codes for consonants and vowels. Concerning consonants, we further demonstrate the existence of two stages of processing. A first phase is characterized by orthogonal and context-invariant neural codes for the dimensions of manner and place of articulation. Within the second stage, manner and place codes are integrated to recover the identity of the phoneme. We conclude that, despite the paucity of articulatory motor plans and speech production skills, pre-babbling infants are already equipped with a structured combinatorial code for speech analysis, which might account for the rapid pace of language acquisition during the first year.

Neural indicators of articulator-specific sensorimotor influences on infant speech perception.

While there is increasing acceptance that even young infants detect correspondences between heard and seen speech, the common view is that oral-motor movements related to speech production cannot influence speech perception until infants begin to babble or speak. We investigated the extent of multimodal speech influences on auditory speech perception in prebabbling infants who have limited speech-like oral-motor repertoires. We used event-related potentials (ERPs) to examine how sensorimotor influences to the infant's own articulatory movements impact auditory speech perception in 3-mo-old infants. In experiment 1, there were ERP discriminative responses to phonetic category changes across two phonetic contrasts (bilabial-dental /ba/-/ɗa/; dental-retroflex /ɗa/-/ɖa/) in a mismatch paradigm, indicating that infants auditorily discriminated both contrasts. In experiment 2, inhibiting infants' own tongue-tip movements had a disruptive influence on the early ERP discriminative response to the /ɗa/-/ɖa/ contrast only. The same articulatory inhibition had contrasting effects on the perception of the /ba/-/ɗa/ contrast, which requires different articulators (the lips vs. the tongue) during production, and the /ɗa/-/ɖa/ contrast, whereby both phones require tongue-tip movement as a place of articulation. This articulatory distinction between the two contrasts plausibly accounts for the distinct influence of tongue-tip suppression on the neural responses to phonetic category change perception in definitively prebabbling, 3-mo-old, infants. The results showing a specificity in the relation between oral-motor inhibition and phonetic speech discrimination suggest a surprisingly early mapping between auditory and motor speech representation already in prebabbling infants.

Event-related variability is modulated by task and development.

In carefully designed experimental paradigms, cognitive scientists interpret the mean event-related potentials (ERP) in terms of cognitive operations. However, the huge signal variability from one trial to the next, questions the representability of such mean events. We explored here whether this variability is an unwanted noise, or an informative part of the neural response. We took advantage of the rapid changes in the visual system during human infancy and analyzed the variability of visual responses to central and lateralized faces in 2-to 6-month-old infants compared to adults using high-density electroencephalography (EEG). We observed that neural trajectories of individual trials always remain very far from ERP components, only moderately bending their direction with a substantial temporal jitter across trials. However, single trial trajectories displayed characteristic patterns of acceleration and deceleration when approaching ERP components, as if they were under the active influence of steering forces causing transient attraction and stabilization. These dynamic events could only partly be accounted for by induced microstate transitions or phase reset phenomena. Importantly, these structured modulations of response variability, both between and within trials, had a rich sequential organization, which in infants, was modulated by the task difficulty and age. Our approaches to characterize Event Related Variability (ERV) expand on classic ERP analyses and provide the first evidence for the functional role of ongoing neural variability in human infants.

Detection of regularities in auditory sequences before and at term-age in human neonates.

During the last trimester of gestation, fetuses and preterm neonates begin to respond to sensory stimulation and to discover the structure of their environment. Yet, neuronal migration is still ongoing. This late migration notably concerns the supra-granular layers neurons, which are believed to play a critical role in encoding predictions and detecting regularities. In order to gain a deeper understanding of how the brain processes and perceives regularities during this stage of development, we conducted a study in which we recorded event-related potentials (ERP) in 31-wGA preterm and full-term neonates exposed to alternating auditory sequences (e.g. "ba ga ba ga ba"), when the regularity of these sequences was violated by a repetition (e.g., ``ba ga ba ga ga''). We compared the ERPs in this case to those obtained when violating a simple repetition pattern ("ga ga ga ga ga" vs. "ga ga ga ga ba"). Our results indicated that both preterm and full-term neonates were able to detect violations of regularity in both types of sequences, indicating that as early as 31 weeks gestational age, human neonates are sensitive to the conditional statistics between successive auditory elements. Full-term neonates showed an early and similar mismatch response (MMR) in the repetition and alternating sequences. In contrast, 31-wGA neonates exhibited a two-component MMR. The first component which was only observed for simple sequences with repetition, corresponded to sensory adaptation. It was followed much later by a deviance-detection component that was observed for both alternation and repetition sequences. This pattern confirms that MMRs detected at the scalp may correspond to a dual cortical process and shows that deviance detection computed by higher-level regions accelerates dramatically with brain maturation during the last weeks of gestation to become indistinguishable from bottom-up sensory adaptation at term.

Multiway generalized canonical correlation analysis.

Regularized generalized canonical correlation analysis (RGCCA) is a general multiblock data analysis framework that encompasses several important multivariate analysis methods such as principal component analysis, partial least squares regression, and several versions of generalized canonical correlation analysis. In this article, we extend RGCCA to the case where at least one block has a tensor structure. This method is called multiway generalized canonical correlation analysis (MGCCA). Convergence properties of the MGCCA algorithm are studied, and computation of higher-level components are discussed. The usefulness of MGCCA is shown on simulation and on the analysis of a cognitive study in human infants using electroencephalography (EEG).

Tracking transitional probabilities and segmenting auditory sequences are dissociable processes in adults and neonates.

Since speech is a continuous stream with no systematic boundaries between words, how do pre-verbal infants manage to discover words? A proposed solution is that they might use the transitional probability between adjacent syllables, which drops at word boundaries. Here, we tested the limits of this mechanism by increasing the size of the word-unit to four syllables, and its automaticity by testing asleep neonates. Using markers of statistical learning in neonates' EEG, compared to adult behavioral performances in the same task, we confirmed that statistical learning is automatic enough to be efficient even in sleeping neonates. We also revealed that: (1) Successfully tracking transition probabilities (TP) in a sequence is not sufficient to segment it. (2) Prosodic cues, as subtle as subliminal pauses, enable to recover words segmenting capacities. (3) Adults' and neonates' capacities to segment streams seem remarkably similar despite the difference of maturation and expertise. Finally, we observed that learning increased the overall similarity of neural responses across infants during exposure to the stream, providing a novel neural marker to monitor learning. Thus, from birth, infants are equipped with adult-like tools, allowing them to extract small coherent word-like units from auditory streams, based on the combination of statistical analyses and auditory parsing cues. RESEARCH HIGHLIGHTS: Successfully tracking transitional probabilities in a sequence is not always sufficient to segment it. Word segmentation solely based on transitional probability is limited to bi- or tri-syllabic elements. Prosodic cues, as subtle as subliminal pauses, enable to recover chunking capacities in sleeping neonates and awake adults for quadriplets.

Repairing Artifacts in Neural Activity Recordings Using Low-Rank Matrix Estimation.

Electrophysiology recordings are frequently affected by artifacts (e.g., subject motion or eye movements), which reduces the number of available trials and affects the statistical power. When artifacts are unavoidable and data are scarce, signal reconstruction algorithms that allow for the retention of sufficient trials become crucial. Here, we present one such algorithm that makes use of large spatiotemporal correlations in neural signals and solves the low-rank matrix completion problem, to fix artifactual entries. The method uses a gradient descent algorithm in lower dimensions to learn the missing entries and provide faithful reconstruction of signals. We carried out numerical simulations to benchmark the method and estimate optimal hyperparameters for actual EEG data. The fidelity of reconstruction was assessed by detecting event-related potentials (ERP) from a highly artifacted EEG time series from human infants. The proposed method significantly improved the standardized error of the mean in ERP group analysis and a between-trial variability analysis compared to a state-of-the-art interpolation technique. This improvement increased the statistical power and revealed significant effects that would have been deemed insignificant without reconstruction. The method can be applied to any time-continuous neural signal where artifacts are sparse and spread out across epochs and channels, increasing data retention and statistical power.

Evolution of reading and face circuits during the first three years of reading acquisition.

Although words and faces activate neighboring regions in the fusiform gyrus, we lack an understanding of how such category selectivity emerges during development. To investigate the organization of reading and face circuits at the earliest stage of reading acquisition, we measured the fMRI responses to words, faces, houses, and checkerboards in three groups of 60 French children: 6-year-old pre-readers, 6-year-old beginning readers and 9-year-old advanced readers. The results showed that specific responses to written words were absent prior to reading, but emerged in beginning readers, irrespective of age. Likewise, specific responses to faces were barely visible in pre-readers and continued to evolve in the 9-year-olds, yet primarily driven by age rather than by schooling. Crucially, the sectors of ventral visual cortex that become specialized for words and faces harbored their own functional connectivity prior to reading acquisition: the VWFA with left-hemispheric spoken language areas, and the FFA with the contralateral region and the amygdalae. The results support the view that reading acquisition occurs through the recycling of a pre-existing but plastic circuit which, in pre-readers, already connects the VWFA site to other distant language areas. We argue that reading acquisition does not compete with the face system directly, through a pruning of preexisting face responses, but indirectly, by hindering the slow growth of face responses in the left hemisphere, thus increasing a pre-existing right hemispheric bias.

Symbolic labeling in 5-month-old human infants.

Humans' ability to create and manipulate symbolic structures far exceeds that of other animals. We hypothesized that this ability rests on an early capacity to use arbitrary signs to represent any mental representation, even as abstract as an algebraic rule. In three experiments, we collected high-density EEG recordings while 150 5-month-old infants were presented with speech triplets characterized by their abstract syllabic structure-the location of syllable repetition-which predicted a following arbitrary label (e.g., ABA words were followed by a fish picture, AAB words by a lion). After a brief learning phase, EEG responses to novel words revealed that infants built expectations about the upcoming label based on the triplet structure and were surprised when it happened to be incongruent. Preverbal infants were thus able to recode the incoming triplets into abstract mental variables to which arbitrary labels were flexibly assigned. Importantly, infants also generalized to novel trials in which the pairing order was reversed (with the label preceding the auditory structure). Beyond conditioned associations, infants instantly inferred a bidirectional mapping between the abstract structures and the following label, a foundational operation for any symbolic system.

The emergence of the visual word form: Longitudinal evolution of category-specific ventral visual areas during reading acquisition.

How does education affect cortical organization? All literate adults possess a region specialized for letter strings, the visual word form area (VWFA), within the mosaic of ventral regions involved in processing other visual categories such as objects, places, faces, or body parts. Therefore, the acquisition of literacy may induce a reorientation of cortical maps towards letters at the expense of other categories such as faces. To test this cortical recycling hypothesis, we studied how the visual cortex of individual children changes during the first months of reading acquisition. Ten 6-year-old children were scanned longitudinally 6 or 7 times with functional magnetic resonance imaging (fMRI) before and throughout the first year of school. Subjects were exposed to a variety of pictures (words, numbers, tools, houses, faces, and bodies) while performing an unrelated target-detection task. Behavioral assessment indicated a sharp rise in grapheme-phoneme knowledge and reading speed in the first trimester of school. Concurrently, voxels specific to written words and digits emerged at the VWFA location. The responses to other categories remained largely stable, although right-hemispheric face-related activity increased in proportion to reading scores. Retrospective examination of the VWFA voxels prior to reading acquisition showed that reading encroaches on voxels that are initially weakly specialized for tools and close to but distinct from those responsive to faces. Remarkably, those voxels appear to keep their initial category selectivity while acquiring an additional and stronger responsivity to words. We propose a revised model of the neuronal recycling process in which new visual categories invade weakly specified cortex while leaving previously stabilized cortical responses unchanged.

Enhancer Locus in ch14q23.1 Modulates Brain Asymmetric Temporal Regions Involved in Language Processing.

Identifying the genes that contribute to the variability in brain regions involved in language processing may shed light on the evolution of brain structures essential to the emergence of language in Homo sapiens. The superior temporal asymmetrical pit (STAP), which is not observed in chimpanzees, represents an ideal phenotype to investigate the genetic variations that support human communication. The left STAP depth was significantly associated with a predicted enhancer annotation located in the 14q23.1 locus, between DACT1 and KIAA0586, in the UK Biobank British discovery sample (N = 16 515). This association was replicated in the IMAGEN cohort (N = 1726) and the UK Biobank non-British validation sample (N = 2161). This genomic region was also associated to a lesser extent with the right STAP depth and the formation of sulcal interruptions, "plis de passage," in the bilateral STAP but not with other structural brain MRI phenotypes, highlighting its notable association with the superior temporal regions. Diffusion MRI emphasized an association with the fractional anisotropy of the left auditory fibers of the corpus callosum and with networks involved in linguistic processing in resting-state functional MRI. Overall, this evidence demonstrates a specific relationship between this locus and the establishment of the superior temporal regions that support human communication.

Individual differences in the acquisition of non-linguistic audio-visual associations in 5 year olds.

Audio-visual associative learning - at least when linguistic stimuli are employed - is known to rely on core linguistic skills such as phonological awareness. Here we ask whether this would also be the case in a task that does not manipulate linguistic information. Another question of interest is whether executive skills, often found to support learning, may play a larger role in a non-linguistic audio-visual associative task compared to a linguistic one. We present a new task that measures learning when having to associate non-linguistic auditory signals with novel visual shapes. Importantly, our novel task shares with linguistic processes such as reading acquisition the need to associate sounds with arbitrary shapes. Yet, rather than phonemes or syllables, it uses novel environmental sounds - therefore limiting direct reliance on linguistic abilities. Five-year-old French-speaking children (N = 76, 39 girls) were assessed individually in our novel audio-visual associative task, as well as in a number of other cognitive tasks evaluating linguistic abilities and executive functions. We found phonological awareness and language comprehension to be related to scores in the audio-visual associative task, while no correlation with executive functions was observed. These results underscore a key relation between foundational language competencies and audio-visual associative learning, even in the absence of linguistic input in the associative task.

The dynamics of cortical folding waves and prematurity-related deviations revealed by spatial and spectral analysis of gyrification.

In the human brain, the appearance of cortical sulci is a complex process that takes place mostly during the second half of pregnancy, with a relatively stable temporal sequence across individuals. Since deviant gyrification patterns have been observed in many neurodevelopmental disorders, mapping cortical development in vivo from the early stages on is an essential step to uncover new markers for diagnosis or prognosis. Recently this has been made possible by MRI combined with post-processing tools, but the reported results are still fragmented. Here we aimed to characterize the typical folding progression ex utero from the pre- to the post-term period, by considering 58 healthy preterm and full-term newborns and infants imaged between 27 and 62 weeks of post-menstrual age. Using a method of spectral analysis of gyrification (SPANGY), we detailed the spatial-frequency structure of cortical patterns in a quantitative way. The modeling of developmental trajectories revealed three successive waves that might correspond to primary, secondary and tertiary folding. Some deviations were further detected in 10 premature infants without apparent neurological impairment and imaged at term equivalent age, suggesting that our approach is sensitive enough to highlight the subtle impact of preterm birth and extra-uterine life on folding.

Genetic Influence on the Sulcal Pits: On the Origin of the First Cortical Folds.

The influence of genes on cortical structures has been assessed through various phenotypes. The sulcal pits, which are the putative first cortical folds, have for long been assumed to be under tight genetic control, but this was never quantified. We estimated the pit depth heritability in various brain regions using the high quality and large sample size of the Human Connectome Project pedigree cohort. Analysis of additive genetic variance indicated that their heritability ranges between 0.2 and 0.5 and displays a regional genetic control with an overall symmetric pattern between hemispheres. However, a noticeable asymmetry of heritability estimates is observed in the superior temporal sulcus and could thus be related to language lateralization. The heritability range estimated in this study reinforces the idea that cortical shape is determined primarily by nongenetic factors, which is consistent with the important increase of cortical folding from birth to adult life and thus predominantly constrained by environmental factors. Nevertheless, the genetic cues, implicated with various local levels of heritability in the formation of sulcal pits, play a fundamental role in the normal gyral pattern development. Quantifying their influence and identifying the underlying genetic variants would provide insight into neurodevelopmental disorders.

The chaotic morphology of the left superior temporal sulcus is genetically constrained.

The asymmetry of the superior temporal sulcus (STS) has been identified as a species-specific feature of the human brain. The so-called superior temporal asymmetrical pit (STAP) area is observed from the last trimester of gestation onwards and is far less pronounced in the chimpanzee brain. This asymmetry is associated with more frequent sulcal interruptions, named plis de passage (PPs), leading to the irregular morphology of the left sulcus. In this paper, we aimed to characterize the variability, asymmetry, and heritability of these interruptions in the STS in comparison with the other main sulci. We developed an automated method to extract PPs across the cortex based on a highly reproducible grid of sulcal pits across individuals, which we applied to a subset of Human Connectome Project (HCP) subjects (N = 820). We report that only a few PPs across the cortex are genetically constrained, namely in the collateral, postcentral and superior temporal sulci and the calcarine fissure. Moreover, some PPs occur more often in one hemisphere than the other, namely in the precentral, postcentral, intraparietal sulci, as well as in both inferior and superior temporal sulci. Most importantly, we found that only the interruptions within the STAP region are both asymmetric and genetically constrained. Because this morphological pattern is located in an area of the left hemisphere related to speech, our results suggest structural constraints on the architecture of the linguistic network.

Functional Maps at the Onset of Auditory Inputs in Very Early Preterm Human Neonates.

During the last trimester of human gestation, neurons reach their final destination and establish long- and short-distance connections. Due to the difficulties obtaining functional data at this age, the characteristics of the functional architecture at the onset of sensory thalamocortical connectivity in humans remain largely unknown. In particular, it is unknown to what extent responses evoked by an external stimulus are general or already sensitive to certain stimuli. In the present study, we recorded high-density event-related potentials (ERPs) in 19 neonates, tested ten weeks before term (28-32 weeks gestational age (wGA), that is, at an average age of 30 wGA) by means of a syllable discrimination task (i.e., a phonetic change: ba vs. ga; and a voice change: male vs. female voice). We first observed that the syllables elicited 4 peaks with distinct topographies implying a progression of the sensory input along a processing hierarchy; second, repetition induced a decrease in the amplitude (repetition suppression) of these peaks, but their latencies and topographies remained stable; and third, a change of stimulus generated mismatch responses, which were more precisely time-locked to event onset in the case of a phonetic change than in the case of a voice change. A hierarchical and parallel functional architecture is therefore able to process environmental sounds in a timely precise fashion, well before term birth. This elaborate functional architecture at the onset of extrinsic neural activity suggests that specialized areas weakly dependent on the environment are present in the perisylvian region as part of the genetic endowment of the human species.

New human-specific brain landmark: the depth asymmetry of superior temporal sulcus.

Identifying potentially unique features of the human cerebral cortex is a first step to understanding how evolution has shaped the brain in our species. By analyzing MR images obtained from 177 humans and 73 chimpanzees, we observed a human-specific asymmetry in the superior temporal sulcus at the heart of the communication regions and which we have named the "superior temporal asymmetrical pit" (STAP). This 45-mm-long segment ventral to Heschl's gyrus is deeper in the right hemisphere than in the left in 95% of typical human subjects, from infanthood till adulthood, and is present, irrespective of handedness, language lateralization, and sex although it is greater in males than in females. The STAP also is seen in several groups of atypical subjects including persons with situs inversus, autistic spectrum disorder, Turner syndrome, and corpus callosum agenesis. It is explained in part by the larger number of sulcal interruptions in the left than in the right hemisphere. Its early presence in the infants of this study as well as in fetuses and premature infants suggests a strong genetic influence. Because this asymmetry is barely visible in chimpanzees, we recommend the STAP region during midgestation as an important phenotype to investigate asymmetrical variations of gene expression among the primate lineage. This genetic target may provide important insights regarding the evolution of the crucial cognitive abilities sustained by this sulcus in our species, namely communication and social cognition.

Language ability in preterm children is associated with arcuate fasciculi microstructure at term.

In the mature human brain, the arcuate fasciculus mediates verbal working memory, word learning, and sublexical speech repetition. However, its contribution to early language acquisition remains unclear. In this work, we aimed to evaluate the role of the direct segments of the arcuate fasciculi in the early acquisition of linguistic function. We imaged a cohort of 43 preterm born infants (median age at birth of 30 gestational weeks; median age at scan of 42 postmenstrual weeks) using high b value high-angular resolution diffusion-weighted neuroimaging and assessed their linguistic performance at 2 years of age. Using constrained spherical deconvolution tractography, we virtually dissected the arcuate fasciculi and measured fractional anisotropy (FA) as a metric of white matter development. We found that term equivalent FA of the left and right arcuate fasciculi was significantly associated with individual differences in linguistic and cognitive abilities in early childhood, independent of the degree of prematurity. These findings suggest that differences in arcuate fasciculi microstructure at the time of normal birth have a significant impact on language development and modulate the first stages of language learning. Hum Brain Mapp 38:3836-3847, 2017. © 2017 Wiley Periodicals, Inc.