A Within-Subject Multimodal NIRS-EEG Classifier for Infant Data.

Functional Near Infrared Spectroscopy (fNIRS) and Electroencephalography (EEG) are commonly employed neuroimaging methods in developmental neuroscience. Since they offer complementary strengths and their simultaneous recording is relatively easy, combining them is highly desirable. However, to date, very few infant studies have been conducted with NIRS-EEG, partly because analyzing and interpreting multimodal data is challenging. In this work, we propose a framework to carry out a multivariate pattern analysis that uses an NIRS-EEG feature matrix, obtained by selecting EEG trials presented within larger NIRS blocks, and combining the corresponding features. Importantly, this classifier is intended to be sensitive enough to apply to individual-level, and not group-level data. We tested the classifier on NIRS-EEG data acquired from five newborn infants who were listening to human speech and monkey vocalizations. We evaluated how accurately the model classified stimuli when applied to EEG data alone, NIRS data alone, or combined NIRS-EEG data. For three out of five infants, the classifier achieved high and statistically significant accuracy when using features from the NIRS data alone, but even higher accuracy when using combined EEG and NIRS data, particularly from both hemoglobin components. For the other two infants, accuracies were lower overall, but for one of them the highest accuracy was still achieved when using combined EEG and NIRS data with both hemoglobin components. We discuss how classification based on joint NIRS-EEG data could be modified to fit the needs of different experimental paradigms and needs.

On the functional independence of numerical acuity and visual working memory.

Deciding where to direct our vehicle in a crowded parking area or where to line up at an airport gateway relies on our ability to appraise the numerosity of multitudes at a glimpse and react accordingly. Approximating numerosities without actually counting is an ontogenetically and phylogenetically primordial ability, given its presence in human infants shortly after birth, and in primate and non-primate animal species. Prior research in the field suggested that numerosity approximation is a ballistic automatism that has little to do with human cognition as commonly intended. Here, we measured visual working memory capacity using a state-of-the-art change detection task and numerosity approximation using a dot-comparison task, and found a null correlation between these two parametrical domains. By checking the evidential strength of the tested correlation using both classic and Bayesian analytical approaches, as well as the construct validity for working memory capacity and numerosity approximation estimates, we concluded that the present psychophysical evidence was sufficiently strong to support the view that visual working memory and numerosity approximation are likely to rely on functionally independent stages of processing of the human cognitive architecture.

Brain responses to repetition-based rule-learning do not exhibit sex differences: an aggregated analysis of infant fNIRS studies.

Studies have repeatedly shown sex differences in some areas of language development, typically with an advantage for female over male children. However, the tested samples are typically small and the effects do not always replicate. Here, we used a meta-analytic approach to address this issue in a larger sample, combining seven fNIRS studies on the neural correlates of repetition- and non-repetition-based rule learning in newborns and 6-month-old infants. The ability to extract structural regularities from the speech input is fundamental for language development, it is therefore highly relevant to understand whether this ability shows sex differences. The meta-analysis tested the effect of Sex, as well as of other moderators on infants' hemodynamic responses to repetition-based (e.g. ABB: "mubaba") and non-repetition-based (e.g. ABC: "mubage") sequences in both anatomically and functionally defined regions of interests. Our analyses did not reveal any sex differences at birth or at 6 months, suggesting that the ability to encode these regularities is robust across sexes. Interestingly, the meta-analysis revealed other moderator effects. Thus in newborns, we found a greater involvement of the bilateral temporal areas compared to the frontal areas for both repetition and non-repetition sequences. Further, non-repetition sequences elicited greater responses in 6-month-olds than in newborns, especially in the bilateral frontal areas. When analyzing functional clusters of HbR timetraces, we found that a larger right-left asymmetry for newborn boys in brain responses compared to girls, which may be interpreted in terms of a larger right-left asymmetry in cerebral blood flow in boys than in girls early in life. We conclude that extracting repetition-based regularities from speech is a robust ability with a well-defined neural substrate present from birth and it does not exhibit sex differences.

Neural oscillations and speech processing at birth.

Are neural oscillations biologically endowed building blocks of the neural architecture for speech processing from birth, or do they require experience to emerge? In adults, delta, theta, and low-gamma oscillations support the simultaneous processing of phrasal, syllabic, and phonemic units in the speech signal, respectively. Using electroencephalography to investigate neural oscillations in the newborn brain we reveal that delta and theta oscillations differ for rhythmically different languages, suggesting that these bands underlie newborns' universal ability to discriminate languages on the basis of rhythm. Additionally, higher theta activity during post-stimulus as compared to pre-stimulus rest suggests that stimulation after-effects are present from birth.

Prenatal experience with language shapes the brain.

Human infants acquire language with notable ease compared to adults, but the neural basis of their remarkable brain plasticity for language remains little understood. Applying a scaling analysis of neural oscillations to address this question, we show that newborns' electrophysiological activity exhibits increased long-range temporal correlations after stimulation with speech, particularly in the prenatally heard language, indicating the early emergence of brain specialization for the native language.

Babies, bugs and brains: How the early microbiome associates with infant brain and behavior development.

Growing evidence is demonstrating the connection between the microbiota gut-brain axis and neurodevelopment. Microbiota colonization occurs before the maturation of many neural systems and is linked to brain health. Because of this it has been hypothesized that the early microbiome interactions along the gut-brain axis evolved to promote advanced cognitive functions and behaviors. Here, we performed a pilot study with a multidisciplinary approach to test if the microbiota composition of infants is associated with measures of early cognitive development, in particular neural rhythm tracking; language (forward speech) versus non-language (backwards speech) discrimination; and social joint attention. Fecal samples were collected from 56 infants between four and six months of age and sequenced by shotgun metagenomic sequencing. Of these, 44 performed the behavioral Point and Gaze test to measure joint attention. Infants were tested on either language discrimination using functional near-infrared spectroscopy (fNIRS; 25 infants had usable data) or neural rhythm tracking using electroencephalogram (EEG; 15 had usable data). Infants who succeeded at the Point and Gaze test tended to have increased Actinobacteria and reduced Firmicutes at the phylum level; and an increase in Bifidobacterium and Eggerthella along with a reduction in Hungatella and Streptococcus at the genus level. Measurements of neural rhythm tracking associated negatively to the abundance of Bifidobacterium and positively to the abundance of Clostridium and Enterococcus for the bacterial abundances, and associated positively to metabolic pathways that can influence neurodevelopment, including branched chain amino acid biosynthesis and pentose phosphate pathways. No associations were found for the fNIRS language discrimination measurements. Although the tests were underpowered due to the small pilot sample sizes, potential associations were identified between the microbiome and measurements of early cognitive development that are worth exploring further.

Special Section Guest Editorial: Thirty Years of Functional Near-Infrared Spectroscopy.

Functional Near-Infrared Spectroscopy (fNIRS) is a non-invasive optical technique that measures cerebral hemodynamics across multiple regions of interest, and thereby characterises brain functional activation. Since its first description in 1993, fNIRS has undergone substantial developments in hardware, analysis techniques, and applications. Thirty years later, this technique is significantly enchancing our understanding in diverse areas of neuroscience research such as neurodevelopment, cognitive neuroscience, psychiatric disorders, neurodegenerative conditions, and brain injury management in intensive care settings. This special issue outlines the latest progress in instrumentation and analysis techniques and showcases some applications within the expanding field of fNIRS over the past decade.

Six-month-old infants' perception of structural regularities in speech.

In order to acquire grammar, infants need to extract regularities from the linguistic input. From birth, infants can detect regularities in speech based on identity relations, and show strong neural activation to syllable sequences containing adjacent repetitions of identical syllables (e.g. ABB: mubaba). Meanwhile, newborns' neural responses to sequences of different syllables (e.g. ABC: mubage, i.e. diversity-based relations) do not differ from baseline. However, this latter ability needs to emerge during development, as most linguistic units, such as words, are composed of highly variable sequences. As infants begin to learn their first word forms at 6 months, we hypothesize that the ability to represent sequences of different syllables might become important for them at this age. Using near-infrared spectroscopy (NIRS), we measured 6-month-old infants' brain responses to repetition- and diversity-based sequences in the bilateral temporal, parietal and frontal areas. We found that 6-month-olds discriminated the repetition- and diversity-based structures in frontal and parietal regions, and exhibited equally strong activation to both grammars as compared to baseline. These results show that by 6 months of age, infants encode sequences with diversity-based structures. They thus provide the earliest evidence that prelexical infants represent difference in speech stimuli, which behavioral studies first attest at 11 months of age.

The neonate brain's sensitivity to repetition-based structure: Specific to speech?

Newborns are able to extract and learn repetition-based regularities from the speech input, that is, they show greater brain activation in the bilateral temporal and left inferior frontal regions to trisyllabic pseudowords of the form AAB (e.g., "babamu") than to random ABC sequences (e.g., "bamuge"). Whether this ability is specific to speech or also applies to other auditory stimuli remains unexplored. To investigate this, we tested whether newborns are sensitive to regularities in musical tones. Neonates listened to AAB and ABC tones sequences, while their brain activity was recorded using functional Near-Infrared Spectroscopy (fNIRS). The paradigm, the frequency of occurrence and the distribution of the tones were identical to those of the syllables used in previous studies with speech. We observed a greater inverted (negative) hemodynamic response to AAB than to ABC sequences in the bilateral temporal and fronto-parietal areas. This inverted response was caused by a decrease in response amplitude, attributed to habituation, over the course of the experiment in the left fronto-temporal region for the ABC condition and in the right fronto-temporal region for both conditions. These findings show that newborns' ability to discriminate AAB from ABC sequences is not specific to speech. However, the neural response to musical tones and spoken language is markedly different. Tones gave rise to habituation, whereas speech was shown to trigger increasing responses over the time course of the study. Relatedly, the repetition regularity gave rise to an inverted hemodynamic response when carried by tones, while it was canonical for speech. Thus, newborns' ability to detect repetition is not speech-specific, but it engages distinct brain mechanisms for speech and music. RESEARCH HIGHLIGHTS: The ability of newborns' to detect repetition-based regularities is not specific to speech, but also extends to other auditory modalities. The brain mechanisms underlying speech and music processing are markedly different.

Erratum: Reproducibility of infant fNIRS studies: a meta-analytic approach (Erratum).

[This corrects the article DOI: 10.1117/1.NPh.10.2.023518.].

Prosodic cues enhance infants' sensitivity to nonadjacent regularities.

In language, grammatical dependencies often hold between items that are not immediately adjacent to each other. Acquiring these nonadjacent dependencies is crucial for learning grammar. However, there are potentially infinitely many dependencies in the language input. How does the infant brain solve this computational learning problem? Here, we demonstrate that while rudimentary sensitivity to nonadjacent regularities may be present relatively early, robust and reliable learning can only be achieved when convergent statistical and perceptual, specifically prosodic cues, are both present, helping the infant brain detect the building blocks that form a nonadjacent dependency. This study contributes to our understanding of the neural foundations of rule learning that pave the way for language acquisition.

Using functional near-infrared spectroscopy to study the early developing brain: future directions and new challenges.

Significance: Functional near-infrared spectroscopy (fNIRS) is a frequently used neuroimaging tool to explore the developing brain, particularly in infancy, with studies spanning from birth to toddlerhood (0 to 2 years). We provide an overview of the challenges and opportunities that the developmental fNIRS field faces, after almost 25 years of research. Aim: We discuss the most recent advances in fNIRS brain imaging with infants and outlines the trends and perspectives that will likely influence progress in the field in the near future. Approach: We discuss recent progress and future challenges in various areas and applications of developmental fNIRS from methodological and technological innovations to data processing and statistical approaches. Results and Conclusions: The major trends identified include uses of fNIRS "in the wild," such as global health contexts, home and community testing, and hyperscanning; advances in hardware, such as wearable technology; assessment of individual variation and developmental trajectories particularly while embedded in studies examining other environmental, health, and context specific factors and longitudinal designs; statistical advances including resting-state network and connectivity, machine learning and reproducibility, and collaborative studies. Standardization and larger studies have been, and will likely continue to be, a major goal in the field, and new data analysis techniques, statistical methods, and collaborative cross-site projects are emerging.

Reproducibility of infant fNIRS studies: a meta-analytic approach.

Significance: Concerns about the reproducibility of experimental findings have recently emerged in many disciplines, from psychology to medicine and neuroscience. As NIRS is a relatively recent brain imaging technique, the question of reproducibility has not yet been systematically addressed. Aim: The current study seeks to test the replicability of effects observed in NIRS experiments assessing young infants' rule-learning ability. Approach: We conducted meta-analyses and mixed-effects modeling-based inferential statistics to determine whether effect sizes were replicable and comparable in a sample of 23 NIRS studies investigating infants' abilities to process repetition- and diversity-based regularities in linguistic and nonlinguistic auditory and visual sequences. Additionally, we tested whether effect sizes were modulated by different factors such as the age of participants or the laboratory. We obtained NIRS data from 12 published and 11 unpublished studies. The 23 studies involved a total of 487 infants, aged between 0 and 9 months, tested in four different countries (Canada, France, Italy, and USA). Results: Our most important finding is that study and laboratory were never significant moderators of variation in effect sizes, indicating that results replicated reliably across the different studies and labs included in the sample. We observed small-to-moderate effect sizes, similar to effect sizes found with other neuroimaging and behavioral techniques in the developmental literature. In line with existing findings, effect sizes were modulated by the participants' age and differed across the different regularities tested, with repetition-based regularities giving rise to the strongest effects; in particular, the overall magnitude of this effect in the left temporal region was 0.27 when analyzing the entire dataset. Conclusions: Meta-analysis is a useful tool for assessing replicability and cross-study variability. Here, we have shown that infant NIRS studies in the language domain replicate robustly across various NIRS machines, testing sites, and developmental populations.

Newborns modulate their crawling in response to their native language but not another language.

Human newborns can propel themselves to their mother's breast when positioned skin to skin on her abdomen just after birth. For decades, researchers have considered this primitive crawling behavior a spinal reflex, immune to supra spinal control. However, recent research suggests that neonatal crawling is already responsive to visual and olfactory stimuli processed at a supra spinal level. Here we report that a few hours post birth, French newborns can also modulate their crawling in response to their native language - a source of information that is processed supra-spinally. The crawling patterns of 23 French-born newborns were recorded on video and via an infrared motion capture system during two randomly ordered 2-min trials. The newborns were secured on a mini skateboard to facilitate arm and leg movements during their crawling propulsion. They heard a repetitive sequence of the same sentences either in French, their native language, or in English, a rhythmically different and hence discriminable unfamiliar language, on each trial. In French, compared to English, crawling was enhanced, with significantly more arm and leg steps and significantly more and larger trunk rotations in the cephalo-caudal axis. Moreover, newborns rotated their heads and trunk toward the appropriate loud speaker when hearing French but not English. These preliminary findings suggest that newborn crawling is not a simple stereotyped reflex under spinal control, but a complex pattern that can be modulated in response to higher-order, supra-spinally processed stimuli. The findings open fascinating questions about the range of stimuli to which newborn crawling is responsive.

Newborns discriminate utterance-level prosodic contours.

Prosody is the fundamental organizing principle of spoken language, carrying lexical, morphosyntactic, and pragmatic information. It, therefore, provides highly relevant input for language development. Are infants sensitive to this important aspect of spoken language early on? In this study, we asked whether infants are able to discriminate well-formed utterance-level prosodic contours from ill-formed, backward prosodic contours at birth. This deviant prosodic contour was obtained by time-reversing the original one, and super-imposing it on the otherwise intact segmental information. The resulting backward prosodic contour was thus unfamiliar to the infants and ill-formed in French. We used near-infrared spectroscopy (NIRS) in 1-3-day-old French newborns (n = 25) to measure their brain responses to well-formed contours as standards and their backward prosody counterparts as deviants in the frontal, temporal, and parietal areas bilaterally. A cluster-based permutation test revealed greater responses to the Deviant than to the Standard condition in right temporal areas. These results suggest that newborns are already capable of detecting utterance-level prosodic violations at birth, a key ability for breaking into the native language, and that this ability is supported by brain areas similar to those in adults. RESEARCH HIGHLIGHTS: At birth, infants have sophisticated speech perception abilities. Prosody may be particularly important for early language development. We show that newborns are already capable of discriminating utterance-level prosodic contours. This discrimination can be localized to the right hemisphere of the neonate brain.

Speakers aren't blank slates (with respect to sign-language phonology)!

A large literature has gauged the linguistic knowledge of signers by comparing sign-processing by signers and non-signers. Underlying this approach is the assumption that non-signers are devoid of any relevant linguistic knowledge, and as such, they present appropriate non-linguistic controls-a recent paper by Meade et al. (2022) articulates this view explicitly. Our commentary revisits this position. Informed by recent findings from adults and infants, we argue that the phonological system is partly amodal. We show that hearing infants use a shared brain network to extract phonological rules from speech and sign. Moreover, adult speakers who are sign-naïve demonstrably project knowledge of their spoken L1 to signs. So, when it comes to sign-language phonology, speakers are not linguistic blank slates. Disregarding this possibility could systematically underestimate the linguistic knowledge of signers and obscure the nature of the language faculty.

Optical imaging and spectroscopy for the study of the human brain: status report.

This report is the second part of a comprehensive two-part series aimed at reviewing an extensive and diverse toolkit of novel methods to explore brain health and function. While the first report focused on neurophotonic tools mostly applicable to animal studies, here, we highlight optical spectroscopy and imaging methods relevant to noninvasive human brain studies. We outline current state-of-the-art technologies and software advances, explore the most recent impact of these technologies on neuroscience and clinical applications, identify the areas where innovation is needed, and provide an outlook for the future directions.

Seven-month-old infants detect symmetrical structures in multi-featured abstract visual patterns.

The present study investigated 7-month-old infants' ability to perceive structural symmetry in mosaic-like abstract visual patterns. We examined infants' (n = 98) spontaneous looking behaviour to mosaic-like sequences with symmetrical and asymmetrical structures. Sequences were composed of square tiles from two categories that differed in their colour scheme and internal shape. We manipulated sequence length (3 or 5 tiles) and abstractness of the symmetry (token vs. category level). The 7-month-olds discriminated structurally symmetrical from asymmetrical mosaics in the first half of the test phase (first 8 trials). Sequence length, level of symmetry, or number of unique tiles per sequence did not significantly modulate infants' looking behaviour. These results suggest that very young infants detect differences in structural symmetry in multi-featured visual patterns.

Developmental changes in the brain response to speech during the first year of life: A near-infrared spectroscopy study of dutch-learning infants.

Language acquisition in the first year of life plays an important role in human development. Although recent research has increased our knowledge of early language development, the origins and developmental trajectories of language processing during infancy are still being debated. One important issue is whether the infant brain has already developed adult-like functional cortical specialization and lateralization for speech and language processing. Although a relatively large number of previous studies have investigated the cortical specialization for speech processing in newborns by comparing responses to normal speech with responses to time-reversed speech as a control, the subsequent development of this differential response is less well understood. In the current study, our primary goal was, therefore, to expand our knowledge of functional specialization for speech during the first year of life. By using functional near-infrared spectroscopy (fNIRS), we examined the hemodynamic responses in the temporal cortex to forward-going speech in the native language, Dutch, and backward Dutch in seventy-eight infants aged 5 and 10 months. We observed that five-month-old infants show bilateral activation to both forward and backward speech without obvious hemispheric lateralization for language, while ten-month-old infants show greater left-lateralized inverted responses (e.g., reduction in oxyhaemoglobin and increase in deoxyhaemoglobin) to forward speech than to backward speech. Overall, our findings indicate that the neural correlates of language processing undergo developmental changes in the first year of life.

Semantic systems are mentalistically activated for and by social partners.

A recently discovered electrophysiological response, the social N400, suggests that we use our language system to track how social partners comprehend language. Listeners show an increased N400 response, when themselves not, only a communicative partner experiences a semantic incongruity. Does the N400 reflect purely semantic or mentalistic computations as well? Do we attribute language comprehension to communicative partners using our semantic systems? In five electrophysiological experiments we identified two subcomponents of the social N400. First, we manipulated the presence-absence of an Observer during object naming: the semantic memory system was activated by the presence of a social partner in addition to semantic predictions for the self. Next, we induced a false belief-and a consequent miscomprehension-in the Observer. Participants showed the social N400, over and above the social presence effect, to labels that were incongruent for the Observer, even though they were congruent for them. This effect appeared only if participants received explicit instructions to track the comprehension of the Observer. These findings suggest that the semantic systems of the brain are not merely sensitive to social information and contribute to the attribution of comprehension, but they appear to be mentalistic in nature.