Revealing the spatiotemporal brain dynamics of covert speech compared with overt speech: A simultaneous EEG-fMRI study.

Covert speech (CS) refers to speaking internally to oneself without producing any sound or movement. CS is involved in multiple cognitive functions and disorders. Reconstructing CS content by brain-computer interface (BCI) is also an emerging technique. However, it is still controversial whether CS is a truncated neural process of overt speech (OS) or involves independent patterns. Here, we performed a word-speaking experiment with simultaneous EEG-fMRI. It involved 32 participants, who generated words both overtly and covertly. By integrating spatial constraints from fMRI into EEG source localization, we precisely estimated the spatiotemporal dynamics of neural activity. During CS, EEG source activity was localized in three regions: the left precentral gyrus, the left supplementary motor area, and the left putamen. Although OS involved more brain regions with stronger activations, CS was characterized by an earlier event-locked activation in the left putamen (peak at 262 ms versus 1170 ms). The left putamen was also identified as the only hub node within the functional connectivity (FC) networks of both OS and CS, while showing weaker FC strength towards speech-related regions in the dominant hemisphere during CS. Path analysis revealed significant multivariate associations, indicating an indirect association between the earlier activation in the left putamen and CS, which was mediated by reduced FC towards speech-related regions. These findings revealed the specific spatiotemporal dynamics of CS, offering insights into CS mechanisms that are potentially relevant for future treatment of self-regulation deficits, speech disorders, and development of BCI speech applications.

Learning at your brain's rhythm: individualized entrainment boosts learning for perceptual decisions.

Training is known to improve our ability to make decisions when interacting in complex environments. However, individuals vary in their ability to learn new tasks and acquire new skills in different settings. Here, we test whether this variability in learning ability relates to individual brain oscillatory states. We use a visual flicker paradigm to entrain individuals at their own brain rhythm (i.e. peak alpha frequency) as measured by resting-state electroencephalography (EEG). We demonstrate that this individual frequency-matched brain entrainment results in faster learning in a visual identification task (i.e. detecting targets embedded in background clutter) compared to entrainment that does not match an individual's alpha frequency. Further, we show that learning is specific to the phase relationship between the entraining flicker and the visual target stimulus. EEG during entrainment showed that individualized alpha entrainment boosts alpha power, induces phase alignment in the pre-stimulus period, and results in shorter latency of early visual evoked potentials, suggesting that brain entrainment facilitates early visual processing to support improved perceptual decisions. These findings suggest that individualized brain entrainment may boost perceptual learning by altering gain control mechanisms in the visual cortex, indicating a key role for individual neural oscillatory states in learning and brain plasticity.

The Design and Development of Instrumented Toys for the Assessment of Infant Cognitive Flexibility.

The first years of an infant's life represent a sensitive period for neurodevelopment where one can see the emergence of nascent forms of executive function (EF), which are required to support complex cognition. Few tests exist for measuring EF during infancy, and the available tests require painstaking manual coding of infant behaviour. In modern clinical and research practice, human coders collect data on EF performance by manually labelling video recordings of infant behaviour during toy or social interaction. Besides being extremely time-consuming, video annotation is known to be rater-dependent and subjective. To address these issues, starting from existing cognitive flexibility research protocols, we developed a set of instrumented toys to serve as a new type of task instrumentation and data collection tool suitable for infant use. A commercially available device comprising a barometer and an inertial measurement unit (IMU) embedded in a 3D-printed lattice structure was used to detect when and how the infant interacts with the toy. The data collected using the instrumented toys provided a rich dataset that described the sequence of toy interaction and individual toy interaction patterns, from which EF-relevant aspects of infant cognition can be inferred. Such a tool could provide an objective, reliable, and scalable method of collecting early developmental data in socially interactive contexts.

Multimodal hyperscanning reveals that synchrony of body and mind are distinct in mother-child dyads.

Hyperscanning studies have begun to unravel the brain mechanisms underlying social interaction, indicating a functional role for interpersonal neural synchronization (INS), yet the mechanisms that drive INS are poorly understood. The current study, thus, addresses whether INS is functionally-distinct from synchrony in other systems - specifically the autonomic nervous system and motor behavior. To test this, we used concurrent functional near-infrared spectroscopy - electrocardiography recordings, while N = 34 mother-child and stranger-child dyads engaged in cooperative and competitive tasks. Only in the neural domain was a higher synchrony for mother-child compared to stranger-child dyads observed. Further, autonomic nervous system and neural synchrony were positively related during competition but not during cooperation. These results suggest that synchrony in different behavioral and biological systems may reflect distinct processes. Furthermore, they show that increased mother-child INS is unlikely to be explained solely by shared arousal and behavioral similarities, supporting recent theories that postulate that INS is higher in close relationships.

A New Remote Guided Method for Supervised Web-Based Cognitive Testing to Ensure High-Quality Data: Development and Usability Study.

BACKGROUND: The global COVID-19 pandemic has triggered a fundamental reexamination of how human psychological research can be conducted safely and robustly in a new era of digital working and physical distancing. Online web-based testing has risen to the forefront as a promising solution for the rapid mass collection of cognitive data without requiring human contact. However, a long-standing debate exists over the data quality and validity of web-based studies. This study examines the opportunities and challenges afforded by the societal shift toward web-based testing and highlights an urgent need to establish a standard data quality assurance framework for online studies. OBJECTIVE: This study aims to develop and validate a new supervised online testing methodology, remote guided testing (RGT). METHODS: A total of 85 healthy young adults were tested on 10 cognitive tasks assessing executive functioning (flexibility, memory, and inhibition) and learning. Tasks were administered either face-to-face in the laboratory (n=41) or online using remote guided testing (n=44) and delivered using identical web-based platforms (Cambridge Neuropsychological Test Automated Battery, Inquisit, and i-ABC). Data quality was assessed using detailed trial-level measures (missed trials, outlying and excluded responses, and response times) and overall task performance measures. RESULTS: The results indicated that, across all data quality and performance measures, RGT data was statistically-equivalent to in-person data collected in the lab (P>.40 for all comparisons). Moreover, RGT participants out-performed the lab group on measured verbal intelligence (P<.001), which could reflect test environment differences, including possible effects of mask-wearing on communication. CONCLUSIONS: These data suggest that the RGT methodology could help ameliorate concerns regarding online data quality-particularly for studies involving high-risk or rare cohorts-and offer an alternative for collecting high-quality human cognitive data without requiring in-person physical attendance.

Emotional valence modulates the topology of the parent-infant inter-brain network.

Emotional communication between parents and children is crucial during early life, yet little is known about its neural underpinnings. Here, we adopt a dual connectivity approach to assess how positive and negative emotions modulate the interpersonal neural network between infants and their mothers during naturalistic interaction. Fifteen mothers were asked to model positive and negative emotions toward pairs of objects during social interaction with their infants (mean age 10.3 months) whilst the neural activity of both mothers and infants was concurrently measured using dual electroencephalography (EEG). Intra-brain and inter-brain network connectivity in the 6-9 Hz range (i.e. infant Alpha band) during maternal expression of positive and negative emotions was computed using directed (partial directed coherence, PDC) and non-directed (phase-locking value, PLV) connectivity metrics. Graph theoretical measures were used to quantify differences in network topology as a function of emotional valence. We found that inter-brain network indices (Density, Strength and Divisibility) consistently revealed strong effects of emotional valence on the parent-child neural network. Parents and children showed stronger integration of their neural processes during maternal demonstrations of positive than negative emotions. Further, directed inter-brain metrics (PDC) indicated that mother to infant directional influences were stronger during the expression of positive than negative emotional states. These results suggest that the parent-infant inter-brain network is modulated by the emotional quality and tone of dyadic social interactions, and that inter-brain graph metrics may be successfully applied to examine these changes in parent-infant inter-brain network topology.

Speaker gaze increases information coupling between infant and adult brains.

When infants and adults communicate, they exchange social signals of availability and communicative intention such as eye gaze. Previous research indicates that when communication is successful, close temporal dependencies arise between adult speakers' and listeners' neural activity. However, it is not known whether similar neural contingencies exist within adult-infant dyads. Here, we used dual-electroencephalography to assess whether direct gaze increases neural coupling between adults and infants during screen-based and live interactions. In experiment 1 (n = 17), infants viewed videos of an adult who was singing nursery rhymes with (i) direct gaze (looking forward), (ii) indirect gaze (head and eyes averted by 20°), or (iii) direct-oblique gaze (head averted but eyes orientated forward). In experiment 2 (n = 19), infants viewed the same adult in a live context, singing with direct or indirect gaze. Gaze-related changes in adult-infant neural network connectivity were measured using partial directed coherence. Across both experiments, the adult had a significant (Granger) causal influence on infants' neural activity, which was stronger during direct and direct-oblique gaze relative to indirect gaze. During live interactions, infants also influenced the adult more during direct than indirect gaze. Further, infants vocalized more frequently during live direct gaze, and individual infants who vocalized longer also elicited stronger synchronization from the adult. These results demonstrate that direct gaze strengthens bidirectional adult-infant neural connectivity during communication. Thus, ostensive social signals could act to bring brains into mutual temporal alignment, creating a joint-networked state that is structured to facilitate information transfer during early communication and learning.

Towards a Personalized Multi-Domain Digital Neurophenotyping Model for the Detection and Treatment of Mood Trajectories.

The commercial availability of many real-life smart sensors, wearables, and mobile apps provides a valuable source of information about a wide range of human behavioral, physiological, and social markers that can be used to infer the user's mental state and mood. However, there are currently no commercial digital products that integrate these psychosocial metrics with the real-time measurement of neural activity. In particular, electroencephalography (EEG) is a well-validated and highly sensitive neuroimaging method that yields robust markers of mood and affective processing, and has been widely used in mental health research for decades. The integration of wearable neuro-sensors into existing multimodal sensor arrays could hold great promise for deep digital neurophenotyping in the detection and personalized treatment of mood disorders. In this paper, we propose a multi-domain digital neurophenotyping model based on the socioecological model of health. The proposed model presents a holistic approach to digital mental health, leveraging recent neuroscientific advances, and could deliver highly personalized diagnoses and treatments. The technological and ethical challenges of this model are discussed.

The promise of two-person neuroscience for developmental psychiatry: using interaction-based sociometrics to identify disorders of social interaction.

Social interactions are fundamental for human development, and disordered social interactions are pervasive in many psychiatric disorders. Recent advances in 'two-person neuroscience' have provided new tools for characterising social interactions. Accordingly, interaction-based 'sociometrics' hold great promise for developmental psychology and psychiatry, particularly in the early identification of social disorders. DECLARATION OF INTEREST: None.

Infants' visual sustained attention is higher during joint play than solo play: is this due to increased endogenous attention control or exogenous stimulus capture?

Previous research has suggested that when a social partner, such as a parent, pays attention to an object, this increases the attention that infants pay to that object during spontaneous, naturalistic play. There are two contrasting reasons why this might be: first, social context may influence increases in infants' endogenous (voluntary) attention control; second, social settings may offer increased opportunities for exogenous attentional capture. To differentiate these possibilities, we compared 12-month-old infants' naturalistic attention patterns in two settings: Solo Play and Joint Play with a social partner (the parent). Consistent with previous research, we found that infants' look durations toward play objects were longer during Joint Play, and that moments of inattentiveness were fewer, and shorter. Follow-up analyses, conducted to differentiate the two above-proposed hypotheses, were more consistent with the latter hypothesis. We found that infants' rate of change of attentiveness was faster during Joint Play than Solo Play, suggesting that internal attention factors, such as attentional inertia, may influence looking behaviour less during Joint Play. We also found that adults' attention forwards-predicted infants' subsequent attention more than vice versa, suggesting that adults' behaviour may drive infants' behaviour. Finally, we found that mutual gaze did not directly facilitate infant attentiveness. Overall, our results suggest that infants spend more time attending to objects during Joint Play than Solo Play, but that these differences are more likely attributable to increased exogenous attentional scaffolding from the parent during social play, rather than to increased endogenous attention control from the infant.

Difficulties in auditory organization as a cause of reading backwardness? An auditory neuroscience perspective.

Over 30 years ago, it was suggested that difficulties in the 'auditory organization' of word forms in the mental lexicon might cause reading difficulties. It was proposed that children used parameters such as rhyme and alliteration to organize word forms in the mental lexicon by acoustic similarity, and that such organization was impaired in developmental dyslexia. This literature was based on an 'oddity' measure of children's sensitivity to rhyme (e.g. wood, book, good) and alliteration (e.g. sun, sock, rag). The 'oddity' task revealed that children with dyslexia were significantly poorer at identifying the 'odd word out' than younger children without reading difficulties. Here we apply a novel modelling approach drawn from auditory neuroscience to study the possible sensory basis of the auditory organization of rhyming and non-rhyming words by children. We utilize a novel Spectral-Amplitude Modulation Phase Hierarchy (S-AMPH) approach to analysing the spectro-temporal structure of rhyming and non-rhyming words, aiming to illuminate the potential acoustic cues used by children as a basis for phonological organization. The S-AMPH model assumes that speech encoding depends on neuronal oscillatory entrainment to the amplitude modulation (AM) hierarchy in speech. Our results suggest that phonological similarity between rhyming words in the oddity task depends crucially on slow (delta band) modulations in the speech envelope. Contrary to linguistic assumptions, therefore, auditory organization by children may not depend on phonemic information for this task. Linguistically, it is assumed that 'book' does not rhyme with 'wood' and 'good' because the final phoneme differs. However, our auditory analysis suggests that the acoustic cues to this phonological dissimilarity depend primarily on the slower amplitude modulations in the speech envelope, thought to carry prosodic information. Therefore, the oddity task may help in detecting reading difficulties because phonological similarity judgements about rhyme reflect sensitivity to slow amplitude modulation patterns. Slower amplitude modulations are known to be detected less efficiently by children with dyslexia.

Prosodic Similarity Effects in Short-Term Memory in Developmental Dyslexia.

Children with developmental dyslexia are characterized by phonological difficulties across languages. Classically, this 'phonological deficit' in dyslexia has been investigated with tasks using single-syllable words. Recently, however, several studies have demonstrated difficulties in prosodic awareness in dyslexia. Potential prosodic effects in short-term memory have not yet been investigated. Here we create a new instrument based on three-syllable words that vary in stress patterns, to investigate whether prosodic similarity (the same prosodic pattern of stressed and unstressed syllables) exerts systematic effects on short-term memory. We study participants with dyslexia and age-matched and younger reading-level-matched typically developing controls. We find that all participants, including dyslexic participants, show prosodic similarity effects in short-term memory. All participants exhibited better retention of words that differed in prosodic structure, although participants with dyslexia recalled fewer words accurately overall compared to age-matched controls. Individual differences in prosodic memory were predicted by earlier vocabulary abilities, by earlier sensitivity to syllable stress and by earlier phonological awareness. To our knowledge, this is the first demonstration of prosodic similarity effects in short-term memory. The implications of a prosodic similarity effect for theories of lexical representation and of dyslexia are discussed. © 2016 The Authors. Dyslexia published by John Wiley & Sons Ltd.

A role for amplitude modulation phase relationships in speech rhythm perception.

Prosodic rhythm in speech [the alternation of "Strong" (S) and "weak" (w) syllables] is cued, among others, by slow rates of amplitude modulation (AM) within the speech envelope. However, it is unclear exactly which envelope modulation rates and statistics are the most important for the rhythm percept. Here, the hypothesis that the phase relationship between "Stress" rate (∼2 Hz) and "Syllable" rate (∼4 Hz) AMs provides a perceptual cue for speech rhythm is tested. In a rhythm judgment task, adult listeners identified AM tone-vocoded nursery rhyme sentences that carried either trochaic (S-w) or iambic patterning (w-S). Manipulation of listeners' rhythm perception was attempted by parametrically phase-shifting the Stress AM and Syllable AM in the vocoder. It was expected that a 1π radian phase-shift (half a cycle) would reverse the perceived rhythm pattern (i.e., trochaic → iambic) whereas a 2π radian shift (full cycle) would retain the perceived rhythm pattern (i.e., trochaic → trochaic). The results confirmed these predictions. Listeners judgments of rhythm systematically followed Stress-Syllable AM phase-shifts, but were unaffected by phase-shifts between the Syllable AM and the Sub-beat AM (∼14 Hz) in a control condition. It is concluded that the Stress-Syllable AM phase relationship is an envelope-based modulation statistic that supports speech rhythm perception.

Age-appropriate adaptation of creativity tasks for infants aged 12-24 months.

Creativity is an important skill that relates to innovation, problem-solving and artistic achievement. However, relatively little is known about the early development of creative potential in very young children, in part due to a paucity of tasks suitable for use during infancy. Current measures of creativity in early childhood include the Unusual Box Test, Torrance's Thinking Creatively in Action and Movement (TCAM) task and the Toca Kitchen Monsters task. These tasks are designed for children aged above 12, 36 and 18 months respectively, but very few measures of creativity can be used for infants aged below 2. Accordingly, here we report age-appropriate adaptations of TCAM and Toca Kitchen Monsters tasks for infants as young as 12 to 24 months. Considerations taken into account include (1) infants' cognitive capacities (i.e., attention span, language comprehension skills, motor skills, and approach to play), and (2) practicality of the stimuli, including suitability for use amid the COVID-19 pandemic. The modified creativity battery for infants includes three tasks: Music Play, Object Play and Exploratory Play tasks. The task protocols elaborated in this paper are intended to facilitate studies on the early development of creativity in infants aged between 12 and 24 months. Primary highlights include:•Age-appropriate adaptation of creativity tasks for use with infants aged between 12 and 24 months.•Consideration of infants' cognitive capacities and stimulus practicality.•Innovative use of movement as expression of infants' creative behaviour.

Protocol to study dam-pup social transmission using a modified paradigm for transmission of food preference.

The social transmission of food preference, a rudimentary form of social learning, has primarily been studied in pairs of adult rodents. Here, we present a protocol to explore the parent-offspring context in social learning using an adaptation of this classic paradigm for rodent dam-pup dyads. We describe steps for studying weanling mice from the same mother and present a worked example using weight-based (food consumption) and time-based (exploration) indices of social learning.

A protocol for social interactive assessment of infant attention set-shifting between 12-24 months of age.

This protocol describes an adaptation of a classic sequential touching object categorisation task to assess infant attention set-shifting, suitable for ages 12-24 months. The task is conducted in a social interactive context with a parent, who scaffolds their infants' attention shift from high-salience to low-salience dimensional properties of objects (e.g., shape vs material). This task is adapted from Ellis and Oakes (2006), where 14 month-old infants were able to flexibly attend to both shape and material. In this paper, we present a methodological innovation which permits the direct measurement of the effect of parent-child interactions on an early developing executive function skill. This novel social interactive protocol permits direct assessment of the effect of parent-child interaction on an early executive function skill, attention set-shifting.•The parental role is to scaffold a shift in their child's attention from a high salient (e.g. shape) to a low-salient (e.g. material) dimension of the stimulus set.•The protocol is suitable for infants aged between 12 and 24 months.

Parent-infant affect synchrony during social and solo play.

While mother-infant affect synchrony has been proposed to facilitate the early development of social understanding, most investigations into affect synchrony have concentrated more on negative than positive affect. We analysed affect sharing during parent-infant object play, comparing positive and negative affect, to examine how it is modulated by shared playful activity. Mother-infant dyads (N = 20, average infant age 10.7 months) played together (social) or separately (solo) using an object. Both participants increased positive affect during social play as compared with solo play. Positive affect synchrony also increased during social play compared with solo play, whereas negative affect synchrony did not differ. Closer examination of the temporal dynamics of affect changes showed that infants' shifts to positive affect tended to occur contingently in response to their mothers', whereas mothers' shifts to negative affect followed their infants'. Further, during social play, positive affect displays were more long-lived while negative more short-lived. While our sample was small and from a homogeneous population (e.g. white, highly educated parents), limiting the implications of the findings, these results demonstrate that maternal active engagement in playful interaction with her infant affords, increases, and extends infant positive affect and parent-infant positive affect synchrony, providing insights into how the social context modulates infants' affective experiences. This article is part of a discussion meeting issue 'Face2face: advancing the science of social interaction'.

Synchrony in parent-offspring social interactions across development: A cross-species review of rodents and humans.

In humans, parent-child neural synchrony has been shown to support early communication, social attunement and learning. Further, some animal species (including rodents and bats) are now known to share neural synchrony during certain forms of social behaviour. However, very little is known about the developmental origins and sequelae of neural synchrony, and whether this neural mechanism might play a causal role in the control of social and communicative behaviour across species. Rodent models are optimal for exploring such questions of causality, with a plethora of tools available for both disruption/induction (optogenetics) and even mechanistic dissection of synchrony-induction pathways (in vivo electrical or optical recording of neural activity). However, before the benefits of rodent models for advancing research on parent-infant synchrony can be realised, it is first important to address a gap in understanding the forms of parent-pup synchrony that occur during rodent development, and how these social relationships evolve over time. Accordingly, this review seeks to identify parent-pup social behaviours that could potentially drive or facilitate synchrony and to discuss key differences or limitations when comparing mouse to human models of parent-infant synchrony. Uniquely, our review will focus on parent-pup dyadic social behaviours that have particular analogies to the human context, including instrumental, social interactive and vocal communicative behaviours. This review is intended to serve as a primer on the study of neurobehavioral synchrony across human and rodent dyadic developmental models.

Potential cognitive and neural benefits of a computerised cognitive training programme based on Structure Learning in healthy adults: study protocol for a randomised controlled trial.

BACKGROUND: Cognitive flexibility refers to the capacity to shift between conceptual representations particularly in response to changes in instruction and feedback. It enables individuals to swiftly adapt to changes in their environment and has significant implications for learning. The present study focuses on investigating changes in cognitive flexibility following an intervention programme-Structure Learning training. METHODS: Participants are pseudo-randomised to either the Training or Control group, while matched on age, sex, intelligence and cognitive flexibility performance. In the Training group, participants undergo around 2 weeks of training (at least 13 sessions) on Structure Learning. In the Control group, participants do not have to undergo any training and are never exposed to the Structure Learning task. The effects of Structure Learning training are investigated at both the behavioural and neural level. We measured covariates that can influence an individual's training performance before the training phase and outcome measures that can potentially show training benefits after the training phase. At the behavioural level, we investigated outcomes in both cognitive and social aspects with a primary focus on executive functions. At the neural level, we employed a multimodality approach and investigated potential changes to functional connectivity patterns, neurometabolite concentration in the frontal brain regions, and brain microstructure and myelination. DISCUSSION: We reported the development of a novel training programme based on Structure Learning that aims to hone a general learning ability to potentially achieve extensive transfer benefits across various cognitive constructs. Potential transfer benefits can be exhibited through better performance in outcome measures between Training and Control participants, and positive associations between training performance and outcomes after the training in Training participants. Moreover, we attempt to substantiate behavioural findings with evidence of neural changes across different imaging modalities by the Structure Learning training. TRIAL REGISTRATION: National Institutes of Health U.S. National Library of Medicine ClinicalTrials.gov NCT05611788. Registered on 7 November 2022. PROTOCOL VERSION: 11 May 2023.

Study protocol: How does cognitive flexibility relate to other executive functions and learning in healthy young adults?

BACKGROUND: Cognitive flexibility (CF) enables individuals to readily shift from one concept or mode of practice/thoughts to another in response to changes in the environment and feedback, making CF vital to optimise success in obtaining goals. However, how CF relates to other executive functions (e.g., working memory, response inhibition), mental abilities (e.g., creativity, literacy, numeracy, intelligence, structure learning), and social factors (e.g., multilingualism, tolerance of uncertainty, perceived social support, social decision-making) is less well understood. The current study aims to (1) establish the construct validity of CF in relation to other executive function skills and intelligence, and (2) elucidate specific relationships between CF, structure learning, creativity, career decision making and planning, and other life skills. METHODS: This study will recruit up to 400 healthy Singaporean young adults (age 18-30) to complete a wide range of cognitive tasks and social questionnaires/tasks. The richness of the task/questionnaire battery and within-participant administration enables us to use computational modelling and structural equation modelling to examine connections between the latent constructs of interest. SIGNIFICANCE AND IMPACT: The current study is the first systematic investigation into the construct validity of CF and its interrelationship with other important cognitive skills such as learning and creativity, within an Asian context. The study will further explore the concept of CF as a non-unitary construct, a novel theoretical proposition in the field. The inclusion of a structure learning paradigm is intended to inform future development of a novel intervention paradigm to enhance CF. Finally, the results of the study will be useful for informing classroom pedagogy and the design of lifelong learning policies and curricula, as part of the wider remit of the Cambridge-NTU Centre for Lifelong Learning and Individualised Cognition (CLIC).