Hyperscanning to explore social interaction among autistic minds.

Hyperscanning - the monitoring of brain activity of two or more people simultaneously - has emerged to be a popular tool for assessing neural features of social interaction. This perspective article focuses on hyperscanning studies that use functional near-infrared spectroscopy (fNIRS), a technique that is very conducive to studies requiring naturalistic paradigms. In particular, we are interested in neural features that are related to social interaction deficits among individuals with autism spectrum disorders (ASD). This population has received relatively little attention in research using neuroimaging hyperscanning techniques, compared to neurotypical individuals. The study is outlined as follows. First, we summarize the findings about brain-behavior connections related to autism from previously published fNIRS hyperscanning studies. Then, we propose a preliminary theoretical framework of inter-brain coherence (IBC) with testable hypotheses concerning this population. Finally, we provide two examples of areas of inquiry in which studies could be particularly relevant for social-emotional/behavioral development for autistic children, focusing on intergenerational relationships in family units and learning in classroom settings in mainstream schools.

Autistic Traits Modulate Social Synchronizations Between School-Aged Children: Insights From Three fNIRS Hyperscanning Experiments.

The current study investigated how autistic traits modulate peer interactions using functional near-infrared spectroscopy (fNIRS) hyperscanning. Across three experiments, we tested the effect of copresence, joint activity, and a tangible goal during cooperative interactions on interbrain coherence (IBC) in school-aged children between 9 and 11 years old. Twenty-three dyads of children watched a video alone or together in Experiment 1, engaged in joint or self-paced book reading in Experiment 2, and pretended to play a Jenga game or played for real in Experiment 3. We found that all three formats of social interactions increased IBC in the frontotemporoparietal networks, which have been reported to support social interaction. Further, our results revealed the shared and unique interbrain connections that were predictive of the lower and higher parent-reported autism-spectrum quotient scores, which indicated child autistic traits. Results from a convergence of three experiments provide the first evidence to date that IBC is modulated by child autistic traits.

Early-stage use of hearing aids preserves auditory cortical structure in children with sensorineural hearing loss.

Hearing is critical to spoken language, cognitive, and social development. Little is known about how early auditory experiences impact the brain structure of children with bilateral sensorineural hearing loss. This study examined the influence of hearing aid use and residual hearing on the auditory cortex of children with severe to profound congenital sensorineural hearing loss. We evaluated cortical preservation in 103 young pediatric cochlear implant candidates (55 females and 48 males) by comparing their multivoxel pattern similarity of auditory cortical structure with that of 78 age-matched children with typical hearing. The results demonstrated that early-stage hearing aid use preserved the auditory cortex of children with bilateral congenital sensorineural hearing loss. Children with less residual hearing experienced a more pronounced advantage from hearing aid use. However, this beneficial effect gradually diminished after 17 months of hearing aid use. These findings support timely fitting of hearing aids in conjunction with early implantation to take advantage of neural preservation to maximize auditory and spoken language development.

Commonality and variation in mental representations of music revealed by a cross-cultural comparison of rhythm priors in 15 countries.

Music is present in every known society but varies from place to place. What, if anything, is universal to music cognition? We measured a signature of mental representations of rhythm in 39 participant groups in 15 countries, spanning urban societies and Indigenous populations. Listeners reproduced random 'seed' rhythms; their reproductions were fed back as the stimulus (as in the game of 'telephone'), such that their biases (the prior) could be estimated from the distribution of reproductions. Every tested group showed a sparse prior with peaks at integer-ratio rhythms. However, the importance of different integer ratios varied across groups, often reflecting local musical practices. Our results suggest a common feature of music cognition: discrete rhythm 'categories' at small-integer ratios. These discrete representations plausibly stabilize musical systems in the face of cultural transmission but interact with culture-specific traditions to yield the diversity that is evident when mental representations are probed across many cultures.

The development of tone discrimination in infancy: Evidence from a cross-linguistic, multi-lab report.

We report the findings of a multi-language and multi-lab investigation of young infants' ability to discriminate lexical tones as a function of their native language, age and language experience, as well as of tone properties. Given the high prevalence of lexical tones across human languages, understanding lexical tone acquisition is fundamental for comprehensive theories of language learning. While there are some similarities between the developmental course of lexical tone perception and that of vowels and consonants, findings for lexical tones tend to vary greatly across different laboratories. To reconcile these differences and to assess the developmental trajectory of native and non-native perception of tone contrasts, this study employed a single experimental paradigm with the same two pairs of Cantonese tone contrasts (perceptually similar vs. distinct) across 13 laboratories in Asia-Pacific, Europe and North-America testing 5-, 10- and 17-month-old monolingual (tone, pitch-accent, non-tone) and bilingual (tone/non-tone, non-tone/non-tone) infants. Across the age range and language backgrounds, infants who were not exposed to Cantonese showed robust discrimination of the two non-native lexical tone contrasts. Contrary to this overall finding, the statistical model assessing native discrimination by Cantonese-learning infants failed to yield significant effects. These findings indicate that lexical tone sensitivity is maintained from 5 to 17 months in infants acquiring tone and non-tone languages, challenging the generalisability of the existing theoretical accounts of perceptual narrowing in the first months of life. RESEARCH HIGHLIGHTS: This is a multi-language and multi-lab investigation of young infants' ability to discriminate lexical tones. This study included data from 13 laboratories testing 5-, 10-, and 17-month-old monolingual (tone, pitch-accent, non-tone) and bilingual (tone/non-tone, non-tone/non-tone) infants. Overall, infants discriminated a perceptually similar and a distinct non-native tone contrast, although there was no evidence of a native tone-language advantage in discrimination. These results demonstrate maintenance of tone discrimination throughout development.

Infant-directed speech facilitates word learning through attentional mechanisms: An fNIRS study of toddlers.

The speech register that adults especially caregivers use when interacting with infants and toddlers, that is, infant-directed speech (IDS) or baby talk, has been reported to facilitate language development throughout the early years. However, the neural mechanisms as well as why IDS results in such a developmental faciliatory effect remain to be investigated. The current study uses functional near-infrared spectroscopy (fNIRS) to evaluate two alternative hypotheses of such a facilitative effect, that IDS serves to enhance linguistic contrastiveness or to attract the child's attention. Behavioral and fNIRS data were acquired from twenty-seven Cantonese-learning toddlers 15-20 months of age when their parents spoke to them in either an IDS or adult-directed speech (ADS) register in a naturalistic task in which the child learned four disyllabic pseudowords. fNIRS results showed significantly greater neural responses to IDS than ADS register in the left dorsolateral prefrontal cortex (L-dlPFC), but opposite response patterns in the bilateral inferior frontal gyrus (IFG). The differences in fNIRS responses to IDS and to ADS in the L-dlPFC and the left parietal cortex (L-PC) showed significantly positive correlations with the differences in the behavioral word-learning performance of toddlers. The same fNIRS measures in the L-dlPFC and right PC (R-PC) of toddlers were significantly correlated with pitch range differences of parents between the two speech conditions. Together, our results suggest that the dynamic prosody in IDS increased toddlers' attention through greater involvement of the left frontoparietal network that facilitated word learning, compared to ADS. RESEARCH HIGHLIGHTS: This study for the first time examined the neural mechanisms of how infant-directed speech (IDS) facilitates word learning in toddlers. Using fNIRS, we identified the cortical regions that were directly involved in IDS processing. Our results suggest that IDS facilitates word learning by engaging a right-lateralized prosody processing and top-down attentional mechanisms in the left frontoparietal networks. The language network including the inferior frontal gyrus and temporal cortex was not directly involved in IDS processing to support word learning.

The form and function processing of lexical tone and intonation in tone-language-speaking children with autism spectrum disorder.

Studies on how the form versus function aspect of tone and intonation is processed by autistic individuals have mainly focused on speakers of non-tonal languages (e.g., English) with equivocal results. While the samples' heterogeneous cognitive abilities may be contributing factors, the phenotype of tone and intonation processing in autism may also vary with one's language background. Thirty-eight cognitively able autistic and 32 non-autistic Mandarin-speaking children completed tone and intonation perception tasks, each containing a function and form condition. Results suggested that the abilities to discriminate tone and intonation were not impaired at either the form or function level in these autistic children, and that these abilities were positively associated with one another in both autistic and non-autistic groups. The more severe the autism symptoms, the worse the form- and function-level of tone and intonation processing. While enhanced tone and intonation processing has been found in a subgroup of autistic children, it may not be a general characteristic of the autistic population with long-term tone language experience. These findings reveal typical tone and intonation processing at both the form and function levels in cognitively able Mandarin-speaking autistic children and provide evidence for associated tone and intonation processing abilities across levels.

Deficits in neural encoding of speech in preterm infants.

Preterm children show developmental cognitive and language deficits that can be subtle and sometimes undetectable until later in life. Studies of brain development in children who are born preterm have largely focused on vascular and gross anatomical characteristics rather than pathophysiological processes that may contribute to these developmental deficits. Neural encoding of speech as reflected in EEG recordings is predictive of future language development and could provide insights into those pathophysiological processes. We recorded EEG from 45 preterm (≤ 34 weeks of gestation) and 45 term (≥ 38 weeks) Chinese-learning infants 0-12 months of (corrected) age during natural sleep. Each child listened to three speech stimuli that differed in lexically meaningful pitch (2 native and 1 non-native speech categories). EEG measures associated with synchronization and gross power of the frequency following response (FFR) were examined. ANCOVAs revealed no main effect of stimulus nativeness but main effects of age, consistent with earlier studies. A main effect of prematurity also emerged, with synchronization measures showing stronger group differences than power. By detailing differences in FFR measures related to synchronization and power, this study brings us closer to identifying the pathophysiological pathway to often subtle language problems experienced by preterm children.

A large-scale repository of spoken narratives in French, German and Spanish from Cantonese-speaking learners.

Interdisciplinary research on foreign language learning has important implications for learning and education. In this paper, we present the Repository of Third Language (L3) Spoken Narratives from Modern Language Learners in Hong Kong (L3HK Repository). This database contains 906 audio recordings and annotated transcripts of spoken narratives in French, German, and Spanish that were elicited from Cantonese-speaking (L1) young adults using a wordless picture book, "Frog, Where Are You?". All participants spoke English as the second language (L2) and learned the target language as a third language (L3). We collected their demographic information, answers to a motivation questionnaire, parental socioeconomic status, and music background. Furthermore, for a subset of participants, we collected their L1 and L2 proficiency scores and additional experimental data on working memory and music perception. This database is valuable for examining cross-sectional changes in foreign language learning. The extensive data on phenotypes provide opportunities to explore learner-internal and learner-external factors in foreign language learning outcomes. These data may also be helpful for those who work on speech recognition.

The Extent of Hearing Input Affects the Plasticity of the Auditory Cortex in Children With Hearing Loss: A Preliminary Study.

PURPOSE: This study investigated to what extent residual hearing and rehabilitation options (e.g., hearing aids [HAs]) affect the auditory cortex in children with hearing loss. METHOD: Twenty-one children with bilateral congenital sensorineural hearing loss who were candidates for cochlear implantation were recruited. Voxel-based morphometry analysis was conducted to assess the gray matter (GM) volume in the auditory cortex. Children's residual hearing was measured by pure-tone audiometry at different frequencies. Multiple linear regression models were conducted to examine the effects of residual hearing and the use of HAs on GM volume in the auditory cortex with the control of age and gender. RESULTS: Children with more residual hearing at high frequencies had larger GM volume ratio (corrected by total intracranial volume) in the left Heschl's gyrus (r = -.545, p = .013). An interaction effect between residual hearing and the use of HAs suggested that the effect of residual hearing on GM ratio was moderated by the use of HAs (ß = -.791, p = .020). Compared with children with less residual hearing, children who had more residual hearing benefited more from longer use of HAs in terms of a larger GM ratio. CONCLUSIONS: Our preliminary findings highlight the impact of residual hearing on the neuroanatomy of the auditory cortex in children with hearing loss. Moreover, our results call for more auditory input via HAs for children with more residual hearing to preserve the auditory cortex before cochlear implantation. For children with less residual hearing who might receive limited benefit from HAs, an early cochlear implant would be necessary.

Native Language Perceptual Sensitivity Predicts Nonnative Speech Perception Differently in Younger and Older Singaporean Bilinguals.

PURPOSE: We investigate in this study how individual variability in native language speech perception (termed Perceptual Sensitivity) influences nonnative speech perception in Singaporean Tamil-English bilinguals. Further, we assess if and how contextual and demographic factors influence Perceptual Sensitivity in the acquired languages and if the influence of Perceptual Sensitivity on nonnative speech perception is different across younger and older bilinguals. METHOD: Perceptual Sensitivity in the native languages was examined by implementing Tamil and English gating tasks in 87 Singaporean Tamil-English bilinguals from two age groups (younger: 19-33 years; older: 55-70 years). Mandarin lexical tone discrimination was implemented as a measure of nonnative speech perception. RESULTS: There was a wide range of variability in Perceptual Sensitivity scores in both languages across both age groups. Perceptual Sensitivity in the first native language (L1 Tamil) was a robust predictor of nonnative speech perception across both age groups, especially for the older bilinguals. However, general intelligence emerged as a stronger predictor than Tamil Perceptual Sensitivity in younger bilinguals. The influence of Tamil Perceptual Sensitivity on lexical tone perception was not tone-specific, supporting a general enhancement of lexical tone perception with better Tamil Perceptual Sensitivity. There was an influence of demographic factors on English Perceptual Sensitivity in older bilinguals, but not for Tamil and not in younger bilinguals. CONCLUSIONS: Our findings corroborate with previous studies in showing that native language Perceptual Sensitivity is positively associated with and predicts nonnative speech perception in younger and older adulthood regardless of language similarity but to varying degrees. Specifically, the influence of Perceptual Sensitivity on nonnative speech perception is stronger in older adulthood, suggesting a possible shift in reliance on crystallized language knowledge with age. Proficiency and use, among other demographic and language variables, do not appear to influence L1 Perceptual Sensitivity in a lesser used language (Tamil) as significantly as previously assumed.

The Hong Kong Grocery Shopping Dialog Task (HK-GSDT): A Quick Screening Test for Neurocognitive Disorders.

The Hong Kong Grocery Shopping Dialog Task (HK-GSDT) is a short and easy-to-administer cognitive test developed for quickly screening neurocognitive disorders (NCDs). In the test, participants are instructed to do a hypothetical instrumental activity of daily living task of purchasing ingredients for a dish from a grocery store and verbally describe the specific shopping procedures. The current study aimed to validate the test with a sample of 545 Hong Kong older adults (58.8% female; aged 73.4 ± 8.37 years), including 464 adults with normal cognitive function, 39 with mild NCD, and 42 with major NCD. Demographic characteristics (i.e., sex, age, education) and clinical diagnosis of cognitive states (i.e., major NCD, mild NCD, and normal aging) were collected. Cognitive functioning was measured using the HK-GSDT and several standardized NCD-screening tests. The results showed good reliability (i.e., internal consistency) and structural validity in the HK-GSDT. It discriminated among different cognitive conditions, particularly between major NCDs and the other conditions, as effectively as did the existing standardized neurocognitive tests (e.g., Montreal Cognitive Assessment, Hong Kong List Learning Test). Moreover, the HK-GSDT explained additional variance of cognitive condition on top of those standardized neurocognitive tests. These results indicate that the HK-GSDT can be used alone, or in combination with other tests, to screen for NCDs.

The ability to use contextual cues to achieve phonological constancy emerges by 14 months.

The ability to map similar sounding words to different meanings alone is far from enough for successful speech processing. To overcome variability in the speech signal, young learners must also recognize words across surface variations. Previous studies have shown that infants at 14 months are able to use variations in word-internal cues (i.e., acoustic cues within the target word) to form phonological categories and to learn words. The present study takes into consideration the fact that talker variability can easily lead to acoustic overlap between phonological categories, in which case reliance on word-external cues (i.e., acoustic cues in the context preceding and/or following the target word, also referred to as contextual cues) as a frame of reference is obligatory for successful talker adaptation. In a series of experiments, the present study examines when infants are able to use word-external cues to tune to different talkers for the benefit of word learning. Cantonese-learning 14-month-old, 18-month-old, and 24-month-old infants (N = 258) were tested on the associative learning of Cantonese Tone 1-Tone 3 contrast. Results showed that talker variability that yielded acoustic overlap between the two tonal categories compromised infants' ability to map the contrast onto word meanings. However, when given speaker-matched contextual cues, infants as young as 14 months of age demonstrated a certain degree of talker adaptation which may have subserved their use of phonetic details in novel word learning. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Cross-linguistic patterns of speech prosodic differences in autism: A machine learning study.

Differences in speech prosody are a widely observed feature of Autism Spectrum Disorder (ASD). However, it is unclear how prosodic differences in ASD manifest across different languages that demonstrate cross-linguistic variability in prosody. Using a supervised machine-learning analytic approach, we examined acoustic features relevant to rhythmic and intonational aspects of prosody derived from narrative samples elicited in English and Cantonese, two typologically and prosodically distinct languages. Our models revealed successful classification of ASD diagnosis using rhythm-relative features within and across both languages. Classification with intonation-relevant features was significant for English but not Cantonese. Results highlight differences in rhythm as a key prosodic feature impacted in ASD, and also demonstrate important variability in other prosodic properties that appear to be modulated by language-specific differences, such as intonation.

Generalizable predictive modeling of semantic processing ability from functional brain connectivity.

Semantic processing (SP) is one of the critical abilities of humans for representing and manipulating conceptual and meaningful information. Neuroimaging studies of SP typically collapse data from many subjects, but its neural organization and behavioral performance vary between individuals. It is not yet understood whether and how the individual variabilities in neural network organizations contribute to the individual differences in SP behaviors. We aim to identify the neural signatures underlying SP variabilities by analyzing functional connectivity (FC) patterns based on a large-sample Human Connectome Project (HCP) dataset and rigorous predictive modeling. We used a two-stage predictive modeling approach to build an internally cross-validated model and to test the model's generalizability with unseen data from different HCP samples and other out-of-sample datasets. FC patterns within a putative semantic brain network were significantly predictive of individual SP scores summarized from five SP-related behavioral tests. This cross-validated model can be used to predict unseen HCP data. The model generalizability was enhanced in the language task compared with other tasks used during scanning and was better for females than males. The model constructed from the HCP dataset can be partially generalized to two independent cohorts that participated in different semantic tasks. FCs connecting to the Perisylvian language network show the most reliable contributions to predictive modeling and the out-of-sample generalization. These findings contribute to our understanding of the neural sources of individual differences in SP, which potentially lay the foundation for personalized education for healthy individuals and intervention for SP and language deficits patients.

The tone atlas of perceptual discriminability and perceptual distance: Four tone languages and five language groups.

Some prior investigations suggest that tone perception is flexible, reasonably independent of native phonology, whereas others suggest it is constrained by native phonology. We address this issue in a systematic and comprehensive investigation of adult tone perception. Sampling from diverse tone and non-tone speaking communities, we tested discrimination of the three major tone systems (Cantonese, Thai, Mandarin) that dominate the tone perception literature, in relation to native language and language experience as well as stimulus variation (tone properties, presentation order, pitch cues) using linear mixed effect modelling and multidimensional scaling. There was an overall discrimination advantage for tone language speakers and for native tones. However, language- and tone-specific effects, and presentation order effects also emerged. Thus, over and above native phonology, stimulus variation exerts a powerful influence on tone discrimination. This study provides a tone atlas, a reference guide to inform empirical studies of tone sensitivity, both retrospectively and prospectively.

Narratives imagined in response to instrumental music reveal culture-bounded intersubjectivity.

The scientific literature sometimes considers music an abstract stimulus, devoid of explicit meaning, and at other times considers it a universal language. Here, individuals in three geographically distinct locations spanning two cultures performed a highly unconstrained task: they provided free-response descriptions of stories they imagined while listening to instrumental music. Tools from natural language processing revealed that listeners provide highly similar stories to the same musical excerpts when they share an underlying culture, but when they do not, the generated stories show limited overlap. These results paint a more complex picture of music's power: music can generate remarkably similar stories in listeners' minds, but the degree to which these imagined narratives are shared depends on the degree to which culture is shared across listeners. Thus, music is neither an abstract stimulus nor a universal language but has semantic affordances shaped by culture, requiring more sustained attention from psychology.

Contributions of common genetic variants to specific languages and to when a language is learned.

Research over the past two decades has identified a group of common genetic variants explaining a portion of variance in native language ability. The present study investigates whether the same group of genetic variants are associated with different languages and languages learned at different times in life. We recruited 940 young adults who spoke from childhood Chinese and English as their first (native) (L1) and second (L2) language, respectively, who were learners of a new, third (L3) language. For the variants examined, we found a general decrease of contribution of genes to language functions from native to foreign (L2 and L3) languages, with variance in foreign languages explained largely by non-genetic factors such as musical training and motivation. Furthermore, genetic variants that were found to contribute to traits specific to Chinese and English respectively exerted the strongest effects on L1 and L2. These results seem to speak against the hypothesis of a language- and time-universal genetic core of linguistic functions. Instead, they provide preliminary evidence that genetic contribution to language may depend at least partly on the intricate language-specific features. Future research including a larger sample size, more languages and more genetic variants is required to further explore these hypotheses.

Early Development of Neural Speech Encoding Depends on Age but Not Native Language Status: Evidence From Lexical Tone.

We investigated the development of early-latency and long-latency brain responses to native and non-native speech to shed light on the neurophysiological underpinnings of perceptual narrowing and early language development. Specifically, we postulated a two-level process to explain the decrease in sensitivity to non-native phonemes toward the end of infancy. Neurons at the earlier stages of the ascending auditory pathway mature rapidly during infancy facilitating the encoding of both native and non-native sounds. This growth enables neurons at the later stages of the auditory pathway to assign phonological status to speech according to the infant's native language environment. To test this hypothesis, we collected early-latency and long-latency neural responses to native and non-native lexical tones from 85 Cantonese-learning children aged between 23 days and 24 months, 16 days. As expected, a broad range of presumably subcortical early-latency neural encoding measures grew rapidly and substantially during the first two years for both native and non-native tones. By contrast, long-latency cortical electrophysiological changes occurred on a much slower scale and showed sensitivity to nativeness at around six months. Our study provided a comprehensive understanding of early language development by revealing the complementary roles of earlier and later stages of speech processing in the developing brain.