Touch to learn: Multisensory input supports word learning and processing.

Infants experience language in rich multisensory environments. For example, they may first be exposed to the word applesauce while touching, tasting, smelling, and seeing applesauce. In three experiments using different methods we asked whether the number of distinct senses linked with the semantic features of objects would impact word recognition and learning. Specifically, in Experiment 1 we asked whether words linked with more multisensory experiences were learned earlier than words linked fewer multisensory experiences. In Experiment 2, we asked whether 2-year-olds' known words linked with more multisensory experiences were better recognized than those linked with fewer. Finally, in Experiment 3, we taught 2-year-olds labels for novel objects that were linked with either just visual or visual and tactile experiences and asked whether this impacted their ability to learn the new label-to-object mappings. Results converge to support an account in which richer multisensory experiences better support word learning. We discuss two pathways through which rich multisensory experiences might support word learning.

Mothers' use of touch across infants' development and its implications for word learning: Evidence from Korean dyadic interactions.

Caregivers' touches that occur alongside words and utterances could aid in the detection of word/utterance boundaries and the mapping of word forms to word meanings. We examined changes in caregivers' use of touches with their speech directed to infants using a multimodal cross-sectional corpus of 35 Korean mother-child dyads across three age groups of infants (8, 14, and 27 months). We tested the hypothesis that caregivers' frequency and use of touches with speech change with infants' development. Results revealed that the frequency of word/utterance-touch alignment as well as word + touch co-occurrence is highest in speech addressed to the youngest group of infants. Thus, this study provides support for the hypothesis that caregivers' use of touch during dyadic interactions is sensitive to infants' age in a way similar to caregivers' use of speech alone and could provide cues useful to infants' language learning at critical points in early development.

Vocal development in a large-scale crosslinguistic corpus.

This study evaluates whether early vocalizations develop in similar ways in children across diverse cultural contexts. We analyze data from daylong audio recordings of 49 children (1-36 months) from five different language/cultural backgrounds. Citizen scientists annotated these recordings to determine if child vocalizations contained canonical transitions or not (e.g., "ba" vs. "ee"). Results revealed that the proportion of clips reported to contain canonical transitions increased with age. Furthermore, this proportion exceeded 0.15 by around 7 months, replicating and extending previous findings on canonical vocalization development but using data from the natural environments of a culturally and linguistically diverse sample. This work explores how crowdsourcing can be used to annotate corpora, helping establish developmental milestones relevant to multiple languages and cultures. Lower inter-annotator reliability on the crowdsourcing platform, relative to more traditional in-lab expert annotators, means that a larger number of unique annotators and/or annotations are required, and that crowdsourcing may not be a suitable method for more fine-grained annotation decisions. Audio clips used for this project are compiled into a large-scale infant vocalization corpus that is available for other researchers to use in future work.

Perception of sibilant-liquid phonotactic frequency in full-term and preterm infants.

We examined full-term and preterm infants' perception of frequent and infrequent phonotactic pairings involving sibilants and liquids. Infants were tested on their preference for syllables with onsets involving /s/ or /ʃ/ followed by /l/ or /r/ using the Headturn Preference Procedure. Full-term infants preferred the frequent to the infrequent phonotactic pairings at 9 months, but not at either younger or older ages. Evidence was inconclusive regarding a possible difference between full-term and preterm samples; however, limitations on the preterm sample size limited our power to detect differences. Preference for the frequent pairing was not related to later vocabulary development.

What Do North American Babies Hear? A large-scale cross-corpus analysis.

A range of demographic variables influences how much speech young children hear. However, because studies have used vastly different sampling methods, quantitative comparison of interlocking demographic effects has been nearly impossible, across or within studies. We harnessed a unique collection of existing naturalistic, day-long recordings from 61 homes across four North American cities to examine language input as a function of age, gender, and maternal education. We analyzed adult speech heard by 3- to 20-month-olds who wore audio recorders for an entire day. We annotated speaker gender and speech register (child-directed or adult-directed) for 10,861 utterances from female and male adults in these recordings. Examining age, gender, and maternal education collectively in this ecologically valid dataset, we find several key results. First, the speaker gender imbalance in the input is striking: children heard 2-3× more speech from females than males. Second, children in higher-maternal education homes heard more child-directed speech than those in lower-maternal education homes. Finally, our analyses revealed a previously unreported effect: the proportion of child-directed speech in the input increases with age, due to a decrease in adult-directed speech with age. This large-scale analysis is an important step forward in collectively examining demographic variables that influence early development, made possible by pooled, comparable, day-long recordings of children's language environments. The audio recordings, annotations, and annotation software are readily available for reuse and reanalysis by other researchers.

The impact of brief restriction to articulation on children's subsequent speech production.

This project explored whether disruption of articulation during listening impacts subsequent speech production in 4-yr-olds with and without speech sound disorder (SSD). During novel word learning, typically-developing children showed effects of articulatory disruption as revealed by larger differences between two acoustic cues to a sound contrast, but children with SSD were unaffected by articulatory disruption. Findings suggest that, when typically developing 4-yr-olds experience an articulatory disruption during a listening task, the children's subsequent production is affected. Children with SSD show less influence of articulatory experience during perception, which could be the result of impaired or attenuated ties between perception and articulation.

Infants adapt to speaking rate differences in word segmentation.

Throughout their development, infants are exposed to varying speaking rates. Thus, it is important to determine whether they are able to adapt to speech at varying rates and recognize target words from continuous speech despite speaking rate differences. To address this question, a series of four experiments were conducted to test whether infants can recognize words in continuous speech when rate is variable. In addition, the underlying mechanisms that infants may use to cope with variations induced by different speaking rates were also examined. Specifically, using the Headturn Preference procedure [Jusczyk and Aslin (1995). Cognitive Psychol. 29, 1-23], infants were familiarized with normal-rate passages containing two trisyllabic target words (e.g., elephants and dinosaurs), and tested with familiar (elephants and dinosaurs) and unfamiliar (crocodiles and platypus) words embedded in normal-rate (experiment 1), fast-rate (experiments 2 and 3), or slow-rate passages (experiment 4). The results indicate that 14-month-olds, but not 11-month-olds, recognized target words in passages with a fast speaking rate. In addition, findings suggest that infants used context to normalize speech across different speaking rates.

Multimodal infant-directed communication: how caregivers combine tactile and linguistic cues.

Both touch and speech independently have been shown to play an important role in infant development. However, little is known about how they may be combined in the input to the child. We examined the use of touch and speech together by having mothers read their 5-month-olds books about body parts and animals. Results suggest that speech+touch multimodal events are characterized by more exaggerated touch and speech cues. Further, our results suggest that maternal touches are aligned with speech and that mothers tend to touch their infants in locations that are congruent with names of body parts. Thus, our results suggest that tactile cues could potentially aid both infant word segmentation and word learning.

Entrainment of prosody in the interaction of mothers with their young children.

Caregiver speech is not a static collection of utterances, but occurs in conversational exchanges, in which caregiver and child dynamically influence each other's speech. We investigate (a) whether children and caregivers modulate the prosody of their speech as a function of their interlocutor's speech, and (b) the influence of the initiator of the conversation on durational characteristics of the exchange. We analyzed naturalistic conversations from 13 mother-infant/toddler dyads aged 12-30 months across full-day recordings of 3-5 days per dyad using LENA and automated analytic tools. We found small, but significant, effects of mothers and their children influencing each other's speech, particularly in pitch measures. We also found longer utterances and shorter response latencies for the initiator of a conversation. While mothers show more mature conversational capabilities (more entrainment, shorter response latencies), our findings converge with prior research to highlight the active role of young children in the conversational exchange.

Mechanisms underlying accent accommodation in early word learning: evidence for general expansion.

Previous work reveals that toddlers can accommodate a novel accent after hearing it for only a brief period of time. A common assumption is that children, like adults, cope with nonstandard pronunciations by relying on words they know (e.g. 'this person pronounces sock as sack, therefore by black she meant block'). In this paper, we assess whether toddlers might additionally use a general expansion strategy, whereby they simply accept non-standard pronunciations when variability is expected. We exposed a group of 24-month-old English-learning toddlers to variability in indexical cues (very diverse voices from native English talkers), and another to variability in social cues (very diverse-looking silent actors); neither group was familiarized with the target novel accent. At test, both groups succeeded in recognizing a novel word when spoken in the novel accent. Thus, even when no lexical cues are available, variability can prepare young children for non-standard pronunciations.

Why the body comes first: effects of experimenter touch on infants' word finding.

The lexicon of 6-month-olds is comprised of names and body part words. Unlike names, body part words do not often occur in isolation in the input. This presents a puzzle: How have infants been able to pull out these words from the continuous stream of speech at such a young age? We hypothesize that caregivers' interactions directed at and on the infant's body may be at the root of their early acquisition of body part words. An artificial language segmentation study shows that experimenter-provided synchronous tactile cues help 4-month-olds to find words in continuous speech. A follow-up study suggests that this facilitation cannot be reduced to the highly social situation in which the directed interaction occurs. Taken together, these studies suggest that direct caregiver-infant interaction, exemplified in this study by touch cues, may play a key role in infants' ability to find word boundaries, and suggests that early vocabulary items may consist of words often linked with caregiver touches. A video abstract of this article can be viewed at http://youtu.be/NfCj5ipatyE.

Acoustic-phonetic differences between infant- and adult-directed speech: the role of stress and utterance position.

Previous studies have shown that infant-directed speech (IDS) differs from adult-directed speech (ADS) on a variety of dimensions. The aim of the current study was to investigate whether acoustic differences between IDS and ADS in English are modulated by prosodic structure. We compared vowels across the two registers (IDS, ADS) in both stressed and unstressed syllables, and in both utterance-medial and -final positions. Vowels in target bisyllabic trochees in the speech of twenty mothers of 4- and 11-month-olds were analyzed. While stressed and unstressed vowels differed between IDS and ADS for a measure of F0, and trended in similar directions for vowel peripherality, neither set differed in duration. These profiles held for both utterance-medial and -final words.

Predicting individual variation in language from infant speech perception measures.

There are increasing reports that individual variation in behavioral and neurophysiological measures of infant speech processing predicts later language outcomes, and specifically concurrent or subsequent vocabulary size. If such findings are held up under scrutiny, they could both illuminate theoretical models of language development and contribute to the prediction of communicative disorders. A qualitative, systematic review of this emergent literature illustrated the variety of approaches that have been used and highlighted some conceptual problems regarding the measurements. A quantitative analysis of the same data established that the bivariate relation was significant, with correlations of similar strength to those found for well-established nonlinguistic predictors of language. Further exploration of infant speech perception predictors, particularly from a methodological perspective, is recommended.

The acoustic properties of bilingual infant-directed speech.

Does the acoustic input for bilingual infants equal the conjunction of the input heard by monolinguals of each separate language? The present letter tackles this question, focusing on maternal speech addressed to 11-month-old infants, on the cusp of perceptual attunement. The acoustic characteristics of the point vowels /a,i,u/ were measured in the spontaneous infant-directed speech of French-English bilingual mothers, as well as in the speech of French and English monolingual mothers. Bilingual caregivers produced their two languages with acoustic prosodic separation equal to that of the monolinguals, while also conveying distinct spectral characteristics of the point vowels in their two languages.

The hyperarticulation hypothesis of infant-directed speech.

Typically, the point vowels [i,ɑ,u] are acoustically more peripheral in infant-directed speech (IDS) compared to adult-directed speech (ADS). If caregivers seek to highlight lexically relevant contrasts in IDS, then two sounds that are contrastive should become more distinct, whereas two sounds that are surface realizations of the same underlying sound category should not. To test this prediction, vowels that are phonemically contrastive ([i-ɪ] and [eɪ-ε]), vowels that map onto the same underlying category ([æ- ] and [ε- ]), and the point vowels [i,ɑ,u] were elicited in IDS and ADS by American English mothers of two age groups of infants (four- and eleven-month-olds). As in other work, point vowels were produced in more peripheral positions in IDS compared to ADS. However, there was little evidence of hyperarticulation per se (e.g. [i-ɪ] was hypoarticulated). We suggest that across-the-board lexically based hyperarticulation is not a necessary feature of IDS.

Semi-Automatic Assessment of Vocalization Quality for Children With and Without Angelman Syndrome.

Automated methods for processing of daylong audio recordings are efficient and may be an effective way of assessing developmental stage for typically developing children; however, their utility for children with developmental disabilities may be limited by constraints of algorithms and the scope of variables produced. Here, we present a novel utterance-level processing (ULP) system that 1) extracts utterances from daylong recordings, 2) verifies automated speaker tags using human annotation, and 3) provides vocal maturity metrics unavailable through automated systems. Study 1 examines the reliability and validity of this system in low-risk controls (LRC); Study 2 extends the ULP to children with Angelman syndrome (AS). Results showed that ULP annotations demonstrated high coder agreement across groups. Further, ULP metrics aligned with language assessments for LRC but not AS, perhaps reflecting limitations of language assessments in AS. We argue that ULP increases accuracy, efficiency, and accessibility of detailed vocal analysis for syndromic populations.

The Effect of Somatosensory Input on Word Recognition in Typical Children and Those With Speech Sound Disorder.

PURPOSE: Recent work suggests that speech perception is influenced by the somatosensory system and that oral sensorimotor disruption has specific effects on the perception of speech both in infants who have not yet begun to talk and in older children and adults with ample speech production experience; however, we do not know how such disruptions affect children with speech sound disorder (SSD). Response to disruption of would-be articulators during speech perception could reveal how sensorimotor linkages work for both typical and atypical speech and language development. Such linkages are crucial to advancing our knowledge on how both typically developing and atypically developing children produce and perceive speech. METHOD: Using a looking-while-listening task, we explored the impact of a sensorimotor restrictor on the recognition of words whose onsets involve late-developing sounds (s, ʃ) for both children with typical development (TD) and their peers with SSD. RESULTS: Children with SSD showed a decrement in performance when they held a restrictor in their mouths during the task, but this was not the case for children with TD. This effect on performance was only observed for the specific speech sounds blocked by the would-be articulators. CONCLUSION: We argue that these findings provide evidence for altered perceptual motor pathways in children with SSD. SUPPLEMENTAL MATERIAL: https://doi.org/10.23641/asha.21809442.

Toddlers recognize words in an unfamiliar accent after brief exposure.

Both subjective impressions and previous research with monolingual listeners suggest that a foreign accent interferes with word recognition in infants, young children, and adults. However, because being exposed to multiple accents is likely to be an everyday occurrence in many societies, it is unexpected that such non-standard pronunciations would significantly impede language processing once the listener has experience with the relevant accent. Indeed, we report that 24-month-olds successfully accommodate an unfamiliar accent in rapid word learning after less than 2 minutes of accent exposure. These results underline the robustness of our speech perception mechanisms, which allow listeners to adapt even in the absence of extensive lexical knowledge and clear known-word referents.

English-learning infants' perception of word stress patterns.

Adult speakers of different free stress languages (e.g., English, Spanish) differ both in their sensitivity to lexical stress and in their processing of suprasegmental and vowel quality cues to stress. In a head-turn preference experiment with a familiarization phase, both 8-month-old and 12-month-old English-learning infants discriminated between initial stress and final stress among lists of Spanish-spoken disyllabic nonwords that were segmentally varied (e.g. ['nila, 'tuli] vs [lu'ta, pu'ki]). This is evidence that English-learning infants are sensitive to lexical stress patterns, instantiated primarily by suprasegmental cues, during the second half of the first year of life.

Contending with foreign accent in early word learning.

By their second birthday, children are beginning to map meaning to form with relative ease. One challenge for these developing abilities is separating information relevant to word identity (i.e. phonemic information) from irrelevant information (e.g. voice and foreign accent). Nevertheless, little is known about toddlers' abilities to ignore irrelevant phonetic detail when faced with the demanding task of word learning. In an experiment with English-learning toddlers, we examined the impact of foreign accent on word learning. Findings revealed that while toddlers aged 2 ; 6 successfully generalized newly learned words spoken by a Spanish-accented speaker and a native English speaker, success of those aged 2 ; 0 was restricted. Specifically, toddlers aged 2 ; 0 failed to generalize words when trained by the native English speaker and tested by the Spanish-accented speaker. Data suggest that exposure to foreign accent in training may promote generalization of newly learned forms. These findings are considered in the context of developmental changes in early word representations.