Sustained looking at faces at 5 months of age is associated with socio-communicative skills in the second year of life.

Efficiently processing information from faces in infancy is foundational for nonverbal communication. We studied individual differences in 5-month-old infants' (N = 517) sustained attention to faces and preference for emotional faces. We assessed the contribution of genetic and environmental influences to individual differences in these gaze behaviors, and the association between these traits and other concurrent and later phenotypes. We found an association between the mean duration of looking at a face (before looking away from it) at 5 months and socio-communicative abilities at 14 months (ß = 0.17, 95% CI: 0.08; 0.26, p < 0.001). Sustained attention to faces predicted socio-communicative abilities over and above variance captured by mean fixation duration. We also found a statistically significant but weak tendency to prefer looking at smiling faces (relative to neutral faces), but no indication that variability in this behavior was explained by genetic effects. Moderate heritability was found for sustained attention to faces (A = 0.23, CI: 0.06; 0.38), while shared environmental influences were non-significant for both phenotypes. These findings suggest that sustained looking at individual faces before looking away is a developmentally significant 'social attention' phenotype in infancy, characterized by moderate heritability and a specific relation to later socio-communicative abilities.

A field test of computer-vision-based gaze estimation in psychology.

Computer-vision-based gaze estimation refers to techniques that estimate gaze direction directly from video recordings of the eyes or face without the need for an eye tracker. Although many such methods exist, their validation is often found in the technical literature (e.g., computer science conference papers). We aimed to (1) identify which computer-vision-based gaze estimation methods are usable by the average researcher in fields such as psychology or education, and (2) evaluate these methods. We searched for methods that do not require calibration and have clear documentation. Two toolkits, OpenFace and OpenGaze, were found to fulfill these criteria. First, we present an experiment where adult participants fixated on nine stimulus points on a computer screen. We filmed their face with a camera and processed the recorded videos with OpenFace and OpenGaze. We conclude that OpenGaze is accurate and precise enough to be used in screen-based experiments with stimuli separated by at least 11 degrees of gaze angle. OpenFace was not sufficiently accurate for such situations but can potentially be used in sparser environments. We then examined whether OpenFace could be used with horizontally separated stimuli in a sparse environment with infant participants. We compared dwell measures based on OpenFace estimates to the same measures based on manual coding. We conclude that OpenFace gaze estimates may potentially be used with measures such as relative total dwell time to sparse, horizontally separated areas of interest, but should not be used to draw conclusions about measures such as dwell duration.

Preferential looking to eyes versus mouth in early infancy: heritability and link to concurrent and later development.

BACKGROUND: From birth, infants orient preferentially to faces, and when looking at the face, they attend primarily to eyes and mouth. These areas convey different types of information, and earlier research suggests that genetic factors influence the preference for one or the other in young children. METHODS: In a sample of 535 5-month-old infant twins, we assessed eye (relative to mouth) preference in early infancy, i.e., before neural systems for social communication and language are fully developed. We investigated the contribution of genetic and environmental factors to the preference for looking at eyes, and the association with concurrent traits and follow-up measures. RESULTS: Eye preference was independent from all other concurrent traits measured, and had a moderate-to-high contribution from genetic influences (A = 0.57; 95% CI: 0.45, 0.66). Preference for eyes at 5 months was associated with higher parent ratings of receptive vocabulary at 14 months. No statistically significant association with later autistic traits was found. Preference for eyes was strikingly stable across different stimulus types (e.g., dynamic vs. still), suggesting that infants' preference at this age does not reflect sensitivity to low-level visual cues. CONCLUSIONS: These results suggest that individual differences in infants' preferential looking to eyes versus mouth to a substantial degree reflect genetic variation. The findings provide new leads on both the perceptual basis and the developmental consequences of these attentional biases.

Infants' sense of approximate numerosity: Heritability and link to other concurrent traits.

The ability to perceive approximate numerosity is present in many animal species, and emerges early in human infants. Later in life, it is moderately heritable and associated with mathematical abilities, but the etiology of the Approximate Number System (ANS) and its degree of independence from other cognitive abilities in infancy is unknown. Here, we assessed the phenotypic specificity as well as the influence of genetic and environmental factors on the ANS in a sample of 5-month-old twins (N = 514). We found a small-to-moderate but statistically significant effect of genetic factors on ANS acuity (heritability = 0.18, 95% CI: 0.02, 0.33), but only when differences in numerosity were relatively large (1:4 ratio). Non-verbal ability assessed with the Mullen Scales of Early Learning (MSEL) was found to be heritable (0.47; 95% CI: 0.34, 0.57) and the phenotypic association between ANS acuity and non-verbal ability performance was close to zero. Similarly, we found no association between ANS acuity and general attention during the task. An unexpected weak but statistically significant negative association between ANS acuity and scores on the receptive language scale of the MSEL was found. These results suggest that early ANS function may be largely independent from other aspects of non-verbal development. Further, variability in ANS in infancy seems to, to some extent, reflect genotypic differences in the population. HIGHLIGHTS: Assessing 514 infant twins with eye tracking, we found that infants' sense of approximate numerosity is heritable and not positively associated with concurrent attentional, cognitive or motor abilities. These results have implications for our understanding of development of mathematical ability and the link between cognitive abilities early in postnatal life.

Larger pupil dilation to nonsocial sounds in infants with subsequent autism diagnosis.

BACKGROUND: Studies of infants with an elevated likelihood of autism spectrum disorder can identify basic developmental processes that are associated with subsequently emerging clinical symptoms. Atypical responsiveness to sounds in infancy is such a potential early marker of autism. Here, we used pupillometry to quantify reactivity to social and nonsocial sounds in infants with a subsequent diagnosis. Previous research suggest that pupil dilation reflects attentional alerting, and link it to the locus coeruleus norepinephrine system. METHODS: We measured pupil dilation responses to child-directed speech and the sound of running water; sounds infants often hear in their everyday life. The final sample consisted of 99 ten-month-old infants (52 girls), of whom 68 had an elevated likelihood of autism and 31 were typically developing low-likelihood infants. At follow-up (36 months of age), 18 children in the elevated-likelihood group were diagnosed with autism. RESULTS: Compared to infants without diagnosis, the infants who were subsequently diagnosed with autism had larger pupil dilation when listening to nonsocial sounds, while reactivity to speech was strikingly similar between groups. In the total sample, more pupil dilation to the nonsocial sound was associated with higher levels of autistic symptoms. We also found that on a trial-by-trial basis, across all conditions and groups, more pupil dilation was associated with making fewer gaze shifts. CONCLUSIONS: This study did not find evidence of atypical pupillary reactivity to child-directed speech early in life in autism. Instead, the results suggest that certain nonsocial sounds elicit atypically strong alerting responses in infants with a subsequent autism diagnosis. These findings may have important theoretical and clinical implications.

Pupil size and pupillary light reflex in early infancy: heritability and link to genetic liability to schizophrenia.

BACKGROUND: Measures based on pupillometry, such as the pupillary light reflex (PLR) and baseline pupil size, reflect physiological responses linked to specific neural circuits that have been implicated as atypical in some psychiatric and neurodevelopmental conditions. METHODS: We investigated the contribution of genetic and environmental factors to the baseline pupil size and the PLR in 510 infant twins assessed at 5 months of age (281 monozygotic and 229 dizygotic pairs), and its associations with common genetic variants associated with neurodevelopmental (autism spectrum disorder and attention deficit hyperactivity disorder) and mental health (bipolar disorder, major depressive disorder and schizophrenia) conditions using genome-wide polygenic scores (GPSs). RESULTS: Univariate twin modelling showed high heritability at 5 months for both pupil size (h2 = .64) and constriction in response to light (h2 = .62), and bivariate twin modeling indicated substantial independence between the genetic factors influencing each (rG = .38). A statistically significant positive association between infant tonic pupil size and the GPS for schizophrenia was found (ß = .15, p = .024), while there was no significant association with the GPS for autism or any other GPSs. CONCLUSIONS: This study shows that some pupil measures are highly heritable in early infancy, although substantially independent in their genetic etiologies, and associated with common genetic variants linked to schizophrenia. It illustrates how genetically informed studies of infants may help us understand early physiological responses associated with psychiatric disorders which emerge much later in life.

T1-Weighted/T2-Weighted Ratio Mapping at 5 Months Captures Individual Differences in Behavioral Development and Differentiates Infants at Familial Risk for Autism from Controls.

Identifying structural measures that capture early brain development and are sensitive to individual differences in behavior is a priority in developmental neuroscience, with potential implications for our understanding of both typical and atypical populations. T1-weighted/T2-weighted (T1w/T2w) ratio mapping, which previously has been linked to myelination, represents an interesting candidate measure in this respect, as an accessible measure from standard magnetic resonance imaging (MRI) sequences. Yet, its value as an early infancy measure remains largely unexplored. Here, we compared T1w/T2w ratio in 5-month-old infants at familial risk (n = 27) for autism spectrum disorder (ASD) to those without elevated autism risk (n = 16). We found lower T1w/T2w ratio in infants at high risk for ASD within widely distributed regions, spanning both white and gray matter. In regions differing between groups, higher T1w/T2w ratio was robustly associated with higher age at scan (range: ~ 4-6.5 months), implying sensitivity to maturation at short developmental timescales. Further, higher T1w/T2w ratio within these regions was associated with higher scores on measures of concurrent developmental level. These findings suggest that T1w/T2w ratio is a developmentally sensitive measure that should be explored further in future studies of both typical and atypical infant populations.

Development of the pupillary light reflex from 9 to 24 months: association with common autism spectrum disorder (ASD) genetic liability and 3-year ASD diagnosis.

BACKGROUND: Although autism spectrum disorder (ASD) is heritable, the mechanisms through which genes contribute to symptom emergence remain unclear. Investigating candidate intermediate phenotypes such as the pupillary light reflex (PLR) prospectively from early in development could bridge genotype and behavioural phenotype. METHODS: Using eye tracking, we longitudinally measured the PLR at 9, 14 and 24 months in a sample of infants (N = 264) enriched for a family history of ASD; 27 infants received an ASD diagnosis at 3 years. We examined the 9- to 24-month developmental trajectories of PLR constriction latency (onset; ms) and amplitude (%) and explored their relation to categorical 3-year ASD outcome, polygenic liability for ASD and dimensional 3-year social affect (SA) and repetitive/restrictive behaviour (RRB) traits. Polygenic scores for ASD (PGSASD ) were calculated for 190 infants. RESULTS: While infants showed a decrease in latency between 9 and 14 months, higher PGSASD was associated with a smaller decrease in latency in the first year (ß = -.16, 95% CI = -0.31, -0.002); infants with later ASD showed a significantly steeper decrease in latency (a putative 'catch-up') between 14 and 24 months relative to those with other outcomes (typical: ß = .54, 95% CI = 0.08, 0.99; other: ß = .53, 95% CI = 0.02, 1.04). Latency development did not associate with later dimensional variation in ASD-related traits. In contrast, change in amplitude was not related to categorical ASD or genetics, but decreasing 9- to 14-month amplitude was associated with higher SA (ß = .08, 95% CI = 0.01, 0.14) and RRB (ß = .05, 95% CI = 0.004, 0.11) traits. CONCLUSIONS: These findings corroborate PLR development as possible intermediate phenotypes being linked to both genetic liability and phenotypic outcomes. Future work should incorporate alternative measures (e.g. functionally informed structural and genetic measures) to test whether distinct neural mechanisms underpin PLR alterations.

Determining Zygosity in Infant Twins - Revisiting the Questionnaire Approach.

Accurate zygosity determination is a fundamental step in twin research. Although DNA-based testing is the gold standard for determining zygosity, collecting biological samples is not feasible in all research settings or all families. Previous work has demonstrated the feasibility of zygosity estimation based on questionnaire (physical similarity) data in older twins, but the extent to which this is also a reliable approach in infancy is less well established. Here, we report the accuracy of different questionnaire-based zygosity determination approaches (traditional and machine learning) in 5.5 month-old twins. The participant cohort comprised 284 infant twin pairs (128 dizygotic and 156 monozygotic) who participated in the Babytwins Study Sweden (BATSS). Manual scoring based on an established technique validated in older twins accurately predicted 90.49% of the zygosities with a sensitivity of 91.65% and specificity of 89.06%. The machine learning approach improved the prediction accuracy to 93.10%, with a sensitivity of 91.30% and specificity of 94.29%. Additionally, we quantified the systematic impact of zygosity misclassification on estimates of genetic and environmental influences using simulation-based sensitivity analysis on a separate data set to show the implication of our machine learning accuracy gain. In conclusion, our study demonstrates the feasibility of determining zygosity in very young infant twins using a questionnaire with four items and builds a scalable machine learning model with better metrics, thus a viable alternative to DNA tests in large-scale infant twin studies.

The Babytwins Study Sweden (BATSS): A Multi-Method Infant Twin Study of Genetic and Environmental Factors Influencing Infant Brain and Behavioral Development.

Twin studies can help us understand the relative contributions of genes and environment to phenotypic trait variation, including attentional and brain activation measures. In terms of applying methodologies such as electroencephalography (EEG) and eye tracking, which are key methods in developmental neuroscience, infant twin studies are almost nonexistent. Here, we describe the Babytwins Study Sweden (BATSS), a multi-method longitudinal twin study of 177 MZ and 134 DZ twin pairs (i.e., 622 individual infants) covering the 5-36 month time period. The study includes EEG, eye tracking and genetics, together with more traditional measures based on in-person testing, direct observation and questionnaires. The results show that interest in participation in research among twin parents is high, despite the comprehensive protocol. DNA analysis from saliva samples was possible in virtually all participants, allowing for both zygosity confirmation and polygenic score analyses. Combining a longitudinal twin design with advanced technologies in developmental cognitive neuroscience and genomics, BATSS represents a new approach in infancy research, which we hope to have impact across multiple disciplines in the coming years.

Eye tracking in human interaction: Possibilities and limitations.

There is a long history of interest in looking behavior during human interaction. With the advance of (wearable) video-based eye trackers, it has become possible to measure gaze during many different interactions. We outline the different types of eye-tracking setups that currently exist to investigate gaze during interaction. The setups differ mainly with regard to the nature of the eye-tracking signal (head- or world-centered) and the freedom of movement allowed for the participants. These features place constraints on the research questions that can be answered about human interaction. We end with a decision tree to help researchers judge the appropriateness of specific setups.

Volitional eye movement control and ADHD traits: a twin study.

BACKGROUND: Top-down volitional command of eye movements may serve as a candidate endophenotype of ADHD, an important function underlying goal-directed action in everyday life. In this twin study, we examined the relation between performance on a response inhibition eye-tracking paradigm and parent-rated ADHD traits in a population-based twin sample. We hypothesized that altered eye movement control is associated with the severity of ADHD traits and that this association is attributable to genetic factors. METHODS: A total of 640 twins (320 pairs, 50% monozygotic) aged 9-14 years) from the Child and Adolescent Twin Study in Sweden (CATSS) participated. Twins performed the antisaccade task indexing inhibitory alterations as either direction errors (following exogenous cues rather than instructions) or premature anticipatory eye movements (failure to wait for cues). We calculated the associations of eye movement control and ADHD traits using linear regression mixed-effects models and genetic and environmental influences with multivariate twin models. RESULTS: Premature anticipatory eye movements were positively associated with inattentive traits (ß = .17; 95% CI: 0.04, 0.31), while controlling for hyperactive behaviors and other covariates. Both premature anticipatory eye movements and inattention were heritable (h2  = 0.40, 95% CI: 0.22, 0.56; h2  = 0.55; 95% CI: 0.42, 0.65; respectively), and their genetic correlation was small but statistically significant (r = .19, 95% CI: 0.02, 0.36). However, the genetic correlation did not remain significant after adjusting for covariates (age, sex, hyperactivity traits, IQ). No link was found between direction errors and ADHD traits. CONCLUSIONS: This study indicates that there is a specific, genetically influenced, relation between top-down eye movement control and the inattentive traits typical of ADHD.

How Infants' Arousal Influences Their Visual Search.

The influence of arousal on visual attention was examined in 6.5-month-old infants (N = 42) in the context of a visual search task. Phasic increases in arousal were induced with brief sounds and measured with pupil dilation. Evidence was found for an inverted U-shaped relation between pupil dilation amplitude and visual orienting, with highest likelihood of a target fixation at intermediate levels of arousal. Effects were similar for facial stimuli and simple objects. Together, these results contribute to our understanding of the relation between arousal and attention in infancy. The study also demonstrates that infants have a bias to orient to human eyes, even when presented in isolation.

The Developmental Origins of Gaze-Following in Human Infants.

During the first year of life, infants develop the capacity to follow the gaze of others. This behavior allows sharing attention and facilitates language acquisition and cognitive development. This article reviews studies that investigated gaze-following before 12 months of age in typically developing infants and discusses current theoretical perspectives on early GF. Recent research has revealed that early GF is highly dependent on situational constraints and individual characteristics, but theories that describe the underlying mechanisms have partly failed to consider this complexity. We propose a novel framework termed the perceptual narrowing account of GF that may have the potential to integrate existing theoretical accounts.

Reduced orienting to audiovisual synchrony in infancy predicts autism diagnosis at 3 years of age.

BACKGROUND: Effective multisensory processing develops in infancy and is thought to be important for the perception of unified and multimodal objects and events. Previous research suggests impaired multisensory processing in autism, but its role in the early development of the disorder is yet uncertain. Here, using a prospective longitudinal design, we tested whether reduced visual attention to audiovisual synchrony is an infant marker of later-emerging autism diagnosis. METHODS: We studied 10-month-old siblings of children with autism using an eye tracking task previously used in studies of preschoolers. The task assessed the effect of manipulations of audiovisual synchrony on viewing patterns while the infants were observing point light displays of biological motion. We analyzed the gaze data recorded in infancy according to diagnostic status at 3 years of age (DSM-5). RESULTS: Ten-month-old infants who later received an autism diagnosis did not orient to audiovisual synchrony expressed within biological motion. In contrast, both infants at low-risk and high-risk siblings without autism at follow-up had a strong preference for this type of information. No group differences were observed in terms of orienting to upright biological motion. CONCLUSIONS: This study suggests that reduced orienting to audiovisual synchrony within biological motion is an early sign of autism. The findings support the view that poor multisensory processing could be an important antecedent marker of this neurodevelopmental condition.

The TimeStudio Project: An open source scientific workflow system for the behavioral and brain sciences.

This article describes a new open source scientific workflow system, the TimeStudio Project, dedicated to the behavioral and brain sciences. The program is written in MATLAB and features a graphical user interface for the dynamic pipelining of computer algorithms developed as TimeStudio plugins. TimeStudio includes both a set of general plugins (for reading data files, modifying data structures, visualizing data structures, etc.) and a set of plugins specifically developed for the analysis of event-related eyetracking data as a proof of concept. It is possible to create custom plugins to integrate new or existing MATLAB code anywhere in a workflow, making TimeStudio a flexible workbench for organizing and performing a wide range of analyses. The system also features an integrated sharing and archiving tool for TimeStudio workflows, which can be used to share workflows both during the data analysis phase and after scientific publication. TimeStudio thus facilitates the reproduction and replication of scientific studies, increases the transparency of analyses, and reduces individual researchers' analysis workload. The project website ( http://timestudioproject.com ) contains the latest releases of TimeStudio, together with documentation and user forums.

Eye contact modulates cognitive processing differently in children with autism.

In humans, effortful cognitive processing frequently takes place during social interaction, with eye contact being an important component. This study shows that the effect of eye contact on memory for nonsocial information is different in children with typical development than in children with autism, a disorder of social communication. Direct gaze facilitated memory performance in children with typical development (n = 25, 6 years old), but no such facilitation was seen in the clinical group (n = 10, 6 years old). Eye tracking conducted during the cognitive test revealed strikingly similar patterns of eye movements, indicating that the results cannot be explained by differences in overt attention. Collectively, these findings have theoretical significance and practical implications for testing practices in children.

The breakdown of social looking.

Individual differences in social looking are commonly believed to reflect one single heritable dimension tightly linked to autism. Yet, recent data suggest that in human infants, looking to eyes (rather than mouth) and preference for faces (versus non-social objects) reflect distinct genetic influences, and neither appear to have a clear-cut relation to autism.

Genetic and environmental contributions to gaze lateralization across social and non-social stimuli in human infants.

A tendency to look at the left side of faces from the observer's point of view has been found in older children and adults, but it is not known when this face-specific left gaze bias develops and what factors may influence individual differences in gaze lateralization. Therefore, the aims of this study were to estimate gaze lateralization during face observation and to more broadly estimate lateralization tendencies across a wider set of social and non-social stimuli, in early infancy. In addition, we aimed to estimate the influence of genetic and environmental factors on lateralization of gaze. We studied gaze lateralization in 592 5-month-old twins (282 females, 330 monozygotic twins) by recording their gaze while viewing faces and two other types of stimuli that consisted of either collections of dots (non-social stimuli) or faces interspersed with objects (mixed stimuli). A right gaze bias was found when viewing faces, and this measure was moderately heritable (A = 0.38, 95% CI 0.24; 0.50). A left gaze bias was observed in the non-social condition, while a right gaze bias was found in the mixed condition, suggesting that there is no general left gaze bias at this age. Genetic influence on individual differences in gaze lateralization was only found for the tendency to look at the right versus left side of faces, suggesting genetic specificity of lateralized gaze when viewing faces.

Infants' looking preferences for social versus non-social objects reflect genetic variation.

To what extent do individual differences in infants' early preference for faces versus non-facial objects reflect genetic and environmental factors? Here in a sample of 536 5-month-old same-sex twins, we assessed attention to faces using eye tracking in two ways: initial orienting to faces at the start of the trial (thought to reflect subcortical processing) and sustained face preference throughout the trial (thought to reflect emerging attention control). Twin model fitting suggested an influence of genetic and unique environmental effects, but there was no evidence for an effect of shared environment. The heritability of face orienting and preference were 0.19 (95% confidence interval (CI) 0.04 to 0.33) and 0.46 (95% CI 0.33 to 0.57), respectively. Face preference was associated positively with later parent-reported verbal competence (ß = 0.14, 95% CI 0.03 to 0.25, P = 0.014, R2 = 0.018, N = 420). This study suggests that individual differences in young infants' selection of perceptual input-social versus non-social-are heritable, providing a developmental perspective on gene-environment interplay occurring at the level of eye movements.