A field test of computer-vision-based gaze estimation in psychology.

Computer-vision-based gaze estimation refers to techniques that estimate gaze direction directly from video recordings of the eyes or face without the need for an eye tracker. Although many such methods exist, their validation is often found in the technical literature (e.g., computer science conference papers). We aimed to (1) identify which computer-vision-based gaze estimation methods are usable by the average researcher in fields such as psychology or education, and (2) evaluate these methods. We searched for methods that do not require calibration and have clear documentation. Two toolkits, OpenFace and OpenGaze, were found to fulfill these criteria. First, we present an experiment where adult participants fixated on nine stimulus points on a computer screen. We filmed their face with a camera and processed the recorded videos with OpenFace and OpenGaze. We conclude that OpenGaze is accurate and precise enough to be used in screen-based experiments with stimuli separated by at least 11 degrees of gaze angle. OpenFace was not sufficiently accurate for such situations but can potentially be used in sparser environments. We then examined whether OpenFace could be used with horizontally separated stimuli in a sparse environment with infant participants. We compared dwell measures based on OpenFace estimates to the same measures based on manual coding. We conclude that OpenFace gaze estimates may potentially be used with measures such as relative total dwell time to sparse, horizontally separated areas of interest, but should not be used to draw conclusions about measures such as dwell duration.

Replacing eye trackers in ongoing studies: A comparison of eye-tracking data quality between the Tobii Pro TX300 and the Tobii Pro Spectrum.

The Tobii Pro TX300 is a popular eye tracker in developmental eye-tracking research, yet it is no longer manufactured. If a TX300 breaks down, it may have to be replaced. The data quality of the replacement eye tracker may differ from that of the TX300, which may affect the experimental outcome measures. This is problematic for longitudinal and multi-site studies, and for researchers replacing eye trackers between studies. We, therefore, ask how the TX300 and its successor, the Tobii Pro Spectrum, compare in terms of eye-tracking data quality. Data quality-operationalized through precision, accuracy, and data loss-was compared between eye trackers for three age groups (around 5-months, 10-months, and 3-years). Precision was better for all gaze position signals obtained with the Spectrum in comparison to the TX300. Accuracy of the Spectrum was higher for the 5-month-old and 10-month-old children. For the three-year-old children, accuracy was similar across both eye trackers. Gaze position signals from the Spectrum exhibited lower proportions of data loss, and the duration of the data loss periods tended to be shorter. In conclusion, the Spectrum produces gaze position signals with higher data quality, especially for the younger infants. Implications for data analysis are discussed.

Two-year-olds at elevated risk for ASD can learn novel words from their parents.

Children diagnosed with autism spectrum disorder (ASD) often have smaller vocabularies in infancy compared to typically-developing children. To understand whether their smaller vocabularies stem from problems in learning, our study compared a prospective risk sample of 18 elevated risk and 11 lower risk 24-month-olds on current vocabulary size and word learning ability using a paradigm in which parents teach their child words. Results revealed that both groups learned novel words, even though parents indicated that infants at elevated risk of ASD knew fewer words. This suggests that these early compromised vocabularies cannot be solely linked to difficulties in word formations.

The emergence of a theta social brain network during infancy.

Infants' socio-cognitive ability develops dramatically during the first year of life. From the perspective of ontogeny, the early development of social behavior allows for parent-child attachment, which in turn enhances survival. Thus, it is theorized that the development of social behavior, driven by social brain networks, forms the core of developmental acquisitions during this period. Further, understanding the maturation within the neural networks during social development is crucial to obtain a better grasp of the development of social developmental disorders. Therefore, we performed a longitudinal study in 854 infants measured at around 5 and 10 months to map the development of functional networks in the brain when infants were processing social and non-social videos. Using EEG, we focused on the frequency bands most commonly connected to social behavior: theta and alpha. We found that alpha networks remained relatively stable over the first year of life and showed no selectivity for social versus non-social stimuli, theta networks, showed strong global reconfigurations. The development of the theta networks progressed from a parietal occipital network in early infancy to a frontoparietal network towards the end of the first year of life. This reconfiguration coincided with selectivity for social versus non-social stimuli, with infants approaching the end of their first year of life showing increased synchronicity of theta communication when watching social videos versus non-social videos. Our findings provide strong evidence for the involvement of a frontoparietal theta network in the development of the social brain.

Exploring emotional face processing in 5-month-olds: The relation with quality of parent-child interaction and spatial frequencies.

It is unclear whether infants differentially process emotional faces in the brain at 5 months of age. Contradictory findings of previous research indicate that additional factors play a role in this process. The current study investigated whether five-month-old infants show differential brain activity between emotional faces. Furthermore, we explored the relation between emotional face processing and (I) stimulus characteristics, specifically the spatial frequency content, and (II) parent, child, and dyadic qualities of interaction characteristics. Face-sensitive components (i.e., N290, P400, Nc) in response to neutral and fearful faces that contained only lower or higher spatial frequencies were assessed. Quality of parent-child interaction was assessed with the Manchester Assessment of Caregiver Infant Interaction (MACI). The results show that, as a full group, none of the components differed between emotional expressions. However, when splitting the group based on median MACI scores, infants who showed high quality of interaction (i.e., more attentiveness to caregiver, positive and negative affect, and liveliness) processed emotions differently, whereas infants who showed low quality did not. These results indicate that a sub-group of infants show differential emotional face processing at 5 months of age, which seem to relate to quality of their behavior during the parent-child interaction.

Individual differences in visual attention and self-regulation: A multimethod longitudinal study from infancy to toddlerhood.

Given the importance of self-regulation for a broad range of developmental outcomes, identifying reliable precursors of self-regulation early in development is important for early prevention of developmental problems. The aim of this study was to examine whether three visual attention measures (fixation duration, variation in fixation duration, and disengagement) in infancy (9.10-11.43 months of age) predicted effortful control and compliance in toddlerhood (26.71-31.80 months). The sample consisted of 74 children (50% boys). In infancy, two eye-tracking tasks were conducted: a visual search task to assess fixation duration and variation in fixation duration (n = 58) and the gap-overlap task to assess disengagement (n = 49). In toddlerhood, children's effortful control (n = 65) and compliance (n = 65) were assessed by parent reports and observed during a delay of gratification task and a cleanup session together with the parents, respectively. Using full information maximum likelihood to account for missing data, multiple regression analyses revealed that, when all three measures of visual attention were taken into account, longer fixations and less variation in fixation duration in infancy predicted better effortful control. Disengagement did not predict effortful control. Compliance in toddlerhood was not predicted by any of the visual attention measures. These findings may indicate that visual attentional measures in infancy predict relatively independent forms of self-regulation in toddlerhood. Future studies are necessary to elucidate the mechanisms that underlie the association between (variation in) fixation duration in infancy and effortful control in toddlerhood.

Noise-robust fixation detection in eye movement data: Identification by two-means clustering (I2MC).

Eye-tracking research in infants and older children has gained a lot of momentum over the last decades. Although eye-tracking research in these participant groups has become easier with the advance of the remote eye-tracker, this often comes at the cost of poorer data quality than in research with well-trained adults (Hessels, Andersson, Hooge, Nyström, & Kemner Infancy, 20, 601-633, 2015; Wass, Forssman, & Leppänen Infancy, 19, 427-460, 2014). Current fixation detection algorithms are not built for data from infants and young children. As a result, some researchers have even turned to hand correction of fixation detections (Saez de Urabain, Johnson, & Smith Behavior Research Methods, 47, 53-72, 2015). Here we introduce a fixation detection algorithm-identification by two-means clustering (I2MC)-built specifically for data across a wide range of noise levels and when periods of data loss may occur. We evaluated the I2MC algorithm against seven state-of-the-art event detection algorithms, and report that the I2MC algorithm's output is the most robust to high noise and data loss levels. The algorithm is automatic, works offline, and is suitable for eye-tracking data recorded with remote or tower-mounted eye-trackers using static stimuli. In addition to application of the I2MC algorithm in eye-tracking research with infants, school children, and certain patient groups, the I2MC algorithm also may be useful when the noise and data loss levels are markedly different between trials, participants, or time points (e.g., longitudinal research).

Octave effect in auditory attention.

After hearing a tone, the human auditory system becomes more sensitive to similar tones than to other tones. Current auditory models explain this phenomenon by a simple bandpass attention filter. Here, we demonstrate that auditory attention involves multiple pass-bands around octave-related frequencies above and below the cued tone. Intriguingly, this "octave effect" not only occurs for physically presented tones, but even persists for the missing fundamental in complex tones, and for imagined tones. Our results suggest neural interactions combining octave-related frequencies, likely located in nonprimary cortical regions. We speculate that this connectivity scheme evolved from exposure to natural vibrations containing octave-related spectral peaks, e.g., as produced by vocal cords.

An in-depth look at saccadic search in infancy.

Two questions were posed in the present study: (1) Do infants search for discrepant items in the absence of instructions? We outline where previous research has been inconclusive in answering this question. (2) In what manner do infants search, and what are the fixation and saccade characteristics in saccadic search? A thorough characterization of saccadic search in infancy is of great importance as a reference for future eye-movement studies in infancy. We presented 10-month-old infants with 24 visual search displays in two separate sessions within two weeks. We report that infant saccadic search performance at 10 months is above what may be expected by our model of chance, and is dependent on the specific target. Infant fixation and saccade characteristics show similarities to adult fixation and saccade characteristics in saccadic search. All findings were highly consistent across two separate sessions on the group level. An examination of the reliability of saccadic search revealed that test-retest reliability for oculomotor characteristics was high, particularly for fixation duration. We suggest that future research into saccadic search in infancy adopt the presented model of chance as a baseline against which to compare search performance. Researchers investigating both the typical and atypical development of visual search may benefit from the presented results.

The area-of-interest problem in eyetracking research: A noise-robust solution for face and sparse stimuli.

A problem in eyetracking research is choosing areas of interest (AOIs): Researchers in the same field often use widely varying AOIs for similar stimuli, making cross-study comparisons difficult or even impossible. Subjective choices while choosing AOIs cause differences in AOI shape, size, and location. On the other hand, not many guidelines for constructing AOIs, or comparisons between AOI-production methods, are available. In the present study, we addressed this gap by comparing AOI-production methods in face stimuli, using data collected with infants and adults (with autism spectrum disorder [ASD] and matched controls). Specifically, we report that the attention-attracting and attention-maintaining capacities of AOIs differ between AOI-production methods, and that this matters for statistical comparisons in one of three groups investigated (the ASD group). In addition, we investigated the relation between AOI size and an AOI's attention-attracting and attention-maintaining capacities, as well as the consequences for statistical analyses, and report that adopting large AOIs solves the problem of statistical differences between the AOI methods. Finally, we tested AOI-production methods for their robustness to noise, and report that large AOIs-using the Voronoi tessellation method or the limited-radius Voronoi tessellation method with large radii-are most robust to noise. We conclude that large AOIs are a noise-robust solution in face stimuli and, when implemented using the Voronoi method, are the most objective of the researcher-defined AOIs. Adopting Voronoi AOIs in face-scanning research should allow better between-group and cross-study comparisons.