Sharing Our World: Impact of Group Motor Skill Learning on Joint Attention in Children with Autism Spectrum Disorder.

Impaired joint attention is a common feature of autism spectrum disorder (ASD), affecting social interaction and communication. We explored if group basketball learning could enhance joint attention in autistic children, and how this relates to brain changes, particularly white matter development integrity. Forty-nine autistic children, aged 4-12 years, were recruited from special education centers. The experimental group underwent a 12-week basketball motor skill learning, while the control group received standard care. Eye-tracking and brain scans were conducted. The 12-week basketball motor skill learning improved joint attention in the experimental group, evidenced by better eye tracking metrics and enhanced white matter integrity. Moreover, reduced time to first fixation correlated positively with decreased mean diffusivity of the left superior corona radiata and left superior fronto-occipital fasciculus in the experimental group. Basketball-based motor skill intervention effectively improved joint attention in autistic children. Improved white matter fiber integrity related to sensory perception, spatial and early attention function may underlie this effect. These findings highlight the potential of group motor skill learning within clinical rehabilitation for treating ASD.

Spying with a pilot's eye: Using eye tracking to investigate pilots' attention allocation and workload during helicopter autorotative gliding.

Flight safety in helicopters is a critical aspect of overall aircraft operational safety management, particularly during engine failures requiring autorotative glide, which makes it extremely challenging for the pilot to land the helicopter successfully. In this study, we evaluated the workload and attention allocation of helicopter pilots under such circumstances. In the experiment, a helicopter flight simulator was used to simulate level flight followed by autorotative glide, with the two phases divided into time segments for data collection. First, the data were visualized using heat maps and saccade sequence diagrams, while changes in eye movement metrics (such as peak value and standard deviation) were statistically analyzed. Finally, the criteria through the inter-criteria correlation (CRITIC) method was used to calculate the weight coefficient for each area of interest. This evaluation system was further applied to analyze and compare the changes in eye-movement data and attention to areas of interest during the two phases. The results revealed a shorter fixation duration, but a greater fixation number during the autorotative glide phase. Further, the mean pupil diameter changed over a larger range than during level flight (in level flight, the mean was 5.229 mm, while the standard deviation was 0.059 mm; in autorotative glide the corresponding values were 5.326 mm and 0.126 mm, respectively). For the tachometer, the weight coefficient matched the color of the heat map (2.7 % and colorless during level flight, but 23.8 % and red during autorotative glide), while those for the airspeed indicator and forward view differed significantly between the two phases. This discrepancy stemmed from the fact that during autorotative glide, the pilots prioritized monitoring aircraft rotation speed and attitude, with a particular focus on the forward view, rotor speed, and airspeed, resulting in a more concentrated attention distribution compared to that achieved during level flight. These results confirmed a significant increase in pilot workload during autorotative glide landing, while a shift was observed from low-frequency long gaze time during level flight to high-frequency short gaze time during autorotative glide. Furthermore, the pilots allocated 81 % of their attention to the tachometer, airspeed indicator, and forward views. Adopting this strategy can improve pilots' landing success and provide flight students with valuable training advice to prevent landing failures when helicopters lose power.

Harnessing technology to measure individual differences in spatial thinking in early childhood from a relational developmental systems perspective.

According to the Relational Developmental Systems perspective, the development of individual differences in spatial thinking (e.g., mental rotation, spatial reorientation, and spatial language) are attributed to various psychological (e.g., children's cognitive strategies), biological (e.g., structure and function of hippocampus), and cultural systems (e.g., caregiver spatial language input). Yet, measuring the development of individual differences in spatial thinking in young children, as well as the psychological, biological, and cultural systems that influence the development of these abilities, presents unique challenges. The current paper outlines ways to harness available technology including eye-tracking, eye-blink conditioning, MRI, Zoom, and LENA technology, to study the development of individual differences in young children's spatial thinking. The technologies discussed offer ways to examine children's spatial thinking development from different levels of analyses (i.e., psychological, biological, cultural), thereby allowing us to advance the study of developmental theory. We conclude with a discussion of the use of artificial intelligence.

Syntactic flexibility and lexical encoding in aging sentence production: an eye tracking study.

Purpose: Successful sentence production requires lexical encoding and ordering them into a correct syntactic structure. It remains unclear how different processes involved in sentence production are affected by healthy aging. We investigated (a) if and how aging affects lexical encoding and syntactic formulation during sentence production, using auditory lexical priming and eye tracking-while-speaking paradigms and (b) if and how verbal working memory contributes to age-related changes in sentence production. Methods: Twenty older and 20 younger adults described transitive and dative action pictures following auditory lexical primes, by which the relative ease of encoding the agent or theme nouns (for transitive pictures) and the theme and goal nouns (for dative pictures) was manipulated. The effects of lexical priming on off-line syntactic production and real-time eye fixations to the primed character were measured. Results: In offline production, older adults showed comparable priming effects to younger adults, using the syntactic structure that allows earlier mention of the primed lexical item in both transitive and dative sentences. However, older adults showed longer lexical priming effects on eye fixations to the primed character during the early stages of sentence planning. Preliminary analysis indicated that reduced verbal working memory may in part account for longer lexical encoding, particularly for older adults. Conclusion: These findings indicate that syntactic flexibility for formulating different grammatical structures remains largely robust with aging. However, lexical encoding processes are more susceptible to age-related changes, possibly due to changes in verbal working memory.

Multimodal insights into granger causality connectivity: Integrating physiological signals and gated eye-tracking data for emotion recognition using convolutional neural network.

This study introduces a groundbreaking method to enhance the accuracy and reliability of emotion recognition systems by combining electrocardiogram (ECG) with electroencephalogram (EEG) data, using an eye-tracking gated strategy. Initially, we propose a technique to filter out irrelevant portions of emotional data by employing pupil diameter metrics from eye-tracking data. Subsequently, we introduce an innovative approach for estimating effective connectivity to capture the dynamic interaction between the brain and the heart during emotional states of happiness and sadness. Granger causality (GC) is estimated and utilized to optimize input for a highly effective pre-trained convolutional neural network (CNN), specifically ResNet-18. To assess this methodology, we employed EEG and ECG data from the publicly available MAHNOB-HCI database, using a 5-fold cross-validation approach. Our method achieved an impressive average accuracy and area under the curve (AUC) of 91.00 % and 0.97, respectively, for GC-EEG-ECG images processed with ResNet-18. Comparative analysis with state-of-the-art studies clearly shows that augmenting ECG with EEG and refining data with an eye-tracking strategy significantly enhances emotion recognition performance across various emotions.

Spatiotemporal Eye Movement Dynamics Reveal Altered Face Prioritization in Early Visual Processing Among Autistic Children.

BACKGROUND: Reduced social attention - looking at faces - is one of the most common manifestations of social difficulty in autism central to social development. Although reduced social attention is well-characterized in autism, qualitative differences in how social attention unfolds across time remains unknown. METHODS: We used a computational modeling (i.e., hidden Markov modeling) approach to assess and compare the spatiotemporal dynamics of social attention in a large, well-characterized sample of autistic (n = 280) and neurotypical (n = 120) children (ages 6-11) that completed three social eye-tracking assays across three longitudinal time points (Baseline, 6 weeks, 24 weeks). RESULTS: Our analysis supported the existence of two common eye movement patterns that emerged across three ET assays. A focused pattern was characterized by small face regions of interest, which had high probability of capturing fixations early in visual processing. In contrast, an exploratory pattern was characterized by larger face regions of interest, with lower initial probability of fixation, and more non-social regions of interest. In the context of social perception, autistic children showed significantly more exploratory eye movement patterns than neurotypical children across all social perception assays and all three longitudinal time points. Eye movement patterns were associated with clinical features of autism, including adaptive function, face recognition, and autism symptom severity. CONCLUSIONS: Decreased likelihood of precisely looking to faces early in social visual processing may be an important feature of autism that was associated with autism-related symptomology and may reflect less visual sensitivity to face information.

Influence of Complexity and Gestalt Principles on Aesthetic Preferences for Building Façades: An Eye Tracking Study.

Buildings are an integral part of our physical environment and have aesthetic significance with respect to the organizational integrity of architectural elements. While Gestalt principles are essential in design education, their relationship with architectural features remains understudied. The present study explored how Gestalt principles and complexity levels influence evaluations of building façades through the use of questionnaires and eye tracking. Twenty-four two-dimensional black and white façade drawings, manipulated using selected Gestalt principles (similarity and proximity) to achieve different levels of complexity (low, medium & high), were presented to 79 participants. The results suggested a negative linear relationship between aesthetic ratings and complexity levels across selected Gestalt principles. In addition, as expected, participants had the highest number of fixations, shortest fixation durations, and lowest aesthetic ratings for higher levels of complexity. Results involving Gestalt principles revealed that proximity-based designs received higher aesthetic ratings, demanded less time, elicited lower number of fixations, and resulted in shorter fixation durations. Conversely, similarity-based designs received lower aesthetic ratings, demanded more time, elicited higher number of fixations, and resulted in longer fixation durations. These findings offer insights into architectural aesthetic experiences and inform future research directions.

Persistence of primitive reflexes associated with asymmetries in fixation and ocular motility values.

This cross-sectional study examined eye movement performance in patients aged 4 to 16 years. Measurements of eye movements were obtained before and after performing therapy for inhibition of four primitive reflexes, asymmetric tonic neck reflex, symmetric tonic neck reflex, labyrinthine tonic reflex and Moro reflex. Subsequently the scores of the four primitive reflexes were compared with the results of five variables: fixation maintenance, % mean saccade size, motility excursions, fixations during excursions and mean duration of fixations. The comparisons showed a significant reduction in evidence of fixation maintenance as well as mean saccade size due to the inhibition of the four primitive reflexes. There was also a significant increase in ocular motility while fixations per saccade and average duration of fixations also decreased significantly. Visual balance between values of both eyes improved in all tests. A device called VisagraphTM III, which measures eye movements, was used for data collection. These results suggest that the oculomotor improvements reflect the involvement of other maturational processes such as the emergence and inhibition of primitive reflexes, the whole reorganization being key to future reading and attentional processes.

No Effects of Auditory and Visual White Noise on Oculomotor Control in Children with ADHD.

BACKGROUND: White noise stimulation has demonstrated efficacy in enhancing working memory in children with ADHD. However, its impact on other executive functions commonly affected by ADHD, such as inhibitory control, remains largely unexplored. This research aims to explore the effects of two types of white noise stimulation on oculomotor inhibitory control in children with ADHD. METHOD: Memory guided saccade (MGS) and prolonged fixation (PF) performance was compared between children with ADHD (N = 52) and typically developing controls (TDC, N = 45), during auditory and visual white noise stimulation as well as in a no noise condition. RESULTS: Neither the auditory nor the visual white noise had any beneficial effects on performance for either group. CONCLUSIONS: White noise stimulation does not appear to be beneficial for children with ADHD in tasks that target oculomotor inhibitory control. Potential explanations for this lack of noise benefit will be discussed.

Gaze behavior reveals automaticity and attention allocation during music teaching vs. observing.

In a unique case-study approach in which I served as both the research participant and the experimenter, I wore eye-tracking glasses while teaching a brief music lesson to two university students learning trumpet, then approximately two weeks later, I watched a video of the lesson and tracked my gaze again. To investigate unconscious perceptual processes engaged during music teaching, I compared my attention allocation while teaching to my attention allocation during selfobservation. My gaze behavior while teaching revealed a high level of automaticity regarding lesson sequencing and allocation of attention. Strategic moment-to-moment shifts in attention between the two students occurred entirely below my conscious awareness, yet post hoc analyses revealed precisely timed changes that were related to momentary goals. While watching the video, absent the demands of behavioral interaction and momentary decision-making, I directed more sustained attention to both students than I had while teaching. These results reveal important features of "teacher thinking" that are not directly observable or typically construed as conscious behavior. That this component of teaching practice does not involve volitional control suggests that teachers' descriptions of their thinking may not reveal to novices important elements of pedagogical expertise.

Accounting for Visual Field Abnormalities when Using Eye-tracking to Diagnose Reading Problems in Neurological Degeneration.

State-of-the-art eye trackers provide valuable information for diagnosing reading problems by measuring and interpreting people's gaze paths as they read through text. Abnormal conditions such as visual field defects, however, can seriously confound most of today's existing methods for interpreting reading gaze patterns. Our objective was to research how visual field defects impact reading gaze path patterns, so the effects of such neurological pathologies can be explicitly incorporated into more comprehensive reading diagnosis methodologies. A cross-sectional, non-randomized, pilot clinical study including 45 patients with various neurologic disorders and 30 normal controls was designed. Participants underwent ophthalmologic/neuropsychologic and eye-tracker examinations using two reading tests of words and numbers. The results showed that the use of the eye tracker showed that patients with brain damage and an altered visual field require more time to complete a reading-text test by fixating a greater number of times (p < 0.001); with longer fixations (p = 0.03); and a greater number of saccades in these patients (p = 0.04). Our study showed objective differences in eye movement characteristics in patients with neurological diseases and an altered visual field who complained of reading difficulties. These findings should be considered as a bias factor and deserve further investigation.

Age-related changes in connected speech production: evidence from eye-tracking in the culturally adapted picture description task.

Purpose: Age-related changes in connected speech production remain a subject of debate, yielding inconsistent findings across various tasks and measures. This study aimed to investigate the effects of aging on picture description tasks using two types of pictures: a standardized picture (the Beach picture) and a culturally and linguistically modified picture tailored for Korean speakers (the Han River picture). Method: Twenty-four young adults and 22 older adults participated in two picture description tasks while their eye movements were recorded. Word-level linguistic variables were used to assess informativeness (Correct Information Units per minute) and productivity (noun and verb counts per utterance) of connected speech production. Eye-movement measures were employed to evaluate real-time cognitive processing associated with planning connected speech (pre-speech fixation counts and durations; eye fixations before the speech onset of each utterance). Results and conclusions: The findings revealed age-related declines in linguistic measures, with older adults exhibiting decreased CIUs per minute and smaller counts of nouns and verbs per utterance. Age-related changes in eye movement measures were evident in that older adults displayed longer pre-speech fixation durations. Unlike younger adults, older adults exhibited higher pre-speech fixation counts on the Han River picture compared to the Beach picture, suggesting cognitive challenges in performing the task that requires producing more words and detailed descriptions. These results suggest that aging is associated with reduced informativeness and productivity of connected speech, as well as a decline in cognitive processing efficiency.

Predicting Basketball Shot Outcome From Visuomotor Control Data Using Explainable Machine Learning.

Quiet eye (QE), the visual fixation on a target before initiation of a critical action, is associated with improved performance. While QE is trainable, it is unclear whether QE can directly predict performance, which has implications for training interventions. This study predicted basketball shot outcome (make or miss) from visuomotor control variables using a decision tree classification approach. Twelve basketball athletes completed 200 shots from six on-court locations while wearing mobile eye-tracking glasses. Training and testing data sets were used for modeling eight predictors (shot location, arm extension time, and absolute and relative QE onset, offset, and duration) via standard and conditional inference decision trees and random forests. On average, the trees predicted over 66% of makes and over 50% of misses. The main predictor, relative QE duration, indicated success for durations over 18.4% (range: 14.5%-22.0%). Training to prolong QE duration beyond 18% may enhance shot success.

Does the subjective response during the measurement of fusional reserves affect the clinical diagnosis?

INTRODUCTION: Fusional reserves differ with the method of measurement. The goal of this study was to compare the subjective and objective responses during the measurement of positive and negative fusional reserves using both step and ramp methods. METHODS: A haploscopic system was used to measure fusional reserves. Eye movements were recorded using an EyeLink 1000 Plus eye tracker (SR Research). The stimulus disparity was changed to either mimic a prism bar (steps) or a Risley prism (ramp). Subjective responses were obtained by pressing a key on the keyboard, whereas objective break and recovery points were determined offline using a custom algorithm coded in Matlab. RESULTS: Thirty-three adults participated in this study. For the ramp method, the subjective and objective responses were similar for the negative (break and recovery points (t(32) = -0.82, p = 0.42) and (t(32) = 0.42, p = 0.67), respectively) and positive fusional reserves (break and recovery points (U = -1.34, p = 0.18) and t(19) = -0.25, p = 0.81), respectively). For the step method, no significant differences in positive fusional reserves were observed when measured subjectively and objectively for the break (t(32) = 1.27, p = 0.21) or the recovery point (U = -2.02, Bonferroni-adjusted p = 0.04). For the negative fusional reserve, differences were not significant for either the break or recovery points (U = -0.10, p = 0.92 and t(19) = 1.17, p = 0.26, respectively). CONCLUSION: Subjective and objective responses exhibited good agreement when measured with the ramp and step methods.

Microsaccades Tracking by Secondary Speckle Pattern Analysis.

Here we propose a not pupil-dependent microsaccades tracking technique and a novel detection method. We present a proof of concept for detecting microsaccades using a non-contact laser-based photonic system recording and processing the temporal changes of speckle patterns scattered from an eye sclera. The data, simultaneously recorded by the speckle-based tracker (SBT) and the video-based eye tracker (Eyelink), was analyzed by the frequently used detection method of Engbert and Kliegl (E&K) and by advanced machine learning detection (MLD) techniques. We detected 93% of microsaccades in the SBT data out of microsaccades detected in the Eyelink data with the E&K method. By utilizing MLD, a precision of 86% was achieved. The findings of our study demonstrate a potential improvement in measuring tiny eye movements, such as microsaccades, using speckle-based eye tracking and, thus, an alternative to video-based eye tracking for detecting microsaccades.

Auxiliary diagnostic method of Parkinson's disease based on eye movement analysis in a virtual reality environment.

Eye movement dysfunction is one of the non-motor symptoms of Parkinson's disease (PD). An accurate analysis method for eye movement is an effective way to gain a deeper understanding of the nervous system function of PD patients. However, currently, there are only a few assistive methods available to help physicians conveniently and consistently assess patients suspected of having PD. To solve this problem, we proposed a novel visual behavioral analysis method using eye tracking to evaluate eye movement dysfunction in PD patients automatically. This method first provided a physician task simulation to induce PD-related eye movements in Virtual Reality (VR). Subsequently, we extracted eye movement features from recorded eye videos and applied a machine learning algorithm to establish a PD diagnostic model. Then, we collected eye movement data from 66 participants (including 22 healthy controls and 44 PD patients) in a VR environment for training and testing during visual tasks. Finally, on this relatively small dataset, the results reveal that the Support Vector Machine (SVM) algorithm has better classification potential.

Automated visual acuity estimation by optokinetic nystagmus using a stepped sweep stimulus.

PURPOSE: To describe an automatic system for objective measurement of visual acuity (VA) using optokinetic nystagmus (OKN). This pilot study tested the system's sensitivity and specificity for detecting reduced VA in healthy adults by comparing VA-OKN to VA with an Early Treatment of Diabetic Retinopathy Study (ETDRS) chart (VA-ETDRS). METHODS: Adult participants (age 30 ± 12 years) with either reduced VA (n = 11, VA-ETDRS > 0.20 logMAR) or normal VA (n = 12, VA-ETDRS ≤ 0.20 logMAR) completed monocular VA-OKN measurements in each eye. The VA-OKN stimulus was an array of drifting (5°/s) vanishing discs presented in descending/ascending size order (0.00-1.00 logMAR in 0.10 steps). The stimulus was stepped every 2 s, and 10 sweeps were shown per eye (five ascending and five descending). Eye-tracking data determined when OKN activity ceased (descending sweep) or began (ascending sweep), which was used to determine VA-OKN for each sweep. The estimates were averaged across sweeps to produce an automated VA-OKN. The automated sweeps were then provided in randomised order to a reviewer blinded to the VA-ETDRS findings who determined a final VA-OKN for an eye. RESULTS: A single randomly selected eye from each observer was used for analysis. The sensitivity and specificity of VA-OKN using the same 0.20 logMAR threshold as VA-ETDRS was 100%. Comparisons between the VA-OKN and VA-ETDRS measures were made for participants in the reduced VA group. There was no significant difference between VA-OKN and VA-ETDRS (p = 0.55) and the two measures produced comparable values (r2 = 0.84, 95% limits of agreement = 0.19 logMAR, intra-class correlation coefficient = 0.90 [95% CI:0.68-0.97]). CONCLUSIONS: Visual acuity using optokinetic nystagmus correctly identified a VA deficit in adults and for those with a VA deficit, VA-OKN was strongly correlated with the gold-standard clinical measure of VA. OKN is a promising method which has the potential for use in cognitively impaired adults and pre-verbal children.

Development of Automated Visual Acuity Measurement Using a Calibration-Free Eye-Tracking System.

Purpose Infant vision assessment often relies on grating acuity; however, its objectivity and convenience must be improved. A calibration-free eye-tracking system, even in preverbal children, enables easy and precise gaze analysis. This pilot study aimed to develop a reliable automated monocular vision screening. Methods Participants (n=118) underwent a grating visual acuity test using the eye-tracking system. Correlations between the grating acuity, uncorrected visual acuity, and refractive error were analyzed across different cutoff values of fixation duration percentage. Results Strong correlations were found between the grating acuity and refractive error at 69% and 88% thresholds. Similar correlations with uncorrected visual acuity were noted at 70% and 89% thresholds. False-negatives around the 70% threshold were noted, indicating potential overestimation of acuity in cases of low visual acuity/high refractive error. Discussion The results highlight the feasibility of calibration-free eye-tracking system-based monocular vision screening with an optimal screening threshold of 90%.

Behavioral science labs: How to solve the multi-user problem.

When lab resources are shared among multiple research projects, issues such as experimental integrity, replicability, and data safety become important. Different research projects often need different software and settings that may well conflict with one another, and data collected for one project may not be safeguarded from exposure to researchers from other projects. In this paper we provide an infrastructure design and an open-source tool, labManager, that render multi-user lab facilities in the behavioral sciences accessible to research projects with widely varying needs. The solutions proposed ensure ease of management while simultaneously offering maximum flexibility by providing research projects with fully separated bare metal environments. This solution also ensures that collected data is kept separate, and compliant with relevant ethical standards and regulations such as General Data Protection Regulation (GDPR) legislation. Furthermore, we discuss preconditions for running shared lab facilities and provide practical advice.

Assessment of silent reading ability among glaucoma patients using an eye tracking system with horizontally scrolling text.

PURPOSE: There have been many reports suggesting that glaucoma patients with visual field defects may have decreased silent reading ability compared with individuals without glaucoma. This study used an eye tracking system to assess the ability of glaucoma patients to silently read horizontally scrolling text. METHODS: Glaucoma patients who met the following criteria were recruited: age of ≤ 70 years, at least one eye with a 10 - 2 threshold on standard automated perimetry, a mean deviation value of n 4.0 dB or less, and corrected decimal visual acuity of 0.7 or better in both eyes. Using heat map images created from data from an eye tracking system operating during presentation of a video in which a sentence scrolled horizontally from right to left, reading time, average gaze position, and average fixation time (AFT) were compared between normal eyes (23 individuals, 46 eyes) and glaucomatous eyes (25 patients, 45 eyes). Four styles of sentences (large slow, large fast, small slow, and small fast) were scrolled in the top or bottom sections of the screen. RESULTS: Primary open-angle glaucoma was the most common type of glaucoma in 34 eyes (75.6%), followed by secondary glaucoma in six eyes (13.3%). In comparison with normal eyes, the reading time among right eyes was significantly longer in glaucomatous eyes when reading large fast text that was shown in the bottom area and left glaucomatous eyes showed a leftward shift in gaze position in the top, bottom, or both sections with all four sentence types. There was no significant difference in AFT between glaucomatous and normal eyes across the four sentence styles. In the left eye with inferior visual field loss, text presented at the top consistently showed a correlation with leftward shift of the gaze position across all scenarios. CONCLUSION: Glaucoma patients with central visual field defects in their left eyes may experience greater difficulty reading horizontally scrolling text than individuals with normal eyes.