Development of a Self-Report Measure of Prediction in Daily Life: The Prediction-Related Experiences Questionnaire.

PURPOSE: Predictions are complex, multisensory, and dynamic processes involving real-time adjustments based on environmental inputs. Disruptions to prediction abilities have been proposed to underlie characteristics associated with autism. While there is substantial empirical literature related to prediction, the field lacks a self-assessment measure of prediction skills related to daily tasks. Such a measure would be useful to better understand the nature of day-to-day prediction-related activities and characterize these abilities in individuals who struggle with prediction. METHODS: An interdisciplinary mixed-methods approach was utilized to develop and validate a self-report questionnaire of prediction skills for adults, the Prediction-Related Experiences Questionnaire (PRE-Q). Two rounds of online field testing were completed in samples of autistic and neurotypical (NT) adults. Qualitative feedback from a subset of these participants regarding question content and quality was integrated and Rasch modeling of the item responses was applied. RESULTS: The final PRE-Q includes 19 items across 3 domains (Sensory, Motor, Social), with evidence supporting the validity of the measure's 4-point response categories, internal structure, and relationship to other outcome measures associated with prediction. Consistent with models of prediction challenges in autism, autistic participants indicated more prediction-related difficulties than the NT group. CONCLUSIONS: This study provides evidence for the validity of a novel self-report questionnaire designed to measure the day-to-day prediction skills of autistic and non-autistic adults. Future research should focus on characterizing the relationship between the PRE-Q and lab-based measures of prediction, and understanding how the PRE-Q may be used to identify potential areas for clinical supports for individuals with prediction-related challenges.

Impact of early visual experience on later usage of color cues.

Human visual recognition is remarkably robust to chromatic changes. In this work, we provide a potential account of the roots of this resilience based on observations with 10 congenitally blind children who gained sight late in life. Several months or years following their sight-restoring surgeries, the removal of color cues markedly reduced their recognition performance, whereas age-matched normally sighted children showed no such decrement. This finding may be explained by the greater-than-neonatal maturity of the late-sighted children's color system at sight onset, inducing overly strong reliance on chromatic cues. Simulations with deep neural networks corroborate this hypothesis. These findings highlight the adaptive significance of typical developmental trajectories and provide guidelines for enhancing machine vision systems.

Autistic Adults Show Intact Learning on a Visuospatial Serial Reaction Time Task.

Some theories have proposed that autistic individuals have difficulty learning predictive relationships. We tested this hypothesis using a serial reaction time task in which participants learned to predict the locations of a repeating sequence of target locations. We conducted a large-sample online study with 61 autistic and 71 neurotypical adults. The autistic group had slower overall reaction times, but demonstrated sequence-specific learning equivalent to the neurotypical group, consistent with other findings of typical procedural memory in autism. The neurotypical group, however, made significantly more prediction-related errors early in the experiment when the stimuli changed from repeated sequences to random locations, suggesting certain limited behavioural differences in the learning or utilization of predictive relationships for autistic adults.

Robustness to Transformations Across Categories: Is Robustness Driven by Invariant Neural Representations?

Deep convolutional neural networks (DCNNs) have demonstrated impressive robustness to recognize objects under transformations (e.g., blur or noise) when these transformations are included in the training set. A hypothesis to explain such robustness is that DCNNs develop invariant neural representations that remain unaltered when the image is transformed. However, to what extent this hypothesis holds true is an outstanding question, as robustness to transformations could be achieved with properties different from invariance; for example, parts of the network could be specialized to recognize either transformed or nontransformed images. This article investigates the conditions under which invariant neural representations emerge by leveraging that they facilitate robustness to transformations beyond the training distribution. Concretely, we analyze a training paradigm in which only some object categories are seen transformed during training and evaluate whether the DCNN is robust to transformations across categories not seen transformed. Our results with state-of-the-art DCNNs indicate that invariant neural representations do not always drive robustness to transformations, as networks show robustness for categories seen transformed during training even in the absence of invariant neural representations. Invariance emerges only as the number of transformed categories in the training set is increased. This phenomenon is much more prominent with local transformations such as blurring and high-pass filtering than geometric transformations such as rotation and thinning, which entail changes in the spatial arrangement of the object. Our results contribute to a better understanding of invariant neural representations in deep learning and the conditions under which it spontaneously emerges.

White matter plasticity following cataract surgery in congenitally blind patients.

The visual system develops abnormally when visual input is absent or degraded during a critical period early in life. Restoration of the visual input later in life is generally thought to have limited benefit because the visual system will lack sufficient plasticity to adapt to and utilize the information from the eyes. Recent evidence, however, shows that congenitally blind adolescents can recover both low-level and higher-level visual function following surgery. In this study, we assessed behavioral performance in both a visual acuity and a face perception task alongside longitudinal structural white matter changes in terms of fractional anisotropy (FA) and mean diffusivity (MD). We studied congenitally blind patients with dense bilateral cataracts, who received cataract surgery at different stages of adolescence. Our goal was to differentiate between age- and surgery-related changes in both behavioral performance and structural measures to identify neural correlates which might contribute to recovery of visual function. We observed surgery-related long-term increases of structural integrity of late-visual pathways connecting the occipital regions with ipsilateral fronto-parieto-temporal regions or homotopic contralateral areas. Comparison to a group of age-matched healthy participants indicated that these improvements went beyond the expected changes in FA and MD based on maturation alone. Finally, we found that the extent of behavioral improvement in face perception was mediated by changes in structural integrity in late visual pathways. Our results suggest that sufficient plasticity remains in adolescence to partially overcome abnormal visual development and help localize the sites of neural change underlying sight recovery.

Developmental change in predictive motor abilities.

Prediction is critical for successful interactions with a dynamic environment. To test the development of predictive processes over the life span, we designed a suite of interceptive tasks implemented as interactive video games. Four tasks involving interactions with a flying ball with titrated challenge quantified spatiotemporal aspects of prediction. For comparison, reaction time was assessed in a matching task. The experiments were conducted in a museum, where over 400 visitors across all ages participated, and in a laboratory with a focused age group. Results consistently showed that predictive ability improved with age to reach adult level by age 12. In contrast, reaction time continued to decrease into late adolescence. Inter-task correlations revealed that the tasks tested different aspects of predictive processes. This developmental progression complements recent findings on cerebellar and cortical maturation. Additionally, these results can serve as normative data to study predictive processes in individuals with neurodevelopmental conditions.

Rhythmic and interval-based temporal orienting in autism.

Individuals with autism spectrum disorder (ASD) may show secondary sensory and cognitive characteristics, including differences in auditory processing, attention, and, according to a prominent hypothesis, the formulation and utilization of predictions. We explored the overlap of audition, attention, and prediction with an online auditory "temporal orienting" task in which participants utilized predictive timing cues (both rhythmic and interval-based) to improve their detection of faint sounds. We compared an autistic (n = 78) with a nonautistic (n = 83) group, controlling for nonverbal IQ, and used signal detection measures and reaction times to evaluate the effect of valid temporally predictive cues. We hypothesized that temporal orienting would be compromised in autism, but this was not supported by the data: the boost in performance induced by predictability was practically identical for the two groups, except for the small subset of the ASD group with co-occurring attention deficit hyperactivity disorder, who received less benefit from interval-based cueing. However, we found that the presence of a rhythm induced a significantly stronger bias toward reporting target detections in the ASD group at large, suggesting weakened response inhibition during rhythmic entrainment.

Recognizing distant faces.

As an 'early alerting' sense, one of the primary tasks for the human visual system is to recognize distant objects. In the specific context of facial identification, this ecologically important task has received surprisingly little attention. Most studies have investigated facial recognition at short, fixed distances. Under these conditions, the photometric and configural information related to the eyes, nose and mouth are typically found to be primary determinants of facial identity. Here we characterize face recognition performance as a function of viewing distance and investigate whether the primacy of the internal features continues to hold across increasing viewing distances. We find that exploring the distance dimension reveals a qualitatively different salience distribution across a face. Observers' recognition performance significantly exceeds that obtained with the internal facial physiognomy, and also exceeds the computed union of performances with internal and external features alone, suggesting that in addition to the mutual configuration of the eyes, nose and mouth, it is the relationships between these features and external head contours that are crucial for recognition. We have also conducted computational studies with convolutional neural networks trained on the task of face recognition to examine whether this representational bias could emerge spontaneously through exposure to faces. The results provide partial support for this possibility while also highlighting important differences between the human and artificial system. These findings have implications for the nature of facial representations useful for a visual system, whether human or machine, for recognition over large and varying distances.

Vulnerability of facial attractiveness perception to early and multi-year visual deprivation.

Judgments of facial attractiveness invariably accompany our perception of faces. Even neonates appear to be capable of making such judgments in a manner consistent with adults. This suggests that the processes supporting facial attractiveness require little, if any, visual experience to manifest. Here we investigate the resilience of these processes to several years of early-onset visual deprivation. Specifically, we study whether congenitally blind children treated several years after birth possess the ability to rate facial attractiveness in a manner congruent to normally sighted individuals. The data reveal significant individual variability in the way each newly sighted child perceives attractiveness. This is in marked contrast to data from normally sighted controls who exhibit strong across-subject agreement in facial attractiveness ratings. This variability may be attributable, in part, to atypical facial encoding strategies used by the newly sighted children. Overall, our results suggest that the development of facial attractiveness perception is likely to be vulnerable to early visual deprivation, pointing to the existence of a possible sensitive period early in the developmental trajectory.

Prenatal auditory experience and its sequelae.

Towards the end of the second trimester of gestation, a human fetus is able to register environmental sounds. This in utero auditory experience is characterized by comprising strongly low-pass-filtered versions of sounds from the external world. Here, we present computational tests of the hypothesis that this early exposure to severely degraded auditory inputs serves an adaptive purpose-it may induce the neural development of extended temporal integration. Such integration can facilitate the detection of information carried by low-frequency variations in the auditory signal, including emotional or other prosodic content. To test this prediction, we characterized the impact of several training regimens, biomimetic and otherwise, on a computational model system trained and tested on the task of emotion recognition. We find that training with an auditory trajectory recapitulating that of a neurotypical infant in the pre-to-postnatal period results in temporally extended receptive field structures and yields the best subsequent accuracy and generalization performance on the task of emotion recognition. This strongly suggests that the progression from low-pass-filtered to full-frequency inputs is likely to be an adaptive feature of our development, conferring significant benefits to later auditory processing abilities relying on temporally extended analyses. Additionally, this finding can help explain some of the auditory impairments associated with preterm births, suggests guidelines for the design of auditory environments in neonatal care units, and points to enhanced training procedures for computational models.

Three approaches to facilitate invariant neurons and generalization to out-of-distribution orientations and illuminations.

The training data distribution is often biased towards objects in certain orientations and illumination conditions. While humans have a remarkable capability of recognizing objects in out-of-distribution (OoD) orientations and illuminations, Deep Neural Networks (DNNs) severely suffer in this case, even when large amounts of training examples are available. Neurons that are invariant to orientations and illuminations have been proposed as a neural mechanism that could facilitate OoD generalization, but it is unclear how to encourage the emergence of such invariant neurons. In this paper, we investigate three different approaches that lead to the emergence of invariant neurons and substantially improve DNNs in recognizing objects in OoD orientations and illuminations. Namely, these approaches are (i) training much longer after convergence of the in-distribution (InD) validation accuracy, i.e., late-stopping, (ii) tuning the momentum parameter of the batch normalization layers, and (iii) enforcing invariance of the neural activity in an intermediate layer to orientation and illumination conditions. Each of these approaches substantially improves the DNN's OoD accuracy (more than 20% in some cases). We report results in four datasets: two datasets are modified from the MNIST and iLab datasets, and the other two are novel (one of 3D rendered cars and another of objects taken from various controlled orientations and illumination conditions). These datasets allow to study the effects of different amounts of bias and are challenging as DNNs perform poorly in OoD conditions. Finally, we demonstrate that even though the three approaches focus on different aspects of DNNs, they all tend to lead to the same underlying neural mechanism to enable OoD accuracy gains - individual neurons in the intermediate layers become invariant to OoD orientations and illuminations. We anticipate this study to be a basis for further improvement of deep neural networks' OoD generalization performance, which is highly demanded to achieve safe and fair AI applications.

Head turning is an effective cue for gaze following: Evidence from newly sighted individuals, school children and adults.

In referential communication, gaze is often interpreted as a social cue that facilitates comprehension and enables word learning. Here we investigated the degree to which head turning facilitates gaze following. We presented participants with static pictures of a man looking at a target object in a first and third block of trials (pre- and post-intervention), while they saw short videos of the same man turning towards the target in the second block of trials (intervention). In Experiment 1, newly sighted individuals (treated for congenital cataracts; N = 8) benefited from the motion cues, both when comparing their initial performance with static gaze cues to their performance with dynamic head turning, and their performance with static cues before and after the videos. In Experiment 2, neurotypical school children (ages 5-10 years; N = 90) and adults (N = 30) also revealed improved performance with motion cues, although most participants had started to follow the static gaze cues before they saw the videos. Our results confirm that head turning is an effective social cue when interpreting new words, offering new insights for a pathways approach to development.

Human (but not animal) motion can be recognized at first sight - After treatment for congenital blindness.

The long-standing nativist vs. empiricist debate asks a foundational question in epistemology - does our knowledge arise through experience or is it available innately? Studies that probe the sensitivity of newborns and patients recovering from congenital blindness are central in informing this dialogue. One of the most robust sensitivities our visual system possesses is to 'biological motion' - the movement patterns of humans and other vertebrates. Various biological motion perception skills (such as distinguishing between movement of human and non-human animals, or between upright and inverted human movement) become evident within the first months of life. The mechanisms of acquiring these capabilities, and specifically the contribution of visual experience to their development, are still under debate. We had the opportunity to directly examine the role of visual experience in biological motion perception, by testing what level of sensitivity is present immediately upon onset of sight following years of congenital visual deprivation. Two congenitally blind patients who underwent sight-restorative cataract-removal surgery late in life (at the ages of 7 and 20 years) were tested before and after sight restoration. The patients were shown displays of walking humans, pigeons, and cats, and asked to describe what they saw. Visual recognition of movement patterns emerged immediately upon eye-opening following surgery, when the patients spontaneously began to identify human, but not animal, biological motion. This recognition ability was evident contemporaneously for upright and inverted human displays. These findings suggest that visual recognition of human motion patterns may not critically depend on visual experience, as it was evident upon first exposure to un-obstructed sight in patients with very limited prior visual exposure, and furthermore, was not limited to the typical (upright) orientation of humans in real-life settings.

Development of Visual Memory Capacity Following Early-Onset and Extended Blindness.

It is unknown whether visual memory capacity can develop if onset of pattern vision is delayed for several years following birth. We had an opportunity to address this question through our work with an unusual population of 12 congenitally blind individuals ranging in age from 8 to 22 years. After providing them with sight surgery, we longitudinally evaluated their visual memory capacity using an image-memorization task. Our findings revealed poor visual memory capacity soon after surgery but significant improvement in subsequent months. Although there may be limits to this improvement, performance 1 year after surgery was found to be comparable with that of control participants with matched visual acuity. These findings provide evidence for plasticity of visual memory mechanisms into late childhood but do not rule out vulnerability to early deprivation. Our computational simulations suggest that a potential mechanism to account for changes in memory performance may be progressive representational elaboration in image encoding.

Visual perspective taking is not automatic in a simplified Dot task: Evidence from newly sighted children, primary school children and adults.

In the Dot task, children and adults involuntarily compute an avatar's visual perspective, which has been interpreted by some as automatic Theory of Mind. This interpretation has been challenged by other researchers arguing that the task reveals automatic attentional orienting. Here we tested a new interpretation of previous findings: the seemingly automatic processes revealed by the Dot task result from the high Executive Control demands of this verification paradigm, which taxes short-term memory and imposes perspective-switching costs. We tested this hypothesis in three experiments conducted in India with newly sighted children (Experiment 1; N = 5; all girls), neurotypical children (Experiment 2; ages 5-10; N = 90; 38 girls) and adults (Experiment 3; N = 30; 18 women) in a highly simplified version of the Dot task. No evidence of automatic perspective-taking was observed, although all groups revealed perspective-taking costs. A newly sighted child and the youngest children in our sample also showed an egocentric bias, which disappeared by age 10, confirming that visual perspective taking develops during the school years. We conclude that the standard Dot task imposes such methodological demands on both children and adults that the alleged evidence of automatic processes (either mindreading or domain general) may simply reveal limitations in Executive Control.

Influence of visual feedback persistence on visuo-motor skill improvement.

Towards the larger goal of understanding factors relevant for improving visuo-motor control, we investigated the role of visual feedback for modulating the effectiveness of a simple hand-eye training protocol. The regimen comprised a series of curve tracing tasks undertaken over a period of one week by neurologically healthy individuals with their non-dominant hands. Our three subject groups differed in the training they experienced: those who received 'Persistent' visual-feedback by seeing their hand and trace evolve in real-time superimposed upon the reference patterns, those who received 'Non-Persistent' visual-feedback seeing their hand movement but not the emerging trace, and a 'Control' group that underwent no training. Improvements in performance were evaluated along two dimensions-accuracy and steadiness, to assess visuo-motor and motor skills, respectively. We found that persistent feedback leads to a significantly greater improvement in accuracy than non-persistent feedback. Steadiness, on the other hand, benefits from training irrespective of the persistence of feedback. Our results not only demonstrate the feasibility of rapid visuo-motor learning in adulthood, but more specifically, the influence of visual veridicality and a critical role for dynamically emergent visual information.

Impact of Temporal Visual Flicker on Spatial Contrast Sensitivity in Myopia.

PURPOSE: To investigate whether short-term exposure to high temporal frequency full-field flicker has an impact on spatial visual acuity in individuals with varying degrees of myopia. METHODS: Thirty subjects (evenly divided between control and experimental groups) underwent a 5-min exposure to full-field flicker. The flicker rate was lower than critical flicker frequency (CFF) for the experimental group (12.5 Hz) and significantly higher than CFF for the controls (60 Hz). Spatial contrast sensitivity function (CSF) was measured before and immediately after flicker exposure. We examined whether the post flicker CSF parameters were different from the pre-exposure CSF values in either of the subject groups. Additionally, we examined the relationship between the amount of CSF change from pre to post timepoints and the degree of subjects' myopia. The CSF parameters included peak frequency, peak sensitivity, bandwidth, truncation, and area under log CSF (AULCSF). RESULTS: There was no significant difference of all five pre-exposure CSF parameters between the two groups at baseline (P = 0.333 ∼ 0.424). Experimental group subjects exhibited significant (P < 0.005) increases in peak sensitivity and AULCSF, when comparing post-exposure results to pre-exposure ones. Controls showed no such enhancements. Furthermore, the extent of these changes in the experimental group was correlated significantly with the participants' refractive error (P = 0.005 and 0.018, respectively). CONCLUSION: Our data suggest that exposure to perceivable high-frequency flicker (but, not to supra-CFF frequencies) enhances important aspects of spatial contrast sensitivity, and these enhancements are correlated to the degree of myopia. This finding has implications for potential interventions for cases of modest myopia.

Resilience of temporal processing to early and extended visual deprivation.

Early visual deprivation is known to have profound consequences on the subsequent development of spatial visual processing. However, its impact on temporal processing is not well characterized. We have examined spatial and temporal contrast sensitivity functions following treatment for early and extended bilateral visual deprivation in fifteen children born with congenital cataracts in rural India. The results reveal a marked difference in post-treatment spatial and temporal sensitivities. Whereas spatial processing in newly sighted children is significantly impaired relative to age-matched controls, temporal processing exhibits remarkable resilience and is comparable to that in the control group. This difference in spatial and temporal outcomes is especially surprising given our computational analyses of video sequences which indicate a strong linkage between the spatial and temporal spectral content of natural visual inputs. We consider possible explanations for this discrepancy.

Prediction in Autism Spectrum Disorder: A Systematic Review of Empirical Evidence.

According to a recent influential proposal, several phenotypic features of autism spectrum disorder (ASD) may be accounted for by differences in predictive skills between individuals with ASD and neurotypical individuals. In this systematic review, we describe results from 47 studies that have empirically tested this hypothesis. We assess the results based on two observable aspects of prediction: learning a pairing between an antecedent and a consequence and responding to an antecedent in a predictive manner. Taken together, these studies suggest distinct differences in both predictive learning and predictive response. Studies documenting differences in learning predictive pairings indicate challenges in detecting such relationships especially when predictive features of an antecedent have low salience or consistency, and studies showing differences in habituation and perceptual adaptation suggest low-level predictive processing differences in ASD. These challenges may account for the observed differences in the influence of predictive priors, in spontaneous predictive movement or gaze, and in social prediction. An important goal for future research will be to better define and constrain the broad domain-general hypothesis by testing multiple types of prediction within the same individuals. Additional promising avenues include studying prediction within naturalistic contexts and assessing the effect of prediction-based intervention on supporting functional outcomes for individuals with ASD. LAY SUMMARY: Researchers have suggested that many features of autism spectrum disorder (ASD) may be explained by differences in the prediction skills of people with ASD. We review results from 47 studies. These studies suggest that ASD may be associated with differences in the learning of predictive pairings (e.g., learning cause and effect) and in low-level predictive processing in the brain (e.g., processing repeated sounds). These findings lay the groundwork for research that can improve our understanding of ASD and inform interventions. Autism Res 2021, 14: 604-630. © 2021 International Society for Autism Research and Wiley Periodicals LLC.

Autonomic and Electrophysiological Evidence for Reduced Auditory Habituation in Autism.

It is estimated that nearly 90% of children on the autism spectrum exhibit sensory atypicalities. What aspects of sensory processing are affected in autism? Although sensory processing can be studied along multiple dimensions, two of the most basic ones involve examining instantaneous sensory responses and how the responses change over time. These correspond to the dimensions of 'sensitivity' and 'habituation'. Results thus far have indicated that autistic individuals do not differ systematically from controls in sensory acuity/sensitivity. However, data from studies of habituation have been equivocal. We have studied habituation in autism using two measures: galvanic skin response (GSR) and magneto-encephalography (MEG). We report data from two independent studies. The first study, was conducted with 13 autistic and 13 age-matched neurotypical young adults and used GSR to assess response to an extended metronomic sequence. The second study involved 24 participants (12 with an ASD diagnosis), different from those in study 1, spanning the pre-adolescent to young adult age range, and used MEG. Both studies reveal consistent patterns of reduced habituation in autistic participants. These results suggest that autism, through mechanisms that are yet to be elucidated, compromises a fundamental aspect of sensory processing, at least in the auditory domain. We discuss the implications for understanding sensory hypersensitivities, a hallmark phenotypic feature of autism, recently proposed theoretical accounts, and potential relevance for early detection of risk for autism.