Can deepfakes be used to study emotion perception? A comparison of dynamic face stimuli.

Video recordings accurately capture facial expression movements; however, they are difficult for face perception researchers to standardise and manipulate. For this reason, dynamic morphs of photographs are often used, despite their lack of naturalistic facial motion. This study aimed to investigate how humans perceive emotions from faces using real videos and two different approaches to artificially generating dynamic expressions - dynamic morphs, and AI-synthesised deepfakes. Our participants perceived dynamic morphed expressions as less intense when compared with videos (all emotions) and deepfakes (fearful, happy, sad). Videos and deepfakes were perceived similarly. Additionally, they perceived morphed happiness and sadness, but not morphed anger or fear, as less genuine than other formats. Our findings support previous research indicating that social responses to morphed emotions are not representative of those to video recordings. The findings also suggest that deepfakes may offer a more suitable standardized stimulus type compared to morphs. Additionally, qualitative data were collected from participants and analysed using ChatGPT, a large language model. ChatGPT successfully identified themes in the data consistent with those identified by an independent human researcher. According to this analysis, our participants perceived dynamic morphs as less natural compared with videos and deepfakes. That participants perceived deepfakes and videos similarly suggests that deepfakes effectively replicate natural facial movements, making them a promising alternative for face perception research. The study contributes to the growing body of research exploring the usefulness of generative artificial intelligence for advancing the study of human perception.

The influence of dynamism and expression intensity on face emotion recognition in individuals with autistic traits.

Face emotion recognition (FER) ability varies across the population, with autistic traits in the general population reported to contribute to this variation. Previous studies used photographs of posed facial expressions, while real social encounters involve dynamic expressions of varying intensity. We used static photographs and dynamic videos, showing peak and partial facial expressions to investigate the influence of dynamism and expression intensity on FER in non-clinical adults who varied in autistic traits. Those with high autistic traits had lower accuracy with both static peak and dynamic partial intensity expressions, when compared to low autistic trait participants. Furthermore, high autistic traits were linked to an accuracy advantage for dynamic compared with static stimuli in both partial and peak expression conditions, while those with low autistic traits demonstrated this dynamic advantage only for partial expressions. These findings reveal the differing importance of dynamism and expression intensity for FER across the non-clinical population and appear linked to self-reported social-communication skills. Furthermore, FER difficulties in autism might relate to the ability to integrate subtle, dynamic information, rather than static emotion categorisation alone.

Embracing deepfakes and AI-generated images in neuroscience research.

The rise of deepfakes and AI-generated images has raised concerns regarding their potential misuse. However, this commentary highlights the valuable opportunities these technologies offer for neuroscience research. Deepfakes deliver accessible, realistic and customisable dynamic face stimuli, while generative adversarial networks (GANs) can generate and modify diverse and high-quality static content. These advancements can enhance the variability and ecological validity of research methods and enable the creation of previously unattainable stimuli. When AI-generated images are informed by brain responses, they provide unique insights into the structure and function of visual systems. The authors argue that experimental psychologists and cognitive neuroscientists stay informed about these emerging tools and embrace their potential to advance the field of visual neuroscience.

Autism Traits and Cognitive Performance: Mediating Roles of Sleep Disturbance, Anxiety and Depression.

Theories about autism spectrum disorder (ASD) have addressed cognitive deficits however few have examined how comorbid diagnoses, including sleep disturbance, anxiety and depression contribute to the underlying deficits. We investigated potential mediations of common ASD comorbidities in the relationship between sub-clinical autism traits and cognitive performance using an international community sample. Cognitive tasks assessed working memory [executive functioning (EF) theory], mental state attribution [theory of mind (ToM)], and global/local visual processing [weak central coherence (WCC) theory]. Structural equation modelling (SEM) demonstrated sleep disturbance and anxiety mediated the relationship of autism traits on measures of EF, but not WCC and ToM. This suggests that treating the symptoms of sleep disturbance and anxiety may lead to improvements in working memory.

Faster social attention disengagement in individuals with higher autism traits.

INTRODUCTION: Atypical visual and social attention has often been associated with clinically diagnosed autism spectrum disorder (ASD), and with the broader autism phenotype. Atypical social attention is of particular research interest given the importance of facial expressions for social communication, with faces tending to attract and hold attention in neurotypical individuals. In autism, this is not necessarily so, where there is debate about the temporal differences in the ability to disengage attention from a face. METHOD: Thus, we have used eye-tracking to record saccadic latencies as a measure of time to disengage attention from a central task-irrelevant face before orienting to a newly presented peripheral nonsocial target during a gap-overlap task. Neurotypical participants with higher or lower autism-like traits (AT) completed the task that included central stimuli with varied expressions of facial emotion as well as an inverted face. RESULTS: High AT participants demonstrated faster saccadic responses to detect the nonsocial target than low AT participants when disengaging attention from a face. Furthermore, faster saccadic responses were recorded when comparing disengagement from upright to inverted faces in low AT but not in high AT participants. CONCLUSIONS: Together, these results extend findings of atypical social attention disengagement in autism and highlight how differences in attention to faces in the broader autism phenotype can lead to apparently superior task performance under certain conditions. Specifically, autism traits were linked to faster attention orienting to a nonsocial target due to the reduced attentional hold of the task irrelevant face stimuli. The absence of an inversion effect in high AT participants also reinforces the suggestion that they process upright or inverted faces similarly, unlike low AT participants for whom inverted faces are thought to be less socially engaging, thus allowing faster disengagement.

Alterations in Rapid Social Evaluations in Individuals with High Autism Traits.

Typically developing adults with low and high Autism Spectrum Quotient (AQ) scores made rapid social evaluations of neutral faces when these were primed by briefly presented emotional faces. High AQ participants rated neutral faces as more threatening than low AQ participants, regardless of the prime condition. Both groups rated target neutral faces as more threatening with fearful compared with neutral primes, while neither group demonstrated an effect of happy primes on the ratings of neutral target faces. These results demonstrate subtle anomalies in rapid visual processing of emotional faces across the broader autism spectrum. They suggest that higher autism traits may be associated with a generalized threat bias in rapid social evaluations.

Corrigendum: Saccade Latency Provides Evidence for Reduced Face Inversion Effects With Higher Autism Traits.

[This corrects the article DOI: 10.3389/fnhum.2019.00470.].

Anxiety as a Common Biomarker for School Children With Additional Health and Developmental Needs Irrespective of Diagnosis.

Currently very little evidence is available regarding the biological characteristics and common comorbid behaviors that are associated with children characterized by learning difficulties who require additional support at school. These children are usually referred to as having Additional Health and Developmental Needs by the Australian Government and the associated public education system more broadly though the problems may arise from academic, social and/or emotional stressors and may or may not include children with clinically diagnosed Neurodevelopmental Disorders. Thus, the aim of this study was to investigate the relationship between anxiety levels (Spence Children's Anxiety Scale- Parent Report), autism traits (Autism Spectrum Quotient - Child Version) and sleep quality (Sleep Disturbance Scale for Children) in children with Additional Health and Developmental Needs without an intellectual disability, but with either a diagnosis of Autism Spectrum Disorder (ASD) (N = 25), Speech and Language Impairment (N = 37) or Other Diagnosis (N = 22). Our results demonstrated that these children with Additional Health and Developmental Needs showed atypically high levels of anxiety and impaired sleep quality, with the ASD group reporting more impairments associated with comorbid anxiety and sleep quality than either of the other clinically diagnosed groups. In fact, greater anxiety level was associated with a greater number of autism traits and poorer sleep quality regardless of diagnostic group suggesting that anxiety is a common experience for children with Additional Health and Developmental Needs. It is suggested that assessment of anxiety, sleep behaviors and autism traits may be useful markers for early identification of children within this population, thus providing scope for early and targeted intervention.

Subclinical high schizotypy traits are associated with slower change detection.

Patients with schizophrenia often show impairments in visual information processing that have been linked to abnormal magnocellular or dorsal stream functioning. However, such deficits are not consistently reported, possibly due to the broad symptomology inherent to schizophrenia, and/or medication effects. To avoid these latter issues this study employed visual perceptual tasks targeting magnocellular (flicker-defined form contrast threshold), dorsal stream (motion coherence, change detection) and ventral stream (form coherence) processing, and compared performance of groups of high and low sub-clinical schizotypy traits from a neurotypical population (n = 20 per group). Significantly worse performance of high compared with low schizotypy participants was only demonstrated on the change detection task that requires rapid attention acquisition and encoding of the first visual array into short term memory prior to a comparison of a second array presentation. No group differences on the other tasks were established. Given this potentially important effect is apparent in a non-clinical population, there are likely to be implications for understanding visual and attentional abnormalities in the schizophrenia spectrum more broadly.

Perceptual size discrimination requires awareness and late visual areas: A continuous flash suppression and interocular transfer study.

We applied continuous flash suppression (CFS) during an interocular transfer paradigm to evaluate the importance of awareness and the contribution of early versus late visual structures in size recognition. Specifically, we tested if size judgements of a visible target could be influenced by a congruent or incongruent prime presented to the same or different eye. Without CFS, participants categorised a target as "small" or "large" more quickly when it was preceded by a congruent prime - regardless of whether the prime and target were presented to the same or different eye. Interocular transfer enabled us to infer that the observed priming was mediated by late visual areas. In contrast, there was no priming under CFS, which underscores the importance of awareness. We conclude that awareness and late visual structures are important for size perception and that any subconscious processing of the stimulus has minimal effect on size recognition.

Saccade Latency Provides Evidence for Reduced Face Inversion Effects With Higher Autism Traits.

Individuals on the autism spectrum are reported to show impairments in the processing of social information, including aspects of eye-movements towards faces. Abnormalities in basic-level visual processing are also reported. In the current study, we sought to determine if the latency of saccades made towards social targets (faces) in a natural scene as opposed to inanimate targets (cars) would be related to sub-clinical autism traits (ATs) in individuals drawn from a neurotypical population. The effect of stimulus inversion was also examined given that difficulties with processing inverted faces are thought to be a function of face expertise. No group differences in saccadic latency were established for face or car targets, regardless of image orientation. However, as expected, we found that individuals with higher autism-like traits did not demonstrate a saccadic face inversion effect, but those with lower autism-like traits did. Neither group showed a car inversion effect. Thus, these results suggest that neurotypical individuals with high autism-like traits also show anomalies in detecting and orienting to faces. In particular, the reduced saccadic face inversion effect established in these participants with high ATs suggests that speed of visual processing and orienting towards faces may be associated with the social difficulties found across the broader autism spectrum.

Conscious awareness is required for the perceptual discrimination of threatening animal stimuli: A visual masking and continuous flash suppression study.

We investigated if the subliminal processing of threatening animal (snakes and spiders) and neutral object (cars and houses) stimuli can influence the discrimination of a subsequent visible stimulus. The prime and target pair were either identical, of the same category but with different physical features, or different in category and physical features. In two experiments, participants discriminated the basic level category (e.g. snake vs. spider) of a visible target stimulus that had been preceded by a visible or perceptually invisible prime stimulus. One experiment used visual masking to render prime stimuli perceptually invisible and the other used continuous flash suppression (CFS). Priming effects were demonstrated in both experiments when the prime was visible but not when the prime was rendered perceptually invisible. These findings demonstrate that conscious awareness could be required in the perceptual discrimination of threatening animal and neutral object images at their specific basic level category.

Perceptual Discrimination of Basic Object Features Is Not Facilitated When Priming Stimuli Are Prevented From Reaching Awareness by Means of Visual Masking.

Our understanding of how form, orientation and size are processed within and outside of awareness is limited and requires further investigation. Therefore, we investigated whether or not the visual discrimination of basic object features can be influenced by subliminal processing of stimuli presented beforehand. Visual masking was used to render stimuli perceptually invisible. Three experiments examined if visible and invisible primes could facilitate the subsequent feature discrimination of visible targets. The experiments differed in the kind of perceptual discrimination that participants had to make. Namely, participants were asked to discriminate visual stimuli on the basis of their form, orientation, or size. In all three experiments, we demonstrated reliable priming effects when the primes were visible but not when the primes were made invisible. Our findings underscore the importance of conscious awareness in facilitating the perceptual discrimination of basic object features.

Size Aftereffects Are Eliminated When Adaptor Stimuli Are Prevented from Reaching Awareness by Continuous Flash Suppression.

Size aftereffects are a compelling perceptual phenomenon in which we perceive the size of a stimulus as being different than it actually is following a period of visual stimulation of an adapter stimulus with a different size. Here, we used continuous flash suppression (CFS) to determine if size aftereffects require a high-level appraisal of the adapter stimulus. The strength of size aftereffects was quantified following a 3-s exposure to perceptually visible and invisible adapters. Participants judged the size of a target that followed the adapter in comparison to a subsequent reference. Our experiments demonstrate that the adapter no longer influenced the perceived size of the subsequent target stimulus under CFS. We conclude that the perception of size aftereffects is prevented when CFS is used to suppress the conscious awarness of the adapting stimulus.

The Maastricht Acute Stress Test (MAST): Physiological and Subjective Responses in Anticipation, and Post-stress.

The Maastricht Acute Stress Test (MAST) is designed to be a simple, quick, and non-invasive procedure aimed at activating the human stress system. The MAST has been developed by combining elements from two of the most common experimental paradigms measuring stress, the Trier Social Stress Test and the Cold Pressor Test. The aim of this study was to use the MAST procedure to elicit strong autonomic and subjective stress responses that can be quantified in terms of (systolic and diastolic) blood pressure, pulse rate (PR), and state anxiety ratings. In healthy individuals, the MAST induced a significant elevation of systolic blood pressure (SBP) from baseline for up to 30 min post-MAST, while diastolic blood pressure (DBP) dropped to baseline within 10 min post-MAST. Interestingly, the presentation of instructions alerting participants to the procedure resulted in significant elevation of both SBP and DBP above baseline. However, BP measurements prior to test initiation were not as high as those measured immediately after the MAST procedure. PR data showed limited variability across time points. Self-reported state anxiety increased dramatically from baseline to immediately following the MAST procedure. Further, individuals who reported higher levels of depression and stress were more likely to demonstrate larger increases in SBP in response to the MAST. Together, these results support the use of the MAST as a useful tool to activate both acute physiological and subjective measures of the stress response in healthy adults lasting up to 30 min.

Impaired Activation of Visual Attention Network for Motion Salience Is Accompanied by Reduced Functional Connectivity between Frontal Eye Fields and Visual Cortex in Strabismic Amblyopia.

Strabismic amblyopia is now acknowledged to be more than a simple loss of acuity and to involve alterations in visually driven attention, though whether this applies to both stimulus-driven and goal-directed attention has not been explored. Hence we investigated monocular threshold performance during a motion salience-driven attention task involving detection of a coherent dot motion target in one of four quadrants in adult controls and those with strabismic amblyopia. Psychophysical motion thresholds were impaired for the strabismic amblyopic eye, requiring longer inspection time and consequently slower target speed for detection compared to the fellow eye or control eyes. We compared fMRI activation and functional connectivity between four ROIs of the occipital-parieto-frontal visual attention network [primary visual cortex (V1), motion sensitive area V5, intraparietal sulcus (IPS) and frontal eye fields (FEF)], during a suprathreshold version of the motion-driven attention task, and also a simple goal-directed task, requiring voluntary saccades to targets randomly appearing along a horizontal line. Activation was compared when viewed monocularly by controls and the amblyopic and its fellow eye in strabismics. BOLD activation was weaker in IPS, FEF and V5 for both tasks when viewing through the amblyopic eye compared to viewing through the fellow eye or control participants' non-dominant eye. No difference in V1 activation was seen between the amblyopic and fellow eye, nor between the two eyes of control participants during the motion salience task, though V1 activation was significantly less through the amblyopic eye than through the fellow eye and control group non-dominant eye viewing during the voluntary saccade task. Functional correlations of ROIs within the attention network were impaired through the amblyopic eye during the motion salience task, whereas this was not the case during the voluntary saccade task. Specifically, FEF showed reduced functional connectivity with visual cortical nodes during the motion salience task through the amblyopic eye, despite suprathreshold detection performance. This suggests that the reduced ability of the amblyopic eye to activate the frontal components of the attention networks may help explain the aberrant control of visual attention and eye movements in amblyopes.

Attention Orienting in Response to Non-conscious Hierarchical Arrows: Individuals with Higher Autistic Traits Differ in Their Global/Local Bias.

One aspect of the social communication impairments that characterize autism spectrum disorder (ASD) include reduced use of often subtle non-verbal social cues. People with ASD, and those with self-reported sub-threshold autistic traits, also show impairments in rapid visual processing of stimuli unrelated to social or emotional properties. Hence, this study sought to investigate whether perceptually non-conscious visual processing is related to autistic traits. A neurotypical sample of thirty young adults completed the Subthreshold Autism Trait Questionnaire and a Posner-like attention cueing task. Continuous Flash Suppression (CFS) was employed to render incongruous hierarchical arrow cues perceptually invisible prior to consciously presented targets. This was achieved via a 10 Hz masking stimulus presented to the dominant eye that suppressed information presented to the non-dominant eye. Non-conscious arrows consisted of local arrow elements pointing in one direction, and forming a global arrow shape pointing in the opposite direction. On each trial, the cue provided either a valid or invalid cue for the spatial location of the subsequent target, depending on which level (global or local) received privileged attention. A significant autism-trait group by global cue validity interaction indicated a difference in the extent of non-conscious local/global cueing between groups. Simple effect analyses revealed that whilst participants with lower autistic traits showed a global arrow cueing effect, those with higher autistic traits demonstrated a small local arrow cueing effect. These results suggest that non-conscious processing biases in local/global attention may be related to individual differences in autistic traits.