Prior probability cues bias sensory encoding with increasing task exposure.

When observers have prior knowledge about the likely outcome of their perceptual decisions, they exhibit robust behavioural biases in reaction time and choice accuracy. Computational modelling typically attributes these effects to strategic adjustments in the criterion amount of evidence required to commit to a choice alternative - usually implemented by a starting point shift - but recent work suggests that expectations may also fundamentally bias the encoding of the sensory evidence itself. Here, we recorded neural activity with EEG while participants performed a contrast discrimination task with valid, invalid, or neutral probabilistic cues across multiple testing sessions. We measured sensory evidence encoding via contrast-dependent steady-state visual-evoked potentials (SSVEP), while a read-out of criterion adjustments was provided by effector-selective mu-beta band activity over motor cortex. In keeping with prior modelling and neural recording studies, cues evoked substantial biases in motor preparation consistent with criterion adjustments, but we additionally found that the cues produced a significant modulation of the SSVEP during evidence presentation. While motor preparation adjustments were observed in the earliest trials, the sensory-level effects only emerged with extended task exposure. Our results suggest that, in addition to strategic adjustments to the decision process, probabilistic information can also induce subtle biases in the encoding of the evidence itself.

Actions are characterized by 'canonical moments' in a sequence of movements.

Understanding what others are doing is an essential aspect of social cognition that depends on our ability to quickly recognize and categorize their actions. To effectively study action recognition we need to understand how actions are bounded, where they start and where they end. Here we borrow a conceptual approach - the notion of 'canonicality' - introduced by Palmer and colleagues in their study of object recognition and apply it to the study of action recognition. Using a set of 50 video clips sourced from stock photography sites, we show that many everyday actions - transitive and intransitive, social and non-social, communicative - are characterized by 'canonical moments' in a sequence of movements that are agreed by participants to 'best represent' a named action, as indicated in a forced choice (Exp 1, n = 142) and a free choice (Exp 2, n = 125) paradigm. In Exp 3 (n = 102) we confirm that canonical moments from action sequences are more readily named as depicting specific actions and, mirroring research in object recognition, that such canonical moments are privileged in memory (Exp 4, n = 95). We suggest that 'canonical moments', being those that convey maximal information about human actions, are integral to the representation of human action.1.

Distinct profiles of multisensory processing between professional goalkeepers and outfield football players.

In association football (soccer), the position of goalkeeper is the most specialised position in the sport and has the primary objective of stopping the opposing team from scoring. While previous studies have highlighted differences in physiological and match performance profiles between goalkeepers and outfield players1, surprisingly little research has focused on whether goalkeepers differ in terms of their perceptual-cognitive abilities. Given that goalkeepers use multiple sensory cues and are often required to make rapid decisions based on incomplete multisensory information to fulfil their role2, we hypothesised that professional goalkeepers would display enhanced multisensory temporal processing relative to their outfield counterparts. To test this hypothesis, we measured the temporal binding windows - the time window within which signals from the different senses are integrated into a single percept - of professional goalkeepers, professional outfield players, and a control group with no professional football experience using the sound-induced flash illusion3. Our results indicated a marked difference in multisensory processing between the three groups. Specifically, we found that the goalkeepers displayed a narrower temporal binding window relative to both outfielders and control participants, indicating more precise audiovisual timing estimation. However, this enhanced multisensory temporal processing was accompanied by a general reduction in crossmodal interactions relative to the other two groups that could be attributed to an a priori tendency to segregate sensory signals. We propose that these differences stem from the idiosyncratic nature of the goalkeeping position that puts a premium on the ability of goalkeepers to make quick decisions, often based on partial or incomplete sensory information.

Examining the Relationship Between HIV-Related Stigma and the Health and Wellbeing of Children and Adolescents Living with HIV: A Systematic Review.

Human immunodeficiency virus (HIV) affects millions of people globally. The associated stigma remains a challenge for individuals living with HIV and children and adolescents face the additional challenge of withstanding the peer, pubertal and identity challenges associated with growing up. The current systematic review aimed to define and explore the major stigma-related challenges of children and adolescents from their own perspectives. A secondary aim was to identify any challenges distinct to childhood and adolescence. Studies included individuals aged 3 to 18 years who were aware of their status. Fifteen studies met inclusion criteria. Narrative synthesis was conducted on the included studies. Five analytic themes emerged describing major stigma-related challenges: disclosure-related anxiety, medication adherence, feelings of abnormality, mental health issues and social exclusion. Disclosure-related anxiety and feelings of abnormality appeared to be largely confined to the experience of children and adolescents. Many of the themes centred around peer influence, highlighting the need to belong in youth. Results suggest that youth require tailored interventions targeting their age-specific challenges.

Perceptual training narrows the temporal binding window of audiovisual integration in both younger and older adults.

There is a growing body of evidence to suggest that multisensory processing changes with advancing age - usually in the form of an enlarged temporal binding window - with some studies linking these multisensory changes to negative clinical outcomes. Perceptual training regimes represent a promising means for enhancing the precision of multisensory integration in ageing; however, to date, the vast majority of studies examining the efficacy of multisensory perceptual learning have focused solely on healthy young adults. Here, we measured the temporal binding windows of younger and older participants before and after training on an audiovisual temporal discrimination task to assess (i) how perceptual training affected the shape of the temporal binding window and (ii) whether training effects were similar in both age groups. Our results replicated previous findings of an enlarged temporal binding window in older adults, as well as providing further evidence that both younger and older participants can improve the precision of their audiovisual timing estimation via perceptual training. We also show that this training protocol led to a narrowing of the temporal binding window associated with the sound-induced flash illusion in both age groups indicating a general refinement of audiovisual integration. However, while younger adults also displayed a general reduction in crossmodal interactions following training, this effect was not observed in the older adult group. Together, our results suggest that perceptual training narrows the temporal binding window of audiovisual integration in both younger and older adults but has less of an impact on prior expectations regarding the source of audiovisual signals in older adults.

The magnitude of the sound-induced flash illusion does not increase monotonically as a function of visual stimulus eccentricity.

The sound-induced flash illusion (SIFI) occurs when a rapidly presented visual stimulus is accompanied by two auditory stimuli, creating the illusory percept of two visual stimuli. While much research has focused on how the temporal proximity of the audiovisual stimuli impacts susceptibility to the illusion, comparatively less research has focused on the impact of spatial manipulations. Here, we aimed to assess whether manipulating the eccentricity of visual flash stimuli altered the properties of the temporal binding window associated with the SIFI. Twenty participants were required to report whether they perceived one or two flashes that were concurrently presented with one or two beeps. Visual stimuli were presented at one of four different retinal eccentricities (2.5, 5, 7.5, or 10 degrees below fixation) and audiovisual stimuli were separated by one of eight stimulus-onset asynchronies. In keeping with previous findings, increasing stimulus-onset asynchrony between the auditory and visual stimuli led to a marked decrease in susceptibility to the illusion allowing us to estimate the width and amplitude of the temporal binding window. However, varying the eccentricity of the visual stimulus had no effect on either the width or the peak amplitude of the temporal binding window, with a similar pattern of results observed for both the "fission" and "fusion" variants of the illusion. Thus, spatial manipulations of the audiovisual stimuli used to elicit the SIFI appear to have a weaker effect on the integration of sensory signals than temporal manipulations, a finding which has implications for neuroanatomical models of multisensory integration.

Young and restless, old and focused: Age-differences in mind-wandering frequency and phenomenology.

The consistently observed age-accompanied diminution in mind-wandering stands seemingly opposed to accounts that present mind-wandering as a failure of executive control. This study examined the impact of aging on the frequency and phenomenology of mind-wandering and investigated distinct variables mediating age-related differences in unintentional and intentional mind-wandering. Thirty-four younger and 34 healthy older adults completed a neuropsychological test battery and contrast change detection task embedded with experience sampling probes asking participants to discriminate the nature of their thoughts. Results revealed age-related decreases in unintentional and intentional mind-wandering, but equivalent task accuracy. Parallel mediations demonstrated that older adults reduced their unintentional mind-wandering through having less anxiety and greater task engagement than younger adults. Despite the evidence of age-related decline on cognitive function tests, neither executive function nor task demand variables further contributed to the model. Our results adjudicate between competing theories, highlighting the roles of affective and motivational factors in unintentional mind-wandering. Intentional mind-wandering showed no significant associations with the neuropsychological measures; however, intentional mind-wandering was associated with more false alarms, which was mediated by greater reaction time variability (RTV). In the context of the exploitation/exploration framework, we suggest that younger adults were more inclined to intentionally mind-wander, indexed by increased RTV, while preserving comparable performance accuracy to older adults. Conversely, older adults exploited greater task focus, marked by reduced RTV, with less bias toward, or resources for, exploration of the mind-wandering space. Therefore, dispositional and strategic factors should be considered in future investigations of mind-wandering across the lifespan. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

What you see is what you hear: Twenty years of research using the Sound-Induced Flash Illusion.

In the Sound-Induced Flash Illusion (SIFI) sound dramatically alters visual perception, as presenting a single flash with two beeps results in the perception of two flashes. In this comprehensive review, we synthesise 20 years of research using the SIFI, from over 100 studies. We discuss the neural and computational principles governing this illusion and examine the influence of perceptual experience, development, ageing and clinical conditions. Convergent findings show that the SIFI results from optimal integration and probabilistic inference and directly reflects crossmodal interactions in the temporal domain. Its neural basis lies in early modulation of visual cortex by auditory and multisensory regions. The SIFI shows increasingly strong potential as an efficient tool for measuring multisensory processing. Greater harmonisation across studies is now required to maximise this potential. We therefore propose considerations for researchers relating to choice of stimulus parameters and signpost directions for future research.

Evaluating the neurophysiological evidence for predictive processing as a model of perception.

For many years, the dominant theoretical framework guiding research into the neural origins of perceptual experience has been provided by hierarchical feedforward models, in which sensory inputs are passed through a series of increasingly complex feature detectors. However, the long-standing orthodoxy of these accounts has recently been challenged by a radically different set of theories that contend that perception arises from a purely inferential process supported by two distinct classes of neurons: those that transmit predictions about sensory states and those that signal sensory information that deviates from those predictions. Although these predictive processing (PP) models have become increasingly influential in cognitive neuroscience, they are also criticized for lacking the empirical support to justify their status. This limited evidence base partly reflects the considerable methodological challenges that are presented when trying to test the unique predictions of these models. However, a confluence of technological and theoretical advances has prompted a recent surge in human and nonhuman neurophysiological research seeking to fill this empirical gap. Here, we will review this new research and evaluate the degree to which its findings support the key claims of PP.

Do synaesthesia and mental imagery tap into similar cross-modal processes?

Synaesthesia has previously been linked with imagery abilities, although an understanding of a causal role for mental imagery in broader synaesthetic experiences remains elusive. This can be partly attributed to our relatively poor understanding of imagery in sensory domains beyond vision. Investigations into the neural and behavioural underpinnings of mental imagery have nevertheless identified an important role for imagery in perception, particularly in mediating cross-modal interactions. However, the phenomenology of synaesthesia gives rise to the assumption that associated cross-modal interactions may be encapsulated and specific to synaesthesia. As such, evidence for a link between imagery and perception may not generalize to synaesthesia. Here, we present results that challenge this idea: first, we found enhanced somatosensory imagery evoked by visual stimuli of body parts in mirror-touch synaesthetes, relative to other synaesthetes or controls. Moreover, this enhanced imagery generalized to tactile object properties not directly linked to their synaesthetic associations. Second, we report evidence that concurrent experience evoked in grapheme-colour synaesthesia was sufficient to trigger visual-to-tactile correspondences that are common to all. Together, these findings show that enhanced mental imagery is a consistent hallmark of synaesthesia, and suggest the intriguing possibility that imagery may facilitate the cross-modal interactions that underpin synaesthesic experiences. This article is part of a discussion meeting issue 'Bridging senses: novel insights from synaesthesia'.

The impact of natural aging on computational and neural indices of perceptual decision making: A review.

It is well established that natural aging negatively impacts on a wide variety of cognitive functions and research has sought to identify core neural mechanisms that may account for these disparate changes. A central feature of any cognitive task is the requirement to translate sensory information into an appropriate action - a process commonly known as perceptual decision making. While computational, psychophysical, and neurophysiological research has made substantial progress in establishing the key computations and neural mechanisms underpinning decision making, it is only relatively recently that this knowledge has begun to be applied to research on aging. The purpose of this review is to provide an overview of this work which is beginning to offer new insights into the core psychological processes that mediate age-related cognitive decline in adults aged 65 years and over. Mathematical modelling studies have consistently reported that older adults display longer non-decisional processing times and implement more conservative decision policies than their younger counterparts. However, there are limits on what we can learn from behavioural modeling alone and neurophysiological analyses can play an essential role in empirically validating model predictions and in pinpointing the precise neural mechanisms that are impacted by aging. Although few studies to date have explicitly examined correspondences between computational models and neural data with respect to cognitive aging, neurophysiological studies have already highlighted age-related changes at multiple levels of the sensorimotor hierarchy that are likely to be consequential for decision making behaviour. Here, we provide an overview of this literature and suggest some future directions for the field.

Reconciling age-related changes in behavioural and neural indices of human perceptual decision-making.

Ageing impacts on decision-making behaviour across a range of cognitive tasks and scenarios. Computational modelling has proved valuable in providing mechanistic interpretations of these age-related differences; however, the extent to which model parameter differences accurately reflect changes to the underlying neural computations remains unclear. Here, we report that age-related effects on neural signatures of decision formation are inconsistent with behavioural fits derived from a prominent accumulation-to-bound model. Most notably, model-predicted bound differences were absent neurophysiologically. However, constraining the model to match the decision-predictive elements of the brain signals provided more parsimonious fits to behaviour and generated predictions regarding the neural data that were empirically validated. These included a task-dependent slowing of evidence accumulation among older adults and reduced between-trial accumulation rate variability, which was linked to enhanced attentional engagement. Our findings highlight how combining neurophysiological measurements with computational modelling can yield unique insights into group differences in neural decision mechanisms.

Individual differences in context-dependent effects reveal common mechanisms underlying the direction aftereffect and direction repulsion.

Both spatial and temporal context influence our perception of visual stimuli. For instance, both nearby moving stimuli and recently viewed motion can lead to biases in the perceived direction of a moving stimulus. Due to similarities in the spatial tuning properties of these spatial and temporal context-dependent effects, it is often assumed that they share a functional goal in motion processing and arise from common neural mechanisms. However, the psychophysical evidence concerning this assumption is inconsistent. Here we used an individual differences approach to examine the relationship between different effects of contextual modulation on perception. We reasoned that if measures of contextual modulation share a common underlying mechanism, they should exhibit a strong positive correlation across participants. To test this hypothesis, estimates of the direction aftereffect, direction repulsion, the tilt aftereffect and contrast adaptation were obtained from 54 healthy participants. Our results show pronounced interindividual differences in the effect sizes of all four tasks. Furthermore, there was a strong positive correlation between the estimates of the direction aftereffect and direction repulsion. This correlation was also evident in the threshold elevations that accompanied these repulsive biases in perceived direction. While the effects of contrast adaptation did not correlate with any of the other tasks, there was a weak, but non-significant, correlation between the direction and tilt aftereffects. These results provide evidence for common mechanisms underlying the direction aftereffect and direction repulsion.

Perceptual learning shapes multisensory causal inference via two distinct mechanisms.

To accurately represent the environment, our brains must integrate sensory signals from a common source while segregating those from independent sources. A reasonable strategy for performing this task is to restrict integration to cues that coincide in space and time. However, because multisensory signals are subject to differential transmission and processing delays, the brain must retain a degree of tolerance for temporal discrepancies. Recent research suggests that the width of this 'temporal binding window' can be reduced through perceptual learning, however, little is known about the mechanisms underlying these experience-dependent effects. Here, in separate experiments, we measure the temporal and spatial binding windows of human participants before and after training on an audiovisual temporal discrimination task. We show that training leads to two distinct effects on multisensory integration in the form of (i) a specific narrowing of the temporal binding window that does not transfer to spatial binding and (ii) a general reduction in the magnitude of crossmodal interactions across all spatiotemporal disparities. These effects arise naturally from a Bayesian model of causal inference in which learning improves the precision of audiovisual timing estimation, whilst concomitantly decreasing the prior expectation that stimuli emanate from a common source.

Task-specific transfer of perceptual learning across sensory modalities.

It is now widely accepted that primary cortical areas of the brain that were once thought to be sensory-specific undergo significant functional reorganisation following sensory deprivation. For instance, loss of vision or audition leads to the brain areas normally associated with these senses being recruited by the remaining sensory modalities [1]. Despite this, little is known about the rules governing crossmodal plasticity in people who experience typical sensory development, or the potential behavioural consequences. Here, we used a novel perceptual learning paradigm to assess whether the benefits associated with training on a task in one sense transfer to another sense. Participants were randomly assigned to a spatial or temporal task that could be performed visually or aurally, which they practiced for five days; before and after training, we measured discrimination thresholds on all four conditions and calculated the extent of transfer between them. Our results show a clear transfer of learning between sensory modalities; however, generalisation was limited to particular conditions. Specifically, learned improvements on the spatial task transferred from the visual domain to the auditory domain, but not vice versa. Conversely, benefits derived from training on the temporal task transferred from the auditory domain to visual domain, but not vice versa. These results suggest a unidirectional transfer of perceptual learning from dominant to non-dominant sensory modalities and place important constraints on models of multisensory processing and plasticity.

Characterizing the role of disparity information in alleviating visual crowding.

The ability to identify a target is reduced by the presence of nearby objects, a phenomenon known as visual crowding. The extent to which crowding impairs our perception is generally governed by the degree of similarity between a target stimulus and its surrounding flankers. Here we investigated the influence of disparity differences between target and flankers on crowding. Orientation discrimination thresholds for a parafoveal target were first measured when the target and flankers were presented at the same depth to establish a flanker separation that induced a significant elevation in threshold for each individual. Flankers were subsequently fixed at this spatial separation while the disparity of the flankers relative to the target was altered. For all participants, thresholds showed a systematic decrease as flanker-target disparity increased. The resulting tuning function was asymmetric: Crowding was lower when the target was perceived to be in front of the flankers rather than behind. A series of control experiments confirmed that these effects were driven by disparity, as opposed to other factors such as flanker-target separation in three-dimensional (3-D) space or monocular positional offsets used to create disparity. When flankers were distributed over a range of crossed and uncrossed disparities, such that the mean was in the plane of the target, there was an equivalent or greater release of crowding compared to when all flankers were presented at the maximum disparity of that range. Overall, our results suggest that depth cues can reduce the effects of visual crowding, and that this reduction is unlikely to be caused by grouping of flankers or positional shifts in the monocular image.

Characterizing the effects of multidirectional motion adaptation.

Recent sensory experience can alter our perception and change the response characteristics of sensory neurons. These effects of sensory adaptation are a ubiquitous property of perceptual systems and are believed to be of fundamental importance to sensory coding. Yet we know little about how adaptation to stimulus ensembles affects our perception of the environment as most psychophysical experiments employ adaptation protocols that focus on prolonged exposure to a single visual attribute. Here, we investigate how concurrent adaptation to multiple directions of motion affects perception of subsequently presented motion using the direction aftereffect. In different conditions, observers adapted to a stimulus ensemble comprised of dot directions sampled from different distributions or to bidirectional motion. Increasing the variance of normally distributed directions reduced the magnitude of the peak direction aftereffect and broadened its tuning profile. Sampling of asymmetric Gaussian and uniform distributions resulted in shifts of direction aftereffect tuning profiles consistent with changes in the perceived global direction of the adapting stimulus. Adding dots in a direction opposite or orthogonal to a unidirectional adapting stimulus led to a pronounced reduction in the direction aftereffect. A simple population-coding model, in which adaptation selectively alters the responsivity of direction-selective neurons, can accommodate the effects of multidirectional adaptation on the perceived direction of motion.

The sound-induced flash illusion reveals dissociable age-related effects in multisensory integration.

While aging can lead to significant declines in perceptual and cognitive function, the effects of age on multisensory integration, the process in which the brain combines information across the senses, are less clear. Recent reports suggest that older adults are susceptible to the sound-induced flash illusion (Shams et al., 2000) across a much wider range of temporal asynchronies than younger adults (Setti et al., 2011). To assess whether this cost for multisensory integration is a general phenomenon of combining asynchronous audiovisual input, we compared the time courses of two variants of the sound-induced flash illusion in young and older adults: the fission illusion, where one flash accompanied by two beeps appears as two flashes, and the fusion illusion, where two flashes accompanied by one beep appear as one flash. Twenty-five younger (18-30 years) and older (65+ years) adults were required to report whether they perceived one or two flashes, whilst ignoring irrelevant auditory beeps, in bimodal trials where auditory and visual stimuli were separated by one of six stimulus onset asynchronies (SOAs). There was a marked difference in the pattern of results for the two variants of the illusion. In conditions known to produce the fission illusion, older adults were significantly more susceptible to the illusion at longer SOAs compared to younger participants. In contrast, the performance of the younger and older groups was almost identical in conditions known to produce the fusion illusion. This surprising difference between sound-induced fission and fusion in older adults suggests dissociable age-related effects in multisensory integration, consistent with the idea that these illusions are mediated by distinct neural mechanisms.

Contour inflections are adaptable features.

An object's shape is a strong cue for visual recognition. Most models of shape coding emphasize the role of oriented lines and curves for coding an object's shape. Yet inflection points, which occur at the junction of two oppositely signed curves, are ubiquitous features in natural scenes and carry important information about the shape of an object. Using a visual aftereffect in which the perceived shape of a contour is changed following prolonged viewing of a slightly different-shaped contour, we demonstrate a specific aftereffect for a contour inflection. Control conditions show that this aftereffect cannot be explained by adaptation to either the component curves or to the local orientation at the point of inflection. Further, we show that the aftereffect transfers weakly to a compound curve without an inflection, ruling out a general compound curvature detector as an explanation of our findings. We assume however that there are adaptable mechanisms for coding other specific forms of compound curves. Taken together, our findings provide evidence that the human visual system contains specific mechanisms for coding contour inflections, further highlighting their role in shape and object coding.