Investigating distortions in perceptual stability during different self-movements using virtual reality.

Using immersive virtual reality (the HTC Vive Head Mounted Display), we measured both bias and sensitivity when making judgements about the scene stability of a target object during both active (self-propelled) and passive (experimenter-propelled) observer movements. This was repeated in the same group of 16 participants for three different observer-target movement conditions in which the instability of a target was yoked to the movement of the observer. We found that in all movement conditions that the target needed to move with (in the same direction) as the participant to be perceived as scene-stable. Consistent with the presence of additional available information (efference copy) about self-movement during active conditions, biases were smaller and sensitivities to instability were higher in these relative to passive conditions. However, the presence of efference copy was clearly not sufficient to completely eliminate the bias and we suggest that the presence of additional visual information about self-movement is also critical. We found some (albeit limited) evidence for correlation between appropriate metrics across different movement conditions. These results extend previous findings, providing evidence for consistency of biases across different movement types, suggestive of common processing underpinning perceptual stability judgements.

Detection of scene-relative object movement and optic flow parsing across the adult lifespan.

Moving around safely relies critically on our ability to detect object movement. This is made difficult because retinal motion can arise from object movement or our own movement. Here we investigate ability to detect scene-relative object movement using a neural mechanism called optic flow parsing. This mechanism acts to subtract retinal motion caused by self-movement. Because older observers exhibit marked changes in visual motion processing, we consider performance across a broad age range (N = 30, range: 20-76 years). In Experiment 1 we measured thresholds for reliably discriminating the scene-relative movement direction of a probe presented among three-dimensional objects moving onscreen to simulate observer movement. Performance in this task did not correlate with age, suggesting that ability to detect scene-relative object movement from retinal information is preserved in ageing. In Experiment 2 we investigated changes in the underlying optic flow parsing mechanism that supports this ability, using a well-established task that measures the magnitude of globally subtracted optic flow. We found strong evidence for a positive correlation between age and global flow subtraction. These data suggest that the ability to identify object movement during self-movement from visual information is preserved in ageing, but that there are changes in the flow parsing mechanism that underpins this ability. We suggest that these changes reflect compensatory processing required to counteract other impairments in the ageing visual system.

The Primary Role of Flow Processing in the Identification of Scene-Relative Object Movement.

Retinal image motion could be due to the movement of the observer through space or an object relative to the scene. Optic flow, form, and change of position cues all provide information that could be used to separate out retinal motion due to object movement from retinal motion due to observer movement. In Experiment 1, we used a minimal display to examine the contribution of optic flow and form cues. Human participants indicated the direction of movement of a probe object presented against a background of radially moving pairs of dots. By independently controlling the orientation of each dot pair, we were able to put flow cues to self-movement direction (the point from which all the motion radiated) and form cues to self-movement direction (the point toward which all the dot pairs were oriented) in conflict. We found that only flow cues influenced perceived probe movement. In Experiment 2, we switched to a rich stereo display composed of 3D objects to examine the contribution of flow and position cues. We moved the scene objects to simulate a lateral translation and counter-rotation of gaze. By changing the polarity of the scene objects (from light to dark and vice versa) between frames, we placed flow cues to self-movement direction in opposition to change of position cues. We found that again flow cues dominated the perceived probe movement relative to the scene. Together, these experiments indicate the neural network that processes optic flow has a primary role in the identification of scene-relative object movement.SIGNIFICANCE STATEMENT Motion of an object in the retinal image indicates relative movement between the observer and the object, but it does not indicate its cause: movement of an object in the scene; movement of the observer; or both. To isolate retinal motion due to movement of a scene object, the brain must parse out the retinal motion due to movement of the eye ("flow parsing"). Optic flow, form, and position cues all have potential roles in this process. We pitted the cues against each other and assessed their influence. We found that flow parsing relies on optic flow alone. These results indicate the primary role of the neural network that processes optic flow in the identification of scene-relative object movement.

Perceptuo-motor, cognitive, and description-based decision-making seem equally good.

Classical studies suggest that high-level cognitive decisions (e.g., choosing between financial options) are suboptimal. In contrast, low-level decisions (e.g., choosing where to put your feet on a rocky ridge) appear near-optimal: the perception-cognition gap. Moreover, in classical tasks, people appear to put too much weight on unlikely events. In contrast, when people can learn through experience, they appear to put too little weight on unlikely events: the description-experience gap. We eliminated confounding factors and, contrary to what is commonly believed, found results suggesting that (i) the perception-cognition gap is illusory and due to differences in the way performance is assessed; (ii) the description-experience gap arises from the assumption that objective probabilities match subjective ones; (iii) people's ability to make decisions is better than the classical literature suggests; and (iv) differences between decision-makers are more important for predicting peoples' choices than differences between choice tasks.

Visual extrapolation under risk: human observers estimate and compensate for exogenous uncertainty.

Humans commonly face choices between multiple options with uncertain outcomes. Such situations occur in many contexts, from purely financial decisions (which shares should I buy?) to perceptuo-motor decisions between different actions (where should I aim my shot at goal?). Regardless of context, successful decision-making requires that the uncertainty at the heart of the decision-making problem is taken into account. Here, we ask whether humans can recover an estimate of exogenous uncertainty and then use it to make good decisions. Observers viewed a small dot that moved erratically until it disappeared behind an occluder. We varied the size of the occluder and the unpredictability of the dot's path. The observer attempted to capture the dot as it emerged from behind the occluded region by setting the location and extent of a 'catcher' along the edge of the occluder. The reward for successfully catching the dot was reduced as the size of the catcher increased. We compared human performance with that of an agent maximizing expected gain and found that observers consistently selected catcher size close to this theoretical solution. These results suggest that humans are finely tuned to exogenous uncertainty information and can exploit it to guide action.

Knowing when to move on: cognitive and perceptual decisions in time.

We investigated people's ability to decide how much time to spend on the task at hand. To make such decisions well, one must take into account, among other things, the cost of failing and how one's task performance changes as a function of time. We first investigated timing decisions when the underlying task was perceptual. Decisions were highly efficient and suggested that people can make good use of perceptual knowledge and abstract reward information. Previous studies have found that perceptual decisions are generally optimal, but that cognitive decisions are generally suboptimal--a perception-cognition gap. Does a similar gap exist for timing decisions? We compared timing decisions for a perceptual task with timing decisions for more cognitive tasks. Performance was highly similar across the tasks, which suggests that knowledge can be acquired, and used to make timing decisions, in an equally efficient way regardless of whether that knowledge is derived through perceptual or cognitive experience.

Does optic flow parsing depend on prior estimation of heading?

We have recently suggested that neural flow parsing mechanisms act to subtract global optic flow consistent with observer movement to aid in detecting and assessing scene-relative object movement. Here, we examine whether flow parsing can occur independently from heading estimation. To address this question we used stimuli comprising two superimposed optic flow fields comprising limited lifetime dots (one planar and one radial). This stimulus gives rise to the so-called optic flow illusion (OFI) in which perceived heading is biased in the direction of the planar flow field. Observers were asked to report the perceived direction of motion of a probe object placed in the OFI stimulus. If flow parsing depends upon a prior estimate of heading then the perceived trajectory should reflect global subtraction of a field consistent with the heading experienced under the OFI. In Experiment 1 we tested this prediction directly, finding instead that the perceived trajectory was biased markedly in the direction opposite to that predicted under the OFI. In Experiment 2 we demonstrate that the results of Experiment 1 are consistent with a positively weighted vector sum of the effects seen when viewing the probe together with individual radial and planar flow fields. These results suggest that flow parsing is not necessarily dependent on prior estimation of heading direction. We discuss the implications of this finding for our understanding of the mechanisms of flow parsing.

The impact of choice discriminability and outcome valence on visual decision making under risk.

Much of human activity involves perceptual or perceptuo-motor choice between options with uncertain outcomes. Previous research suggests that decisions in these contexts can be near-optimal in some circumstances but can also be significantly biased. Here we investigate how biases might depend on: i) discriminability of available choice outcomes, adjusted by manipulating the Expected Value (EV) function curvature; ii) outcome valence, which changes the tendency for risk seeking/aversive behaviour in cognitive decision making. In three experiments, participants set the size of a catcher in order to catch a dot moving on a random walk (with varying levels of predictability) after it emerged from behind an occluder. Catching and missing the dot were associated with scoring a variable number of outcome points depending on catcher size. In experiment 1 outcomes were most discriminable (high EV curvature) and catcher size settings were near-optimal. In experiments 2 and 3 outcomes were harder to discriminate (low EV curvature) and there was a significant bias to set the catcher size too small. Unlike cognitive decision making, the valence manipulation had little effect. Subsequent analyses suggest observed biases might reflect participants moving settings towards the region with highest EV curvature, where feedback is most informative. These data suggest that: i) unlike cognitive decisions, in this task choices are largely insensitive to outcome valence; ii) EV curvature is potentially an important factor when interpreting performance in such tasks; iii) Choice may be biased towards high EV curvature regions, consistent with value being placed on exploration to increase information return.

The effect of eccentricity on the linear-radial speed bias: Testing the motion-in-depth model.

Radial motion is perceived as faster than linear motion when local spatiotemporal properties are matched. This radial speed bias (RSB) is thought to occur because radial motion is partly interpreted as motion-in-depth. Geometry dictates that a fixed amount of radial expansion at increasing eccentricities is consistent with smaller motion in depth, so it is perhaps surprising that the impact of eccentricity on RSB has not been examined. With this issue in mind, across 3 experiments we investigated the RSB as a function of eccentricity. In a 2IFC task, participants judged which of a linear (test - variable speed) or radial (reference - 2 or 4°/s) stimulus appeared to move faster. Linear and radial stimuli comprised 4 Gabor patches arranged left, right, above and below fixation at varying eccentricities (3.5°-14°). For linear stimuli, Gabors all drifted left or right, whereas for radial stimuli Gabors drifted towards or away from the centre. The RSB (difference in perceived speeds between matched linear and radial stimuli) was recovered from fitted psychometric functions. Across all 3 experiments we found that the RSB decreased with eccentricity but this tendency was less marked beyond 7° - i.e. at odds with the geometry, the effect did not continue to decrease as a function of eccentricity. This was true irrespective of whether stimuli were fixed in size (Experiment 1) or varied in size to account for changes in spatial scale across the retina (Experiment 2). It was also true when we removed conflicting stereo cues via monocular viewing (Experiment 3). To further investigate our data, we extended a previous model of speed perception, which suggests perceived motion for such stimuli reflects a balance between two opposing perceptual interpretations, one for motion in depth and the other for object deformation. We propose, in the context of this model, that our data are consistent with placing greater weight on the motion in depth interpretation with increasing eccentricity and this is why the RSB does not continue to reduce in line with purely geometric constraints.

Recovery of surface pose from texture orientation statistics under perspective projection.

In a seminal paper, Witkin (1981) derived a model of surface slant and tilt recovery based on the statistics of the orientations of texture elements (texels) on a planar surface. This model made use of basic mathematical properties of probability distributions to formulate a posterior distribution on slant and tilt given a set of image orientations under orthographic projection. One problem with the Witkin model was that it produced a posterior distribution with multiple maxima, reflecting the inherent ambiguity in scene reconstruction under orthographic projection. In the present article, we extend Witkin's method to incorporate the effects of perspective projection. An identical approach is used to that of Witkin; however, the model now reflects the effects of perspective projection on texel orientation. Performance of the new model is compared against that of Witkin's model in a basic surface pose recovery task using both a maximum a posteriori (MAP) decision rule and a rule based on the expected value of the posterior distribution. The resultant posterior of the new model is shown to have only one maximum and thereby the ambiguity in scene interpretation is resolved. Furthermore, the model performs better than Witkin's model using both MAP and expected value decision rules. The results are discussed in the context of human slant estimation.

Collinear facilitation and contour integration in autistic adults: Examining lateral and feedback connectivity.

Alongside difficulties with communication and social interaction, autism is often accompanied by unusual sensory and perceptual experiences including enhanced visual performance on tasks that involve separating local parts from global context. This superiority may be the result of atypical integrative processing, involving feedback and lateral connections between visual neurons. The current study investigated the integrity of these connections in autistic adults by examining two psychophysics tasks that rely on these processes - collinear facilitation and contour integration. The relative contribution of feedback and lateral connectivity was studied by altering the timing of the target relative to the flankers in the collinear facilitation task, in 16 autistic and 16 non-autistic adults. There were no significant differences in facilitation between the autistic and non-autistic groups, indicating that for this task and participant sample, lateral and feedback connectivity appear relatively intact in autistic individuals. Contour integration was examined in a different group of 20 autistic and 18 non-autistic individuals, for open and closed contours to assess the closure effect (improved detection of closed compared to open contours). Autistic individuals showed a reduced closure effect at both short (150 ms) and longer (500 ms) stimulus presentation durations that was driven by better performance of the autistic group for the open contours. These results suggest that reduced closure in a simple contour detection paradigm is unlikely to be due to slower global processing. Reduced closure has implications for understanding sensory overload by contributing to reduced figure-ground segregation of salient visual features.

Perceptions of randomness: why three heads are better than four.

A long tradition of psychological research has lamented the systematic errors and biases in people's perception of the characteristics of sequences generated by a random mechanism such as a coin toss. It is proposed that once the likely nature of people's actual experience of such processes is taken into account, these "errors" and "biases" actually emerge as apt reflections of the probabilistic characteristics of sequences of random events. Specifically, seeming biases reflect the subjective experience of a finite data stream for an agent with a limited short-term memory capacity. Consequently, these biases seem testimony not to the limitations of people's intuitive statistics but rather to the extent to which the human cognitive system is finely attuned to the statistics of the environment.

The Effect of Ageing on Optimal Integration of Conflicting and Non-Conflicting Visual-Haptic Stimuli.

Multisensory integration typically follows the predictions of a statistically optimal model whereby the contribution of each sensory modality is weighted according to its reliability. Previous research has shown that multisensory integration is affected by ageing, however it is less certain whether older adults follow this statistically optimal model. Additionally, previous studies often present multisensory cues which are conflicting in size, shape or location, yet naturally occurring multisensory cues are usually non-conflicting. Therefore, the mechanisms of integration in older adults might differ depending on whether the multisensory cues are consistent or conflicting. In the current experiment, young ( n = 21) and older ( n = 30) adults were asked to make judgements regarding the height of wooden blocks using visual, haptic or combined visual-haptic information. Dual modality visual-haptic blocks could be presented as equal or conflicting in size. Young and older adults' size discrimination thresholds (i.e., precision) were not significantly different for visual, haptic or visual-haptic cues. In addition, both young and older adults' discrimination thresholds and points of subjective equality did not follow model predictions of optimal integration, for both conflicting and non-conflicting cues. Instead, there was considerable between subject variability as to how visual and haptic cues were processed when presented simultaneously. This finding has implications for the development of multisensory therapeutic aids and interventions to assist older adults with everyday activities, where these should be tailored to the needs of each individual.

Evidence for flow-parsing in radial flow displays.

Retinal motion of objects is not in itself enough to signal whether or how objects are moving in the world; the same pattern of retinal motion can result from movement of the object, the observer or both. Estimation of scene-relative movement of an object is vital for successful completion of many simple everyday tasks. Recent research has provided evidence for a neural flow-parsing mechanism which uses the brain's sensitivity to optic flow to separate retinal motion signals into those components due to observer movement and those due to the movement of objects in the scene. In this study we provide further evidence that flow-parsing is implicated in the assessment of object trajectory during observer movement. Furthermore, it is shown that flow-parsing involves a global analysis of retinal motion, as might be expected if optic flow processing underpinned this mechanism.

Rapid size scaling in visual search.

In order to compute a representation of an object's size within a 3D scene, the visual system must scale retinal size by an estimate of the distance to the object. Evidence from size discrimination and visual search studies suggests that we have no access to the representation of retinal size when performing such tasks. In this study we investigate whether observers have early access to retinal size prior to scene size. Observer performance was assessed in a visual search task (requiring search within a 3D scene) in which processing was interrupted at a range of short presentation times. If observers have access to retinal size then we might expect to find a presentation time before which observers behave as if using retinal size and after which they behave as if using scene size. Observers searched for a larger or smaller target object within a group of objects viewed against a textured plane slanted at 0 degrees or 60 degrees . Stimuli were presented for 100, 200, 400 or 800ms and immediately followed by a mask. We measured the effect of target location within a stimulus (near vs. far) on task performance and how this was influenced by the background slant. The results of experiments 1 and 2 suggest that background slant had a significant influence on performance at all presentation times consistent with the use of scene size and not retinal size. Experiment 3 shows that this finding cannot be explained by a 2D texture contrast effect. Experiment 4 indicates that contextual information learned across a block of trials could be an important factor in such visual search experiments. In spite of this finding, our results suggest that distance scaling may occur prior to 100ms and we find no clear evidence for explicit access to a retinal representation of size.

Visual-tactile selective attention in autism spectrum condition: An increased influence of visual distractors.

We have previously observed that participants with autism spectrum condition (ASC) are more influenced by visual distractors during a tactile task compared with controls (Poole, Gowen, Warren, & Poliakoff, 2015). This finding suggests that changes in multisensory processing could underpin differences in sensory reactivity in ASC. Here we explore the cognitive mechanisms underlying this effect. Adults with ASC (n = 22) and matched neurotypical (NT) controls (n = 22) completed 3 tasks involving similar stimuli. In Experiment 1, we again showed that when participants with ASC were performing a tactile task they were distracted more by visual stimuli compared with NTs. In Experiment 2, however, no differences between the groups were observed on an alternative visual-tactile task (temporal order judgment) requiring attention to both the stimuli. That is, ASC performance was typical when the task did not require the visual stimuli to be suppressed. Furthermore, in Experiment 3 the effects of visual distractors were comparable between the groups when the tactile target was replaced with a visual target. When comparing performance across Experiments 1 and 3, NT participants were better able to suppress visual distractors when the target was tactile than when the target was visual (Experiment 1 vs. 3), but this crossmodal benefit was not observed in participants with ASC. The effects of visual distractors were comparable regardless of the target modality suggesting that the efficacy of visual-tactile selective attention may be reduced in ASC. (PsycINFO Database Record

A re-examination of "bias" in human randomness perception.

Human randomness perception is commonly described as biased. This is because when generating random sequences humans tend to systematically under- and overrepresent certain subsequences relative to the number expected from an unbiased random process. In a purely theoretical analysis we have previously suggested that common misperceptions of randomness may actually reflect genuine aspects of the statistical environment, once cognitive constraints are taken into account which impact on how that environment is actually experienced (Hahn & Warren, Psychological Review, 2009). In the present study we undertake an empirical test of this account, comparing human-generated against unbiased process-generated binary sequences in two experiments. We suggest that comparing human and theoretically unbiased sequences using metrics reflecting the constraints imposed on human experience provides a more meaningful picture of lay people's ability to perceive randomness. Finally, we propose a simple generative model of human random sequence generation inspired by the Hahn and Warren account. Taken together our results question the notion of bias in human randomness perception. (PsycINFO Database Record

The pop out of scene-relative object movement against retinal motion due to self-movement.

An object that moves is spotted almost effortlessly; it "pops out". When the observer is stationary, a moving object is uniquely identified by retinal motion. This is not so when the observer is also moving; as the eye travels through space all scene objects change position relative to the eye producing a complicated field of retinal motion. Without the unique identifier of retinal motion an object moving relative to the scene should be difficult to locate. Using a search task, we investigated this proposition. Computer-rendered objects were moved and transformed in a manner consistent with movement of the observer. Despite the complex pattern of retinal motion, objects moving relative to the scene were found to pop out. We suggest the brain uses its sensitivity to optic flow to "stabilise" the scene, allowing the scene-relative movement of an object to be identified.

Perception of object trajectory: parsing retinal motion into self and object movement components.

A moving observer needs to be able to estimate the trajectory of other objects moving in the scene. Without the ability to do so, it would be difficult to avoid obstacles or catch a ball. We hypothesized that neural mechanisms sensitive to the patterns of motion generated on the retina during self-movement (optic flow) play a key role in this process, "parsing" motion due to self-movement from that due to object movement. We investigated this "flow parsing" hypothesis by measuring the perceived trajectory of a moving probe placed within a flow field that was consistent with movement of the observer. In the first experiment, the flow field was consistent with an eye rotation; in the second experiment, it was consistent with a lateral translation of the eyes. We manipulated the distance of the probe in both experiments and assessed the consequences. As predicted by the flow parsing hypothesis, manipulating the distance of the probe had differing effects on the perceived trajectory of the probe in the two experiments. The results were consistent with the scene geometry and the type of simulated self-movement. In a third experiment, we explored the contribution of local and global motion processing to the results of the first two experiments. The data suggest that the parsing process involves global motion processing, not just local motion contrast. The findings of this study support a role for optic flow processing in the perception of object movement during self-movement.

Contrast effects on speed perception for linear and radial motion.

Speed perception is vital for safe activity in the environment. However, considerable evidence suggests that perceived speed changes as a function of stimulus contrast, with some investigators suggesting that this might have meaningful real-world consequences (e.g. driving in fog). In the present study we investigate whether the neural effects of contrast on speed perception occur at the level of local or global motion processing. To do this we examine both speed discrimination thresholds and contrast-dependent speed perception for two global motion configurations that have matched local spatio-temporal structure. Specifically we compare linear and radial configurations, the latter of which arises very commonly due to self-movement. In experiment 1 the stimuli comprised circular grating patches. In experiment 2, to match stimuli even more closely, motion was presented in multiple local Gabor patches equidistant from central fixation. Each patch contained identical linear motion but the global configuration was either consistent with linear or radial motion. In both experiments 1 and 2, discrimination thresholds and contrast-induced speed biases were similar in linear and radial conditions. These results suggest that contrast-based speed effects occur only at the level of local motion processing, irrespective of global structure. This result is interpreted in the context of previous models of speed perception and evidence suggesting differences in perceived speed of locally matched linear and radial stimuli.