Multiple object tracking in the presence of a goal: Attentional anticipation and suppression.

In previous studies, we found that tracking multiple objects involves anticipatory attention, especially in the linear direction, even when a target bounced against a wall. We also showed that active involvement, in which the wall was replaced by a controllable paddle, resulted in increased allocation of attention to the bounce direction. In the current experiments, we wanted to further investigate the potential influence of the valence of the heading of an object. In Experiments 1 and 2, participants were instructed to catch targets with a movable goal. In Experiment 3, participants were instructed to manipulate the permeability of a static wall in order to let targets either approach goals (i.e., green goals) or avoid goals (i.e., red goals). The results of Experiment 1 showed that probe detection ahead of a target that moved in the direction of the goal was higher as compared to probe detection in the direction of a no-goal area. Experiment 2 provided further evidence that the attentional highlighting found in the first experiment depends on the movement direction toward the goal. In Experiment 3, we found that not so much the positive (or neutral) valence (here, the green and no-goal areas) led to increased allocation of attention but rather a negative valence (here the red goals) led to a decreased allocation of attention.

Magic for the mind's eye: A promising avenue for more universal design in the art of magic.

In the art of conjuring, as well as in cognitive science, possibilities for designing magic tricks that are suitable for people who are blind or visually impaired have only rarely been considered. In this article, we argue that many magic tricks which are normally presented in a visual way, are not inherently based on visual processes, but instead on systematic illusions and limitations in visual imagery and mental simulations. Accordingly, it should be possible to adapt these tricks for presentation in a non-visual format, which should be suitable for people who are blind or visually impaired. As an initial test of this general approach, we adapted three magic tricks for non-visual presentation and presented them for blindfolded participants. Standard versions of the tricks were also presented to seeing participants. The participants in both groups were asked to indicate how magical they felt the tricks were, as well as whether they had any idea about the secrets behind them. The results suggest that the non-visual versions of the tricks are roughly comparable to the regular visual versions. We conclude that adapting magic tricks based on illusions of imagery for non-visual presentation appears to be a promising avenue for more universal design in the art of magic. We also argue that the illusions of imagery responsible for the experiences of magic evoked presents interesting challenges for basic cognitive science.

Influences of active control on attention allocation in MOT.

We investigated the influence of active involvement on the way visual attention is distributed during multiple-object tracking (MOT), specifically when objects bounce, using two experiments modeled after the videogame Pong. In both experiments, participants were either assigned to an active group or a passive group. The active groups were instructed to move a virtual paddle in order to bounce target objects as often as possible. Participants in the passive groups viewed recordings of trials from the active groups. In all conditions, participants were asked to track the target objects and to detect dot probes that briefly appeared on the screen. Using probe detection, we explored the distribution of attentional resources over the linear and bounce trajectories of tracked objects. We found that active involvement can enhance probe detection along the future post-bounce trajectory, but it depends on the difficulty of the task.

The illusion of absence: how a common feature of magic shows can explain a class of road accidents.

The purpose of the present note is to draw attention to the potential role of a recently discovered visual illusion in creating traffic accidents. The illusion consists in a compelling and immediate experience that the space behind an occluding object in the foreground is empty. Although the illusion refers to a region of space, which is invisible due to occlusion (a blind spot), there is evidence to suggest that it is nevertheless driven by visual mechanisms and that it can be just as deceptive and powerful as ordinary visual illusions. We suggest that this novel illusion can make situations involving blind spots in a road user's field of view even more dangerous than one would expect based on the lack of visibility by itself. This could be because it erroneously makes the road user feel that (s)he has actually seen everything there is to see, and thus has verified that the blind spot is empty. This hypothesis requires further testing before definitive conclusions can be drawn, but we wish to make researchers and authorities involved in the analysis of traffic accidents and on-the-spot crash investigations aware of its potential role in order to encourage registration of relevant data and facilitate further research.

How Visual Perception of the Inside of Things Creates the Impossible Dovetail.

Here, we consider a well-known wooden puzzle known as the impossible dovetail. We argue that an intriguing form of amodal completion, dealing with spontaneous interpretations of the inside of objects is the key to understanding why people find it difficult to see how the impossible dovetail is indeed possible.

Enhanced spatial navigation skills in sequence-space synesthetes.

Individuals with sequence-space synesthesia (SSS) perceive sequences like months, days and numbers in certain spatial arrangements. Several cognitive benefits have been associated with SSS, such as enhanced mental rotation, more vivid visual imagery and an advantage in spatial processing. The current study aimed to further investigate these cognitive benefits, focusing on spatial navigation skills, to explore if their enhanced sensitivity to spatial relations is reflected in enhanced navigational performance. Synesthetes were distinguished from controls by means of a questionnaire, a consistency test and drawings. A virtual Morris Water Maze (MWM) task with two allocentric and two egocentric navigation conditions was used to assess spatial navigation abilities. For the allocentric tasks, participants had to use object cues to find a hidden platform and for the egocentric tasks, they had to use their own position as a reference. Results showed that synesthetes performed significantly better compared to controls on the allocentric and egocentric tasks that reflected real life situations more accurately. However, this significant result was only found for the time taken to find the platform and not for the length of the path that was taken. In exploratory analyses, no significant relations were found between task performance and the specific features of the manifestation of each individual's synesthesia. Our hypothesis that synesthetes with the ability to mentally rotate their spatial arrangements would perform better on the allocentric task was not confirmed. Results add to the growing body of literature concerning the cognitive benefits of SSS and are consistent with the possibility that enhanced spatial navigation skills emerge from generally enhanced visuospatial abilities in SSS.

The Relation Between Autistic Traits, the Degree of Synaesthesia, and Local/Global Visual Perception.

Synaesthesia is highly prevalent in autism spectrum disorder. We assessed the relation between the degree of autistic traits (Autism Spectrum Quotient, AQ) and the degree of synaesthesia in a neurotypical population, and hypothesized both are related to a local bias in visual perception. A positive correlation between total AQ scores and the degree of synaesthesia was found, extending previous studies in clinical populations. Consistent with our hypothesis, AQ-attention to detail scores were related to increased performance on an Embedded Figures Task and reduced susceptibility to visual illusions. We found no relation between autistic traits and performance on a motion coherence task, and no relation between synaesthesia and local visual perception. Possibly, this relation is reserved for supra-threshold synaesthetes.

Evidence for confounding eye movements under attempted fixation and active viewing in cognitive neuroscience.

Eye movements can have serious confounding effects in cognitive neuroscience experiments. Therefore, participants are commonly asked to fixate. Regardless, participants will make so-called fixational eye movements under attempted fixation, which are thought to be necessary to prevent perceptual fading. Neural changes related to these eye movements could potentially explain previously reported neural decoding and neuroimaging results under attempted fixation. In previous work, under attempted fixation and passive viewing, we found no evidence for systematic eye movements. Here, however, we show that participants' eye movements are systematic under attempted fixation when active viewing is demanded by the task. Since eye movements directly affect early visual cortex activity, commonly used for neural decoding, our findings imply alternative explanations for previously reported results in neural decoding.

Autistic traits in synaesthesia: atypical sensory sensitivity and enhanced perception of details.

In synaesthetes, specific sensory stimuli (e.g. black letters) elicit additional experiences (e.g. colour). Synaesthesia is highly prevalent among individuals with autism spectrum disorder (ASD), but the mechanisms of this co-occurrence are not clear. We hypothesized autism and synaesthesia share atypical sensory sensitivity and perception. We assessed autistic traits, sensory sensitivity and visual perception in two synaesthete populations. In Study 1, synaesthetes (N = 79, of different types) scored higher than non-synaesthetes (N = 76) on the Attention-to-detail and Social skills subscales of the autism spectrum quotient indexing autistic traits, and on the Glasgow Sensory Questionnaire indexing sensory hypersensitivity and hyposensitivity which frequently occur in autism. Synaesthetes performed two local/global visual tasks because individuals with autism typically show a bias towards detail processing. In synaesthetes, elevated motion coherence thresholds (MCTs) suggested reduced global motion perception, and higher accuracy on an embedded figures task suggested enhanced local perception. In Study 2, sequence-space synaesthetes (N = 18) completed the same tasks. Questionnaire and embedded figures results qualitatively resembled Study 1 results, but no significant group differences with non-synaesthetes (N = 20) were obtained. Unexpectedly, sequence-space synaesthetes had reduced MCTs. Altogether, our studies suggest atypical sensory sensitivity and a bias towards detail processing are shared features of synaesthesia and ASD. This article is part of the discussion meeting issue 'Bridging senses: novel insights from synaesthesia'.

Enhanced self-reported affect and prosocial behaviour without differential physiological responses in mirror-sensory synaesthesia.

Mirror-sensory synaesthetes mirror the pain or touch that they observe in other people on their own bodies. This type of synaesthesia has been associated with enhanced empathy. We investigated whether the enhanced empathy of people with mirror-sensory synesthesia influences the experience of situations involving touch or pain and whether it affects their prosocial decision making. Mirror-sensory synaesthetes (N = 18, all female), verified with a touch-interference paradigm, were compared with a similar number of age-matched control individuals (all female). Participants viewed arousing images depicting pain or touch; we recorded subjective valence and arousal ratings, and physiological responses, hypothesizing more extreme reactions in synaesthetes. The subjective impact of positive and negative images was stronger in synaesthetes than in control participants; the stronger the reported synaesthesia, the more extreme the picture ratings. However, there was no evidence for differential physiological or hormonal responses to arousing pictures. Prosocial decision making was assessed with an economic game assessing altruism, in which participants had to divide money between themselves and a second player. Mirror-sensory synaesthetes donated more money than non-synaesthetes, showing enhanced prosocial behaviour, and also scored higher on the Interpersonal Reactivity Index as a measure of empathy. Our study demonstrates the subjective impact of mirror-sensory synaesthesia and its stimulating influence on prosocial behaviour. This article is part of the discussion meeting issue 'Bridging senses: novel insights from synaesthesia'.

Neuroimaging Findings on Amodal Completion: A Review.

Amodal completion is the phenomenon of perceiving completed objects even though physically they are partially occluded. In this review, we provide an extensive overview of the results obtained from a variety of neuroimaging studies on the neural correlates of amodal completion. We discuss whether low-level and high-level cortical areas are implicated in amodal completion; provide an overview of how amodal completion unfolds over time while dissociating feedforward, recurrent, and feedback processes; and discuss how amodal completion is represented at the neuronal level. The involvement of low-level visual areas such as V1 and V2 is not yet clear, while several high-level structures such as the lateral occipital complex and fusiform face area seem invariant to occlusion of objects and faces, respectively, and several motor areas seem to code for object permanence. The variety of results on the timing of amodal completion hints to a mixture of feedforward, recurrent, and feedback processes. We discuss whether the invisible parts of the occluded object are represented as if they were visible, contrary to a high-level representation. While plenty of questions on amodal completion remain, this review presents an overview of the neuroimaging findings reported to date, summarizes several insights from computational models, and connects research of other perceptual completion processes such as modal completion. In all, it is suggested that amodal completion is the solution to deal with various types of incomplete retinal information, and highly depends on stimulus complexity and saliency, and therefore also give rise to a variety of observed neural patterns.

Decomposing Complexity Preferences for Music.

Recently, we demonstrated complexity as a major factor for explaining individual differences in visual preferences for abstract digital art. We have shown that participants could best be separated into two groups based on their liking ratings for abstract digital art comprising geometric patterns: one group with a preference for complex visual patterns and another group with a preference for simple visual patterns. In the present study, building up on these results, we extended our investigations for complexity preferences from highly controlled visual stimuli to ecologically valid stimuli in the auditory modality. Similar to visual preferences, we showed that music preferences are highly influenced by stimulus complexity. We demonstrated this by clustering a large number of participants based on their liking ratings for song excerpts from various musical genres. Our results show that, based on their liking ratings, participants can best be separated into two groups: one group with a preference for more complex songs and another group with a preference for simpler songs. Finally, we considered various demographic and personal characteristics to explore differences between the groups, and reported that at least for the current data set age and gender to be significant factors separating the two groups.

A Remarkable Depth Confusion in Images of the Incomplete Statues of Bruno Catalano.

Images of Bruno Catalano's sculptures of incomplete bodies give rise to a remarkable depth confusion in which the background is partly pushed to the front. We argue that this confusion is related to what happens in the Kanizsa square, although the effect in the images of Catalano's sculpture appears to be driven by knowledge-based processing.

No evidence for confounding orientation-dependent fixational eye movements under baseline conditions.

Decoding has become a standard analysis technique for contemporary cognitive neuroscience. Already more than a decade ago, it was shown that orientation information could be decoded from functional magnetic resonance imaging voxel time series. However, the underlying neural mechanism driving the decodable information is still under debate. Here, we investigated whether eye movements and pupil dilation during attempted fixation and passive viewing of visually presented square-wave grating stimuli could explain orientation decoding. We hypothesized that there are confounding orientation-dependent fixational eye movements (e.g., microsaccades), which systematically alter brain activity, and hence can be the source of decodable information. We repeated one of the original orientation decoding studies, but recorded eye movements instead of brain activity. We found no evidence that stimulus orientation can be decoded from eye movements under baseline conditions, but cannot rule out the potential confounding effect of eye movements under different conditions. With this study, we emphasize the importance, and show the implications of such potential confounding eye movements for decoding studies and cognitive neuroscience in general.

Temporal properties of amodal completion: Influences of knowledge.

We studied the influence of knowledge in the interpretation of partly occluded objects. In the past decades, amodal completion has often been studied by using abstract, meaningless outlines of rather stylistic, geometric shapes. It has been recognized that smooth continuation of partly occluded contours behind an occluding surface is a strong completion tendency. In the current study we contrast this structurally driven completion tendency with knowledge driven tendencies. We used a set of partly occluded well-known objects for which structure-based completions and knowledge-based completions resulted in either the same or different interpretations. We adopted the behavioural primed matching paradigm to measure differential priming effects due to these completion tendencies. Our results implied differential temporal properties for structure-based and knowledge-based effects during perception of partly occluded objects. Interestingly, knowledge has an influence as early as 150 ms after the onset of the prime.

Representations of naturalistic stimulus complexity in early and associative visual and auditory cortices.

The complexity of sensory stimuli has an important role in perception and cognition. However, its neural representation is not well understood. Here, we characterize the representations of naturalistic visual and auditory stimulus complexity in early and associative visual and auditory cortices. This is realized by means of encoding and decoding analyses of two fMRI datasets in the visual and auditory modalities. Our results implicate most early and some associative sensory areas in representing the complexity of naturalistic sensory stimuli. For example, parahippocampal place area, which was previously shown to represent scene features, is shown to also represent scene complexity. Similarly, posterior regions of superior temporal gyrus and superior temporal sulcus, which were previously shown to represent syntactic (language) complexity, are shown to also represent music (auditory) complexity. Furthermore, our results suggest the existence of gradients in sensitivity to naturalistic sensory stimulus complexity in these areas.

Effects of Auditory Patterns on Judged Displacements of an Occluded Moving Object.

Using displays in which a moving disk disappeared behind an occluder, we examined whether an accompanying auditory rhythm influenced the perceived displacement of the disk during occlusion. We manipulated a baseline rhythm, comprising a relatively fast alternation of equal sound and pause durations. We had two different manipulations to create auditory sequences with a slower rhythm: either the pause durations or the sound durations were increased. In the trial, a disk moved at a constant speed, and at a certain point moved behind an occluder during which an auditory rhythm was played. Participants were instructed to track the occluded disk, and judge the expected position of the disk at the moment that the auditory rhythm ended by touching the judged position on a touch screen. We investigated the influence of the auditory rhythm, i.e., ratio of sound to pause duration, and the influence of auditory density, i.e., the number of sound onsets per time unit, on the judged distance. The results showed that the temporal characteristics affected the spatial judgments. Overall, we found that in the current paradigm relatively slow rhythms led to shorter judged distance as compared to relatively fast rhythms for both pause and sound variations. There was no main effect of auditory density on the judged distance of an expected visual event. That is, whereas the speed of the auditory rhythm appears crucial, the number of sound onsets per time unit as such, i.e., the auditory density, appears a much weaker factor.

Distinguishing influences of overt and covert attention in anticipatory attentional target tracking.

This study investigated the relative contributions of overt and covert attention on the apparent anticipatory nature of attention in two experiments, using two different object tracking tasks, both combined with a probe detection task. In Experiment 1, we investigated the distribution of attention for overtly and covertly tracked targets separately at low tracking load using a single-object tracking task (one target, one distractor). We found anisotropic distributions of probe detection rates for both overtly tracked and covertly tracked targets, with highest detection rates at locations ahead of the target's movement. In Experiment 2, we investigated the distribution of attention in overt and covert tracking at a relatively higher tracking load using a multiple-object tracking task (two targets, two distractors) in which viewers overtly tracked one target while simultaneously covertly tracking a second target. We found anisotropic distributions of probe detection rates around covertly tracked targets only. We conclude that covert attention always anticipates motion when keeping track of moving objects, while overt attention is more flexible and its anticipatory nature depends on the tracking task.

Touching and Hearing Unseen Objects: Multisensory Effects on Scene Recognition.

In three experiments, we investigated the influence of object-specific sounds on haptic scene recognition without vision. Blindfolded participants had to recognize, through touch, spatial scenes comprising six objects that were placed on a round platform. Critically, in half of the trials, object-specific sounds were played when objects were touched (bimodal condition), while sounds were turned off in the other half of the trials (unimodal condition). After first exploring the scene, two objects were swapped and the task was to report, which of the objects swapped positions. In Experiment 1, geometrical objects and simple sounds were used, while in Experiment 2, the objects comprised toy animals that were matched with semantically compatible animal sounds. In Experiment 3, we replicated Experiment 1, but now a tactile-auditory object identification task preceded the experiment in which the participants learned to identify the objects based on tactile and auditory input. For each experiment, the results revealed a significant performance increase only after the switch from bimodal to unimodal. Thus, it appears that the release of bimodal identification, from audio-tactile to tactile-only produces a benefit that is not achieved when having the reversed order in which sound was added after having experience with haptic-only. We conclude that task-related factors other than mere bimodal identification cause the facilitation when switching from bimodal to unimodal conditions.