Continuous flash suppression: Manual action affects eye movements but not the reported percept.

Diverse paradigms, including ambiguous stimuli and mental imagery, have suggested a shared representation between motor and perceptual domains. We examined the effects of manual action on ambiguous perception in a continuous flash suppression (CFS) experiment. Specifically, we asked participants to try to perceive a suppressed grating while rotating a manipulandum. In one condition, the grating's motion was fully controlled by the manipulandum movement; in another condition the coupling was weak; and in a third condition, no movement was executed. We found no effect of the movement condition on the subjectively reported visibility of the grating, which is in contrast to previous studies that allowed for more top-down influence. However, we did observe an effect on eye movements: the gain of the optokinetic nystagmus induced by the grating was modulated by its coupling to the manual movement. Our results (a) indicate that action-to-perception transfer can occur on different levels of perceptual organization, (b) demonstrate that CFS involves the shared representations between action and perception differently than paradigms used in earlier studies, and

No effect of delay on the spatial representation of serial reach targets.

When reaching for remembered target locations, it has been argued that the brain primarily relies on egocentric metrics and especially target position relative to gaze when reaches are immediate, but that the visuo-motor system relies stronger on allocentric (i.e., object-centered) metrics when a reach is delayed. However, previous reports from our group have shown that reaches to single remembered targets are represented relative to gaze, even when static visual landmarks are available and reaches are delayed by up to 12 s. Based on previous findings which showed a stronger contribution of allocentric coding in serial reach planning, the present study aimed to determine whether delay influences the use of a gaze-dependent reference frame when reaching to two remembered targets in a sequence after a delay of 0, 5 or 12 s. Gaze was varied relative to the first and second target and shifted away from the target before each reach. We found that participants used egocentric and allocentric reference frames in combination with a stronger reliance on allocentric information regardless of whether reaches were executed immediately or after a delay. Our results suggest that the relative contributions of egocentric and allocentric reference frames for spatial coding and updating of sequential reach targets do not change with a memory delay between target presentation and reaching.

How visuomotor predictability and task demands affect tactile sensitivity on a moving limb during object interaction in a virtual environment.

Tactile sensitivity is decreased on a moving limb compared to the same static limb. This tactile suppression likely reflects an interplay between sensorimotor predictions and sensory feedback. Here, we examined how visuomotor predictability influences tactile suppression. Participants were instructed to hit an approaching virtual object, with the object either never rotating, or always rotating, or rotating unpredictably, prompting related movement adjustments. We probed tactile suppression by delivering a vibrotactile stimulus of varying intensities to the moving hand briefly after the object's rotation and asked participants to indicate if they had felt a vibration. We hypothesized that Unpredictable Rotations would require upweighting of somatosensory feedback from the hand and therefore decrease suppression. Instead, we found stronger suppression with unpredictable than Predictable Rotations. This finding persisted even when visual input from the moving hand was removed and participants had to rely solely on somatosensory feedback of their hand. Importantly, we found a correlation between task demand and tactile suppression in both experiments, indicating that task load can amplify tactile suppression, possibly by downweighting task-irrelevant somatosensory feedback signals to allow for successful task performance when visuomotor task demands are high.

Salience-based object prioritization during active viewing of naturalistic scenes in young and older adults.

Whether fixation selection in real-world scenes is guided by image salience or by objects has been a matter of scientific debate. To contrast the two views, we compared effects of location-based and object-based visual salience in young and older (65 + years) adults. Generalized linear mixed models were used to assess the unique contribution of salience to fixation selection in scenes. When analysing fixation guidance without recurrence to objects, visual salience predicted whether image patches were fixated or not. This effect was reduced for the elderly, replicating an earlier finding. When using objects as the unit of analysis, we found that highly salient objects were more frequently selected for fixation than objects with low visual salience. Interestingly, this effect was larger for older adults. We also analysed where viewers fixate within objects, once they are selected. A preferred viewing location close to the centre of the object was found for both age groups. The results support the view that objects are important units of saccadic selection. Reconciling the salience view with the object view, we suggest that visual salience contributes to prioritization among objects. Moreover, the data point towards an increasing relevance of object-bound information with increasing age.

Visual Awareness in Binocular Rivalry Modulates Induced Pupil Fluctuations.

When a visual stimulus oscillates in luminance, pupil size follows this oscillation. Recently, it has been demonstrated that such induced pupil oscillations can be used to tag which stimulus is covertly attended. Here we ask whether this "pupil frequency tagging" approach can be extended to visual awareness, specifically to inferring perceptual dominance in Binocular Rivalry between complex stimuli. We presented two distinct stimuli, a face and a house, to each eye and modulated their luminance at 1.7 Hz either in counter-phase (180° phase shift), with a 90° phase shift or in phase (0° control). In some conditions, we additionally asked observers to attend either of the stimuli. The luminance modulation was sufficiently subtle that rivalry dynamics did not differ among these conditions, and was also indistinguishable from unmodulated presentation of the stimuli. For the 180° and the 90° phase-shifted stimuli, we found that the phase of the pupil response relative to the stimuli was modulated by perceptual dominance; that is, the relative phase depended on the stimulus the observer was aware of. In turn, this perceptually dominant stimulus could be decoded from the phase of the pupil response significantly above chance. Neither percept dependence of the phase nor significant decoding was found for the 0° control condition. Our results show that visual awareness modulates pupil responses and provide proof of principle that dominance in rivalry for complex stimuli can be inferred from induced pupil fluctuations.

How Well Can Saliency Models Predict Fixation Selection in Scenes Beyond Central Bias? A New Approach to Model Evaluation Using Generalized Linear Mixed Models.

Since the turn of the millennium, a large number of computational models of visual salience have been put forward. How best to evaluate a given model's ability to predict where human observers fixate in images of real-world scenes remains an open research question. Assessing the role of spatial biases is a challenging issue; this is particularly true when we consider the tendency for high-salience items to appear in the image center, combined with a tendency to look straight ahead ("central bias"). This problem is further exacerbated in the context of model comparisons, because some-but not all-models implicitly or explicitly incorporate a center preference to improve performance. To address this and other issues, we propose to combine a-priori parcellation of scenes with generalized linear mixed models (GLMM), building upon previous work. With this method, we can explicitly model the central bias of fixation by including a central-bias predictor in the GLMM. A second predictor captures how well the saliency model predicts human fixations, above and beyond the central bias. By-subject and by-item random effects account for individual differences and differences across scene items, respectively. Moreover, we can directly assess whether a given saliency model performs significantly better than others. In this article, we describe the data processing steps required by our analysis approach. In addition, we demonstrate the GLMM analyses by evaluating the performance of different saliency models on a new eye-tracking corpus. To facilitate the application of our method, we make the open-source Python toolbox "GridFix" available.

Allocentric information is used for memory-guided reaching in depth: A virtual reality study.

Previous research has demonstrated that humans use allocentric information when reaching to remembered visual targets, but most of the studies are limited to 2D space. Here, we study allocentric coding of memorized reach targets in 3D virtual reality. In particular, we investigated the use of allocentric information for memory-guided reaching in depth and the role of binocular and monocular (object size) depth cues for coding object locations in 3D space. To this end, we presented a scene with objects on a table which were located at different distances from the observer and served as reach targets or allocentric cues. After free visual exploration of this scene and a short delay the scene reappeared, but with one object missing (=reach target). In addition, the remaining objects were shifted horizontally or in depth. When objects were shifted in depth, we also independently manipulated object size by either magnifying or reducing their size. After the scene vanished, participants reached to the remembered target location on the blank table. Reaching endpoints deviated systematically in the direction of object shifts, similar to our previous results from 2D presentations. This deviation was stronger for object shifts in depth than in the horizontal plane and independent of observer-target-distance. Reaching endpoints systematically varied with changes in object size. Our results suggest that allocentric information is used for coding targets for memory-guided reaching in depth. Thereby, retinal disparity and vergence as well as object size provide important binocular and monocular depth cues.

Gaze-centered spatial updating of reach targets across different memory delays.

Previous research has demonstrated that remembered targets for reaching are coded and updated relative to gaze, at least when the reaching movement is made soon after the target has been extinguished. In this study, we want to test whether reach targets are updated relative to gaze following different time delays. Reaching endpoints systematically varied as a function of gaze relative to target irrespective of whether the action was executed immediately or after a delay of 5 s, 8 s or 12 s. The present results suggest that memory traces for reach targets continue to be coded in a gaze-dependent reference frame if no external cues are present.