The role of attention in immersion: The two-competitor model.

Currently, we face an exponentially increasing interest in immersion, especially sensory-driven immersion, mainly due to the rapid development of ideas and business models centered around a digital virtual universe as well as the increasing availability of affordable immersive technologies for education, communication, and entertainment. However, a clear definition of 'immersion', in terms of established neurocognitive concepts and measurable properties, remains elusive, slowing research on the human side of immersive interfaces. To address this problem, we propose a conceptual, taxonomic model of attention in immersion. We argue (a) modeling immersion theoretically as well as studying immersion experimentally requires a detailed characterization of the role of attention in immersion, even though (b) attention, while necessary, cannot be a sufficient condition for defining immersion. Our broader goal is to characterize immersion in terms that will be compatible with established psychophysiolgical measures that could then in principle be used for the assessment and eventually the optimization of an immersive experience. We start from the perspective that immersion requires the projection of attention to an induced reality, and build on accepted taxonomies of different modes of attention for the development of our two-competitor model. The two-competitor model allows for a quantitative implementation and has an easy graphical interpretation. It helps to highlight the important link between different modes of attention and affect in studying immersion.

Multisensory perception of natural versus unnatural motion.

Previous research has shown that visual perception is influenced by Newtonian constraints. Kominsky et al. showed humans detect unnatural motion, where objects break Newtonian constraints by moving at a faster speed after colliding with another object, faster than collisions that do not violate Newtonian constraints. These findings show that the perceptual system distinguishes between realistic and unrealistic causal events. However, real-world collisions are rarely silent. The present study extends this research by including sound at the collision point between two objects to evaluate how multisensory integration influences the perception of natural versus unnatural colliding events. Participants viewed an array of three simultaneous videos, each depicting two objects moving in a horizontal back and forth motion. Two of the videos showed the objects moving at the same speed while the third video was an oddball that either moved faster before the collision and slower after (natural target), or slower before the collision and faster after (unnatural target). A brief click was presented at the collision point of one or none of the videos. Participants were asked to indicate the oddball video via keypress. Replicating Kominsky et al., participants were faster when identifying unnatural target motion events compared with natural target motion events, both with and without sound. The findings also demonstrated lower accuracy rates for unnatural events compared with natural events, especially when a sound was added. These findings suggest that the addition of a sound could be distracting to participants, possibly due to limitations in attentional resources.

Sound-modulations of visual motion perception implicate the cortico-vestibular brain.

A widely used example of the intricate (yet poorly understood) intertwining of multisensory signals in the brain is the audiovisual bounce inducing effect (ABE). This effect presents two identical objects moving along the azimuth with uniform motion and towards opposite directions. The perceptual interpretation of the motion is ambiguous and is modulated if a transient (sound) is presented in coincidence with the point of overlap of the two objects' motion trajectories. This phenomenon has long been written-off to simple attentional or decision-making mechanisms, although the neurological underpinnings for the effect are not well understood. Using behavioural metrics concurrently with event-related fMRI, we show that sound-induced modulations of motion perception can be further modulated by changing motion dynamics of the visual targets. The phenomenon engages the posterior parietal cortex and the parieto-insular-vestibular cortical complex, with a close correspondence of activity in these regions with behaviour. These findings suggest that the insular cortex is engaged in deriving a probabilistic perceptual solution through the integration of multisensory data.

Ageing and selective inhibition of irrelevant information in an attention-demanding rapid serial visual presentation task.

Attention involves both an ability to selectively focus on relevant information and simultaneously ignore irrelevant information (i.e. inhibitory control). Many factors impact inhibitory control such as individual differences, relative timing of stimuli presentation, distractor characteristics, and participant age. Previous research with young adults responding to an attention-demanding rapid serial visual presentations of pictures superimposed with task-irrelevant words evaluated the extent to which unattended information may be subject to inhibitory control. Surprise recognition tests following the rapid serial visual presentation task showed that recognition for unattended words presented with non-targets (i.e. non-aligned or 'NA' words) during the rapid serial visual presentation task were recognised at chance levels. However, when the unattended words were infrequently paired with the attended picture targets (i.e. target-aligned or 'TA' words), recognition rates were significantly below chance and significantly lower compared to NA words, suggesting selective inhibitory control for the previously unattended TA words. The current study adapted this paradigm to compare healthy younger and older adults' ability to engage in inhibitory control. In line with previous research, younger adults demonstrated selective inhibition with recognition rates for TA words significantly lower than NA words and chance, while NA words were recognised at chance levels. However, older adults showed no difference in recognition rates between word types (TA versus NA). Rather all items were recognised at rates significantly below chance suggesting inhibited recognition for all unattended words, regardless of when they were presented during the primary task. Finally, older adults recognised significantly fewer NA words compared to young adults. These findings suggest that older adults may experience a decline in their ability to selectively inhibit the processing of irrelevant information, while maintaining the capacity to exercise global inhibition over unattended lexical information.

Mindful awareness moderates the association between psychological inflexibility and distress variables: A cross-sectional investigation.

OBJECTIVE: Informed by the contextual behavioral science (CBS) model of behavioral health, the present cross-sectional study examined whether mindful awareness moderated the associations between psychological inflexibility and four distress variables. PARTICIPANTS: Cross-sectional data were collected from 402 ethnically diverse undergraduate college students from September 2015 to October 2015. METHODS: Participants competed an online self-report survey. RESULTS: Mindful awareness moderated the associations between psychological inflexibility and distress variables, with stronger associations for somatization and anxiety, and weaker associations for general distress and depression. Specifically, the strength of the positive associations between psychological inflexibility and these distress variables were substantially greater among those low in mindful awareness. CONCLUSION: These findings suggest that a greater degree of mindful awareness may buffer the effects of psychological inflexibility on distress variables, particularly somatization and anxiety. Theoretical and applied implications as well as limitations of the study are discussed.

Fast variational alignment of non-flat 1D displacements for applications in neuroimaging.

BACKGROUND: In the context of signal analysis and pattern matching, alignment of 1D signals for the comparison of signal morphologies is an important problem. For image processing and computer vision, 2D optical flow (OF) methods find wide application for motion analysis and image registration and variational OF methods have been continuously improved over the past decades. NEW METHOD: We propose a variational method for the alignment and displacement estimation of 1D signals. We pose the estimation of non-flat displacements as an optimization problem with a similarity and smoothness term similar to variational OF estimation. To this end, we can make use of efficient optimization strategies that allow real-time applications on consumer grade hardware. RESULTS: We apply our method to two applications from functional neuroimaging: The alignment of 2-photon imaging line scan recordings and the denoising of evoked and event-related potentials in single trial matrices. We can report state of the art results in terms of alignment quality and computing speeds. EXISTING METHODS: Existing methods for 1D alignment target mostly constant displacements, do not allow native subsample precision or precise control over regularization or are slower than the proposed method. CONCLUSIONS: Our method is implemented as a MATLAB toolbox and is online available. It is suitable for 1D alignment problems, where high accuracy and high speed is needed and non-constant displacements occur.

Cutaneous saltation within and across arms: a new measure of the saltation illusion in somatosensation.

A new objective procedure was used to measure the strength of cutaneous saltation, in order to clarify current debates about the nature of this illusion. Three taps were presented successively to three possible forearm locations. Participants attended to the middle location and reported whether a tap was perceived there. When all stimuli were delivered to the same arm and intertap intervals were short, participants were unable to distinguish real and illusory stimuli at the middle location. When both arms were stimulated, location judgments on one arm were shifted toward a tap subsequently delivered to the other arm. These results challenge the view that saltation is a purely attentional phenomenon, but they are inconsistent with the idea that this illusion is produced in the primary somatosensory cortex.