The influence of spatial and temporal attention on visual awareness-a behavioral and ERP study.

Whether attention is a prerequisite of perceptual awareness or an independent and dissociable process remains a matter of debate. Importantly, understanding the relation between attention and awareness is probably not possible without taking into account the fact that both are heterogeneous and multifaceted mechanisms. Therefore, the present study tested the impact on visual awareness of two attentional mechanisms proposed by the Posner model: temporal alerting and spatio-temporal orienting. Specifically, we evaluated the effects of attention on the perceptual level, by measuring objective and subjective awareness of a threshold-level stimulus; and on the neural level, by investigating how attention affects two postulated event-related potential correlates of awareness. We found that alerting and orienting mechanisms additively facilitate perceptual consciousness, with activation of the latter resulting in the most vivid awareness. Furthermore, we found that late positivity is unlikely to constitute a neural correlate of consciousness as its amplitude was modulated by both attentional mechanisms, but early visual awareness negativity was independent of the alerting and orienting mechanisms. In conclusion, our study reveals a nuanced relationship between attention and awareness; moreover, by investigating the effect of the alerting mechanism, this study provides insights into the role of temporal attention in perceptual consciousness.

Continuous Theta Burst Stimulation to the left anterior medial prefrontal cortex influences metacognitive efficiency.

The contribution of the prefrontal areas to visual awareness is critical for the Global Neuronal Workspace Theory and higher-order theories of consciousness. The goal of the present study was to test the potential engagement of the anterior medial prefrontal cortex (aMPFC) in visual awareness judgements. We aimed to temporarily influence the neuronal dynamics of the left aMPFC via neuroplasticity-like mechanisms. We used different Theta Burst Stimulation (TBS) protocols in combination with a visual identification task and visual awareness ratings. Either continuous TBS (cTBS), intermittent TBS (iTBS), or sham TBS was applied prior to the experimental paradigm in a within-participant design. Compared with sham TBS, we observed an increase in participants' ability to judge their perception adequately (metacognitive efficiency) following cTBS but not iTBS. The effect was accompanied by lower visual awareness ratings in incorrect responses. No significant differences in the identification task performance were observed. We interpret these results as evidence of the involvement of PFC in the brain network that underlies metacognition. Further, we discuss whether the results of TMS studies on perceptual metacognition can be taken as evidence for PFC involvement in awareness itself.

Splitting the Unity of Bodily Self: Toward a Comprehensive Review of Phenomenology and Psychopathology of Heautoscopy.

BACKGROUND: Heautoscopy refers to a pathological experience of visual reduplication of one's body with an ambiguous sense of self-location and a disturbing sensation of owning the illusory body. It has been recognized to occur in the course of strikingly diverse psychiatric and neurological disorders, such as schizophrenia, space-occupying lesions, frequently of the temporal or parietal lobes, migraine, epilepsy, and depression. The literature on the subject suffers from numerous conceptual inconsistencies, scarcity of clinical data, and a lack of theoretical integratory framework that could explain the uniqueness of these symptoms. AIMS: In the study, we aimed to review all case reports on heautoscopy we could cull from the literature with an attempt to extract common factors and to foster a theoretical synthesis. METHODS: All medical and psychological databases were rigorously searched, along with reference lists of the preselected articles. First-person reports were classified according to aspects of bodily self-consciousness primarily affected: body ownership, self-location, sense of agency and consequently, collated with their etiological backgrounds. RESULTS: Out of over 140 case studies, a total of only 9 patients with heautoscopy were selected as satisfying functional criteria, carefully distinguishing heautoscopy from other typically conflated full-body anomalies: autoscopy, out-of-body experience, or feeling of presence. Numerous cases turned out to be mislabeling autoscopy or out-of-body experience as heautoscopy. In addition, several problems with existing neuroimaging experiments were identified. CONCLUSION: Phenomenological analysis revealed that from the patients' perspective, heautoscopy resembles a somatesthetic-proprioceptive illusion, rather than a cognitive delusion, and occurs much less frequently than reported. A most peculiar symptom, described by some as a sense of "bilocation," appears to stem from dynamic shifts in self-location and expanded body ownership, rather than an expanded first-person perspective. Although extremely rare in its pure form, heautoscopy gives a unique opportunity to explore the brain limits to the plasticity of bodily boundaries and the origin of the first-person spatial perspective.

Modelling human vision needs to account for subjective experience.

Vision is inseparably connected to perceptual awareness which can be seen as the culmination of sensory processing. Studies on conscious vision reveal that object recognition is just one of the means through which our representation of the world is built. We propose an operationalization of subjective experience in the context of deep neural networks (DNNs) that could encourage a more thorough comparison of human and artificial vision.

Sensory attenuation of action outcomes of varying amplitude and valence.

Stimuli caused by self-initiated actions are perceived as less intense than those caused externally; this effect is called sensory attenuation (SA). In two experiments, we aimed to assess the impact of the amplitude of outcomes and its affective valence on SA and explicit ratings of sense of agency. This allowed us to test the predictions of the available SA frameworks and better understand the link between SA, affect, and agency. The results indicated that SA can be reversed, and such sensory amplification is driven by low-amplitude and positive-valence outcomes. We also show that intentional action influences the perceived valence of outcomes, and that modulations of explicit sense of agency are divergent from those of SA. Our study shows that valence influences the processing of the amplitude of intentional action outcomes and suggests that none of the currently available frameworks give full justice to SA's variability.

Investigating the validity of the Perceptual Awareness Scale - The effect of task-related difficulty on subjective rating.

The Perceptual Awareness Scale (PAS) is often used to probe conscious experience, but the assumptions behind the scale and its validity are rarely tested. Using a continuous colour estimation task to assess perceptual quality, we focus on how well PAS follows perceptual quality and how the presence of the estimation task affects PAS ratings. We varied the number and presentation time of stimuli in a simultaneous presentation and target position in a sequential presentation. In all experiments, PAS rating closely followed colour precision. However, it was affected by task-induced response bias, even when the possible task difficulty was judged, without performing the task itself. Still, this bias was only observed on the absolute rating level rather than the scale's ability to capture changes in perceptual quality. Reported studies shed light on factors influencing scales outside of the scale formulation and construction.

Colorophone 2.0: A Wearable Color Sonification Device Generating Live Stereo-Soundscapes-Design, Implementation, and Usability Audit.

The successful development of a system realizing color sonification would enable auditory representation of the visual environment. The primary beneficiary of such a system would be people that cannot directly access visual information-the visually impaired community. Despite the plethora of sensory substitution devices, developing systems that provide intuitive color sonification remains a challenge. This paper presents design considerations, development, and the usability audit of a sensory substitution device that converts spatial color information into soundscapes. The implemented wearable system uses a dedicated color space and continuously generates natural, spatialized sounds based on the information acquired from a camera. We developed two head-mounted prototype devices and two graphical user interface (GUI) versions. The first GUI is dedicated to researchers, and the second has been designed to be easily accessible for visually impaired persons. Finally, we ran fundamental usability tests to evaluate the new spatial color sonification algorithm and to compare the two prototypes. Furthermore, we propose recommendations for the development of the next iteration of the system.

Visual Echolocation Concept for the Colorophone Sensory Substitution Device Using Virtual Reality.

Detecting characteristics of 3D scenes is considered one of the biggest challenges for visually impaired people. This ability is nonetheless crucial for orientation and navigation in the natural environment. Although there are several Electronic Travel Aids aiming at enhancing orientation and mobility for the blind, only a few of them combine passing both 2D and 3D information, including colour. Moreover, existing devices either focus on a small part of an image or allow interpretation of a mere few points in the field of view. Here, we propose a concept of visual echolocation with integrated colour sonification as an extension of Colorophone-an assistive device for visually impaired people. The concept aims at mimicking the process of echolocation and thus provides 2D, 3D and additionally colour information of the whole scene. Even though the final implementation will be realised by a 3D camera, it is first simulated, as a proof of concept, by using VIRCO-a Virtual Reality training and evaluation system for Colorophone. The first experiments showed that it is possible to sonify colour and distance of the whole scene, which opens up a possibility to implement the developed algorithm on a hardware-based stereo camera platform. An introductory user evaluation of the system has been conducted in order to assess the effectiveness of the proposed solution for perceiving distance, position and colour of the objects placed in Virtual Reality.

Visual awareness judgments are sensitive to accuracy feedback in stimulus discrimination tasks.

In this study we tested the hypothesis that perceptual awareness judgments are sensitive to accuracy feedback about the previous action. We used a perceptual discrimination task in which participants reported their stimulus awareness. We created two conditions: No-feedback and Feedback (discrimination accuracy feedback was provided at the end of each trial). The results showed that visual awareness judgments are related to the accuracy of current and previous responses. Participants reported lower stimulus awareness for incorrectly versus correctly discriminated stimuli in both conditions; they also reported lower stimulus awareness in trials preceded by incorrect discrimination responses, compared to trials preceded by correct discrimination responses. This difference was significantly stronger in the Feedback condition, in which we also observed post-error slowing for PAS ratings. We discuss the relation between visual awareness and the effects of performance monitoring and interpret the results in the context of current theories of consciousness.

Comparing theories of consciousness: Object position, not probe modality, reliably influences experience and accuracy in object recognition tasks.

People often claim seeing images completely despite performing poorly. This highlights an issue with conscious representations. We introduce an experimental manipulation aiming to disentangle two prevalent positions: Rich views posit that people virtually represent the external world with unlimited capacity; Sparse views state that representations are reconstructed from expectations and information. In two experiments using the object recognition task, we tested two probe types: Images, which should aid reconstruction more, and Words, which should aid it less. From a sparse view, one should expect that Images lead to greater accuracy and reported experience. We found no reliable differences in accuracy and reported experience across probe types; however, we observed that the object positions influenced both accuracy and reported experience, which is surprising from a Rich view as it seemingly requires assumptions of different access across the visual field. Both theoretical positions thus currently need further development to explain our results.

In search of the optimal measure of awareness: Discrete or continuous?

Studies of perceptual awareness require sensitive measures reflecting subjective judgments of visibility. Two scales have been proposed for this purpose: the Continuous Scale (CS) and the Perceptual Awareness Scale (PAS). Here we compare the scales in the context of the Gabor patch orientation discrimination task and propose a Continuous Perceptual Awareness Scale (C-PAS) that aims to combine their advantages. The results of the study shown no differences in sensitivity between the scales. However, we observed differences between the scales in awareness ratings frequencies and accuracy associated with the lowest ratings. We concluded that visibility ratings are often biased, and thus, the scale sensitivity may not be optimal. Furthermore, based on the additional analyses, we argued that there is an advantage of using C-PAS over CS. The scale allows to use an additional variability of judgment within PAS categories and thus it may enable more fine-grained measurement of visibility at near-threshold conditions.

Motor response influences perceptual awareness judgements.

What is the relation between perceptual awareness and action? In this study we tested the hypothesis that motor response influences perceptual awareness judgements. We used a perceptual discrimination task in which presentation of the stimulus was immediately followed by a cue requiring a motor response that was irrelevant to the task but could be the same, opposite, or neutral to the correct response to the stimulus. After responding to the cue, participants rated their stimulus awareness using the Perceptual Awareness Scale, and then carried out their discrimination response. Participants reported a higher level of stimulus awareness after carrying out responses that were either congruent or incongruent with the response required by the stimulus, compared to the neutral condition. The results suggest that the motor response overlapping with a potential response to the stimulus provides information about the outcome of decision process and increases the reported awareness of stimuli.

The role of levels of processing in disentangling the ERP signatures of conscious visual processing.

We aimed to distinguish electrophysiological signatures of visual awareness from other task-related processes through manipulating the level of processing of visual stimuli. During an event-related EEG experiment, 36 subjects performed either color (low-level condition) or magnitude (high-level condition) evaluations of masked digits. Participants also assessed subjective visibility of each stimulus using the Perceptual Awareness Scale (PAS). Mean amplitude of the components of interest was analyzed (VAN - 140-240 ms; LP - 380-480 ms) with weighted regression mixed model. In the VAN component time window the mean amplitude correlated with PAS rating in both conditions. Mean amplitude in the LP time window correlated with PAS ratings in the high-level condition, but not in the low-level condition. Our results support the temporal unfolding of ERP makers of conscious processing, with an early component reflecting the initial perceptual experience and a late component being a correlate of the conscious experience of non-perceptual information.

Unexpected action outcomes produce enhanced temporal binding but diminished judgement of agency.

Sense of agency (SoA) is the feeling of being the author of given actions and their effects. Recent works have investigated the cue integration approach to agency, according to which different predictive and inferential cues form SoA. In the current research we focus on how two such cues, i.e. accuracy of sensorimotor prediction and prior causal belief, influence SoA measured by temporal binding (TB) and questionnaires. Our results show that whereas learnt action effects produce normal TB and explicit agency, unexpected oddball effects produce enhanced TB but diminished explicit agency. Increased binding was modulated by temporal prediction, but not by identity prediction. A few interpretations of the results are given, including cue integration and pre-activation mechanisms. The research casts new light on the mechanisms and dynamics of TB and adds to the evidence for discrepancies between SoA measures.

Does level of processing affect the transition from unconscious to conscious perception?

Recently, Windey, Gevers, and Cleeremans (2013) proposed a level of processing (LoP) hypothesis claiming that the transition from unconscious to conscious perception is influenced by the level of processing imposed by task requirements. Here, we carried out two experiments to test the LoP hypothesis. In both, participants were asked to classify briefly presented pairs of letters as same or different, based either on the letters' physical features (a low-level task), or on a semantic rule (a high-level task). Stimulus awareness was measured by means of the four-point Perceptual Awareness Scale (PAS). The results showed that low or moderate stimulus visibility was reported more frequently in the low-level task than in the high-level task, suggesting that the transition from unconscious to conscious perception is more gradual in the former than in the latter. Therefore, although alternative interpretations remain possible, the results of the present study fully support the LoP hypothesis.

Different subjective awareness measures demonstrate the influence of visual identification on perceptual awareness ratings.

We compare four subjective awareness measures in the context of a visual identification task and investigate quantitative differences in terms of scale use and correlation with task performance. We also analyse the effect of identification task decisions on subsequent subjective reports. Results show that awareness ratings strongly predict accuracy for all scale types, although the type of awareness measure may influence the reported level of perceptual awareness. Surprisingly, the overall relationship between awareness ratings and performance was weaker when participants rated their awareness before providing identification responses. Furthermore, the Perceptual Awareness Scale was most exhaustive only when used after the identification task, whereas confidence ratings were most exhaustive when used before the identification task. We conclude that the type of subjective measure applied may influence the reports on visual awareness. We also propose that identification task decisions may affect subsequent awareness ratings.

The perception of visual emotion: comparing different measures of awareness.

Here, we explore the sensitivity of different awareness scales in revealing conscious reports on visual emotion perception. Participants were exposed to a backward masking task involving fearful faces and asked to rate their conscious awareness in perceiving emotion in facial expression using three different subjective measures: confidence ratings (CRs), with the conventional taxonomy of certainty, the perceptual awareness scale (PAS), through which participants categorize "raw" visual experience, and post-decision wagering (PDW), which involves economic categorization. Our results show that the CR measure was the most exhaustive and the most graded. In contrast, the PAS and PDW measures suggested instead that consciousness of emotional stimuli is dichotomous. Possible explanations of the inconsistency were discussed. Finally, our results also indicate that PDW biases awareness ratings by enhancing first-order accuracy of emotion perception. This effect was possibly a result of higher motivation induced by monetary incentives.

Fusion of EEG and Eye Blink Analysis for Detection of Driver Fatigue.

OBJECTIVE: The driver fatigue detection using multi-channel electroencephalography (EEG) has been extensively addressed in the literature. However, the employment of a single prefrontal EEG channel should be prioritized as it provides users with more comfort. Furthermore, eye blinks from such channel can be analyzed as the complementary information. Here, we present a new driver fatigue detection method based on simultaneous EEG and eye blinks analysis using an Fp1 EEG channel. METHODS: First, the moving standard deviation algorithm identifies eye blink intervals (EBIs) to extract blink-related features. Second, the discrete wavelet transform filters the EBIs from the EEG signal. Third, the filtered EEG signal is decomposed into sub-bands, and various linear and nonlinear features are extracted. Finally, the prominent features are selected by the neighbourhood components analysis and fed to a classifier to discriminate between fatigue and alert driving. In this paper, two different databases are investigated. The first one is used for parameters' tuning of proposed method for the eye blink detection and filtering, nonlinear EEG measures, and feature selection. The second one is solely used for testing the robustness of the tuned parameters. MAIN RESULTS: The comparison between the obtained results from both databases by the AdaBoost classifier in terms of sensitivity (90.2% vs. 87.4%), specificity (87.7% vs. 85.5%), and accuracy (88.4% vs. 86.8%) indicates the reliability of the proposed method for the driver fatigue detection. SIGNIFICANCE: Considering the existence of commercial single prefrontal channel EEG headbands, the proposed method can be used to detect the driver fatigue in real-world scenarios.

Subjective measures of consciousness in artificial grammar learning task.

Consciousness can be measured in various ways, but different measures often yield different conclusions about the extent to which awareness relates to performance. Here, we compare five different subjective measures of awareness in the context of an artificial grammar learning task. Participants (N=217) expressed their subjective awareness of rules using one of five different scales: confidence ratings (CRs), post-decision wagering (PDW), feeling of warmth (FOW), rule awareness (RAS), and continuous scale (SDS). All scales were equally sensitive to conscious knowledge. PDW, however, was affected by risk aversion, and both RAS and SDS applied different minimal criteria for rule awareness. CR seems to capture the largest range of consciousness, but failed to indicate unconscious knowledge with the guessing criterion. We close by discussing the theoretical implications of scale sensitivity and propose that CR's unique features enable (in conjunction with RAS and FOW) a finer assessment of subjective states of awareness.

How much consciousness is there in complexity?

The notion of complexity currently receives significant attention in neuroscience, mainly through the popularity of the Integrated Information Theory (IIT). It has proven successful in research centred on discriminating states of consciousness, while little theoretical and experimental effort was directed toward studying the content. In this paper, we argue that exploring the relationship between complexity and conscious content is necessary to understand the importance of information-theoretic measures for consciousness research properly. We outline how content could be experimentally operationalised and how rudimental testable hypotheses can be formulated without requiring IIT formalisms. This approach would not only allow for a better understanding of aspects of consciousness captured by complexity but could also facilitate comparison efforts for theories of consciousness.