A new 'CFS tracking' paradigm reveals uniform suppression depth regardless of target complexity or salience.

When the eyes view separate and incompatible images, the brain suppresses one image and promotes the other into visual awareness. Periods of interocular suppression can be prolonged during continuous flash suppression (CFS) - when one eye views a static 'target' while the other views a complex dynamic stimulus. Measuring the time needed for a suppressed image to break CFS (bCFS) has been widely used to investigate unconscious processing, and the results have generated controversy regarding the scope of visual processing without awareness. Here, we address this controversy with a new 'CFS tracking' paradigm (tCFS) in which the suppressed monocular target steadily increases in contrast until breaking into awareness (as in bCFS) after which it decreases until it again disappears (reCFS), with this cycle continuing for many reversals. Unlike bCFS, tCFS provides a measure of suppression depth by quantifying the difference between breakthrough and suppression thresholds. tCFS confirms that (i) breakthrough thresholds indeed differ across target types (e.g. faces vs gratings, as bCFS has shown) - but (ii) suppression depth does not vary across target types. Once the breakthrough contrast is reached for a given stimulus, all stimuli require a strikingly uniform reduction in contrast to reach the corresponding suppression threshold. This uniform suppression depth points to a single mechanism of CFS suppression, one that likely occurs early in visual processing because suppression depth was not modulated by target salience or complexity. More fundamentally, it shows that variations in bCFS thresholds alone are insufficient for inferring whether the barrier to achieving awareness exerted by interocular suppression is weaker for some categories of visual stimuli compared to others.

Binocular rivalry under naturalistic geometry: Evidence from worlds simulated in virtual reality.

Binocular rivalry is a fascinating, widely studied visual phenomenon in which perception alternates between two competing images. This experience, however, is generally restricted to laboratory settings where two irreconcilable images are presented separately to the two eyes, an implausible geometry where two objects occupy the same physical location. Such laboratory experiences are in stark contrast to everyday visual behavior, where rivalry is almost never encountered, casting doubt on whether rivalry is relevant to our understanding of everyday binocular vision. To investigate the external validity of binocular rivalry, we manipulated the geometric plausibility of rival images using a naturalistic, cue-rich, 3D-corridor model created in virtual reality. Rival stimuli were presented in geometrically implausible, semi-plausible, or plausible layouts. Participants tracked rivalry fluctuations in each of these three layouts and for both static and moving rival stimuli. Results revealed significant and canonical binocular rivalry alternations regardless of geometrical plausibility and stimulus type. Rivalry occurred for layouts that mirrored the unnatural geometry used in laboratory studies and for layouts that mimicked real-world occlusion geometry. In a complementary 3D modeling analysis, we show that interocular conflict caused by geometrically plausible occlusion is a common outcome in a visual scene containing multiple objects. Together, our findings demonstrate that binocular rivalry can reliably occur for both geometrically implausible interocular conflicts and conflicts caused by a common form of naturalistic occlusion. Thus, key features of binocular rivalry are not simply laboratory artifacts but generalize to conditions that match the geometry of everyday binocular vision.

Audiovisual interactions outside of visual awareness during motion adaptation.

Motion aftereffects (MAEs), illusory motion experienced in a direction opposed to real motion experienced during prior adaptation, have been used to assess audiovisual interactions. In a previous study from our laboratory, we demonstrated that a congruent direction of auditory motion presented concurrently with visual motion during adaptation strengthened the consequent visual MAE, compared to when auditory motion was incongruent in direction. Those judgments of MAE strength, however, could have been influenced by expectations or response bias from mere knowledge of the state of audiovisual congruity during adaptation. To prevent such knowledge, we now employed continuous flash suppression to render visual motion perceptually invisible during adaptation, ensuring that observers were completely unaware of visual adapting motion and only aware of the motion direction of the sound they were hearing. We found a small but statistically significant congruence effect of sound on adaptation strength produced by invisible adaptation motion. After considering alternative explanations for this finding, we conclude that auditory motion can impact the strength of visual processing produced by translational visual motion even when that motion transpires outside of awareness.

Procedure for extracting temporal structure embedded within psychophysical data.

The idea that mental events unfold over time with an intrinsically paced regularity has a long history within experimental psychology, and it has gained traction from the actual measurement of brain rhythms evident in EEG signals recorded from the human brain and from direct recordings of action potentials and local field potentials within the nervous systems of nonhumans. The weak link in this idea, however, is the challenge of extracting signatures of this temporal structure from behavioral measures. Because there is nothing in the seamless stream of conscious awareness that belies rhythmic modulations in sensitivity or mental acuity, one must deploy inferential strategies for extracting evidence for the existence of temporal regularities in neural activity. We have devised a parametric procedure for analysis of temporal structure embedded in behaviorally measured data comprising durations. We confirm that this procedure, dubbed PATS, achieves comparable results to those obtained using spectral analysis, and that it outperforms conventional spectral analysis when analyzing human response time data containing just a few hundred data points per condition. PATS offers an efficient, sensitive means for bridging the gap between oscillations identified neurophysiologically and estimates of rhythmicity embedded within durations measured behaviorally.

CFS-crafter: An open-source tool for creating and analyzing images for continuous flash suppression experiments.

Continuous flash suppression (CFS) is a popular masking technique used to manipulate visual awareness. By presenting a rapidly changing stimulus to one eye (the 'mask'), a static image viewed by the other (the 'target') may remain invisible for many seconds. This effectiveness affords a means to assess unconscious visual processing, leading to the widespread use of CFS in several basic and clinical sciences. However, the lack of principled stimulus selection has impeded generalization of conclusions across studies, as the strength of interocular suppression is dependent on the spatiotemporal properties of the CFS mask and target. To address this, we created CFS-crafter, a point-and-click, open-source tool for creating carefully controlled CFS stimuli. The CFS-crafter provides a streamlined workflow to create, modify, and analyze mask and target stimuli, requiring only a rudimentary understanding of image processing that is well supported by help files in the application. Users can create CFS masks ranging from classic Mondrian patterns to those comprising objects or faces, or they can create, upload, and analyze their own images. Mask and target images can be custom-designed using image-processing operations performed in the frequency domain, including phase-scrambling and spatial/temporal/orientation filtering. By providing the means for the customization and analysis of CFS stimuli, the CFS-crafter offers controlled creation, analysis, and cross-study comparison. Thus, the CFS-crafter-with its easy-to-use image processing functionality-should facilitate the creation of visual conditions that allow a principled assessment of hypotheses about visual processing outside of awareness.

Contribution of a common ability in average and variability judgments.

People can make judgments about statistical properties of visual features within groups of objects, such as the average size, size variability, or numerosity of circles. Emerging from recent work is the view that these kinds of visual estimations, collectively dubbed ensemble perception, rely on independent abilities that are specific to the statistical property being estimated (mean, variance, range, numerosity). Here we revisit evidence for the claim that different statistical judgments (i.e., average and variability) for the same object feature are based on independent abilities. We tested a large sample of people, using a pre-registered open-ended sequential design to avoid ending up with weak evidence. We estimated the shared variance in ability across different ensemble judgments, with common constraints for the different tasks. We found that the abilities to judge the average size and the size variability for an array of circles are positively correlated, even after controlling for the ability to discriminate the size of single circles. Our results refute the idea that judgments of average and variability for the same object feature rely on completely independent abilities.

Optics and neural adaptation jointly limit human stereovision.

Stereovision is the ability to perceive fine depth variations from small differences in the two eyes' images. Using adaptive optics, we show that even minute optical aberrations that are not clinically correctable, and go unnoticed in everyday vision, can affect stereo acuity. Hence, the human binocular system is capable of using fine details that are not experienced in everyday vision. Interestingly, stereo acuity varied considerably across individuals even when they were provided identical perfect optics. We also found that individuals' stereo acuity is better when viewing with their habitual optics rather than someone else's (better) optics. Together, these findings suggest that the visual system compensates for habitual optical aberrations through neural adaptation and thereby optimizes stereovision uniquely for each individual. Thus, stereovision is limited by small optical aberrations and by neural adaptation to one's own optics.

The role of category- and exemplar-specific experience in ensemble processing of objects.

People can relatively easily report summary properties for ensembles of objects, suggesting that this information can enrich visual experience and increase the efficiency of perceptual processing. Here, we ask whether the ability to judge diversity within object arrays improves with experience. We surmised that ensemble judgments would be more accurate for commonly experienced objects, and perhaps even more for objects of expertise like faces. We also expected improvements in ensemble processing with practice with a novel category, and perhaps even more with repeated experience with specific exemplars. We compared the effect of experience on diversity judgments for arrays of objects, with participants being tested with either a small number of repeated exemplars or with a large number of exemplars from the same object category. To explore the role of more prolonged experience, we tested participants with completely novel objects (random blobs), with objects familiar at the category level (cars), and with objects with which observers are experts at subordinate-level recognition (faces). For objects that are novel, participants showed evidence of improved ability to distribute attention. In contrast, for object categories with long-term experience, i.e., faces and cars, performance improved during the experiment but not necessarily due to improved ensemble processing. Practice with specific exemplars did not result in better diversity judgments for all object categories. Considered together, these results suggest that ensemble processing improves with experience. However, experience operates rapidly, the role of experience does not rely on exemplar-level knowledge and may not benefit from subordinate-level expertise.

Reflections on Eriksen's seminal essay on discrimination, performance and learning without awareness.

Early in his career C.W. Eriksen published in Psychological Review what turned out to be a highly impactful critique on methods and findings on the topic of unconscious influences on discrimination and awareness. His incisive commentary on extant methodology employed at that time - especially the heavy dependence on subjective reports - clearly was heard by others moving forward, as evidenced by the subsequent, lively discussions within the literature concerning the very definition of the notion of unconscious processing. Of equal importance, Eriksen's paper provided an impetus for the development of more refined techniques for manipulating perceptual awareness and for measuring the consequences of those manipulations. My purpose in this essay is to ensure that Eriksen's seminal contributions concerning unconscious phenomena remain within the awareness of the many current investigators working on this popular topic.

Visual-Tactile Spatial Multisensory Interaction in Adults With Autism and Schizophrenia.

Background: Individuals with autism spectrum disorder (ASD) and schizophrenia (SZ) exhibit multisensory processing difficulties and social impairments, with growing evidence that the former contributes to the latter. However, this work has largely reported on separate cohorts, introducing method variance as a barrier to drawing broad conclusions across studies. Further, very few studies have addressed touch, resulting in sparse knowledge about how these two clinical groups may integrate somatic information with other senses. Methods: In this study, we compared adults with ASD (n = 29), SZ (n = 24), and typical developmental histories (TD, n = 37) on two tasks requiring visual-tactile spatial multisensory processing. In the first task (crossmodal congruency), participants judged the location of a tactile stimulus in the presence or absence of simultaneous visual input that was either spatially congruent or incongruent, with poorer performance for incongruence an index of spatial multisensory interaction. In the second task, participants reacted to touch in the presence or absence of dynamic visual stimuli that appeared to approach or recede from the body. Within a certain radius around the body, defined as peripersonal space (PPS), an approaching visual or auditory stimulus reliably speeds reaction times (RT) to touch; outside of this radius, in extrapersonal space (EPS), there is no multisensory effect. PPS can be defined both by its size (radius) and slope (sharpness of the PPS-EPS boundary). Clinical measures were administered to explore relations with visual-tactile processing. Results: Neither clinical group differed from controls on the crossmodal congruency task. The ASD group had significantly smaller and more sharply-defined PPSs compared to the other two groups. Small PPS size was related to social symptom severity across groups, but was largely driven by the TD group, without significant effects in either clinical group. Conclusions: These results suggest that: (1) spatially static visual-tactile facilitation is intact in adults with ASD and SZ, (2) spatially dynamic visual-tactile facilitation impacting perception of the body boundary is affected in ASD but not SZ, and (3) body boundary perception is related to social-emotional function, but not in a way that maps on to clinical status.

Judging Relative Onsets and Offsets of Audiovisual Events.

This study assesses the fidelity with which people can make temporal order judgments (TOJ) between auditory and visual onsets and offsets. Using an adaptive staircase task administered to a large sample of young adults, we find that the ability to judge temporal order varies widely among people, with notable difficulty created when auditory events closely follow visual events. Those findings are interpretable within the context of an independent channels model. Visual onsets and offsets can be difficult to localize in time when they occur within the temporal neighborhood of sound onsets or offsets.

Congruent audio-visual stimulation during adaptation modulates the subsequently experienced visual motion aftereffect.

Sensory information registered in one modality can influence perception associated with sensory information registered in another modality. The current work focuses on one particularly salient form of such multisensory interaction: audio-visual motion perception. Previous studies have shown that watching visual motion and listening to auditory motion influence each other, but results from those studies are mixed with regard to the nature of the interactions promoting that influence and where within the sequence of information processing those interactions transpire. To address these issues, we investigated whether (i) concurrent audio-visual motion stimulation during an adaptation phase impacts the strength of the visual motion aftereffect (MAE) during a subsequent test phase, and (ii) whether the magnitude of that impact was dependent on the congruence between auditory and visual motion experienced during adaptation. Results show that congruent direction of audio-visual motion during adaptation induced a stronger initial impression and a slower decay of the MAE than did the incongruent direction, which is not attributable to differential patterns of eye movements during adaptation. The audio-visual congruency effects measured here imply that visual motion perception emerges from integration of audio-visual motion information at a sensory neural stage of processing.

Novel procedure for generating continuous flash suppression: Seurat meets Mondrian.

Continuous flash suppression (CFS) entails presentation of a stationary target to one eye and an animated sequence of arrays of geometric figures, the mask, to the other eye. The prototypical CFS sequence comprises different sized rectangles of various colors, dubbed Mondrians. Presented as a rapid, changing sequence to one eye, Mondrians or other similarly constructed textured arrays can abolish awareness of the target viewed by the other eye for many seconds at a time, producing target suppression durations much longer than those associated with conventional binocular rivalry. We have devised an animation technique that replaces meaningless Mondrian figures with recognizable visual objects and scenes as inducers of CFS, allowing explicit manipulation of the visual semantic content of those masks. By converting each image of these CFS sequences into successively presented objects or scenes each comprised of many small, circular patches of color, we create pointillist CFS sequences closely matched in terms of their spatio-temporal power spectra. Randomly rearranging the positions of the pointillist patches scrambles the images so they are no longer recognizable. CFS sequences comprising a stream of different objects produces more robust interocular suppression than do sequences comprising a stream of different scenes, even when the two categories of CFS are matched in root mean square contrast and spatial frequency content. Factors promoting these differences in CFS potency could range from low-level, image-based features to high-level factors including attention and recognizability. At the same time, object- and scene-based CFS sequences, when themselves suppressed from awareness, do not differ in their durations of suppression, implying that semantic content of those images comprising CFS sequences are not registered during suppression. The pointillist technique itself offers a potentially useful means for examining the impact of high-level image meaning on aspects of visual perception other than interocular suppression.

Evidence for neural rhythms embedded within binocular rivalry.

Evidence for perceptual periodicity emerges from studies showing periodic fluctuations in visual perception and decision making that are accompanied by neural oscillations in brain activity. We have uncovered signs of periodicity in the time course of binocular rivalry, a widely studied form of multistable perception. This was done by analyzing time series data contained in an unusually large dataset of rivalry state durations associated with states of exclusive monocular dominance and states of mixed perception during transitions between exclusive dominance. Identifiable within the varying durations of dynamic mixed perception are rhythmic clusters of durations whose incidence falls within the frequency band associated with oscillations in neural activity accompanying periodicity in perceptual judgments. Endogenous neural oscillations appear to be especially impactful when perception is unusually confounding.

Spatial suppression promotes rapid figure-ground segmentation of moving objects.

Segregation of objects from their backgrounds is a fundamental visual function and one that is particularly effective when objects are in motion. Theoretically, suppressive center-surround mechanisms are well suited for accomplishing motion segregation. This longstanding hypothesis, however, has received limited empirical support. We report converging correlational and causal evidence that spatial suppression of background motion signals is critical for rapid segmentation of moving objects. Motion segregation ability is strongly predicted by both individual and stimulus-driven variations in spatial suppression strength. Moreover, aging-related superiority in perceiving background motion is associated with profound impairments in motion segregation. This segregation deficit is alleviated via perceptual learning, but only when motion segregation training also causes decreased sensitivity to background motion. We argue that perceptual insensitivity to large moving stimuli effectively implements background subtraction, which, in turn, enhances the visibility of moving objects and accounts for the observed link between spatial suppression and motion segregation.

Individual differences in continuous flash suppression: Potency and linkages to binocular rivalry dynamics.

Binocular rivalry (BR) and continuous flash suppression (CFS) are compelling psychophysical phenomena involving interocular suppression. Using an individual differences approach we assessed whether interocular suppression induced by CFS is predictable in potency from characteristics of BR that are plausibly governed by interocular inhibition. We found large individual differences in BR dynamics and, in addition, in the strength of CFS as gauged by the incidence and durations of breakthroughs in CFS during an extended viewing periods. CFS's potency waned with repeated trials, but stable individual differences persisted despite these mean shifts. We also discovered large individual differences in the strength of the post-CFS shift in BR dominance produced by interocular suppression. While CFS breakthroughs were significantly negatively correlated with shifts in BR dominance after CFS, there were no significant associations between individual differences in alternation rate during pre-CFS binocular rivalry and either breakthroughs during CFS or post-CFS dominance shifts. Bayesian hypothesis tests and highest posterior density intervals confirmed the weak association between these two forms of interocular suppression. Thus, our findings suggest that the substantial individual differences in BR dynamics and CFS effectiveness are modestly related but not entirely mediated by one common neural substrate.

Battle of the Mondrians: Investigating the Role of Unpredictability in Continuous Flash Suppression.

In continuous flash suppression (CFS), a dynamic sequence of Mondrian patterns presented to one eye suppresses a static target in the other eye for several seconds at a time. Its effectiveness has been linked to low-level properties such as spatial frequency and orientation, but the role of higher order influences remains unstudied. Here, using a tracking paradigm, we asked if the spatial and temporal predictability of the Mondrian sequence affects CFS dynamics. Predictable temporal sequences were regularly updated every 100 ms or modulated sinusoidally in pixel luminance at 2 Hz. Unpredictable temporal sequences were irregularly updated or had stochastic pixel luminance changes across time. To vary spatial predictability, sequences were either updated with different Mondrian patterns or had a fixed spatial pattern. We found a modest effect of spatial uncertainty when the target modulation was low (0.125 Hz) but not temporal uncertainty, which had no significant effects regardless of target modulation. Similar results were obtained when we pitted the standard Mondrian sequence against sequences with a fixed spatial pattern and temporally low-pass filtered sequences in a binocular rivalry paradigm. Thus, not only was the effect of information predictability was modest and spatial, but it was also dependent on the presence of higher temporal frequencies. Together, the results demonstrate the significance of low-level properties in affecting CFS dynamics and the possible involvement of pattern structure masking in CFS.

Composite binocular perception from dichoptic stimulus arrays with similar ensemble information.

We view the world through laterally displaced eyes that generate two streams of image signals differing slightly in their perspectives of the visual scene. The brain derives three-dimensional structures from these two image streams by establishing binocular matches and computing image disparities between the two eyes' views. Since the binocular matching problem can have multiple, alternative solutions, vision relies on several strategies to determine the most probable matches. The current study investigated whether the visual system might utilize regularities among neighbouring features (feature ensembles) when confronting this problem. We hypothesized that binocular perception with unlikely, anomalous ensembles would indicate unsuccessful binocular matches. We made dichoptic stimulus arrays of coloured circles and manipulated the colour similarity of stimulus items to produce probable or unusual ensembles when superimposed. Using binocular rivalry as a proxy index, we found that composite perception of dichoptic arrays was more stable when the stimulus items shared similar colours, and that unusual ensembles induced binocular rivalry. Our results suggest that binocular ensembles can be utilized to detect unsuccessful binocular matches, thus uncovering a potentially useful supplemental strategy for identifying binocular matches when viewing potentially confusing visual scenes containing redundant visual features.

Probing Electrophysiological Indices of Perceptual Awareness across Unisensory and Multisensory Modalities.

The neural underpinnings of perceptual awareness have been extensively studied using unisensory (e.g., visual alone) stimuli. However, perception is generally multisensory, and it is unclear whether the neural architecture uncovered in these studies directly translates to the multisensory domain. Here, we use EEG to examine brain responses associated with the processing of visual, auditory, and audiovisual stimuli presented near threshold levels of detectability, with the aim of deciphering similarities and differences in the neural signals indexing the transition into perceptual awareness across vision, audition, and combined visual-auditory (multisensory) processing. More specifically, we examine (1) the presence of late evoked potentials (∼>300 msec), (2) the across-trial reproducibility, and (3) the evoked complexity associated with perceived versus nonperceived stimuli. Results reveal that, although perceived stimuli are associated with the presence of late evoked potentials across each of the examined sensory modalities, between-trial variability and EEG complexity differed for unisensory versus multisensory conditions. Whereas across-trial variability and complexity differed for perceived versus nonperceived stimuli in the visual and auditory conditions, this was not the case for the multisensory condition. Taken together, these results suggest that there are fundamental differences in the neural correlates of perceptual awareness for unisensory versus multisensory stimuli. Specifically, the work argues that the presence of late evoked potentials, as opposed to neural reproducibility or complexity, most closely tracks perceptual awareness regardless of the nature of the sensory stimulus. In addition, the current findings suggest a greater similarity between the neural correlates of perceptual awareness of unisensory (visual and auditory) stimuli when compared with multisensory stimuli.