The human subthalamic nucleus transiently inhibits active attentional processes.

The subthalamic nucleus (STN) of the basal ganglia is key to the inhibitory control of movement. Consequently, it is a primary target for the neurosurgical treatment of movement disorders like Parkinson's Disease, where modulating the STN via deep-brain stimulation (DBS) can release excess inhibition of thalamo-cortical motor circuits. However, the STN is also anatomically connected to other thalamo-cortical circuits, including those underlying cognitive processes like attention. Notably, STN-DBS can also affect these processes. This suggests that the STN may also contribute to the inhibition of non-motor activity, and that STN-DBS may cause changes to this inhibition. We here tested this hypothesis in humans. We used a novel, wireless outpatient method to record intracranial local field potentials (LFP) from STN DBS implants during a visual attention task (Experiment 1, N=12). These outpatient measurements allowed the simultaneous recording of high-density EEG, which we used to derive the steady-state visual evoked potential (SSVEP), a well-established neural index of visual attentional engagement. By relating STN activity to this neural marker of attention (instead of overt behavior), we avoided possible confounds resulting from STN's motor role. We aimed to test whether the STN contributes to the momentary inhibition of the SSVEP caused by unexpected, distracting sounds. Furthermore, we causally tested this association in a second experiment, where we modulated STN via DBS across two sessions of the task, spaced at least one week apart (N=21, no sample overlap with Experiment 1). The LFP recordings in Experiment 1 showed that reductions of the SSVEP after distracting sounds were preceded by sound-related γ-frequency (>60Hz) activity in the STN. Trial-to-trial modeling further showed that this STN activity statistically mediated the sounds' suppressive effect on the SSVEP. In Experiment 2, modulating STN activity via DBS significantly reduced these sound-related SSVEP reductions. This provides causal evidence for the role of the STN in the surprise-related inhibition of attention. These findings suggest that the human STN contributes to the inhibition of attention, a non-motor process. This supports a domain-general view of the inhibitory role of the STN. Furthermore, these findings also suggest a potential mechanism underlying some of the known cognitive side-effects of STN-DBS treatment, especially on attentional processes. Finally, our newly-established outpatient LFP recording technique facilitates the testing of the role of subcortical nuclei in complex cognitive tasks, alongside recordings from the rest of the brain, and in much shorter time than perisurgical recordings.

Limited midlevel mediation of visual crowding: Surface completion fails to support uncrowding.

Visual crowding refers to impaired object recognition that is caused by nearby stimuli. It increases with eccentricity. Image-level explanations of crowding maintain that it is caused by information loss within early encoding processes that vary in functionality with eccentricity. Alternative explanations maintain that the interference is not limited to two-dimensional image-level interactions but that it is mediated within representations that reflect three-dimensional scene structure. Uncrowding refers to when adding stimulus information to a display, which increases the noise at an image level, nonetheless decreasing the amount of crowding that occurs. Uncrowding has been interpreted as evidence of midlevel mediation of crowding because the additional information tends to provide an opportunity for perceptually organizing stimuli into distinct and therefore protected representations. It is difficult, however, to rule out image-level explanations of crowding and uncrowding when stimulus differences exist between conditions. We adapted displays of a specific form of uncrowding to minimize stimulus differences across conditions, while retaining the potential for perceptual organization, specifically perceptual surface completion. Uncrowding under these conditions would provide strong support for midlevel mediation of crowding. In five experiments, however, we found no evidence of midlevel mediation of crowding, indicating that at least for this version of uncrowding, image-level explanations cannot be ruled out.

Saccades to partially occluded objects: Perceptual completion mediates oculomotor control.

Oculomotor behavior typically consists of directing gaze to objects in complex scenes for the purpose of extracting detailed perceptual information. Here, we probed the nature of the visual representations over which saccades to objects are computed. We contrasted an image-based oculomotor control hypothesis, holding that saccades are computed solely over information explicit in the retinal image, and an object-based oculomotor control hypothesis, holding that saccades are computed over object representations reflecting the three-dimensional structure of the scene. We recorded saccade landing positions to partially occluded objects in a naturalistic search task. In Experiment 1, saccade landing positions were biased toward the center of the perceptually completed object. Experiment 2 demonstrated that the bias held even when it would have been strategically advantageous to avoid it. Experiment 3 demonstrated that the bias was not due to image-level differences generated by the presence of occluders. The results indicate that saccade motor programs are computed, at least in part, over object-level representations reflecting the completion of occluded surfaces.

Testing hemifield independence for divided attention in visual object tasks.

In this study, we asked to what degree hemifields contribute to divided attention effects observed in tasks with object-based judgments. If object recognition processes in the two hemifields were fully independent, then placing stimuli in separate hemifields would eliminate divided attention effects; in the alternative extreme, if object recognition processes in the two hemifields were fully integrated, then placing stimuli in separate hemifields would not modulate divided attention effects. Using a dual-task paradigm, we compared performance in a semantic categorization task for relevant stimuli arranged in the same hemifield to performance for relevant stimuli arranged in separate left and right hemifields. In two experiments, there was a reliable decrease in divided attention effects when stimuli were shown in separate hemifields compared to the same hemifield. However, the effect of divided attention was not eliminated. These results reject both the independent and integrated hypotheses, and instead support a third alternative - that object recognition processes in the two hemifields are partially dependent. More specifically, the magnitude of modulation by hemifields was closer to the prediction of the integrated hypothesis, suggesting that for dual tasks with objects, dependent processing is mostly shared across the visual field.

Divided attention effects in visual search are caused by objects not by space.

Divided attention effects have been observed across a variety of stimuli and perceptual tasks, which have given rise to both object-based and space-based theories of divided attention. Object-based theories assert that processing information from multiple objects is limited, whereas space-based theories assert that processing information from multiple locations is limited. Extant results in the literature are collectively inconsistent with both simple object-based theories and simple space-based theories of divided attention. Using a visual search task with the extended simultaneous-sequential method to reveal capacity limitations, we found evidence of limited-capacity processing of object properties and unlimited-capacity processing of feature contrast. We found no evidence of a separate spatial limitation. A multiple pathway processing theory can account for these and a large body of previous results. According to this theory, tasks that require object processing must follow a limited-capacity pathway and therefore incur divided attention effects. Tasks that depend on only feature contrast can follow a separate unlimited-capacity processing pathway and therefore do not incur divided attention effects.

Is there a serial bottleneck in visual object recognition?

Divided attention has little effect for simple tasks, such as luminance detection, but it has large effects for complex tasks, such as semantic categorization of masked words. Here, we asked whether the semantic categorization of visual objects shows divided attention effects as large as those observed for words, or as small as those observed for simple feature judgments. Using a dual-task paradigm with nameable object stimuli, performance was compared with the predictions of serial and parallel models. At the extreme, parallel processes with unlimited capacity predict no effect of divided attention; alternatively, an all-or-none serial process makes two predictions: a large divided attention effect (lower accuracy for dual-task trials, compared to single-task trials) and a negative response correlation in dual-task trials (a given response is more likely to be incorrect when the response about the other stimulus is correct). These predictions were tested in two experiments examining object judgments. In both experiments, there was a large divided attention effect and a small negative correlation in responses. The magnitude of these effects was larger than for simple features, but smaller than for words. These effects were consistent with serial models, and rule out some but not all parallel models. More broadly, the results help establish one of the first examples of likely serial processing in perception.

The perceptual processing capacity of summary statistics between and within feature dimensions.

The simultaneous-sequential method was used to test the processing capacity of statistical summary representations both within and between feature dimensions. Sixteen gratings varied with respect to their size and orientation. In Experiment 1, the gratings were equally divided into four separate smaller sets, one of which with a mean size that was larger or smaller than the other three sets, and one of which with a mean orientation that was tilted more leftward or rightward. The task was to report the mean size and orientation of the oddball sets. This therefore required four summary representations for size and another four for orientation. The sets were presented at the same time in the simultaneous condition or across two temporal frames in the sequential condition. Experiment 1 showed evidence of a sequential advantage, suggesting that the system may be limited with respect to establishing multiple within-feature summaries. Experiment 2 eliminates the possibility that some aspect of the task, other than averaging, was contributing to this observed limitation. In Experiment 3, the same 16 gratings appeared as one large superset, and therefore the task only required one summary representation for size and another one for orientation. Equal simultaneous-sequential performance indicated that between-feature summaries are capacity free. These findings challenge the view that within-feature summaries drive a global sense of visual continuity across areas of the peripheral visual field, and suggest a shift in focus to seeking an understanding of how between-feature summaries in one area of the environment control behavior.

Divided attention limits perception of 3-D object shapes.

Can one perceive multiple object shapes at once? We tested two benchmark models of object shape perception under divided attention: an unlimited-capacity and a fixed-capacity model. Under unlimited-capacity models, shapes are analyzed independently and in parallel. Under fixed-capacity models, shapes are processed at a fixed rate (as in a serial model). To distinguish these models, we compared conditions in which observers were presented with simultaneous or sequential presentations of a fixed number of objects (The extended simultaneous-sequential method: Scharff, Palmer, & Moore, 2011a, 2011b). We used novel physical objects as stimuli, minimizing the role of semantic categorization in the task. Observers searched for a specific object among similar objects. We ensured that non-shape stimulus properties such as color and texture could not be used to complete the task. Unpredictable viewing angles were used to preclude image-matching strategies. The results rejected unlimited-capacity models for object shape perception and were consistent with the predictions of a fixed-capacity model. In contrast, a task that required observers to recognize 2-D shapes with predictable viewing angles yielded an unlimited capacity result. Further experiments ruled out alternative explanations for the capacity limit, leading us to conclude that there is a fixed-capacity limit on the ability to perceive 3-D object shapes.

Evidence from partially valid cueing that words are processed serially.

There has been a longstanding debate about whether lexical and semantic processing of words is serial or parallel. We addressed this debate using partially valid cueing, where one of two words is cued. The cue was valid on 80% and invalid on the other 20% of the trials. The task was semantic categorization, and performance was measured by accuracy. The new feature was to limit attentional switching using a postmask of consonants that closely followed the presentation of words. We found a large effect of cueing and, most importantly, performance for the uncued word was at chance. This chance performance was consistent with serial processing, but not with typical parallel processing. This result adds to the evidence from other recent studies that the lexical and semantic processing of words is serial.

An object-mediated updating account of insensitivity to transsaccadic change.

Recent evidence has suggested that relatively precise information about the location and visual form of a saccade target object is retained across a saccade. However, this information appears to be available for report only when the target is removed briefly, so that the display is blank when the eyes land. We hypothesized that the availability of precise target information is dependent on whether a post-saccade object is mapped to the same object representation established for the presaccade target. If so, then the post-saccade features of the target overwrite the presaccade features, a process of object mediated updating in which visual masking is governed by object continuity. In two experiments, participants' sensitivity to the spatial displacement of a saccade target was improved when that object changed surface feature properties across the saccade, consistent with the prediction of the object-mediating updating account. Transsaccadic perception appears to depend on a mechanism of object-based masking that is observed across multiple domains of vision. In addition, the results demonstrate that surface-feature continuity contributes to visual stability across saccades.

Distinguishing blocking from attenuation in visual selective attention.

Sensory information must be processed selectively in order to represent the world and guide behavior. How does such selection occur? Here we consider two alternative classes of selection mechanisms: In blocking, unattended stimuli are blocked entirely from access to downstream processes, and in attenuation, unattended stimuli are reduced in strength but if strong enough can still access downstream processes. Existing evidence as to whether blocking or attenuation is a more accurate model of human performance is mixed. Capitalizing on a general distinction between blocking and attenuation-blocking cannot be overcome by strong stimuli, whereas attenuation can-we measured how attention interacted with the strength of stimuli in two spatial selection paradigms, spatial filtering and spatial monitoring. The evidence was consistent with blocking for the filtering paradigm and with attenuation for the monitoring paradigm. This approach provides a general measure of the fate of unattended stimuli.

Task-specific engagement of object-based and space-based attention with spatiotemporally defined objects.

We used a form of ambiguous apparent motion known as Ternus motion to isolate the effects of object-based and space-based attention, and to explore functional differences between them. Two frames of horizontally aligned disks that were shifted by one position between frames were temporally separated by either a short or a long inter-stimulus interval (ISI). Short ISI displays were perceived as element motion where one disk appeared to jump across the other two. Long ISI displays were perceived as group motion where all three disks appeared to move together. Because element and group motion imply mutually exclusive object structures, adding stimuli (e.g., a small gap) to one disk in each frame created conditions of orthogonal object and location status (same or different), depending on ISI. We used two tasks with different functional demands, an identification task (Experiments 1 and 3a) in which observers responded to a single attribute of the final stimulus, and a comparison task (Experiments 2 and 3b) in which observers compared two attributes across two stimuli. Reliable object-specific effects occurred only with the comparison task, whereas location-specific effects occurred with both tasks. These results confirm that attention can be directed to objects separately from spatial locations and vice versa, and, moreover, that object-based and space-based attention are engaged differently depending on the processing demands of the task.

Visual working memory content influences correspondence processes.

Representing objects as continuous across time requires the establishment of correspondence, whereby current stimuli are represented as deriving from the same object as earlier stimuli. Spatiotemporal continuity and surface-feature similarity play important roles in these correspondence processes. Because objects are often represented across extended periods of time, visual working memory (VWM) content should also play a role in object correspondence. We tested this prediction using Ternus motion. Displays consisted of three-disk arrays that shifted horizontally by one position between frames. Depending on how correspondence is resolved, Ternus displays are perceived as group motion, where all three disks appear to move together, or element motion, where one disk appears to jump across the others. Reports of which motion is perceived provide an index of how correspondence was resolved. Ternus displays were adapted such that the color of some disks biased element motion while the color of others biased group motion. Maintaining one or the other of the colors in VWM for later report systematically biased which type of motion was perceived (Experiments 1 and 2). When color was incidental to the VWM task, however, it did not (Experiment 3). These results confirm that VWM content contributes to object correspondence. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Target-flanker similarity effects reflect image segmentation not perceptual grouping.

When responding to the identity of a visual target, nearby stimuli (flankers) that are associated with the same response as the target cause faster and more accurate responding than flankers that are associated with different responses. Because this flanker-congruence effect (FCE) decreases with increasing target-flanker separation, it was thought to reflect limited precision of spatial selection mechanisms. Later studies, however, showed that FCEs are larger when the target and flankers are the same color compared to when they are different colors. This led to the group selection hypothesis, which states that flankers are perceptually grouped with the target and are obligatorily selected along with it, regardless of spatial separation. An alternative hypothesis, the image segmentation hypothesis, states that feature differences facilitate the segmentation of visual information into relevant and irrelevant parts, thereby mitigating the limitations of spatial precision of selection mechanisms. We test between these hypotheses using a design in which targets and flankers are grouped or not grouped, while holding feature differences in the stimulus constant. Contrary to earlier results, we found that same-colored flankers do not yield larger FCEs than different-colored flankers when feature differences are held constant. We conclude that similarity effects on the FCE reflect differential support for image segmentation, on which selection depends, rather than the obligatory selection of perceptually grouped flankers and targets.

Object correspondence: Using perceived causality to infer how the visual system knows what went where.

Anne Treisman and colleagues developed an influential theoretical framework surrounding the construct of "object files" as a means of understanding the functional need for an episodic representation of objects as they move, change, disappear, and reappear from view (Kahneman, Treisman, & Gibbs, Cognitive Psychology, 24, 175-219, 1992; Treisman, The Quarterly Journal of Experimental Psychology, 40, 201-237, 1988). Within that framework, object files are defined through the process of object correspondence, whereby stimuli are associated with and represented as later instantiations of existing object representations and are used to selectively update those representations. A central assertion of the object file framework is that object correspondence is established on the basis of spatiotemporal continuity, without regard to feature information. We tested this assertion by investigating whether feature information, separate from spatiotemporal information, can determine how object correspondence is resolved. We used the perception of causality in simple dynamic displays, which provides a means of inferring how object correspondence is resolved. We found that, contrary to the spatiotemporal dominance assertion, feature information is used to resolve object correspondence. We suggest that the object-file framework be extended to reflect the importance of both feature and spatiotemporal information in establishing and maintaining episodic object representations.

Illusory size determines the perception of ambiguous apparent motion.

The visual system constructs perceptions based on ambiguous information. For motion perception, the correspondence problem arises, i.e., the question of which object went where. We asked at which level of processing correspondence is solved - lower levels based on information that is directly available in the retinal input or higher levels based on information that has been abstracted beyond the input directly available at the retina? We used a Ponzo-like illusion to manipulate the perceived size and separations of elements in an ambiguous apparent motion display. Specifically, we presented Ternus displays - for which the type of motion that is perceived depends on how correspondence is resolved - at apparently different distances from the viewer using pictorial depth cues. We found that the perception of motion depended on the apparent depth of the displays, indicating that correspondence processes utilize information that is produced at higher-level processes.

The role of object history in establishing object correspondence.

Our visual system establishes correspondence between objects and thus enables us to perceive an object, like a car on the road, as moving continuously. A central question regarding correspondence is whether our visual system uses relatively unprocessed image-based information or further processed object-based information to establish correspondence. While it has been shown that some object-based attributes, such as perceived lightness, can influence correspondence, manipulating object-based information typically involves at least minimal changes of image-based information as well, making it difficult to clearly distinguish between the two levels. To avoid this confound, we manipulated object-based information prior to the task in which we measured correspondence. We used 3-element Ternus displays to assess correspondence. These are ambiguous apparent-motion displays that, depending on how correspondence is solved, are perceived as either one element jumping across the others or as all three elements moving together as a group. We manipulated object-based information by presenting one of two object histories prior to the Ternus display. In one, they moved or changed luminance independently, and thus appeared independent from each other. In the other, the elements moved or changed their luminance all together and thus appeared grouped with each other. We found that the object history did influence how the Ternus displays were perceived, thereby confirming that object-based information alone can be used as a basis for establishing correspondence in line with object-based theories of correspondence.

Endogenous cueing effects for detection can be accounted for by a decision model of selective attention.

Spatial cues help participants detect a visual target when it appears at the cued location. One hypothesis for this cueing effect, called selective perception, is that cueing a location enhances perceptual encoding at that location. Another hypothesis, called selective decision, is that the cue has no effect on perception, but instead provides prior information that facilitates decision-making. We distinguished these hypotheses by comparing a simultaneous display with two spatial locations to sequential displays with two temporal intervals. The simultaneous condition had a partially valid spatial cue, and the sequential condition had a partially valid temporal cue. Selective perception predicts no cueing effect for sequential displays given there is enough time to switch attention. In contrast, selective decision predicts cueing effects for sequential displays regardless of time. We used endogenous cueing of a detection-like coarse orientation discrimination task with clear displays (no external noise or postmasks). Results showed cueing effects for the sequential condition, supporting a decision account of selective attention for endogenous cueing of detection-like tasks.

Explicit eye movements failed to facilitate the precision of subsequent attentional localization.

This study investigated the usefulness of explicit spatial coordinates from eye movements for the precision of covert shifts of attention within dense arrays of items. Observers shifted their attention covertly from one item to the next in response to a series of beeps and reported the color of the disc on which the series ended, providing an estimate of the accuracy of the "attentional walk". We compared performance in this task when only covert shifts of attention were done to performance when observers first executed an explicit eye movement to the starting point of the attentional walk before beginning the covert attentional walk. The hypothesis was that the eye movement would activate explicit coordinates of the starting point of the attentional walk within brain systems that are involved in controlling both shifts of attention and eye movements. This in turn would provide an anchor for the attentional walk, thereby improving performance. The evidence did not support this hypothesis. Performance was no better with an explicit eye movement prior to the attentional walk than without one. This suggests that covert orienting--shifting attention--and overt orienting--shifting the eyes-access the same coordinate system and therefore activating new coordinates interferes with the old ones, no matter what the system of orienting is.

The path of least persistence: object status mediates visual updating.

On what basis does the visual system use recently sampled information to update existing representations of the world? One possibility is that representations are updated through an image-based point-for-point replacement process. An alternative possibility is that representations are updated on the basis of perceptually organized units that reflect objects in the scene rather than locations within the visual field. We report a new effect involving a modulation of visible persistence that seems to support this alternative possibility. In particular, we show that a moving stimulus leaves a visible trace of itself when it undergoes an abrupt and transient change in size but does not do so when the stimulus does not change. Further we show that this effect is substantially reduced when a scene-based reason for the abrupt change in size is provided (i.e., the object is shown to be passing behind an occluding surface that has a very small window in it through which the stimulus shows briefly). We suggest that the visible persistence in the face of change reflects a disruption of the normal updating process which is object-based and disrupted because of the discontinuity of the object. Providing a scene-based reason for the discontinuity allows the object representation to be maintained, and thus does not result in a disruption of the updating process.