People can reliably detect action changes and goal changes during naturalistic perception.

As a part of ongoing perception, the human cognitive system segments others' activities into discrete episodes (event segmentation). Although prior research has shown that this process is likely related to changes in an actor's actions and goals, it has not yet been determined whether untrained observers can reliably identify action and goal changes as naturalistic activities unfold, or whether the changes they identify are tied to visual features of the activity (e.g., the beginnings and ends of object interactions). This study addressed these questions by examining untrained participants' identification of action changes, goal changes, and event boundaries while watching videos of everyday activities that were presented in both first-person and third-person perspectives. We found that untrained observers can identify goal changes and action changes consistently, and these changes are not explained by visual change and the onsets or offsets of contact with objects. Moreover, the action and goal changes identified by untrained observers were associated with event boundaries, even after accounting for objective visual features of the videos. These findings suggest that people can identify action and goal changes consistently and with high agreement, that they do so by using sensory information flexibly, and that the action and goal changes they identify may contribute to event segmentation.

Omnipresence of the sensorimotor-association axis topography in the human connectome.

Low-dimensional representations are increasingly used to study meaningful organizational principles within the human brain. Most notably, the sensorimotor-association axis consistently explains the most variance in the human connectome as its so-called principal gradient, suggesting that it represents a fundamental organizational principle. While recent work indicates these low dimensional representations are relatively robust, they are limited by modeling only certain aspects of the functional connectivity structure. To date, the majority of studies have restricted these approaches to the strongest connections in the brain, treating weaker or negative connections as noise despite evidence of meaningful structure among them. The present work examines connectivity gradients of the human connectome across a full range of connectivity strengths and explores the implications for outcomes of individual differences, identifying potential dependencies on thresholds and opportunities to improve prediction tasks. Interestingly, the sensorimotor-association axis emerged as the principal gradient of the human connectome across the entire range of connectivity levels. Moreover, the principal gradient of connections at intermediate strengths encoded individual differences, better followed individual-specific anatomical features, and was also more predictive of intelligence. Taken together, our results add to evidence of the sensorimotor-association axis as a fundamental principle of the brain's functional organization, since it is evident even in the connectivity structure of more lenient connectivity thresholds. These more loosely coupled connections further appear to contain valuable and potentially important information that could be used to improve our understanding of individual differences, diagnosis, and the prediction of treatment outcomes.

The attentional boost effect in free recall dynamics.

With the attentional boost effect (ABE), responding to a briefly presented target in a detection task enhances the encoding of other items presented at the same time. However, the effects of target detection on context memory for the event in which the stimulus appeared remain unclear. Here, we present findings from verbal free recall and recognition experiments that test the effects of target detection during encoding on temporal and relational aspects of context memory. Consistent with prior demonstrations of limited effects of target detection on context memory, in Experiment 1 there was no evidence that target detection influenced the likelihood of transitioning to items that were presented at similar times during encoding, or that were in the same encoding condition. These null effects were replicated in a second experiment, which added an old/new recognition and relational memory test. These results indicate that target detection during encoding has minimal effects on the formation of temporal associations between words in memory.

Measuring event segmentation: An investigation into the stability of event boundary agreement across groups.

People spontaneously divide everyday experience into smaller units (event segmentation). To measure event segmentation, studies typically ask participants to explicitly mark the boundaries between events as they watch a movie (segmentation task). Their data may then be used to infer how others are likely to segment the same movie. However, significant variability in performance across individuals could undermine the ability to generalize across groups, especially as more research moves online. To address this concern, we used several widely employed and novel measures to quantify segmentation agreement across different sized groups (n = 2-32) using data collected on different platforms and movie types (in-lab & commercial film vs. online & everyday activities). All measures captured nonrandom and video-specific boundaries, but with notable between-sample variability. Samples of 6-18 participants were required to reliably detect video-driven segmentation behavior within a single sample. As sample size increased, agreement values improved and eventually stabilized at comparable sample sizes for in-lab & commercial film data and online & everyday activities data. Stabilization occurred at smaller sample sizes when measures reflected (1) agreement between two groups versus agreement between an individual and group, and (2) boundary identification between small (fine-grained) rather than large (coarse-grained) events. These analyses inform the tailoring of sample sizes based on the comparison of interest, materials, and data collection platform. In addition to demonstrating the reliability of online and in-lab segmentation performance at moderate sample sizes, this study supports the use of segmentation data to infer when events are likely to be segmented.

Estimates of locus coeruleus function with functional magnetic resonance imaging are influenced by localization approaches and the use of multi-echo data.

The locus coeruleus (LC) plays a central role in regulating human cognition, arousal, and autonomic states. Efforts to characterize the LC's function in humans using functional magnetic resonance imaging have been hampered by its small size and location near a large source of noise, the fourth ventricle. We tested whether the ability to characterize LC function is improved by employing neuromelanin-T1 weighted images (nmT1) for LC localization and multi-echo functional magnetic resonance imaging (ME-fMRI) for estimating intrinsic functional connectivity (iFC). Analyses indicated that, relative to a probabilistic atlas, utilizing nmT1 images to individually localize the LC increases the specificity of seed time series and clusters in the iFC maps. When combined with independent components analysis (ME-ICA), ME-fMRI data provided significant improvements in the temporal signal to noise ratio and DVARS relative to denoised single echo data (1E-fMRI). The effects of acquiring nmT1 images and ME-fMRI data did not appear to only reflect increases in power: iFC maps for each approach overlapped only moderately. This is consistent with findings that ME-fMRI offers substantial advantages over 1E-fMRI acquisition and denoising. It also suggests that individually identifying LC with nmT1 scans is likely to reduce the influence of other nearby brainstem regions on estimates of LC function.

Attending to behaviorally relevant moments enhances incidental relational memory.

Memory for the items one has recently encountered is sometimes enhanced in divided attention tasks: Attending to behaviorally relevant items, such as a target in a detection task, boosts memory for unrelated background items (e.g., scenes or words). However, a central feature of episodic memory is memory for the spatiotemporal relationship between items and other elements of an event (relational memory), not just the item itself. Three experiments examined whether attending to a behaviorally relevant target-item boosts memory for the relationship between that item, its features, and a background scene. Participants memorized briefly presented scenes. At the same time, they pressed a button if a second unrelated item (a figure or face) was a particular target color (Experiments 1 and 2) or target gender (Experiment 3) rather than a distractor color or gender. Target and distractor items also varied in task-irrelevant features (shape, location, or facial identity). If attending to behaviorally relevant events influences relational memory, then participants should be better able to report both target-defining and irrelevant features of items that appeared with target-paired scenes rather than distractor-paired scenes. This was the case in all experiments: memory was enhanced for the target-paired scenes as well as the association between a scene and features of the paired target-item. Attending to behaviorally relevant moments therefore has broader effects on memory encoding than previously thought. In addition to boosting memory for unrelated background items, attending to targets facilitates relational memory in these tasks.

Changing viewer perspectives reveals constraints to implicit visual statistical learning.

Statistical learning-learning environmental regularities to guide behavior-likely plays an important role in natural human behavior. One potential use is in search for valuable items. Because visual statistical learning can be acquired quickly and without intention or awareness, it could optimize search and thereby conserve energy. For this to be true, however, visual statistical learning needs to be viewpoint invariant, facilitating search even when people walk around. To test whether implicit visual statistical learning of spatial information is viewpoint independent, we asked participants to perform a visual search task from variable locations around a monitor placed flat on a stand. Unbeknownst to participants, the target was more often in some locations than others. In contrast to previous research on stationary observers, visual statistical learning failed to produce a search advantage for targets in high-probable regions that were stable within the environment but variable relative to the viewer. This failure was observed even when conditions for spatial updating were optimized. However, learning was successful when the rich locations were referenced relative to the viewer. We conclude that changing viewer perspective disrupts implicit learning of the target's location probability. This form of learning shows limited integration with spatial updating or spatiotopic representations.

Nonlinear changes in pupillary attentional orienting responses across the lifespan.

The cognitive aging process is not necessarily linear. Central task-evoked pupillary responses, representing a brainstem-pupil relationship, may vary across the lifespan. Thus we examined, in 75 adults ranging in age from 19 to 86, whether task-evoked pupillary responses to an attention task may serve in as an index of cognitive aging. This is because the locus coeruleus (LC), located in the brainstem, is not only among the earliest sites of degeneration in pathological aging, but also supports both attentional and pupillary behaviors. We assessed brief, task-evoked phasic attentional orienting to behaviorally relevant and irrelevant auditory tones, stimuli known specifically to recruit the LC in the brainstem and evoke pupillary responses. Due to potential nonlinear changes across the lifespan, we used a novel data-driven analysis on 6 dynamic pupillary behaviors on 10% of the data to reveal cut off points that best characterized the three age bands: young (19-41 years old), middle aged (42-68 years old), and older adults (69 + years old). Follow-up analyses on independent data, the remaining 90%, revealed age-related changes such as monotonic decreases in tonic pupillary diameter and dynamic range, along with curvilinear phasic pupillary responses to the behaviorally relevant target events, increasing in the middle-aged group and then decreasing in the older group. Additionally, the older group showed decreased differentiation of pupillary responses between target and distractor events. This pattern is consistent with potential compensatory LC activity in midlife that is diminished in old age, resulting in decreased adaptive gain. Beyond regulating responses to light, pupillary dynamics reveal a nonlinear capacity for neurally mediated gain across the lifespan, thus providing evidence in support of the LC adaptive gain hypothesis.

Body and head tilt reveals multiple frames of reference for spatial attention.

Most modern theories of spatial attention suggest that it is based on a maplike representation that prioritizes information in some spatial locations over others. However, movement through space changes the relationship between what is "out there" and a person's viewpoint. Does spatial attention move with the viewer, or does it stay in environmental locations? Several recent psychophysical and neuroscience studies have attempted to address this question by probing attention following saccadic eye movements. The alignment of the head and body to the external environment in these studies, however, makes it impossible to determine whether attention is based on the viewer's location in space or on the external environment. The current study therefore introduces a head and/or body tilt through the vertical plane to dissociate viewer-centered from environment-centered representations. Participants first acquired a long-lasting attentional bias to a region of the search display that was likely to contain a target. They then tilted their head or body, and the location of the spatial bias was evaluated. The results suggest that attention has both a viewer-centered component that rotates with the viewer's head and an environment-centered component that is tied to environmental locations.

Visual search and location probability learning from variable perspectives.

Do moving observers code attended locations relative to the external world or relative to themselves? To address this question we asked participants to conduct visual search on a tabletop. The search target was more likely to occur in some locations than others. Participants walked to different sides of the table from trial to trial, changing their perspective. The high-probability locations were stable on the tabletop but variable relative to the viewer. When participants were informed of the high-probability locations, search was faster when the target was in those locations, demonstrating probability cuing. However, in the absence of explicit instructions and awareness, participants failed to acquire an attentional bias toward the high-probability locations even when the search items were displayed over an invariant natural scene. Additional experiments showed that locomotion did not interfere with incidental learning, but the lack of a consistent perspective prevented participants from acquiring probability cuing incidentally. We conclude that spatial biases toward target-rich locations are directed by two mechanisms: incidental learning and goal-driven attention. Incidental learning codes attended locations in a viewer-centered reference frame and is not updated with viewer movement. Goal-driven attention can be deployed to prioritize an environment-rich region.

Attention-dependent coupling with forebrain and brainstem neuromodulatory nuclei changes across the lifespan.

Attentional states continuously reflect the predictability and uncertainty in one's environment having important consequences for learning and memory. Beyond well known cortical contributions, rapid shifts in attention are hypothesized to also originate from deep nuclei, such as the basal forebrain (BF) and locus coeruleus (LC) neuromodulatory systems. These systems are also the first to change with aging. Here we characterized the interplay between these systems and their regulation of afferent targets - the hippocampus (HPC) and posterior cingulate cortex (PCC) - across the lifespan. To examine the role of attentional salience on task-dependent functional connectivity, we used a target-distractor go/no go task presented during functional MRI. In younger adults, BF coupling with the HPC, and LC coupling with the PCC, increased with behavioral relevance (targets vs distractors). Although the strength and presence of significant regional coupling changed in middle age, the most striking change in network connectivity was in old age, such that in older adults BF and LC coupling with their cortical afferents was largely absent and replaced by stronger interconnectivity between LC-BF nuclei. Overall rapid changes in attention related to behavioral relevance revealed distinct roles of subcortical neuromodulatory systems. The pronounced changes in functional network architecture across the lifespan suggest a decrease in these distinct roles, with deafferentation of cholinergic and noradrenergic systems associated with a shift towards mutual support during attention guided to external stimuli.

Selection of events in time enhances activity throughout early visual cortex.

Temporal selection poses unique challenges to the perceptual system. Selection is needed to protect goal-relevant stimuli from interference from new sensory input. In addition, contextual information that occurs at the same time as goal-relevant stimuli may be critical for learning. Using fMRI, we characterized how visual cortical regions respond to the temporal selection of auditory and visual stimuli. Critically, we focused on brain regions that are not involved in processing the target itself. Participants pressed a button when they heard a prespecified target tone and did not respond to other tones. Although more attention was directed to auditory input when the target tone was selected, activity in primary visual cortex increased more after target tones than after distractor tones. In contrast to spatial attention, this effect was larger in V1 than in V2 and V3. It was present in regions not typically involved in representing the target stimulus. Additional experiments demonstrated that these effects were not due to multimodal processing, rare targets, or motor responses to the targets. Thus temporal selection of behaviorally relevant stimuli enhances, rather than reduces, activity in perceptual regions involved in processing other information.

"Guidance of spatial attention by incidental learning and endogenous cuing": Retraction.

Reports the retraction of "Guidance of spatial attention by incidental learning and endogenous cuing" by Yuhong V. Jiang, Khena M. Swallow and Gail M. Rosenbaum (Journal of Experimental Psychology: Human Perception and Performance, 2013[Feb], Vol 39[1], 285-297). The retraction is at the request of the authors. There was an unintentional error in the MATLAB experimental script used for Experiment 5 that caused one experimental condition to be incorrectly recorded in the data files. The authors confirmed that the MATLAB scripts used for Experiments 1 and 2 did not contain any errors and the findings and conclusions remain valid. However, for Experiments 3 and 4, the programming error led to two issues: (a) one variable was incorrectly written to the data files, and (b) the actual number of trials per condition during the training phase was unbalanced. To ensure that the scientific record is adequately corrected, the authors have uploaded additional information, including the MATLAB scripts for all experiments, the reanalysis of the data from Experiments 3, 4, and 5, and the validation of Experiments 1 and 2, to this OSF repository: https://osf.io/k79j4/?view_only=2220d62d0bb643f9b4ca53 e7a6da872f. The first author of the paper, who programmed the MATLAB scripts, takes full responsibility for the error. The authors sincerely regret this error and apologize for its effects on the editors, reviewers, and the broader scientific community. All authors of the original article joined in the request for the retraction. (The following abstract of the original article appeared in record 2012-09470-001). Our visual system is highly sensitive to regularities in the environment. Locations that were important in one's previous experience are often prioritized during search, even though observers may not be aware of the learning. In this study we characterized the guidance of spatial attention by incidental learning of a target's spatial probability, and examined the interaction between endogenous cuing and probability cuing. Participants searched for a target (T) among distractors (Ls). The target was more often located in one region of the screen than in others. We found that search reaction time (RT) was faster when the target appeared in the high-frequency region rather than the low-frequency regions. This difference increased when there were more items on the display, suggesting that probability cuing guides spatial attention. Additional data indicated that on their own, probability cuing and endogenous cuing (e.g., a central arrow that predicted a target's location) were similarly effective at guiding attention. However, when both cues were presented at once, probability cuing was largely eliminated. Thus, although both incidental learning and endogenous cuing can effectively guide attention, endogenous cuing takes precedence over incidental learning. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Auditory Target Detection Enhances Visual Processing and Hippocampal Functional Connectivity.

Though dividing one's attention between two input streams typically impairs performance, detecting a behaviorally relevant stimulus can sometimes enhance the encoding of unrelated information presented at the same time. Previous research has shown that selection of this kind boosts visual cortical activity and memory for concurrent items. An important unanswered question is whether such effects are reflected in processing quality and functional connectivity in visual regions and in the hippocampus. In this fMRI study, participants were asked to memorize a stream of naturalistic images and press a button only when they heard a predefined target tone (400 or 1,200 Hz, counterbalanced). Images could be presented with a target tone, with a distractor tone, or without a tone. Auditory target detection increased activity throughout the ventral visual cortex but lowered it in the hippocampus. Enhancements in functional connectivity between the ventral visual cortex and the hippocampus were also observed following auditory targets. Multi-voxel pattern classification of image category was more accurate on target tone trials than on distractor and no tone trials in the fusiform gyrus and parahippocampal gyrus. This effect was stronger in visual cortical clusters whose activity was more correlated with the hippocampus on target tone than on distractor tone trials. In agreement with accounts suggesting that subcortical noradrenergic influences play a role in the attentional boost effect, auditory target detection also caused an increase in locus coeruleus activity and phasic pupil responses. These findings outline a network of cortical and subcortical regions that are involved in the selection and processing of information presented at behaviorally relevant moments.

Grounding the Attentional Boost Effect in Events and the Efficient Brain.

Attention and memory for everyday experiences vary over time, wherein some moments are better attended and subsequently better remembered than others. These effects have been demonstrated in naturalistic viewing tasks with complex and relatively uncontrolled stimuli, as well as in more controlled laboratory tasks with simpler stimuli. For example, in the attentional boost effect (ABE), participants perform two tasks at once: memorizing a series of briefly presented stimuli (e.g., pictures of outdoor scenes) for a later memory test, and responding to other concurrently presented cues that meet pre-defined criteria (e.g., participants press a button for a blue target square and do nothing for a red distractor square). However, rather than increasing dual-task interference, attending to a target cue boosts, rather than impairs, subsequent memory for concurrently presented information. In this review we describe current data on the extent and limitations of the attentional boost effect and whether it may be related to activity in the locus coeruleus neuromodulatory system. We suggest that insight into the mechanisms that produce the attentional boost effect may be found in recent advances in the locus coeruleus literature and from understanding of how the neurocognitive system handles stability and change in everyday events. We consequently propose updates to an early account of the attentional boost effect, the dual-task interaction model, to better ground it in what is currently known about event cognition and the role that the LC plays in regulating brain states.

Changes in events alter how people remember recent information.

Observers spontaneously segment larger activities into smaller events. For example, "washing a car" might be segmented into "scrubbing," "rinsing," and "drying" the car. This process, called event segmentation, separates "what is happening now? from "what just happened." In this study, we show that event segmentation predicts activity in the hippocampus when people access recent information. Participants watched narrative film and occasionally attempted to retrieve from memory objects that recently appeared in the film. The delay between object presentation and test was always 5 sec. Critically, for some of the objects, the event changed during the delay whereas for others the event continued. Using fMRI, we examined whether retrieval-related brain activity differed when the event changed during the delay. Brain regions involved in remembering past experiences over long periods, including the hippocampus, were more active during retrieval when the event changed during the delay. Thus, the way an object encountered just 5 sec ago is retrieved from memory appears to depend in part on what happened in those 5 sec. These data strongly suggest that the segmentation of ongoing activity into events is a control process that regulates when memory for events is updated.

The visual attractor illusion.

In many visual illusions, the perceived features of an object such as its size or orientation are influenced by nearby objects. In contrast, the presence of nearby, static objects often enhances the perceived spatial location of another object. Here we present a type of visual illusion in which the presence of a static object alters another object's perceived location. Participants localized the edge of a briefly presented and masked target object. Localization was accurate when the masked target was presented in isolation. However, when another nearby object was presented at the same time as the target, localization deviated toward the nearby object (the "attractor"). This "visual attractor illusion" was stronger when the attractor object was task-relevant rather than irrelevant and diminished as the experiment progressed, suggesting that it was modulated by attention. Visual transients also play an important role in the illusion, which depends on the sudden onset of the attractor object and backward masking of the target. We suggest that the brief appearance of an object (the attractor) distorts perceptual space and draws in the perceived location of a neighboring object. Alternatively, localization of a masked target may be weighted toward the position of a concurrently presented visual transient.

Culture influences how people divide continuous sensory experience into events.

Everyday experience is divided into meaningful events as a part of human perception. Current accounts of this process, known as event segmentation, focus on how characteristics of the experience (e.g., situation changes) influence segmentation. However, characteristics of the viewers themselves have been largely neglected. We test whether one such viewer characteristic, their cultural background, impacts online event segmentation. Culture could impact event segmentation (1) by emphasizing different aspects of experiences as being important for comprehension, memory, and communication, and (2) by providing different exemplars of how everyday activities are performed, which objects are likely to be used, and how scenes are laid out. Indian and US viewers (N = 152) identified events in everyday activities (e.g., making coffee) recorded in Indian and US settings. Consistent with their cultural preference for analytical processing, US viewers segmented the activities into more events than did Indian viewers. Furthermore, event boundaries identified by US viewers were more strongly associated with visual changes, whereas boundaries identified by Indian viewers were more strongly associated with goal changes. There was no evidence that familiarity with an activity impacted segmentation. Thus, culture impacts event perception by altering the types of information people prioritize when dividing experience into meaningful events.

Attention and cardiac phase boost judgments of trust.

Fluctuations in mental and bodily states have both been shown to be associated with negative affective experience. Here we examined how momentary fluctuations in attentional and cardiac states combine to regulate the perception of positive social value. Faces varying in trustworthiness were presented during a go/no-go letter target discrimination task synchronized with systolic or diastolic cardiac phase. Go trials lead to an attentional boosting of perceived trust on high trust and ambiguous neutral faces, suggesting attention both boosted existing and generated positive social value. Cardiac phase during face presentation interacted with attentional boosting of trust, enhancing high trust faces specifically during relaxed diastolic cardiac states. Confidence judgments revealed that attentional trust boosting, and its cardiac modulation, did not reflect altered perceptual or response fluency. These results provide evidence for how moment-to moment fluctuations in top-down mental and bottom-up bodily inputs combine to enhance a priori and generate de novo positive social value.

Event boundaries in perception affect memory encoding and updating.

Memory for naturalistic events over short delays is important for visual scene processing, reading comprehension, and social interaction. The research presented here examined relations between how an ongoing activity is perceptually segmented into events and how those events are remembered a few seconds later. In several studies, participants watched movie clips that presented objects in the context of goal-directed activities. Five seconds after an object was presented, the clip paused for a recognition test. Performance on the recognition test depended on the occurrence of perceptual event boundaries. Objects that were present when an event boundary occurred were better recognized than other objects, suggesting that event boundaries structure the contents of memory. This effect was strongest when an object's type was tested but was also observed for objects' perceptual features. Memory also depended on whether an event boundary occurred between presentation and test; this variable produced complex interactive effects that suggested that the contents of memory are updated at event boundaries. These data indicate that perceptual event boundaries have immediate consequences for what, when, and how easily information can be remembered.