Human Representation Learning.

The central theme of this review is the dynamic interaction between information selection and learning. We pose a fundamental question about this interaction: How do we learn what features of our experiences are worth learning about? In humans, this process depends on attention and memory, two cognitive functions that together constrain representations of the world to features that are relevant for goal attainment. Recent evidence suggests that the representations shaped by attention and memory are themselves inferred from experience with each task. We review this evidence and place it in the context of work that has explicitly characterized representation learning as statistical inference. We discuss how inference can be scaled to real-world decisions by approximating beliefs based on a small number of experiences. Finally, we highlight some implications of this inference process for human decision-making in social environments.

The visible gorilla: Unexpected fast-not physically salient-Objects are noticeable.

It is widely believed that observers can fail to notice clearly visible unattended objects, even if they are moving. Here, we created parametric tasks to test this belief and report the results of three high-powered experiments (total n = 4,493) indicating that this effect is strongly modulated by the speed of the unattended object. Specifically, fast-but not slow-objects are readily noticeable, whether they are attended or not. These results suggest that fast motion serves as a potent exogenous cue that overrides task-focused attention, showing that fast speeds, not long exposure duration or physical salience, strongly diminish inattentional blindness effects.

Decomposing Neural Circuit Function into Information Processing Primitives.

It is challenging to measure how specific aspects of coordinated neural dynamics translate into operations of information processing and, ultimately, cognitive functions. An obstacle is that simple circuit mechanisms-such as self-sustained or propagating activity and nonlinear summation of inputs-do not directly give rise to high-level functions. Nevertheless, they already implement simple the information carried by neural activity. Here, we propose that distinct functions, such as stimulus representation, working memory, or selective attention, stem from different combinations and types of low-level manipulations of information or information processing primitives. To test this hypothesis, we combine approaches from information theory with simulations of multi-scale neural circuits involving interacting brain regions that emulate well-defined cognitive functions. Specifically, we track the information dynamics emergent from patterns of neural dynamics, using quantitative metrics to detect where and when information is actively buffered, transferred or nonlinearly merged, as possible modes of low-level processing (storage, transfer and modification). We find that neuronal subsets maintaining representations in working memory or performing attentional gain modulation are signaled by their boosted involvement in operations of information storage or modification, respectively. Thus, information dynamic metrics, beyond detecting which network units participate in cognitive processing, also promise to specify how and when they do it, that is, through which type of primitive computation, a capability that may be exploited for the analysis of experimental recordings.

A Neural Decision Signal during Internal Sampling from Working Memory in Humans.

How humans transform sensory information into decisions that steer purposeful behavior is a central question in psychology and neuroscience that is traditionally investigated during the sampling of external environmental signals. The decision-making framework of gradual information sampling toward a decision has also been proposed to apply when sampling internal sensory evidence from working memory. However, neural evidence for this proposal remains scarce. Here we show (using scalp EEG in male and female human volunteers) that sampling internal visual representations from working memory elicits a scalp EEG potential associated with gradual evidence accumulation-the central parietal positivity. Consistent with an evolving decision process, we show how this signal (1) scales with the time participants require to reach a decision about the cued memory content and (2) is amplified when having to decide among multiple contents in working memory. These results bring the electrophysiology of decision-making into the domain of working memory and suggest that variability in memory-guided behavior may be driven (at least in part) by variations in the sampling of our inner mental contents.

Transient Attention Gates Access Consciousness: Coupling N2pc and P3 Latencies Using Dynamic Time Warping.

The N2pc and P3 event-related potentials (ERPs), used to index selective attention and access to working memory and conscious awareness, respectively, have been important tools in cognitive sciences. Although it is likely that these two components and the underlying cognitive processes are temporally and functionally linked, such links have not yet been convincingly demonstrated. Adopting a novel methodological approach based on dynamic time warping (DTW), we provide evidence that the N2pc and P3 ERP components are temporally linked. We analyzed data from an experiment where 23 participants (16 women) monitored bilateral rapid serial streams of letters and digits in order to report a target digit indicated by a shape cue, separately for trials with correct responses and trials where a temporally proximal distractor was reported instead (distractor intrusion). DTW analyses revealed that N2pc and P3 latencies were correlated in time, both when the target or a distractor was reported. Notably, this link was weaker on distractor intrusion trials. This N2pc-P3 association is discussed with respect to the relationship between attention and access consciousness. Our results demonstrate that our novel method provides a valuable approach for assessing temporal links between two cognitive processes and their underlying modulating factors. This method allows to establish links and their modulator for any two time-series across all domains of the field (general-purpose MATLAB functions and a Python module are provided alongside this paper).

Tracking the Misallocation and Reallocation of Spatial Attention toward Auditory Stimuli.

Completely ignoring a salient distractor presented concurrently with a target is difficult, and sometimes attention is involuntarily attracted to the distractor's location (attentional capture). Employing the N2ac component as a marker of attention allocation toward sounds, in this study we investigate the spatiotemporal dynamics of auditory attention across two experiments. Human participants (male and female) performed an auditory search task, where the target was accompanied by a distractor in two-third of the trials. For a distractor more salient than the target (Experiment 1), we observe not only a distractor N2ac (indicating attentional capture) but the full chain of attentional dynamics implied by the notion of attentional capture, namely, (1) the distractor captures attention before the target is attended, (2) allocation of attention to the target is delayed by distractor presence, and (3) the target is attended after the distractor. Conversely, for a distractor less salient than the target (Experiment 2), although responses were delayed, no attentional capture was observed. Together, these findings reveal two types of spatial attentional dynamics in the auditory modality (distraction with and without attentional capture).

Visual periodicity reveals distinct attentional signatures for face and non-face categories.

Observers can selectively deploy attention to regions of space, moments in time, specific visual features, individual objects, and even specific high-level categories-for example, when keeping an eye out for dogs while jogging. Here, we exploited visual periodicity to examine how category-based attention differentially modulates selective neural processing of face and non-face categories. We combined electroencephalography with a novel frequency-tagging paradigm capable of capturing selective neural responses for multiple visual categories contained within the same rapid image stream (faces/birds in Exp 1; houses/birds in Exp 2). We found that the pattern of attentional enhancement and suppression for face-selective processing is unique compared to other object categories: Where attending to non-face objects strongly enhances their selective neural signals during a later stage of processing (300-500 ms), attentional enhancement of face-selective processing is both earlier and comparatively more modest. Moreover, only the selective neural response for faces appears to be actively suppressed by attending towards an alternate visual category. These results underscore the special status that faces hold within the human visual system, and highlight the utility of visual periodicity as a powerful tool for indexing selective neural processing of multiple visual categories contained within the same image sequence.

The effect of voice familiarity on attention to speech in a cocktail party scenario.

Selective attention to one speaker in multi-talker environments can be affected by the acoustic and semantic properties of speech. One highly ecological feature of speech that has the potential to assist in selective attention is voice familiarity. Here, we tested how voice familiarity interacts with selective attention by measuring the neural speech-tracking response to both target and non-target speech in a dichotic listening "Cocktail Party" paradigm. We measured Magnetoencephalography from n = 33 participants, presented with concurrent narratives in two different voices, and instructed to pay attention to one ear ("target") and ignore the other ("non-target"). Participants were familiarized with one of the voices during the week prior to the experiment, rendering this voice familiar to them. Using multivariate speech-tracking analysis we estimated the neural responses to both stimuli and replicate their well-established modulation by selective attention. Importantly, speech-tracking was also affected by voice familiarity, showing enhanced response for target speech and reduced response for non-target speech in the contra-lateral hemisphere, when these were in a familiar vs. an unfamiliar voice. These findings offer valuable insight into how voice familiarity, and by extension, auditory-semantics, interact with goal-driven attention, and facilitate perceptual organization and speech processing in noisy environments.

Auditory change detection and visual selective attention: association between MMN and N2pc.

While the auditory and visual systems each provide distinct information to our brain, they also work together to process and prioritize input to address ever-changing conditions. Previous studies highlighted the trade-off between auditory change detection and visual selective attention; however, the relationship between them is still unclear. Here, we recorded electroencephalography signals from 106 healthy adults in three experiments. Our findings revealed a positive correlation at the population level between the amplitudes of event-related potential indices associated with auditory change detection (mismatch negativity) and visual selective attention (posterior contralateral N2) when elicited in separate tasks. This correlation persisted even when participants performed a visual task while disregarding simultaneous auditory stimuli. Interestingly, as visual attention demand increased, participants whose posterior contralateral N2 amplitude increased the most exhibited the largest reduction in mismatch negativity, suggesting a within-subject trade-off between the two processes. Taken together, our results suggest an intimate relationship and potential shared mechanism between auditory change detection and visual selective attention. We liken this to a total capacity limit that varies between individuals, which could drive correlated individual differences in auditory change detection and visual selective attention, and also within-subject competition between the two, with task-based modulation of visual attention causing within-participant decrease in auditory change detection sensitivity.

The Relation Between Attention and Memory.

The relation between attention and memory has long been deemed important for understanding cognition, and it was heavily researched even in the first experimental psychology laboratory by Wilhelm Wundt and his colleagues. Since then, the importance of the relation between attention and memory has been explored in myriad subdisciplines of psychology, and we incorporate a wide range of these diverse fields. Here, we examine some of the practical consequences of this relation and summarize work with various methodologies relating attention to memory in the fields of working memory, long-term memory, individual differences, life-span development, typical brain function, and neuropsychological conditions. We point out strengths and unanswered questions for our own embedded processes view of information processing, which is used to organize a large body of evidence. Last, we briefly consider the relation of the evidence to a range of other theoretical views before drawing conclusions about the state of the field.

Attentional Modulation of the Cortical Contribution to the Frequency-Following Response Evoked by Continuous Speech.

Selective attention to one of several competing speakers is required for comprehending a target speaker among other voices and for successful communication with them. It moreover has been found to involve the neural tracking of low-frequency speech rhythms in the auditory cortex. Effects of selective attention have also been found in subcortical neural activities, in particular regarding the frequency-following response related to the fundamental frequency of speech (speech-FFR). Recent investigations have, however, shown that the speech-FFR contains cortical contributions as well. It remains unclear whether these are also modulated by selective attention. Here we used magnetoencephalography to assess the attentional modulation of the cortical contributions to the speech-FFR. We presented both male and female participants with two competing speech signals and analyzed the cortical responses during attentional switching between the two speakers. Our findings revealed robust attentional modulation of the cortical contribution to the speech-FFR: the neural responses were higher when the speaker was attended than when they were ignored. We also found that, regardless of attention, a voice with a lower fundamental frequency elicited a larger cortical contribution to the speech-FFR than a voice with a higher fundamental frequency. Our results show that the attentional modulation of the speech-FFR does not only occur subcortically but extends to the auditory cortex as well.SIGNIFICANCE STATEMENT Understanding speech in noise requires attention to a target speaker. One of the speech features that a listener can use to identify a target voice among others and attend it is the fundamental frequency, together with its higher harmonics. The fundamental frequency arises from the opening and closing of the vocal folds and is tracked by high-frequency neural activity in the auditory brainstem and in the cortex. Previous investigations showed that the subcortical neural tracking is modulated by selective attention. Here we show that attention affects the cortical tracking of the fundamental frequency as well: it is stronger when a particular voice is attended than when it is ignored.

Dopaminergic lesions of the anterior cingulate cortex of rats increase vulnerability to salient distractors.

The anterior cingulate cortex (ACC) has been shown to be critical to many aspects of executive function including filtering irrelevant information, updating response contingencies when reinforcement contingencies change and stabilizing task sets. Nonspecific lesions to this region in rats produce a vulnerability to distractors that have gained salience through prior associations with reinforcement. These lesions also exacerbate cognitive fatigue in tests of sustained attention but do not produce global attentional impairments nor do they produce distractibility to novel distractors that do not have a prior association with reinforcement. To determine the neurochemical basis of these cognitive impairments, dopaminergically selective lesions of the ACC were made in both male and female Long-Evans, hooded rats prior to assessment in two attentional tasks. Dopaminergic lesions of the ACC increase the vulnerability of subjects to previously reinforced distractors and impede formation of an attentional set. Lesioned rats were not more susceptible to the effects of novel, irrelevant stimuli in a test of sustained attention as has been previously shown. Additionally, the effects of dopaminergic lesions were found to differ based on sex. Lesioned female, but not male, rats were more vulnerable than sham-lesioned females to the effects of prolonged testing and the removal of reinforcement during a test of sustained attention. Together, these data support the hypothesis that dopamine in the ACC is critical to filtering distractors whose salience has been gained through reinforcement.

The neuroanatomy of visual extinction following right hemisphere brain damage: Insights from multivariate and Bayesian lesion analyses in acute stroke.

Multi-target attention, that is, the ability to attend and respond to multiple visual targets presented simultaneously on the horizontal meridian across both visual fields, is essential for everyday real-world behaviour. Given the close link between the neuropsychological deficit of extinction and attentional limits in healthy subjects, investigating the anatomy that underlies extinction is uniquely capable of providing important insights concerning the anatomy critical for normal multi-target attention. Previous studies into the brain areas critical for multi-target attention and its failure in extinction patients have, however, produced heterogeneous results. In the current study, we used multivariate and Bayesian lesion analysis approaches to investigate the anatomical substrate of visual extinction in a large sample of 108 acute right hemisphere stroke patients. The use of acute stroke patient data and multivariate/Bayesian lesion analysis approaches allowed us to address limitations associated with previous studies and so obtain a more complete picture of the functional network associated with visual extinction. Our results demonstrate that the right temporo-parietal junction (TPJ) is critically associated with visual extinction. The Bayesian lesion analysis additionally implicated the right intraparietal sulcus (IPS), in line with the results of studies in neurologically healthy participants that highlighted the IPS as the area critical for multi-target attention. Our findings resolve the seemingly conflicting previous findings, and emphasise the urgent need for further research to clarify the precise cognitive role of the right TPJ in multi-target attention and its failure in extinction patients.

Chinese medical dialogue information extraction via contrastive multi-utterance inference.

Medical Dialogue Information Extraction (MDIE) is a promising task for modern medical care systems, which greatly facilitates the development of many real-world applications such as electronic medical record generation, automatic disease diagnosis, etc. Recent methods have firstly achieved considerable performance in Chinese MDIE but still suffer from some inherent limitations, such as poor exploitation of the inter-dependencies in multiple utterances, weak discrimination of the hard samples. In this paper, we propose a contrastive multi-utterance inference (CMUI) method to address these issues. Specifically, we first use a type-aware encoder to provide an efficient encode mechanism toward different categories. Subsequently, we introduce a selective attention mechanism to explicitly capture the dependencies among utterances, which thus constructs a multi-utterance inference. Finally, a supervised contrastive learning approach is integrated into our framework to improve the recognition ability for the hard samples. Extensive experiments show that our model achieves state-of-the-art performance on a public benchmark Chinese-based dataset and delivers significant performance gain on MDIE as compared with baselines. Specifically, we outperform the state-of-the-art results in F1-score by 2.27%, 0.55% in Recall and 3.61% in Precision (The codes that support the findings of this study are openly available in CMUI at https://github.com/jc4357/CMUI.).

How the Listener's Attention Dynamically Switches Between Different Speakers During a Natural Conversation.

The neural mechanisms underpinning the dynamic switching of a listener's attention between speakers are not well understood. Here we addressed this issue in a natural conversation involving 21 triadic adult groups. Results showed that when the listener's attention dynamically switched between speakers, neural synchronization with the to-be-attended speaker was significantly enhanced, whereas that with the to-be-ignored speaker was significantly suppressed. Along with attention switching, semantic distances between sentences significantly increased in the to-be-ignored speech. Moreover, neural synchronization negatively correlated with the increase in semantic distance but not with acoustic change of the to-be-ignored speech. However, no difference in neural synchronization was found between the listener and the two speakers during the phase of sustained attention. These findings support the attenuation model of attention, indicating that both speech signals are processed beyond the basic physical level. Additionally, shifting attention imposes a cognitive burden, as demonstrated by the opposite fluctuations of interpersonal neural synchronization.

Acute stress does not modulate selective attention in a composite letter task.

Acute stress has been demonstrated to affect a diverse array of attentional processes, one of which is selective attention. Selective attention refers to the cognitive process of deliberately allocating attentional resources to a specific stimulus, while ignoring other, distracting stimuli. While catecholamines have been shown to narrow attention, investigations on the influence of the stress hormone cortisol have yielded ambiguous results. We conducted two separate studies utilizing different laboratory stress induction paradigms to examine if cortisol influences the ability to selectively attend to local or global elements of a visual stimulus. In Study 1, 72 healthy young men took part either in the stressful Socially Evaluated Cold Pressor Test (SECPT) or a non-stressful (warm water) control, before being exposed to a composite letter task (CLT). Study 2 comprised a sample of 72 healthy young men and women and made use of a modified version of the Trier Social Stress Test (TSST) as well as a non-stressful control version, the friendly-TSST (f-TSST). Via endocrine, physiological, and subjective markers, we confirmed a successful stress induction. As verified with Bayesian statistics, stress did not affect selective attention in neither of the two studies. Furthermore, we were able to replicate the previously demonstrated absence of global precedence for composite figures composed of letters. Our results offer novel insights into the temporal dynamics of the effects of acute stress on attentional processes. Future studies should manipulate the timing of stress induction and investigate the effects of stress on letter vs. non-letter composite figures to shed further light on the underlying mechanisms.

Selective attention towards infants in nulliparous women across the menstrual cycle.

Research in women showed that testosterone is associated with decreased selective attention towards infant stimuli, which can be compensated for by oxytocin administration. In theory, caregiving behavior is thought to be mediated by oxytocin. Oxytocin binds to dopaminergic neurons and thus supposedly motivates aspects of caregiving through its influence on dopaminergic transmission. Most previous studies on caregiving behaviors were thereby performed in women under hormonal contraception to avoid hormonal fluctuations. However, recent studies repeatedly demonstrated decisive influences of the hormonal changes across the female menstrual cycle on dopamine-mediated behaviors, suggesting that estradiol acts as dopamine agonist in the follicular phase and progesterone as dopamine antagonist in the luteal phase. In the present study, we investigated selective attention towards infants as one central aspect of caregiving behavior over the natural menstrual cycle and in relation to interindividual differences of estradiol and progesterone. As expected, we found that women with higher estradiol in the follicular phase also showed higher selective attention towards infant faces among adult distractors, whereas the correlation disappeared in the luteal phase. In contrast, progesterone did not correlate with selective attention towards infants. The present findings collectively support the assumption that estradiol may act as dopamine agonist in the follicular phase, thereby supposedly promoting an important aspect of caretaking behavior.

The Single-Matrix Digit Cancellation Test, a Screener for Selective Attention Deficits: Standardization in an Italian Population Sample and Clinical Usability in Acute Stroke Patients.

INTRODUCTION: This study aimed at validating and providing Italian norms for the Single-Matrix Digit Cancellation Test (SMDCT), a cancellation task to screen for selective attention deficits, as well as providing clinical usability evidence for it in acute stroke patients. METHODS: The SMDCT stimulus is a specular, 4-quadrant, horizontally oriented matrix, across which target distribution is homogeneous. Both accuracy (-A) and time (-T) outcomes were computed. N = 263 healthy participants (HPs) and N = 76 acute stroke patients were recruited. N = 108 HPs also underwent the Mini-Mental State Examination, Frontal Assessment Battery (FAB), and Trail-Making Test (TMT), while patients were further assessed by the Mental Performance in Acute Stroke (MEPS). Regression-based norms were derived (equivalent scores). Construct and factorial validity, as well as case-control discrimination, were tested. RESULTS: The matrix was underpinned by a two-component structure reflecting left and right hits. The SMDCT-T and -A were associated with TMT and FAB scores, respectively. Education predicted the SMDCT-A/-T, whereas age predicted the SMDCT-T only. In patients, the SMDCT converged with the MEPS, also accurately discriminating them from HPs. An index of right-left difference differentiated right- from left-damaged patients. CONCLUSIONS: The SMDCT is a valid and normed screener for selective attention deficits, encompassing measures of both accuracy and time, whose adoption is encouraged in acute stroke patients. Relatedly, the horizontal disposition of its matrix does allow for the qualitative report of either leftward of rightward biases due to underlying visual or attentional-representational deficits in this population.

Temporal interplay between cognitive conflict and attentional markers in social collaboration.

Cognitive processes deal with contradictory demands in social contexts. On the one hand, social interactions imply a demand for cooperation, which requires processing social signals, and on the other, demands for selective attention require ignoring irrelevant signals, to avoid overload. We created a task with a humanoid robot displaying irrelevant social signals, imposing conflicting demands on selective attention. Participants interacted with the robot as a team (high social demand; n = 23) or a passive co-actor (low social demand; n = 19). We observed that theta oscillations indexed conflict processing of social signals. Subsequently, alpha oscillations were sensitive to the conflicting social signals and the mode of interaction. These findings suggest that brains have distinct mechanisms for dealing with the complexity of social interaction and that these mechanisms are activated differently depending on the mode of the interaction. Thus, how we process environmental stimuli depends on the beliefs held regarding our social context.

Target switch costs in visual search arise during the preparatory activation of target templates.

Prior research on task switching has shown that the reconfiguration of stimulus-response mappings across trials is associated with behavioral switch costs. Here, we investigated the effects of switching representations of target-defining features in visual search (attentional templates). Participants searched for one of two color-defined target objects that changed predictably every two trials (Experiment 1) or every four trials (Experiment 2). Substantial costs were observed for search performance on target switch relative to target repeat trials. Preparatory target template activation processes were tracked by measuring N2pc components (indicative of attentional capture) to a rapid series of task-irrelevant color singleton probes that appeared during the interval between search displays, and either matched the currently relevant or the other target color. N2pcs to relevant target color probes emerged from 800 ms before search display onset on target repetition trials, reflecting the activation of a corresponding color template. Crucially, probe N2pcs only emerged immediately before target onset on target switch trials, indicating that preparatory template activation was strongly delayed. In contrast, irrelevant color singleton probes did not trigger N2pcs on either repeat or switch trials, suggesting the absence of any target template inertia across trials. These results show that switching the identity of search targets delays preparatory target template activation and impairs subsequent attentional guidance processes. They suggest that performance costs on switch versus repeat trials are associated with differences in the time course of task preparation.