Human Representation Learning.

The central theme of this review is the dynamic interaction between information selection and learning. We pose a fundamental question about this interaction: How do we learn what features of our experiences are worth learning about? In humans, this process depends on attention and memory, two cognitive functions that together constrain representations of the world to features that are relevant for goal attainment. Recent evidence suggests that the representations shaped by attention and memory are themselves inferred from experience with each task. We review this evidence and place it in the context of work that has explicitly characterized representation learning as statistical inference. We discuss how inference can be scaled to real-world decisions by approximating beliefs based on a small number of experiences. Finally, we highlight some implications of this inference process for human decision-making in social environments.

The visible gorilla: Unexpected fast-not physically salient-Objects are noticeable.

It is widely believed that observers can fail to notice clearly visible unattended objects, even if they are moving. Here, we created parametric tasks to test this belief and report the results of three high-powered experiments (total n = 4,493) indicating that this effect is strongly modulated by the speed of the unattended object. Specifically, fast-but not slow-objects are readily noticeable, whether they are attended or not. These results suggest that fast motion serves as a potent exogenous cue that overrides task-focused attention, showing that fast speeds, not long exposure duration or physical salience, strongly diminish inattentional blindness effects.

Decomposing Neural Circuit Function into Information Processing Primitives.

It is challenging to measure how specific aspects of coordinated neural dynamics translate into operations of information processing and, ultimately, cognitive functions. An obstacle is that simple circuit mechanisms-such as self-sustained or propagating activity and nonlinear summation of inputs-do not directly give rise to high-level functions. Nevertheless, they already implement simple the information carried by neural activity. Here, we propose that distinct functions, such as stimulus representation, working memory, or selective attention, stem from different combinations and types of low-level manipulations of information or information processing primitives. To test this hypothesis, we combine approaches from information theory with simulations of multi-scale neural circuits involving interacting brain regions that emulate well-defined cognitive functions. Specifically, we track the information dynamics emergent from patterns of neural dynamics, using quantitative metrics to detect where and when information is actively buffered, transferred or nonlinearly merged, as possible modes of low-level processing (storage, transfer and modification). We find that neuronal subsets maintaining representations in working memory or performing attentional gain modulation are signaled by their boosted involvement in operations of information storage or modification, respectively. Thus, information dynamic metrics, beyond detecting which network units participate in cognitive processing, also promise to specify how and when they do it, that is, through which type of primitive computation, a capability that may be exploited for the analysis of experimental recordings.

Transient Attention Gates Access Consciousness: Coupling N2pc and P3 Latencies Using Dynamic Time Warping.

The N2pc and P3 event-related potentials (ERPs), used to index selective attention and access to working memory and conscious awareness, respectively, have been important tools in cognitive sciences. Although it is likely that these two components and the underlying cognitive processes are temporally and functionally linked, such links have not yet been convincingly demonstrated. Adopting a novel methodological approach based on dynamic time warping (DTW), we provide evidence that the N2pc and P3 ERP components are temporally linked. We analyzed data from an experiment where 23 participants (16 women) monitored bilateral rapid serial streams of letters and digits in order to report a target digit indicated by a shape cue, separately for trials with correct responses and trials where a temporally proximal distractor was reported instead (distractor intrusion). DTW analyses revealed that N2pc and P3 latencies were correlated in time, both when the target or a distractor was reported. Notably, this link was weaker on distractor intrusion trials. This N2pc-P3 association is discussed with respect to the relationship between attention and access consciousness. Our results demonstrate that our novel method provides a valuable approach for assessing temporal links between two cognitive processes and their underlying modulating factors. This method allows to establish links and their modulator for any two time-series across all domains of the field (general-purpose MATLAB functions and a Python module are provided alongside this paper).

A Neural Decision Signal during Internal Sampling from Working Memory in Humans.

How humans transform sensory information into decisions that steer purposeful behavior is a central question in psychology and neuroscience that is traditionally investigated during the sampling of external environmental signals. The decision-making framework of gradual information sampling toward a decision has also been proposed to apply when sampling internal sensory evidence from working memory. However, neural evidence for this proposal remains scarce. Here we show (using scalp EEG in male and female human volunteers) that sampling internal visual representations from working memory elicits a scalp EEG potential associated with gradual evidence accumulation-the central parietal positivity. Consistent with an evolving decision process, we show how this signal (1) scales with the time participants require to reach a decision about the cued memory content and (2) is amplified when having to decide among multiple contents in working memory. These results bring the electrophysiology of decision-making into the domain of working memory and suggest that variability in memory-guided behavior may be driven (at least in part) by variations in the sampling of our inner mental contents.

Tracking the Misallocation and Reallocation of Spatial Attention toward Auditory Stimuli.

Completely ignoring a salient distractor presented concurrently with a target is difficult, and sometimes attention is involuntarily attracted to the distractor's location (attentional capture). Employing the N2ac component as a marker of attention allocation toward sounds, in this study we investigate the spatiotemporal dynamics of auditory attention across two experiments. Human participants (male and female) performed an auditory search task, where the target was accompanied by a distractor in two-third of the trials. For a distractor more salient than the target (Experiment 1), we observe not only a distractor N2ac (indicating attentional capture) but the full chain of attentional dynamics implied by the notion of attentional capture, namely, (1) the distractor captures attention before the target is attended, (2) allocation of attention to the target is delayed by distractor presence, and (3) the target is attended after the distractor. Conversely, for a distractor less salient than the target (Experiment 2), although responses were delayed, no attentional capture was observed. Together, these findings reveal two types of spatial attentional dynamics in the auditory modality (distraction with and without attentional capture).

The effect of voice familiarity on attention to speech in a cocktail party scenario.

Selective attention to one speaker in multi-talker environments can be affected by the acoustic and semantic properties of speech. One highly ecological feature of speech that has the potential to assist in selective attention is voice familiarity. Here, we tested how voice familiarity interacts with selective attention by measuring the neural speech-tracking response to both target and non-target speech in a dichotic listening "Cocktail Party" paradigm. We measured Magnetoencephalography from n = 33 participants, presented with concurrent narratives in two different voices, and instructed to pay attention to one ear ("target") and ignore the other ("non-target"). Participants were familiarized with one of the voices during the week prior to the experiment, rendering this voice familiar to them. Using multivariate speech-tracking analysis we estimated the neural responses to both stimuli and replicate their well-established modulation by selective attention. Importantly, speech-tracking was also affected by voice familiarity, showing enhanced response for target speech and reduced response for non-target speech in the contra-lateral hemisphere, when these were in a familiar vs. an unfamiliar voice. These findings offer valuable insight into how voice familiarity, and by extension, auditory-semantics, interact with goal-driven attention, and facilitate perceptual organization and speech processing in noisy environments.

Visual periodicity reveals distinct attentional signatures for face and non-face categories.

Observers can selectively deploy attention to regions of space, moments in time, specific visual features, individual objects, and even specific high-level categories-for example, when keeping an eye out for dogs while jogging. Here, we exploited visual periodicity to examine how category-based attention differentially modulates selective neural processing of face and non-face categories. We combined electroencephalography with a novel frequency-tagging paradigm capable of capturing selective neural responses for multiple visual categories contained within the same rapid image stream (faces/birds in Exp 1; houses/birds in Exp 2). We found that the pattern of attentional enhancement and suppression for face-selective processing is unique compared to other object categories: Where attending to non-face objects strongly enhances their selective neural signals during a later stage of processing (300-500 ms), attentional enhancement of face-selective processing is both earlier and comparatively more modest. Moreover, only the selective neural response for faces appears to be actively suppressed by attending towards an alternate visual category. These results underscore the special status that faces hold within the human visual system, and highlight the utility of visual periodicity as a powerful tool for indexing selective neural processing of multiple visual categories contained within the same image sequence.

Auditory change detection and visual selective attention: association between MMN and N2pc.

While the auditory and visual systems each provide distinct information to our brain, they also work together to process and prioritize input to address ever-changing conditions. Previous studies highlighted the trade-off between auditory change detection and visual selective attention; however, the relationship between them is still unclear. Here, we recorded electroencephalography signals from 106 healthy adults in three experiments. Our findings revealed a positive correlation at the population level between the amplitudes of event-related potential indices associated with auditory change detection (mismatch negativity) and visual selective attention (posterior contralateral N2) when elicited in separate tasks. This correlation persisted even when participants performed a visual task while disregarding simultaneous auditory stimuli. Interestingly, as visual attention demand increased, participants whose posterior contralateral N2 amplitude increased the most exhibited the largest reduction in mismatch negativity, suggesting a within-subject trade-off between the two processes. Taken together, our results suggest an intimate relationship and potential shared mechanism between auditory change detection and visual selective attention. We liken this to a total capacity limit that varies between individuals, which could drive correlated individual differences in auditory change detection and visual selective attention, and also within-subject competition between the two, with task-based modulation of visual attention causing within-participant decrease in auditory change detection sensitivity.

The Relation Between Attention and Memory.

The relation between attention and memory has long been deemed important for understanding cognition, and it was heavily researched even in the first experimental psychology laboratory by Wilhelm Wundt and his colleagues. Since then, the importance of the relation between attention and memory has been explored in myriad subdisciplines of psychology, and we incorporate a wide range of these diverse fields. Here, we examine some of the practical consequences of this relation and summarize work with various methodologies relating attention to memory in the fields of working memory, long-term memory, individual differences, life-span development, typical brain function, and neuropsychological conditions. We point out strengths and unanswered questions for our own embedded processes view of information processing, which is used to organize a large body of evidence. Last, we briefly consider the relation of the evidence to a range of other theoretical views before drawing conclusions about the state of the field.

Attentional Modulation of the Cortical Contribution to the Frequency-Following Response Evoked by Continuous Speech.

Selective attention to one of several competing speakers is required for comprehending a target speaker among other voices and for successful communication with them. It moreover has been found to involve the neural tracking of low-frequency speech rhythms in the auditory cortex. Effects of selective attention have also been found in subcortical neural activities, in particular regarding the frequency-following response related to the fundamental frequency of speech (speech-FFR). Recent investigations have, however, shown that the speech-FFR contains cortical contributions as well. It remains unclear whether these are also modulated by selective attention. Here we used magnetoencephalography to assess the attentional modulation of the cortical contributions to the speech-FFR. We presented both male and female participants with two competing speech signals and analyzed the cortical responses during attentional switching between the two speakers. Our findings revealed robust attentional modulation of the cortical contribution to the speech-FFR: the neural responses were higher when the speaker was attended than when they were ignored. We also found that, regardless of attention, a voice with a lower fundamental frequency elicited a larger cortical contribution to the speech-FFR than a voice with a higher fundamental frequency. Our results show that the attentional modulation of the speech-FFR does not only occur subcortically but extends to the auditory cortex as well.SIGNIFICANCE STATEMENT Understanding speech in noise requires attention to a target speaker. One of the speech features that a listener can use to identify a target voice among others and attend it is the fundamental frequency, together with its higher harmonics. The fundamental frequency arises from the opening and closing of the vocal folds and is tracked by high-frequency neural activity in the auditory brainstem and in the cortex. Previous investigations showed that the subcortical neural tracking is modulated by selective attention. Here we show that attention affects the cortical tracking of the fundamental frequency as well: it is stronger when a particular voice is attended than when it is ignored.

Dopaminergic lesions of the anterior cingulate cortex of rats increase vulnerability to salient distractors.

The anterior cingulate cortex (ACC) has been shown to be critical to many aspects of executive function including filtering irrelevant information, updating response contingencies when reinforcement contingencies change and stabilizing task sets. Nonspecific lesions to this region in rats produce a vulnerability to distractors that have gained salience through prior associations with reinforcement. These lesions also exacerbate cognitive fatigue in tests of sustained attention but do not produce global attentional impairments nor do they produce distractibility to novel distractors that do not have a prior association with reinforcement. To determine the neurochemical basis of these cognitive impairments, dopaminergically selective lesions of the ACC were made in both male and female Long-Evans, hooded rats prior to assessment in two attentional tasks. Dopaminergic lesions of the ACC increase the vulnerability of subjects to previously reinforced distractors and impede formation of an attentional set. Lesioned rats were not more susceptible to the effects of novel, irrelevant stimuli in a test of sustained attention as has been previously shown. Additionally, the effects of dopaminergic lesions were found to differ based on sex. Lesioned female, but not male, rats were more vulnerable than sham-lesioned females to the effects of prolonged testing and the removal of reinforcement during a test of sustained attention. Together, these data support the hypothesis that dopamine in the ACC is critical to filtering distractors whose salience has been gained through reinforcement.

The neuroanatomy of visual extinction following right hemisphere brain damage: Insights from multivariate and Bayesian lesion analyses in acute stroke.

Multi-target attention, that is, the ability to attend and respond to multiple visual targets presented simultaneously on the horizontal meridian across both visual fields, is essential for everyday real-world behaviour. Given the close link between the neuropsychological deficit of extinction and attentional limits in healthy subjects, investigating the anatomy that underlies extinction is uniquely capable of providing important insights concerning the anatomy critical for normal multi-target attention. Previous studies into the brain areas critical for multi-target attention and its failure in extinction patients have, however, produced heterogeneous results. In the current study, we used multivariate and Bayesian lesion analysis approaches to investigate the anatomical substrate of visual extinction in a large sample of 108 acute right hemisphere stroke patients. The use of acute stroke patient data and multivariate/Bayesian lesion analysis approaches allowed us to address limitations associated with previous studies and so obtain a more complete picture of the functional network associated with visual extinction. Our results demonstrate that the right temporo-parietal junction (TPJ) is critically associated with visual extinction. The Bayesian lesion analysis additionally implicated the right intraparietal sulcus (IPS), in line with the results of studies in neurologically healthy participants that highlighted the IPS as the area critical for multi-target attention. Our findings resolve the seemingly conflicting previous findings, and emphasise the urgent need for further research to clarify the precise cognitive role of the right TPJ in multi-target attention and its failure in extinction patients.

Chinese medical dialogue information extraction via contrastive multi-utterance inference.

Medical Dialogue Information Extraction (MDIE) is a promising task for modern medical care systems, which greatly facilitates the development of many real-world applications such as electronic medical record generation, automatic disease diagnosis, etc. Recent methods have firstly achieved considerable performance in Chinese MDIE but still suffer from some inherent limitations, such as poor exploitation of the inter-dependencies in multiple utterances, weak discrimination of the hard samples. In this paper, we propose a contrastive multi-utterance inference (CMUI) method to address these issues. Specifically, we first use a type-aware encoder to provide an efficient encode mechanism toward different categories. Subsequently, we introduce a selective attention mechanism to explicitly capture the dependencies among utterances, which thus constructs a multi-utterance inference. Finally, a supervised contrastive learning approach is integrated into our framework to improve the recognition ability for the hard samples. Extensive experiments show that our model achieves state-of-the-art performance on a public benchmark Chinese-based dataset and delivers significant performance gain on MDIE as compared with baselines. Specifically, we outperform the state-of-the-art results in F1-score by 2.27%, 0.55% in Recall and 3.61% in Precision (The codes that support the findings of this study are openly available in CMUI at https://github.com/jc4357/CMUI.).

Exploration, Distributed Attention, and Development of Category Learning.

Category learning is a crucial aspect of cognition that involves organizing entities into equivalence classes. Whereas adults tend to focus on category-relevant features, young children often distribute attention between relevant and irrelevant ones. The reasons for children's distributed attention are not fully understood. In two category-learning experiments with adults and with children aged 4, 5, and 6 (N = 201), we examined potential drivers of distributed attention, including (a) immature filtering of distractors and (b) the general tendency for exploration or broad information sampling. By eliminating distractor competition, we reduced filtering demands. Despite identifying the features critical for accurate categorization, children, regardless of their categorization performance, continued sampling more information than was necessary. These results indicate that the tendency to sample information extensively contributes to distributed attention in young children. We identify candidate drivers of this tendency that need to be examined in future research.

How the Listener's Attention Dynamically Switches Between Different Speakers During a Natural Conversation.

The neural mechanisms underpinning the dynamic switching of a listener's attention between speakers are not well understood. Here we addressed this issue in a natural conversation involving 21 triadic adult groups. Results showed that when the listener's attention dynamically switched between speakers, neural synchronization with the to-be-attended speaker was significantly enhanced, whereas that with the to-be-ignored speaker was significantly suppressed. Along with attention switching, semantic distances between sentences significantly increased in the to-be-ignored speech. Moreover, neural synchronization negatively correlated with the increase in semantic distance but not with acoustic change of the to-be-ignored speech. However, no difference in neural synchronization was found between the listener and the two speakers during the phase of sustained attention. These findings support the attenuation model of attention, indicating that both speech signals are processed beyond the basic physical level. Additionally, shifting attention imposes a cognitive burden, as demonstrated by the opposite fluctuations of interpersonal neural synchronization.

Directing Attention Shapes Learning in Adults but Not Children.

Children sometimes learn distracting information better than adults do, perhaps because of the development of selective attention. To understand this potential link, we ask how the learning of children (aged 7-9 years) and the learning of adults differ when information is the directed focus of attention versus when it is not. Participants viewed drawings of common objects and were told to attend to the drawings (Experiment 1: 42 children, 35 adults) or indicate when shapes (overlaid on the drawings) repeated (Experiment 2: 53 children, 60 adults). Afterward, participants identified fragments of these drawings as quickly as possible. Adults learned better than children when directed to attend to the drawings; however, when drawings were task irrelevant, children showed better learning than adults in the first half of the test. And although directing attention to the drawings improved learning in adults, children learned the drawings similarly across experiments regardless of whether the drawings were the focus of the task or entirely irrelevant.

Acute stress does not modulate selective attention in a composite letter task.

Acute stress has been demonstrated to affect a diverse array of attentional processes, one of which is selective attention. Selective attention refers to the cognitive process of deliberately allocating attentional resources to a specific stimulus, while ignoring other, distracting stimuli. While catecholamines have been shown to narrow attention, investigations on the influence of the stress hormone cortisol have yielded ambiguous results. We conducted two separate studies utilizing different laboratory stress induction paradigms to examine if cortisol influences the ability to selectively attend to local or global elements of a visual stimulus. In Study 1, 72 healthy young men took part either in the stressful Socially Evaluated Cold Pressor Test (SECPT) or a non-stressful (warm water) control, before being exposed to a composite letter task (CLT). Study 2 comprised a sample of 72 healthy young men and women and made use of a modified version of the Trier Social Stress Test (TSST) as well as a non-stressful control version, the friendly-TSST (f-TSST). Via endocrine, physiological, and subjective markers, we confirmed a successful stress induction. As verified with Bayesian statistics, stress did not affect selective attention in neither of the two studies. Furthermore, we were able to replicate the previously demonstrated absence of global precedence for composite figures composed of letters. Our results offer novel insights into the temporal dynamics of the effects of acute stress on attentional processes. Future studies should manipulate the timing of stress induction and investigate the effects of stress on letter vs. non-letter composite figures to shed further light on the underlying mechanisms.

Selective attention towards infants in nulliparous women across the menstrual cycle.

Research in women showed that testosterone is associated with decreased selective attention towards infant stimuli, which can be compensated for by oxytocin administration. In theory, caregiving behavior is thought to be mediated by oxytocin. Oxytocin binds to dopaminergic neurons and thus supposedly motivates aspects of caregiving through its influence on dopaminergic transmission. Most previous studies on caregiving behaviors were thereby performed in women under hormonal contraception to avoid hormonal fluctuations. However, recent studies repeatedly demonstrated decisive influences of the hormonal changes across the female menstrual cycle on dopamine-mediated behaviors, suggesting that estradiol acts as dopamine agonist in the follicular phase and progesterone as dopamine antagonist in the luteal phase. In the present study, we investigated selective attention towards infants as one central aspect of caregiving behavior over the natural menstrual cycle and in relation to interindividual differences of estradiol and progesterone. As expected, we found that women with higher estradiol in the follicular phase also showed higher selective attention towards infant faces among adult distractors, whereas the correlation disappeared in the luteal phase. In contrast, progesterone did not correlate with selective attention towards infants. The present findings collectively support the assumption that estradiol may act as dopamine agonist in the follicular phase, thereby supposedly promoting an important aspect of caretaking behavior.

The Single-Matrix Digit Cancellation Test, a Screener for Selective Attention Deficits: Standardization in an Italian Population Sample and Clinical Usability in Acute Stroke Patients.

INTRODUCTION: This study aimed at validating and providing Italian norms for the Single-Matrix Digit Cancellation Test (SMDCT), a cancellation task to screen for selective attention deficits, as well as providing clinical usability evidence for it in acute stroke patients. METHODS: The SMDCT stimulus is a specular, 4-quadrant, horizontally oriented matrix, across which target distribution is homogeneous. Both accuracy (-A) and time (-T) outcomes were computed. N = 263 healthy participants (HPs) and N = 76 acute stroke patients were recruited. N = 108 HPs also underwent the Mini-Mental State Examination, Frontal Assessment Battery (FAB), and Trail-Making Test (TMT), while patients were further assessed by the Mental Performance in Acute Stroke (MEPS). Regression-based norms were derived (equivalent scores). Construct and factorial validity, as well as case-control discrimination, were tested. RESULTS: The matrix was underpinned by a two-component structure reflecting left and right hits. The SMDCT-T and -A were associated with TMT and FAB scores, respectively. Education predicted the SMDCT-A/-T, whereas age predicted the SMDCT-T only. In patients, the SMDCT converged with the MEPS, also accurately discriminating them from HPs. An index of right-left difference differentiated right- from left-damaged patients. CONCLUSIONS: The SMDCT is a valid and normed screener for selective attention deficits, encompassing measures of both accuracy and time, whose adoption is encouraged in acute stroke patients. Relatedly, the horizontal disposition of its matrix does allow for the qualitative report of either leftward of rightward biases due to underlying visual or attentional-representational deficits in this population.