A domain-general frontoparietal network interacts with domain-preferential intermediate pathways to support working memory task.

Working memory (WM) is essential for cognition, but the underlying neural mechanisms remain elusive. From a hierarchical processing perspective, this paper proposed and tested a hypothesis that a domain-general network at the top of the WM hierarchy can interact with distinct domain-preferential intermediate circuits to support WM. Employing a novel N-back task, we first identified the posterior superior temporal gyrus (pSTG), middle temporal area (MT), and postcentral gyrus (PoCG) as intermediate regions for biological motion and shape motion processing, respectively. Using further psychophysiological interaction analyses, we delineated a frontal-parietal network (FPN) as the domain-general network. These results were further verified and extended by a delayed match to sample (DMS) task. Although the WM load-dependent and stimulus-free activations during the DMS delay phase confirm the role of FPN as a domain-general network to maintain information, the stimulus-dependent activations within this network during the DMS encoding phase suggest its involvement in the final stage of the hierarchical processing chains. In contrast, the load-dependent activations of intermediate regions in the N-back task highlight their further roles beyond perception in WM tasks. These results provide empirical evidence for a hierarchical processing model of WM and may have significant implications for WM training.

Selectively maintaining an object's feature in visual working memory: A comparison between highly discriminable and fine-grained features.

Selectively maintaining information is an essential function of visual working memory (VWM). Recent VWM studies have mainly focused on selective maintenance of objects, leaving the mechanisms of selectively maintaining an object's feature in VWM unknown. Based on the interactive model of perception and VWM, we hypothesized that there are distinct selective maintenance mechanisms for objects containing fine-grained features versus objects containing highly discriminable features. To test this hypothesis, we first required participants to memorize a dual-feature object (colored simple shapes vs. colored polygons), and informed them about the target feature via a retro-cue. Then a visual search task was added to examine the fate of the irrelevant feature. The selective maintenance of an object's feature predicted that the irrelevant feature should be removed from the active state of VWM and should not capture attention when presented as a distractor in the visual search task. We found that irrelevant simple shapes impaired performance in the visual search task (Experiment 1). However, irrelevant polygons did not affect visual search performance (Experiment 2), and this could not be explained by decay of polygons (Experiment 3) or by polygons not capturing attention (Experiment 4). These findings suggest that VWM adopts dissociable mechanisms to selectively maintain an object's feature, depending on the feature's perceptual characteristics.

Unraveling the binding problem in working memory: insights from the hierarchical binding model.

The binding problem is a crucial issue in the study of working memory (WM) and remains a central topic of debate among various WM models. Over the past decade, we have explored feature binding within WM, guided by the Hierarchical Binding Model (HBM). This model suggests that WM binding occurs in two stages: an initial implicit binding involving rapid, coarse feature processing, followed by explicit binding where focused attention refines these features via a reentry process. We found that implicit binding is closely related to the attentional processing of features during the perceptual stage. Basic features that can be rapidly and coarsely processed in parallel through spread attention are involuntarily extracted into WM along with the target features, forming a rough bound representation. For explicit binding, we examined the role of attention in retaining explicit binding in WM, emphasizing the unique role of reentry in the HBM. Our findings indicate that WM binding requires additional object attention through the reentry process. These results demonstrate that both implicit and explicit bindings are integral to WM and that the HBM is effective in elucidating the binding mechanisms within WM.

Development of information integration in the visual working memory of preschoolers.

Visual working memory (WM) plays a pivotal role in integrating fragments into meaningful units, but no study has addressed how visual WM integration takes place in children. The current study examined whether WM integration emerges once preschoolers master Gestalt cue and can retain two representations in WM (automatic integration hypothesis), or still needs time to mature (maturation-of-integration hypothesis). Four experiments (N = 168, 81 females, 4- to 6-year-olds, Chinese, in Hangzhou, China, from 2016.10 to 2021.11) were conducted. Although 4-year-olds can retain two objects in WM and benefit from Gestalt cues in simultaneous display (Cohen's ds >1.00), they failed when memory arrays were presented sequentially. Meanwhile, 5- and 6-year-olds consistently demonstrated WM integration ability (all Cohen's ds >0.69), supporting the maturation-of-integration hypothesis.

Does the presence of more features in a bound representation in working memory require extra object-based attention?

Recent studies have examined the role of attention in retaining bound representations in working memory (WM) and found that object-based attention plays a pivotal role. However, no study has investigated whether maintaining bound representations with more features in WM requires extra object-based attention. We investigated this by examining whether a secondary task consuming object-based attention was more disruptive to the maintenance of bindings in WM when more features were stored per object. We instructed participants to memorize three bound representations in a WM task while manipulating the number of features (two vs. three features) contained in each representation. Moreover, we manipulated whether a secondary task consuming object-based attention was interpolated into the maintenance phase of WM. If extra object-based attention was required after the addition of an extra feature in the bound representation, the secondary task would result in a greater disruption of the three- rather than two-featured binding. In two experiments, we found that the added secondary task significantly impaired the binding performance, but the performance of the two- and three-featured bindings was disrupted to the same extent. These results suggest that the presence of more features in a bound representation in WM does not require extra object-based attention.

Object-based attention in retaining binding in working memory: Influence of activation states of working memory.

It has been suggested that retaining bindings in working memory (WM) requires more object-based attention than retaining constituent features. Recent studies have found that when memorized stimuli are presented sequentially, the most recent stimulus is in a highly accessible privileged state such that it is retained in a relatively automatic and resource-free manner, whereas the other stimuli are in a non-privileged state. The current study investigated whether the activation states of WM modulate the role of object-based attention in retaining bindings in WM. To address this question, we presented three colored shapes sequentially and added a transparent-motion task (Experiment 1) or a mental rotation task (Experiment 2) into the WM maintenance phase to consume object-based attention. We consistently found that consuming object-based attention led to a larger impairment to bindings relative to constituent features, which is independent of the WM activation states, suggesting that object-based attention is critical in retaining bindings in WM across activation states of WM.

The role of attention in retaining the binding of integral features in working memory.

Previous studies have suggested that retaining bindings in working memory (WM) requires more object-based attention than retaining constituent features. However, we still need to address the object-based attention hypothesis to determine both the generality (Does the object-based attention hypothesis of binding apply to feature bindings other than those tested?) and the reality (Was the observed effect in previous studies an artifact of the testing process?). We addressed these two issues by focusing on the binding of integral features, which was ignored in previous studies. Integral features can be manipulated independently but cannot be attended to or processed independently of each other, and they are primarily perceived in a more unitary fashion. Consequently, integral-feature bindings should be processed as integrated units without the help of extra object-based attention. We examined whether or not the object-based attention hypothesis applied to integral-feature bindings (generality), and these results enabled us to check the reality of the hypothesis. In line with our prediction, we found that a secondary task consuming object-based attention did not selectively impair the binding performance (Experiments 1, 2, 3, 5, and 7). The absence of selective binding impairment was not attributable to the use of an invalid secondary task (Experiment 4), failure to memorize the binding between length and width (Experiment 6), tapping the incorrect type of attention (Experiment 6), the feasibility of feature categorization (Experiment 7), or poor task performance (Experiment 7). Overall, these results suggest that the object-based attention hypothesis does not fit for the integral-feature bindings, and that the pivotal role of object-based attention reported by previous studies was reliable.

Development of Social Working Memory in Preschoolers and Its Relation to Theory of Mind.

Social working memory (WM) has distinct neural substrates from canonical cognitive WM (e.g., color). However, no study, to the best of our knowledge, has yet explored how social WM develops. The current study explored the development of social WM capacity and its relation to theory of mind (ToM). Experiment 1 had sixty-four 3- to 6-year-olds memorize 1-5 biological motion stimuli, the processing of which is considered a hallmark of social cognition. The social WM capacity steadily increased between 3- and 6-year-olds, with the increase between 4 and 5 years being sharp. Furthermore, social WM capacity positively predicted preschoolers' ToM scores, while nonsocial WM capacity did not; this positive correlation was particularly strong among 4-year-olds (Experiment 2, N = 144).

Agent identity drives adaptive encoding of biological motion into working memory.

To engage in normal social interactions, we have to encode human biological motions (BMs, e.g., walking and jumping), which is one of the most salient and biologically significant types of kinetic information encountered in everyday life, into working memory (WM). Critically, each BM in real life is produced by a distinct person, carrying a dynamic motion signature (i.e., identity). Whether agent identity influences the WM processing of BMs remains unknown. Here, we addressed this question by examining whether memorizing BMs with different identities promoted the WM processing of task-irrelevant clothing colors. Two opposing hypotheses were tested: (a) WM only stores the target action (element-based hypothesis) and (b) WM stores both action and irrelevant clothing color (event-based hypothesis), interpreting each BM as an event. We required participants to memorize actions that either performed by one agent or distinct agents, while ignoring clothing colors. Then we examined whether the irrelevant color was also stored in WM by probing a distracting effect: If the color was extracted into WM, the change of irrelevant color in the probe would lead to a significant distracting effect on action performance. We found that WM encoding of BMs was adaptive: Once the memorized actions had different identities, WM adopted an event-based encoding mode regardless of memory load and probe identity (Experiment 1, different-identity group of Experiment 2, and Experiment 3). However, WM used an element-based encoding mode when memorized-actions shared the same identity (same-identity group of Experiment 2) or were inverted (Experiment 4). Overall, these findings imply that agent identity information has a significant effect on the WM processing of BMs.

Using a Kinect sensor to acquire biological motion: Toolbox and evaluation.

Biological motion (BM) is the movement of animate entities, which conveys rich social information. To obtain pure BM, researchers nowadays predominantly use point-light displays (PLDs), which depict BM through a set of light points (e.g., 12 points) placed at distinct joints of a moving human body. Most prevalent BM stimuli are created by state-of-the-art motion capture systems. Although these stimuli are highly precise, the motion capture system is expensive and bulky, and its process of constructing a PLD-based BM is time-consuming and complex. These factors impede the investigation of BM mechanisms. In this study, we propose a free Kinect-based biological motion capture (KBC) toolbox based on the Kinect Sensor 2.0 in C++. The KBC toolbox aims to help researchers acquire PLD-based BM in an easy, low-cost, and user-friendly way. We conducted three experiments to examine whether KBC-generated BM can genuinely reflect the processing characteristics of BM: (1) Is BM from this source processed globally in vision? (2) Does its BM (e.g., from the feet) retain detailed local information? and (3) Does the BM convey emotional information? We obtained positive results in response to all three questions. Therefore, we think that the KBC toolbox can be useful in generating BM for future research.

Two Equals One: Two Human Actions During Social Interaction Are Grouped as One Unit in Working Memory.

Every day, people perceive other people performing interactive actions. Retaining these actions of human agents in working memory (WM) plays a pivotal role in a normal social life. However, whether the semantic knowledge embedded in the interactive actions has a pervasive impact on the storage of the actions in WM remains unknown. In the current study, we investigated two opposing hypotheses: (a) that WM stores the interactions individually (the individual-storage hypothesis) and (b) that WM stores the interactions as chunks (the chunk-storage hypothesis). We required participants to memorize a set of individual actions while ignoring the underlying social interactions. We found that although the social-interaction aspect was task irrelevant, the interactive actions were stored in WM as chunks that were not affected by memory load (Experiments 1 and 2); however, inverting the human actions vertically abolished this chunking effect (Experiment 3). These results suggest that WM automatically and efficiently used semantic knowledge about interactive actions to store them and support the chunk-storage hypothesis.

Rehearsing biological motion in working memory: an EEG study.

Holding biological motion (BM), the movements of animate entities, in working memory (WM) is important to our daily social life. However, how BM is maintained in WM remains unknown. The current study investigated this issue and hypothesized that, analogous to BM perception, the human mirror neuron system (MNS) is involved in rehearsing BM in WM. To examine the MNS hypothesis of BM rehearsal, we used an EEG index of mu suppression (8-12 Hz), which has been linked to the MNS. Using a change detection task, we manipulated the BM memory load in three experiments. We predicted that mu suppression in the maintenance phase of WM would be modulated by the BM memory load; moreover, a negative correlation between the number of BM stimuli in WM and the degree of mu suppression may emerge. The results of Experiment 1 were in line with our predictions and revealed that mu suppression increased as the memory load increased from two to four BM stimuli; however, mu suppression then plateaued, as WM could only hold, at most, four BM stimuli. Moreover, the predicted negative correlation was observed. Corroborating the findings of Experiment 1, Experiment 2 further demonstrated that once participants used verbal codes to process the motion information, the mu suppression or modulation by memory load vanished. Finally, Experiment 3 demonstrated that the findings in Experiment 1 were not limited to one specific type of stimuli. Together, these results provide evidence that the MNS underlies the process of rehearsing BM in WM.

Involuntary and voluntary processes compete for entering the focus of attention of working memory.

Representations in the focus of attention (FoA) of working memory (WM) have the highest activation state and processing privilege among representations in WM. There are two distinct processes for representations entering the FoA: involuntary and voluntary. The former is an automatic attentional response to stimuli, while the latter is directed by the central executive. Although extensive WM research has examined these processes individually, their interaction, particularly in competitive scenarios, remains poorly understood. To address this, we conducted experiments by displaying memorized stimuli that contain a color singleton to trigger an involuntary process, followed by a retro-cue in the WM maintenance phase to initiate a voluntary process. By manipulating the retro-cue validity, we probed how the singleton effect was modulated when the two processes had distinct targets. Our findings indicated that when the retro-cue validity was low, the singleton effect remained unaffected by a retro-cue directing to a nonsingleton target. However, when the retro-cue validity was high, the singleton effect was eliminated on reaction time, suggesting that involuntary and voluntary processes compete for a limited capacity of the FoA, with the stronger one prevailing in this competition. These findings illuminate the intricate interplay between involuntary and voluntary attentional processes in WM and offer critical insights into the nature and allocation mechanisms of the FoA. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Holding the product of visual working memory integration: The role of attention.

The involuntary integration of discrete fragments into meaningful units (e.g., Gestalt) within visual working memory (VWM) is a crucial process in mind. However, the mechanisms governing the maintenance of these integrated products within VWM have remained largely unexplored. The current study sought to address this gap by investigating whether maintaining such VWM integration products places a greater demand on attention resources compared to discrete representations. We hypothesized that maintenance may be costless or require additional attention, which may be domain-specific or domain-general. To examine these hypotheses, we tested whether the emerged Gestalts by VWM integration can be abolished by an attention consumption task. Participants were required to memorize a sequence of oriented disks with or without Gestalt cues, alongside a secondary task during maintenance, consuming a specific type of attention. We found that a task consuming spatial attention impaired the VWM Gestalts of bar contours (Experiments 1 and 3), but not the Gestalts of square contours (Experiment 2). Moreover, a task consuming domain-general attention did not affect the VWM Gestalts of bar contours (Experiment 4). These findings provide evidence suggesting that maintaining VWM integration products requires more attention than discrete representations and that the type of attention required is domain-specific.

Dual routes of chunking social interaction: Insights from grouping two agent actions in working memory.

Humans have evolved the sophisticated ability to extract social relations embedded in interactive entities. One typical demonstration is a social chunking phenomenon wherein the cognitive system chunks individual actions into a unified episode basing on perceived interactive actions. However, the mechanisms underlying social chunking remain to be elucidated. Most studies have adopted static images and manipulated interactions through agents' facingness (face-to-face vs. back-to-back). Connecting agents via directed contingent actions is crucial in forming real-life social interaction. Hence, we employed dynamic actions as stimuli, separated physical- and communicative-contingency interactive actions, and predicted that domain-general physical regularities and domain-specific social relationships are crucial in social interactions, respectively. We tested this prediction by using an involuntary chunking effect in working memory, wherein two individual actions are involuntarily chunked when containing task-irrelevant interactive information. We found that involuntary chunking occurred for both types of upright interactive actions (Experiments 1, 3, 5, and 6). Inverting actions erased the chunking of communicative- but not physical-contingency actions (Experiments 2, 4, and 5). The facingness of dyads did not participate in chunking physical-contingency actions but was a prerequisite for chunking communicative-contingency actions (Experiments 3 and 6). These results reveal the dual routes of chunking interactive actions. Moreover, they suggest that the chunking mechanisms of dynamic social interaction are distinct from those of static images, highlighting the importance of using dynamic stimuli to explore the mechanisms of social interaction in emerging people-watching interdisciplinarity. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Microsaccades reflect attention shifts: a mini review of 20 years of microsaccade research.

Microsaccades are small, involuntary eye movements that occur during fixation. Since the 1950s, researchers have conducted extensive research on the role of microsaccades in visual information processing, and found that they also play an important role in human advanced visual cognitive activities. Research over the past 20 years further suggested that there is a close relationship between microsaccades and visual attention, yet lacking a timely review. The current article aims to provide a state-of-the-art review and bring microsaccades studies into the sight of attention research. We firstly introduce basic characteristics about microsaccades, then summarized the empirical evidence supporting the view that microsaccades can reflect both external (perception) and internal (working memory) attention shifts. We finally conclude and highlight three promising avenues for future research.

Building blocks of visual working memory: objects or Boolean maps?

The nature of the building blocks of information in visual working memory (VWM) is a fundamental issue that has not been well resolved. Most researchers take objects as the building blocks, although this perspective has received criticism. The objects could be physically separated ones (strict object hypothesis) or hierarchical objects created from separated individuals (broad object hypothesis). Meanwhile, a newly proposed Boolean map theory for visual attention suggests that Boolean maps may be the building blocks of VWM (Boolean map hypothesis); this perspective could explain many critical findings of VWM. However, no previous study has examined these hypotheses. We explored this issue by focusing on a critical point on which they make distinct predictions. We asked participants to remember two distinct objects (2-object), three distinct objects (3-object), or three objects with repeated information (mixed-3-object, e.g., one red bar and two green bars, green bars could be represented as one hierarchical object) and adopted contralateral delay activity (CDA) to tap into the maintenance phase of VWM. The mixed-3-object condition could generate two Boolean maps, three objects, or three objects most of the time (hierarchical objects are created in certain trials, retaining two objects). Simple orientations (Experiment 1) and colors (Experiments 2 and 3) were used as stimuli. Although the CDA of the mixed-3-object condition was slightly lower than that of the 3-object condition, no significant difference was revealed between them. Both conditions displayed significantly higher CDAs than the 2-object condition. These findings support the broad object hypothesis. We further suggest that Boolean maps might be the unit for retrieval/comparison in VWM.

A magnetoencephalographic study of face processing: M170, gamma-band oscillations and source localization.

EEG studies suggested that the N170 ERP and Gamma-band responses to faces reflect early and later stages of a multiple-level face-perception mechanism, respectively. However, these conclusions should be considered cautiously because EEG-recorded Gamma may be contaminated by noncephalic activity such as microsaccades. Moreover, EEG studies of Gamma cannot easily reveal its intracranial sources. Here we recorded MEG rather than EEG, assessed the sources of the M170 and Gamma oscillations using beamformer, and explored the sensitivity of these neural manifestations to global, featural and configural information in faces. The M170 was larger in response to faces and face components than in response to watches. Scrambling the configuration of the inner components of the face even if presented without the face contour reduced and delayed the M170. The amplitude of MEG Gamma oscillations (30-70 Hz) was higher than baseline during an epoch between 230-570 ms from stimulus onset and was particularly sensitive to the configuration of the stimuli, regardless of their category. However, in the lower part of this frequency range (30-40 Hz) only physiognomic stimuli elevated the MEG above baseline. Both the M170 and Gamma were generated in a posterior-ventral network including the fusiform, inferior-occipital and lingual gyri, all in the right hemisphere. The generation of Gamma involved additional sources in the visual system, bilaterally. We suggest that the evoked M170 manifests a face-perception mechanism based on the global characteristics of face, whereas the induced Gamma oscillations are associated with the integration of visual input into a pre-existent coherent perceptual representation.

Object-based encoding in visual working memory: a life span study.

Recent studies on development of visual working memory (VWM) predominantly focus on VWM capacity and spatial-based information filtering in VWM. Here we explored another new aspect of VWM development: object-based encoding (OBE), which refers to the fact that even if one feature dimension is required to be selected into VWM, the other irrelevant dimensions are also extracted. We explored the OBE in children, young adults, and old adults, by probing an "irrelevant-change distracting effect" in which a change of stored irrelevant feature dramatically affects the performance of task-relevant features in a change-detection task. Participants were required to remember two or four simple colored shapes, while color was used as the relevant dimension. We found that changes to irrelevant shapes led to a significant distracting effect across the three age groups in both load conditions; however, children showed a greater degree of OBE than did young and old adults. These results suggest that OBE exists in VWM over the life span (6-67 years), yet continues to develop along with VWM.

Robust object-based encoding in visual working memory.

Recently, researchers have begun to investigate how nonspatial perceptual information is extracted into visual working memory (VWM), focusing particularly on object-based encoding (OBE). That is, whenever even one feature-dimension is selected for entry into VWM, the others are also extracted automatically. While there is evidence supporting robust OBE in VWM, some researchers have argued that it is restricted to certain conditions, suggesting that OBE might be weak. The current study analyzed the experimental differences between prior studies revealing OBE and the ones that failed, and suggested that there were three critical differences in the experimental settings. Studies supporting robust OBE predominantly were conducted by probing an "irrelevant-change distracting effect," in which a change of stored irrelevant-feature dramatically affects performance. To examine whether OBE in VWM is robust or weak, we manipulated these three aspects under the irrelevant-change distracting effect to check whether OBE could be erased. In three experiments, we found similar degrees of the distracting effect between the experimental condition (controlling these factors) and the control condition; this suggests that these factors do not affect OBE. We conclude that robust OBE exists in VWM.