A domain-general frontoparietal network interacts with domain-preferential intermediate pathways to support working memory task.

Working memory (WM) is essential for cognition, but the underlying neural mechanisms remain elusive. From a hierarchical processing perspective, this paper proposed and tested a hypothesis that a domain-general network at the top of the WM hierarchy can interact with distinct domain-preferential intermediate circuits to support WM. Employing a novel N-back task, we first identified the posterior superior temporal gyrus (pSTG), middle temporal area (MT), and postcentral gyrus (PoCG) as intermediate regions for biological motion and shape motion processing, respectively. Using further psychophysiological interaction analyses, we delineated a frontal-parietal network (FPN) as the domain-general network. These results were further verified and extended by a delayed match to sample (DMS) task. Although the WM load-dependent and stimulus-free activations during the DMS delay phase confirm the role of FPN as a domain-general network to maintain information, the stimulus-dependent activations within this network during the DMS encoding phase suggest its involvement in the final stage of the hierarchical processing chains. In contrast, the load-dependent activations of intermediate regions in the N-back task highlight their further roles beyond perception in WM tasks. These results provide empirical evidence for a hierarchical processing model of WM and may have significant implications for WM training.

Development of information integration in the visual working memory of preschoolers.

Visual working memory (WM) plays a pivotal role in integrating fragments into meaningful units, but no study has addressed how visual WM integration takes place in children. The current study examined whether WM integration emerges once preschoolers master Gestalt cue and can retain two representations in WM (automatic integration hypothesis), or still needs time to mature (maturation-of-integration hypothesis). Four experiments (N = 168, 81 females, 4- to 6-year-olds, Chinese, in Hangzhou, China, from 2016.10 to 2021.11) were conducted. Although 4-year-olds can retain two objects in WM and benefit from Gestalt cues in simultaneous display (Cohen's ds >1.00), they failed when memory arrays were presented sequentially. Meanwhile, 5- and 6-year-olds consistently demonstrated WM integration ability (all Cohen's ds >0.69), supporting the maturation-of-integration hypothesis.

Does the presence of more features in a bound representation in working memory require extra object-based attention?

Recent studies have examined the role of attention in retaining bound representations in working memory (WM) and found that object-based attention plays a pivotal role. However, no study has investigated whether maintaining bound representations with more features in WM requires extra object-based attention. We investigated this by examining whether a secondary task consuming object-based attention was more disruptive to the maintenance of bindings in WM when more features were stored per object. We instructed participants to memorize three bound representations in a WM task while manipulating the number of features (two vs. three features) contained in each representation. Moreover, we manipulated whether a secondary task consuming object-based attention was interpolated into the maintenance phase of WM. If extra object-based attention was required after the addition of an extra feature in the bound representation, the secondary task would result in a greater disruption of the three- rather than two-featured binding. In two experiments, we found that the added secondary task significantly impaired the binding performance, but the performance of the two- and three-featured bindings was disrupted to the same extent. These results suggest that the presence of more features in a bound representation in WM does not require extra object-based attention.

Object-based attention in retaining binding in working memory: Influence of activation states of working memory.

It has been suggested that retaining bindings in working memory (WM) requires more object-based attention than retaining constituent features. Recent studies have found that when memorized stimuli are presented sequentially, the most recent stimulus is in a highly accessible privileged state such that it is retained in a relatively automatic and resource-free manner, whereas the other stimuli are in a non-privileged state. The current study investigated whether the activation states of WM modulate the role of object-based attention in retaining bindings in WM. To address this question, we presented three colored shapes sequentially and added a transparent-motion task (Experiment 1) or a mental rotation task (Experiment 2) into the WM maintenance phase to consume object-based attention. We consistently found that consuming object-based attention led to a larger impairment to bindings relative to constituent features, which is independent of the WM activation states, suggesting that object-based attention is critical in retaining bindings in WM across activation states of WM.

The role of attention in retaining the binding of integral features in working memory.

Previous studies have suggested that retaining bindings in working memory (WM) requires more object-based attention than retaining constituent features. However, we still need to address the object-based attention hypothesis to determine both the generality (Does the object-based attention hypothesis of binding apply to feature bindings other than those tested?) and the reality (Was the observed effect in previous studies an artifact of the testing process?). We addressed these two issues by focusing on the binding of integral features, which was ignored in previous studies. Integral features can be manipulated independently but cannot be attended to or processed independently of each other, and they are primarily perceived in a more unitary fashion. Consequently, integral-feature bindings should be processed as integrated units without the help of extra object-based attention. We examined whether or not the object-based attention hypothesis applied to integral-feature bindings (generality), and these results enabled us to check the reality of the hypothesis. In line with our prediction, we found that a secondary task consuming object-based attention did not selectively impair the binding performance (Experiments 1, 2, 3, 5, and 7). The absence of selective binding impairment was not attributable to the use of an invalid secondary task (Experiment 4), failure to memorize the binding between length and width (Experiment 6), tapping the incorrect type of attention (Experiment 6), the feasibility of feature categorization (Experiment 7), or poor task performance (Experiment 7). Overall, these results suggest that the object-based attention hypothesis does not fit for the integral-feature bindings, and that the pivotal role of object-based attention reported by previous studies was reliable.

Development of Social Working Memory in Preschoolers and Its Relation to Theory of Mind.

Social working memory (WM) has distinct neural substrates from canonical cognitive WM (e.g., color). However, no study, to the best of our knowledge, has yet explored how social WM develops. The current study explored the development of social WM capacity and its relation to theory of mind (ToM). Experiment 1 had sixty-four 3- to 6-year-olds memorize 1-5 biological motion stimuli, the processing of which is considered a hallmark of social cognition. The social WM capacity steadily increased between 3- and 6-year-olds, with the increase between 4 and 5 years being sharp. Furthermore, social WM capacity positively predicted preschoolers' ToM scores, while nonsocial WM capacity did not; this positive correlation was particularly strong among 4-year-olds (Experiment 2, N = 144).

Agent identity drives adaptive encoding of biological motion into working memory.

To engage in normal social interactions, we have to encode human biological motions (BMs, e.g., walking and jumping), which is one of the most salient and biologically significant types of kinetic information encountered in everyday life, into working memory (WM). Critically, each BM in real life is produced by a distinct person, carrying a dynamic motion signature (i.e., identity). Whether agent identity influences the WM processing of BMs remains unknown. Here, we addressed this question by examining whether memorizing BMs with different identities promoted the WM processing of task-irrelevant clothing colors. Two opposing hypotheses were tested: (a) WM only stores the target action (element-based hypothesis) and (b) WM stores both action and irrelevant clothing color (event-based hypothesis), interpreting each BM as an event. We required participants to memorize actions that either performed by one agent or distinct agents, while ignoring clothing colors. Then we examined whether the irrelevant color was also stored in WM by probing a distracting effect: If the color was extracted into WM, the change of irrelevant color in the probe would lead to a significant distracting effect on action performance. We found that WM encoding of BMs was adaptive: Once the memorized actions had different identities, WM adopted an event-based encoding mode regardless of memory load and probe identity (Experiment 1, different-identity group of Experiment 2, and Experiment 3). However, WM used an element-based encoding mode when memorized-actions shared the same identity (same-identity group of Experiment 2) or were inverted (Experiment 4). Overall, these findings imply that agent identity information has a significant effect on the WM processing of BMs.

Using a Kinect sensor to acquire biological motion: Toolbox and evaluation.

Biological motion (BM) is the movement of animate entities, which conveys rich social information. To obtain pure BM, researchers nowadays predominantly use point-light displays (PLDs), which depict BM through a set of light points (e.g., 12 points) placed at distinct joints of a moving human body. Most prevalent BM stimuli are created by state-of-the-art motion capture systems. Although these stimuli are highly precise, the motion capture system is expensive and bulky, and its process of constructing a PLD-based BM is time-consuming and complex. These factors impede the investigation of BM mechanisms. In this study, we propose a free Kinect-based biological motion capture (KBC) toolbox based on the Kinect Sensor 2.0 in C++. The KBC toolbox aims to help researchers acquire PLD-based BM in an easy, low-cost, and user-friendly way. We conducted three experiments to examine whether KBC-generated BM can genuinely reflect the processing characteristics of BM: (1) Is BM from this source processed globally in vision? (2) Does its BM (e.g., from the feet) retain detailed local information? and (3) Does the BM convey emotional information? We obtained positive results in response to all three questions. Therefore, we think that the KBC toolbox can be useful in generating BM for future research.

Two Equals One: Two Human Actions During Social Interaction Are Grouped as One Unit in Working Memory.

Every day, people perceive other people performing interactive actions. Retaining these actions of human agents in working memory (WM) plays a pivotal role in a normal social life. However, whether the semantic knowledge embedded in the interactive actions has a pervasive impact on the storage of the actions in WM remains unknown. In the current study, we investigated two opposing hypotheses: (a) that WM stores the interactions individually (the individual-storage hypothesis) and (b) that WM stores the interactions as chunks (the chunk-storage hypothesis). We required participants to memorize a set of individual actions while ignoring the underlying social interactions. We found that although the social-interaction aspect was task irrelevant, the interactive actions were stored in WM as chunks that were not affected by memory load (Experiments 1 and 2); however, inverting the human actions vertically abolished this chunking effect (Experiment 3). These results suggest that WM automatically and efficiently used semantic knowledge about interactive actions to store them and support the chunk-storage hypothesis.

Rehearsing biological motion in working memory: an EEG study.

Holding biological motion (BM), the movements of animate entities, in working memory (WM) is important to our daily social life. However, how BM is maintained in WM remains unknown. The current study investigated this issue and hypothesized that, analogous to BM perception, the human mirror neuron system (MNS) is involved in rehearsing BM in WM. To examine the MNS hypothesis of BM rehearsal, we used an EEG index of mu suppression (8-12 Hz), which has been linked to the MNS. Using a change detection task, we manipulated the BM memory load in three experiments. We predicted that mu suppression in the maintenance phase of WM would be modulated by the BM memory load; moreover, a negative correlation between the number of BM stimuli in WM and the degree of mu suppression may emerge. The results of Experiment 1 were in line with our predictions and revealed that mu suppression increased as the memory load increased from two to four BM stimuli; however, mu suppression then plateaued, as WM could only hold, at most, four BM stimuli. Moreover, the predicted negative correlation was observed. Corroborating the findings of Experiment 1, Experiment 2 further demonstrated that once participants used verbal codes to process the motion information, the mu suppression or modulation by memory load vanished. Finally, Experiment 3 demonstrated that the findings in Experiment 1 were not limited to one specific type of stimuli. Together, these results provide evidence that the MNS underlies the process of rehearsing BM in WM.

Microsaccades reflect attention shifts: a mini review of 20 years of microsaccade research.

Microsaccades are small, involuntary eye movements that occur during fixation. Since the 1950s, researchers have conducted extensive research on the role of microsaccades in visual information processing, and found that they also play an important role in human advanced visual cognitive activities. Research over the past 20 years further suggested that there is a close relationship between microsaccades and visual attention, yet lacking a timely review. The current article aims to provide a state-of-the-art review and bring microsaccades studies into the sight of attention research. We firstly introduce basic characteristics about microsaccades, then summarized the empirical evidence supporting the view that microsaccades can reflect both external (perception) and internal (working memory) attention shifts. We finally conclude and highlight three promising avenues for future research.

Dual routes of chunking social interaction: Insights from grouping two agent actions in working memory.

Humans have evolved the sophisticated ability to extract social relations embedded in interactive entities. One typical demonstration is a social chunking phenomenon wherein the cognitive system chunks individual actions into a unified episode basing on perceived interactive actions. However, the mechanisms underlying social chunking remain to be elucidated. Most studies have adopted static images and manipulated interactions through agents' facingness (face-to-face vs. back-to-back). Connecting agents via directed contingent actions is crucial in forming real-life social interaction. Hence, we employed dynamic actions as stimuli, separated physical- and communicative-contingency interactive actions, and predicted that domain-general physical regularities and domain-specific social relationships are crucial in social interactions, respectively. We tested this prediction by using an involuntary chunking effect in working memory, wherein two individual actions are involuntarily chunked when containing task-irrelevant interactive information. We found that involuntary chunking occurred for both types of upright interactive actions (Experiments 1, 3, 5, and 6). Inverting actions erased the chunking of communicative- but not physical-contingency actions (Experiments 2, 4, and 5). The facingness of dyads did not participate in chunking physical-contingency actions but was a prerequisite for chunking communicative-contingency actions (Experiments 3 and 6). These results reveal the dual routes of chunking interactive actions. Moreover, they suggest that the chunking mechanisms of dynamic social interaction are distinct from those of static images, highlighting the importance of using dynamic stimuli to explore the mechanisms of social interaction in emerging people-watching interdisciplinarity. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Building blocks of visual working memory: objects or Boolean maps?

The nature of the building blocks of information in visual working memory (VWM) is a fundamental issue that has not been well resolved. Most researchers take objects as the building blocks, although this perspective has received criticism. The objects could be physically separated ones (strict object hypothesis) or hierarchical objects created from separated individuals (broad object hypothesis). Meanwhile, a newly proposed Boolean map theory for visual attention suggests that Boolean maps may be the building blocks of VWM (Boolean map hypothesis); this perspective could explain many critical findings of VWM. However, no previous study has examined these hypotheses. We explored this issue by focusing on a critical point on which they make distinct predictions. We asked participants to remember two distinct objects (2-object), three distinct objects (3-object), or three objects with repeated information (mixed-3-object, e.g., one red bar and two green bars, green bars could be represented as one hierarchical object) and adopted contralateral delay activity (CDA) to tap into the maintenance phase of VWM. The mixed-3-object condition could generate two Boolean maps, three objects, or three objects most of the time (hierarchical objects are created in certain trials, retaining two objects). Simple orientations (Experiment 1) and colors (Experiments 2 and 3) were used as stimuli. Although the CDA of the mixed-3-object condition was slightly lower than that of the 3-object condition, no significant difference was revealed between them. Both conditions displayed significantly higher CDAs than the 2-object condition. These findings support the broad object hypothesis. We further suggest that Boolean maps might be the unit for retrieval/comparison in VWM.

A magnetoencephalographic study of face processing: M170, gamma-band oscillations and source localization.

EEG studies suggested that the N170 ERP and Gamma-band responses to faces reflect early and later stages of a multiple-level face-perception mechanism, respectively. However, these conclusions should be considered cautiously because EEG-recorded Gamma may be contaminated by noncephalic activity such as microsaccades. Moreover, EEG studies of Gamma cannot easily reveal its intracranial sources. Here we recorded MEG rather than EEG, assessed the sources of the M170 and Gamma oscillations using beamformer, and explored the sensitivity of these neural manifestations to global, featural and configural information in faces. The M170 was larger in response to faces and face components than in response to watches. Scrambling the configuration of the inner components of the face even if presented without the face contour reduced and delayed the M170. The amplitude of MEG Gamma oscillations (30-70 Hz) was higher than baseline during an epoch between 230-570 ms from stimulus onset and was particularly sensitive to the configuration of the stimuli, regardless of their category. However, in the lower part of this frequency range (30-40 Hz) only physiognomic stimuli elevated the MEG above baseline. Both the M170 and Gamma were generated in a posterior-ventral network including the fusiform, inferior-occipital and lingual gyri, all in the right hemisphere. The generation of Gamma involved additional sources in the visual system, bilaterally. We suggest that the evoked M170 manifests a face-perception mechanism based on the global characteristics of face, whereas the induced Gamma oscillations are associated with the integration of visual input into a pre-existent coherent perceptual representation.

Robust object-based encoding in visual working memory.

Recently, researchers have begun to investigate how nonspatial perceptual information is extracted into visual working memory (VWM), focusing particularly on object-based encoding (OBE). That is, whenever even one feature-dimension is selected for entry into VWM, the others are also extracted automatically. While there is evidence supporting robust OBE in VWM, some researchers have argued that it is restricted to certain conditions, suggesting that OBE might be weak. The current study analyzed the experimental differences between prior studies revealing OBE and the ones that failed, and suggested that there were three critical differences in the experimental settings. Studies supporting robust OBE predominantly were conducted by probing an "irrelevant-change distracting effect," in which a change of stored irrelevant-feature dramatically affects performance. To examine whether OBE in VWM is robust or weak, we manipulated these three aspects under the irrelevant-change distracting effect to check whether OBE could be erased. In three experiments, we found similar degrees of the distracting effect between the experimental condition (controlling these factors) and the control condition; this suggests that these factors do not affect OBE. We conclude that robust OBE exists in VWM.

Object-based encoding in visual working memory: a life span study.

Recent studies on development of visual working memory (VWM) predominantly focus on VWM capacity and spatial-based information filtering in VWM. Here we explored another new aspect of VWM development: object-based encoding (OBE), which refers to the fact that even if one feature dimension is required to be selected into VWM, the other irrelevant dimensions are also extracted. We explored the OBE in children, young adults, and old adults, by probing an "irrelevant-change distracting effect" in which a change of stored irrelevant feature dramatically affects the performance of task-relevant features in a change-detection task. Participants were required to remember two or four simple colored shapes, while color was used as the relevant dimension. We found that changes to irrelevant shapes led to a significant distracting effect across the three age groups in both load conditions; however, children showed a greater degree of OBE than did young and old adults. These results suggest that OBE exists in VWM over the life span (6-67 years), yet continues to develop along with VWM.

Atypical development of social and nonsocial working memory capacity among preschoolers with autism spectrum disorders.

Individuals with autism spectrum disorders (ASD) have shown impaired performance in canonical and nonsocial working memory (WM). However, no study has investigated social WM and its early development. Using biological motion stimuli, our study assessed the development of social and nonsocial WM capacity among children with or without ASD across the age span between 4 and 6 (N = 150). While typically developing (TD) children show a rapid development from age 5 to 6, children with ASD showed a delayed development for both social and nonsocial WM capacity, reaching a significant group difference at age 6. Furthermore, we found a negative correlation between social (but not nonsocial) WM capacity and the severity of autistic symptoms among children with ASD. In contrast, there is a positive correlation between both types of WM capacity and intelligence among TD children but not among children with ASD. Our findings thus indicate that individuals with ASD miss the rapid development of WM capacity in early childhood and, particularly, their delayed social WM development might contribute to core symptoms that critically depend on social information processing.

Mood congruency affects physiological synchrony but not empathic accuracy in a naturalistic empathy task.

Empathy is a crucial aspect of our daily lives, as it enhances our wellbeing and is a proxy for prosocial behavior. It encompasses two related but partially distinct components: cognitive and affective empathy. Both are susceptible to context, biases and an individual's physiological state. Few studies have explored the effects of a person's mood on these empathy components, and results are mixed. The current study takes advantage of an ecological, naturalistic empathy task - the empathic accuracy (EA) task - in combination with physiological measurements to examine and differentiate between the effects of one's mood on both empathy components. Participants were induced with positive or negative mood and presented videos of targets narrating autobiographical negative stories, selected from a Chinese empathy dataset that we developed (now publicly available). The stories were conveyed in audio-only, visual-only and full-video formats. Participants rated the target's emotional state while watching or listening to their stories, and physiological measures were taken throughout the process. Importantly, similar measures were taken from the targets when they narrated the stories, allowing a comparison between participants' and targets' measures. We found that in audio-only and visual-only conditions, participants whose moods were congruent with the target showed higher physiological synchrony than those with incongruent mood, implying a mood-congruency effect on affective empathy. However, there was no mood effect on empathic accuracy (reflecting cognitive empathy), suggesting a different influence of mood on the two empathy components.

Is the social chunking of agent actions in working memory resource-demanding?

Retaining social interactions in working memory (WM) for further social activities is vital for a successful social life. Researchers have noted a social chunking phenomenon in WM: WM involuntarily uses the social interaction cues embedded in the individual actions and chunks them as one unit. Our study is the first to examine whether the social chunking in WM is an automatic process, by asking whether social chunking of agent actions in WM is resource-demanding, a key hallmark of automaticity. We achieved this by probing whether retaining agent interactions in WM as a chunk required more attention than retaining actions without interaction. We employed a WM change-detection task with actions containing social interaction cues as memory stimuli, and required participants only memorizing individual actions. As domain-general attention and object-based attention are suggested playing a key role in retaining chunks in WM, a secondary task was inserted in the WM maintenance phase to consume these two types of attention. We reestablished the fact that the social chunking in WM required no voluntary control (Experiments 1 and 2). Critically, we demonstrated substantial evidence that social chunking in WM did not require extra domain-general attention (Experiment 1) or object-based attention (Experiment 2). These findings imply that the social chunking of agent actions in WM is not resource-demanding, supporting an automatic view of social chunking in WM.

Object-based encoding in visual working memory: A critical revisit.

Visual working memory (VWM) is responsible for the temporal retention and manipulation of visual information. It has been suggested that VWM employs an object-based encoding (OBE) manner to extract highly discriminable information from visual perception: Whenever one feature dimension of the objects is selected for entry into VWM, the other task-irrelevant highly discriminable dimension is also extracted into VWM involuntarily. However, the task-irrelevant feature in OBE studies might reflect a high capacity fragile VWM (FVWM) trace that stores maskable sensory representations. To directly compare the VWM storage hypothesis and the FVWM storage hypothesis, we used a unique characteristic of FVWM that the representations in FVWM could be erased by backward masks presented at the original locations of the memory array. We required participants to memorise the orientations of three coloured bars while ignoring their colours, and presented backward masks during the VWM maintenance interval. In four experiments, we consistently observed that the OBE occurs regardless of the presentation of the backward masks, except when even the task-relevant features in VWM were significantly interrupted by immediate backward masks, suggesting that the task-irrelevant features of objects are stored in VWM rather than in FVWM.