Fade In, Fade Out: Do Shifts in Visual Perspective Predict the Consistency of Real-World Memories?

Memories of our personal past are not exact accounts of what occurred. Instead, memory reconstructs the past in adaptive-though not always faithful-ways. Using a naturalistic design, we asked how the visual perspective adopted in the mind's eye when recalling the past-namely, an "own eyes" versus "observer" perspective-relates to the stability of autobiographical memories. We hypothesized that changes in visual perspective over time would predict poorer consistency of memories. Young adults (N = 178) rated the phenomenology of and freely recalled self-selected memories of everyday events at two time points (10 weeks apart). Multilevel linear modeling revealed, as expected, that greater shifts in visual perspective over time predicted lower memory consistency, particularly for emotional details. Our results offer insight into the factors that predict the fidelity of memories for everyday events. Moreover, our results may elucidate new metrics that are useful in interpreting eyewitness testimony or experiences relayed in clinical contexts.

The effect of visual perspective on episodic memory in aging: A virtual reality study.

The possibility of flexibly retrieving our memories using a first-person or a third-person perspective (1PP or 3PP) has been extensively investigated in episodic memory research. Here, we used a Virtual Reality-based paradigm to manipulate the visual perspective used during the encoding stage to investigate age-related differences in the formation of memories experienced from 1PP vs. 3PP. 32 young adults and 32 seniors participated in the study. Participants navigated through two virtual cities to encode complex real-life virtual events, from either a 1PP (as if from their egocentric viewpoint) or a 3PP, while actively controlling an avatar. While recognition accuracy was higher in young adults after encoding in 1PP compared to 3PP, there was no benefit in memory formation in 1PP for older adults. These findings are discussed in terms of both age-related changes in episodic memory functioning and self-referencing processes.

Differential influence of first- vs. third-person visual perspectives on segmentation and memory of complex dynamic events.

Until now, most studies investigating the relationship between event segmentation and memory have used videos filmed from a third-person perspective, although people experience their lives from a first-person perspective. The present study aimed to determine whether visual perspective impacts events segmentation and further recall. Fifty-seven participants were recruited and assigned to either first- (1PP) or third-person perspective (3PP) condition, before segmenting videos of daily life activities. Our results showed that the although the number of event boundaries was higher in the 3PP condition than in the 1PP, no differences were observed for event segmentation qualitative abilities and organization. Memory of temporal order was better for events encoded in the 3PP than in the 1PP, while memory content was similar in both conditions. Higher event segmentation rates were correlated with a better recall of small actions and temporal order.

Visual perspective in autobiographical memories of self-incongruent episodes.

It is widely assumed that autobiographical memory relies on an integration of episodic memory with the self-model. We hypothesise that self-memory integration depends critically on self-congruence. More specifically, self-incongruent experiences such as those that elicit shame or guilt may be more difficult to integrate. Self-incongruence may affect both the semantic reports of memories and their phenomenological characteristics, in particular their visual perspective (1PP or 3PP, i.e., field or observer perspective), their affective valence, and their perceived centrality. Diary based memories were assigned to 4 categories (shame, guilt, negative, neutral) and were rated for the different phenomenological dimensions. We used a deep neural network, univariate and multilevel models to assess differences and relationships between different variables. We found that memories that elicited shame (but not guilt) showed more pronounced 3PP as compared to other experiences. Shameful episodes also elicited the most pronounced negative affect. A multilevel analysis revealed that the amount of shame that an episode elicited, and its semantic similarity with shame episodes, predicted higher 3PP, while affective valence did not. Our results show that self-incongruence affects memories both at the level of their semantic reports and their phenomenology, and thus contributes to a mechanistic understanding of self-memory integration.

Demonstrative systems: From linguistic typology to social cognition.

This study explores the connection between language and social cognition by empirically testing different typological analyses of various demonstrative systems. Linguistic typology classifies demonstrative systems as distance-oriented or person-oriented, depending on whether they indicate the location of a referent relative only to the speaker, or to both the speaker and the listener. From the perspective of social cognition, speakers of languages with person-oriented systems must monitor their listener's spatial location in order to accurately use their demonstratives, while speakers of languages with distance-oriented systems can use demonstratives from their own, egocentric perspective. Resolving an ongoing controversy around the nature of the Spanish demonstrative system, the results of Experiment 1 confirmed that this demonstrative system is person oriented, while the English system is distance oriented. Experiment 2 revealed that not all three-way demonstrative systems are person oriented, with Japanese speakers showing sensitivity to the listener's spatial location, while Turkish speakers did not show such an effect in their demonstrative choice. In Experiment 3, Catalan-Spanish bilinguals showed sensitivity to listener position in their choice of the Spanish distal form, but not in their choice of the medial form. These results were interpreted as a transfer effect from Catalan, which revealed analogous results to English. Experiment 4 investigated the use of demonstratives to redirect a listener's attention to the intended referent, which is a universal function of demonstratives that also hinges on social cognition. Japanese and Spanish speakers chose between their proximal and distal demonstratives flexibly, depending on whether the listener was looking closer or further from the referent, whereas Turkish speakers chose their medial form for attention correction. In conclusion, the results of this study support the view that investigating how speakers of different languages jointly use language and social cognition in communication has the potential to unravel the deep connection between these two fundamentally human capacities.

The eyes of the past: larger pupil size for autobiographical memories retrieved from field perspective.

BACKGROUND: Visual perspective during memory retrieval has mainly been evaluated with methodologies based on introspection and subjective reports. The current study investigates whether visual perspective can be evaluated with a physiological measurement: pupil dilation. METHODS: While their pupil diameter was measured with an eye-tracker, forty-five participants retrieved one memory from a field perspective (i.e., as viewed through our own eyes) and one memory from an observer perspective (i.e., as viewed from a spectator's standpoint). After retrieval, participants rated the emotional intensity of the memories. RESULTS: Analysis demonstrated larger pupils during the retrieval of memories from a field perspective and higher emotional intensity for memories retrieved from a field perspective. DISCUSSION: The larger pupils for memories recalled from a field perspective could, however, not be attributed to their higher emotional intensity. These findings suggest that pupil dilation could be used as a physiological assessment of visual perspective during memory retrieval.

Working memory capacity, mental rotation, and visual perspective taking: A study of the developmental cascade hypothesis.

The present study aimed to investigate the mechanism underlying the development of level 2 visual perspective taking (VPT2). Specifically, we examined the role of working memory capacity (WMC) and mental rotation (MR) in the developmental change of VPT2 among early school-aged children. Children aged between 6 and 8 years (N = 150) completed measures to assess WMC, MR, and VPT2. Results showed that WMC, the ability of MR, and VPT2 developed progressively from 6 to 8 years old. The ability of VPT2 was significantly correlated with WMC and MR, even when age was statistically controlled for. Mediation analyses further revealed that both age-related changes in WMC and MR partially mediated the development of VPT2. Furthermore, age-related development in MR mediated the relationship between changes of WMC and VPT2. Our findings suggest the importance of WMC and MR in the early development of VPT2 and provide preliminary support for the developmental cascade hypothesis. That is, as children grow up, their WMC increases, leading to better capability of MR, which in turn results in the improvement of VPT2.

The influence of shifting perspective on episodic and semantic details during autobiographical memory recall.

Shifting to a novel visual perspective during retrieval influences autobiographical memories (AM) and can lead to persistent changes in memories. Adopting an observer-like compared to an own eyes perspective reduces episodic information during AM recall, but less is known regarding how viewpoint influences semantic information. In the current study, we investigated how shifting from an own eyes to an observer-like perspective during narrative recall of AMs influences episodic and semantic information. Shifting perspective reduced the number of episodic details associated with emotions and thoughts, and also led to similar reductions in personal semantics. We replicated prior research showing that shifting perspective reduces emotional intensity in subsequent memories, but these subjective changes were not coupled with objective changes in a narrative recall. Our findings suggest that shifting perspective influences the interplay between episodic and semantic information during proximate recall and subjective changes when memories are later recalled.

Developmental changes of the neural mechanisms underlying level 2 visual perspective-taking: A functional near-infrared spectroscopy study.

The ability to understand the way other people see the world differs from one's own viewpoint is referred to as ''visual perspective-taking'' (VPT). Previous studies have demonstrated the behavioral performance in level 2 VPT (VPT2), the ability to understand that two different observers can have unique visual experiences of the same scene or object depending on the observers' physical location, changes during childhood. However, the developmental aspects underlying the neural mechanisms of VPT2 remains unknown. We measured the hemodynamic responses to a VPT2 task using functional near-infrared spectroscopy, with mental rotation (MR) as a control task in 7- to 11-year-old and 11- to 16-year-old groups. In the VPT2 task, participants were required to mentally compute the perspective of a toy on the turntable from that of a doll placed in a different location from the observer. For the MR task, participants reported their perspectives after the toy was rotated. We found significantly higher oxy-hemoglobin changes during the VPT2 task than the MR task in the 7- to 11-year-old group but not in the 11- to 16-year-old group, in the right middle and superior temporal, angular gyrus and frontal regions. These findings highlight the important role of the right temporoparietal region in processing perspective, up to 11 years.

Effects of non-invasive brain stimulation on visual perspective taking: A meta-analytic study.

Visual perspective taking (VPT) is a critical ability required by complex social interaction. Non-invasive brain stimulation (NIBS) has been increasingly used to examine the causal relationship between brain activity and VPT, yet with heterogeneous results. In the current study, we conducted two meta-analyses to examine the effects of NIBS of the right temporoparietal junction (rTPJ) or dorsomedial prefrontal cortex (dmPFC) on VPT, respectively. We performed a comprehensive literature search to identify qualified studies and computed the standardized effect size (ES) for each combination of VPT level (Level-1: visibility judgment; Level-2: mental rotation) and perspective (self and other). Thirteen studies (rTPJ: 12 studies, 23 ESs; dmPFC: 4 studies, 14 ESs) were included in the meta-analyses. Random-effects models were used to generate the overall effects. Subgroup analyses for distinct VPT conditions were also performed. We found that rTPJ stimulation significantly improved participants' visibility judgment from the allocentric perspective, whereas its effects on other VPT conditions are negligible. Stimulation of dmPFC appeared to influence Level-1 performance from the egocentric perspective, although this finding was only based on a small number of studies. Notably, contrary to some theoretical models, we did not find strong evidence that these regions are involved in Level-2 VPT with a higher requirement of mental rotation. These findings not only advance our understanding of the causal roles of the rTPJ and dmPFC in VPT, but also reveal that the efficacy of NIBS on VPT is relatively small. Additionally, researchers should also be cautious about the potential publication bias and selective reporting.

Visual perspective as a two-dimensional construct in episodic future thought.

Visual perspective (first-person vs. third-person) is a salient characteristic of memory and mental imagery with important cognitive and behavioural consequences. Most work on visual perspective treats it as a unidimensional construct. However, third-person perspective can have opposite effects on emotion and motivation, sometimes intensifying these and other times acting as a distancing mechanism, as in PTSD. For this reason among others, we propose that visual perspective in memory and mental imagery is best understood as varying along two dimensions: first, the degree to which first-person perspective predominates in the episodic imagery, and second, the degree to which the self is visually salient from a third-person perspective. We show that, in episodic future thinking, these are anticorrelated but non-redundant. These results further our basic understanding of the potent but divergent effects visual perspective has on emotion and motivation, both in everyday life and in psychiatric conditions.

The stability of visual perspective and vividness during mental time travel.

When remembering or imagining, people can experience an event from their own eyes, or as an outside observer, with differing levels of vividness. The perspective from, and vividness with, which a person remembers or imagines has been related to numerous individual difference characteristics. These findings require that phenomenology during mental time travel be trait-like-that people consistently experience similar perspectives and levels of vividness. This assumption remains untested. Across two studies (combined N = 295), we examined the stability of visual perspective and vividness across multiple trials and timepoints. Perspective and vividness showed weak within-session stability when reported across just a few trials but showed strong within-session stability when sufficient trials were collected. Importantly, both visual perspective and vividness demonstrated good-to-excellent across-session stability across different delay intervals (two days to six weeks). Overall, our results suggest that people dependably experience similar visual phenomenology across occurrences of mental time travel.

Inferring hidden objects from still and communicative onlookers at 8, 14, and 36 months of age.

The current study investigated across five eye-tracking experiments children's developing skill of adopting others' referential perspective (Level 1 perspective taking) and to what extent it involves automatic processes or requires ostensive communicative cues. Three age groups (8-, 14-, and 36-month-olds) were tested on their expectation of an object appearing behind one of two peripheral occluders. A centrally presented person in profile either provided an ostensive communicative pointing cue or sat still, oriented to one of the two occluders. The 14-month-olds anticipated the hidden object when the onlooker had communicatively pointed to the location, as revealed by faster target detection in congruent trials (latency effect) and longer dwell times to the empty side in incongruent trials (violation-of-expectation effect). This was not the case when a still person was only oriented to one side. Adding emotional expressions to the still person (Experiment 2) did not help to produce the effects. However, at 36 months of age (Experiment 3), children showed both effects for the still person. The 8-month-olds did not show the violation-of-expectation effect for communicative pointing (Experiment 4) or for a matched abbreviated reach (Experiment 5b), showing it only for a complete reach behind the occluder (Experiment 5a), although they were faster to detect the congruent object in Experiment 4 and 5a. Findings reveal that automatic perspective taking develops after communicative perspective taking and that communicative perspective taking is a developmental outcome of the first year of life. The developmental pattern suggests a continuous social construction process of perspective-taking skills.

The presence of other-race people disrupts spontaneous level-2 visual perspective taking.

Visual perspective taking is an essential skill for effective social interaction. Previous studies have tested various perceiver-based factors that affect intentional perspective taking; however, the factors affecting spontaneous perspective taking remain unknown. To fill this gap, the present study used a novel spontaneous visual perspective taking paradigm to explore how an agent's race and emotion affect spontaneous level-2 visual perspective taking. In Experiment 1, the participants completed a mental rotation task while a human agent simultaneously gazed at the target with positive, negative, or neutral facial expressions. The agent was African, Caucasian, or Chinese. The results revealed that the other-race agents disrupted the participants' spontaneous level-2 visual perspective taking, while emotion weakly affected it. Experiment 2 retested whether emotion could affect spontaneous level-2 visual perspective taking while only own-race agents were used. The participants completed the same task as that in Experiment 1. The results revealed that emotions weakly affected spontaneous level-2 visual perspective taking. In summary, the present study first examined what target-based factors affect spontaneous level-2 visual perspective taking. The results extend the representation and incorporation of the close others' responses (RICOR) model. Specifically, people routinely construct representations of other people's points of view when they share the same racial group.

Counting human chromosomes before 1960: preconceptions, perceptions and predilections.

In 1956 the biomedical world was surprised to hear a report that human cells each contained forty six chromosomes, rather than the forty eight count that had been documented since the 1920s. Application of available techniques to culture human cells in vitro, halt their division at metaphase, and disperse chromosomes in an optical plane permitted perception of visual images not seen before. Researchers continued to obtain the preconceived forty eight counts until reeducation with these novel epistemic 'chromosomes' convinced them that they could confidently report forty six chromosomes per cell. Within only a few years, and virtually without dissent, the social community of human cytogeneticists agreed upon a shared visual culture of human chromosome count and morphology. The initial forty six count proved not to be an anomaly. A new comparison of historical and ethnomethodological studies has suggested a better understanding of how applied technologies coupled with altered human perceptions established a new science. Human cytogenetics then collaborated with medical genetics to correlate changes in the new human karyotype with disorders of clinical significance.

Stimulation of the dorsolateral prefrontal cortex impacts conflict resolution in Level-1 visual perspective taking.

Theory of mind is the ability to understand others' beliefs, mental states, and knowledge. Perspective-taking is a key part of this capacity, and while previous research has suggested that calculating another's perspective is relatively straightforward, executive function is required to resolve the conflict between the self and that other perspective. Previous studies have shown that theory of mind is selectively impaired by transcranial magnetic stimulation (TMS) of the dorsolateral prefrontal cortex (DLPFC). However, it has been hitherto unclear as to which specific aspect of perspective-taking is impacted. The current study administered rTMS (N = 31 adult participants) to the DLPFC (active condition) and vertex (control condition) in a within-subjects design. Participants completed a L1 VPT task after each stimulation session, and focus (relative performance on self-perspective trials compared with other perspective trials) and conflict indices (relative ability to resolve competing self/other perspectives) were calculated. Results showed that stimulation of the DLPFC selectively impaired the conflict index, suggesting that the DLPFC may be causally related with the resolution of conflict between self and other perspectives, and that self-other interference may rely on domain-general processes.

Competitive children, cooperative mothers? Effect of various social factors on the retrospective and prospective use of theory of mind.

Our capacity to attribute mental states to others, or theory of mind (ToM), affects the way in which we manage social interactions. Likewise, the social scenario in which we find ourselves probably influences our use of ToM. In this study, 6-year-old children and adult women participated in pairs in a task where participants needed to infer their partner's behavior considering the partner's visual perception (Experiment 1), knowledge (Experiment 2), and false belief (Experiment 3) regarding the placement of rewards under cups. The results were analyzed according to the temporal direction of the inference (past or future behavior of the partner), the social context (competition or cooperation), and-in the case of women-the type of social relationship with their partner (another adult or their own child). Children solved only the visual perception task, and adults solved the three tasks but performed better in the visual perception task than in the false belief task, suggesting that not only developmental issues but also differences in the intrinsic difficulty of the tasks underlie children's results. The temporal direction of the inference, in contrast, did not influence their results. Whereas children performed better in the competition context, adults performed better in the cooperation context in one experiment. Moreover, women avoided competing against their own child, and even cooperated with her or him when this was against their own interest, suggesting that cooperation between mothers and children might have been a key driving force in the evolution of ToM in our species.

No evidence for automatic response activation with target onset in the avatar-compatibility task.

When people take the perspective of an avatar and perform a stimulus-response compatibility task, they generally show the same compatibility effects that are expected from the avatar's position instead of their own. In this study, we investigated if these effects are caused by automatic response activation, a concept featured in dual-route models of stimulus-response compatibility. In two experiments we asked 24 participants each to perform a compatibility task from an avatar's point of view. We introduced a delay between the presentation of the target and the avatar in half of the trials so that the participants had to wait until the avatar appeared to select the correct response. Because the automatic response activation is known to decay quickly, its influence is eliminated in this condition. In contrast to the prediction by the automatic response activation account, we observed a larger compatibility effect in the delayed condition with orthogonal (Experiment 1) and parallel (Experiment 2) stimulus-response pairings. Additionally, distributional analyses of the compatibility effects did not support the automaticity predictions. We conclude that these results call into question the role of automatic response activation for spatial compatibility in general and perspective-based compatibility effects in particular.

Do depressive symptoms and subjective well-being influence the valence or visual perspective of autobiographical memories in young adults?

The present study examines predictors of autobiographical memory valence and visual perspective. Participants (N = 144) between the ages of 18-35 years completed an online survey assessing depressive symptoms, and different aspects of subjective well-being (i.e., life satisfaction, positive affect, and negative affect). Participants retrieved six autobiographical memories cued via positive, negative, and neutral words and completed a questionnaire assessing characteristics of the memories, including memory valence and visual perspective. Using structural equation modelling, we found that the valence of neutral cued memories were significantly negatively associated with depressive symptoms and negative affect, and significantly positively associated with life satisfaction, even after controlling for current mood. Depressive symptoms were generally not significantly related to visual perspective. These results support previous findings that depressive symptoms and well-being are related to differences in memory characteristics but suggest that some of the relationships may be less robust when examined in a non-clinical sample.

Measuring visual perspective taking in the brain with avatars and arrows: Which question are we asking?

There is an ongoing debate about the involvement of Theory of Mind (ToM) processes in Visual Perspective Taking (VPT). In an fMRI study (Schurz et al., 2015), we borrowed the positive features from a novel VPT task - which is widely used in behavioral research - to study previously overlooked experimental factors in neuroimaging studies. However, as Catmur et al. (2016) rightly argue in a comment on our work, our data do not speak strongly to questions discussed in the original behavioral studies, in particular the issue of implicit mentalizing. We appreciate the clarification of these interpretational limitations of our study, but would like to point out the differences between questions emerging from behavioral and neuroimaging research on VPT. Different from what Catmur et al. (2016) discuss, our study was not intended as a test of implicit mentalizing. In fact, the terms "automatic" and "implicit mentalizing" were never mentioned in our manuscript. Our study addressed a methodological gap between ToM and VPT research, which we identified in two previous meta-analyses on the topics (Schurz et al., 2013, 2014). With this difference in mind we show that the critical points levelled by Catmur et al. (2016) cease to apply.