Temporal organization of narrative recall is present but attenuated in adults with hippocampal amnesia.

Studies of the impact of brain injury on memory processes often focus on the quantity and episodic richness of those recollections. Here, we argue that the organization of one's recollections offers critical insights into the impact of brain injury on functional memory. It is well-established in studies of word list memory that free recall of unrelated words exhibits a clear temporal organization. This temporal contiguity effect refers to the fact that the order in which word lists are recalled reflects the original presentation order. Little is known, however, about the organization of recall for semantically rich materials, nor how recall organization is impacted by hippocampal damage and memory impairment. The present research is the first study, to our knowledge, of temporal organization in semantically rich narratives in three groups: (1) Adults with bilateral hippocampal damage and severe declarative memory impairment, (2) adults with bilateral ventromedial prefrontal cortex (vmPFC) damage and no memory impairment, and (3) demographically matched non-brain-injured comparison participants. We find that although the narrative recall of adults with bilateral hippocampal damage reflected the temporal order in which those narratives were experienced above chance levels, their temporal contiguity effect was significantly attenuated relative to comparison groups. In contrast, individuals with vmPFC damage did not differ from non-brain-injured comparison participants in temporal contiguity. This pattern of group differences yields insights into the cognitive and neural systems that support the use of temporal organization in recall. These data provide evidence that the retrieval of temporal context in narrative recall is hippocampal-dependent, whereas damage to the vmPFC does not impair the temporal organization of narrative recall. This evidence of limited but demonstrable organization of memory in participants with hippocampal damage and amnesia speaks to the power of narrative structures in supporting meaningfully organized recall despite memory impairment.

Comparing Functional Trend and Learning among Groups in Intensive Binary Longitudinal Eye-Tracking Data using By-Variable Smooth Functions of GAMM.

This paper presents a model specification for group comparisons regarding a functional trend over time within a trial and learning across a series of trials in intensive binary longitudinal eye-tracking data. The functional trend and learning effects are modeled using by-variable smooth functions. This model specification is formulated as a generalized additive mixed model, which allowed for the use of the freely available mgcv package (Wood in Package 'mgcv.' https://cran.r-project.org/web/packages/mgcv/mgcv.pdf , 2023) in R. The model specification was applied to intensive binary longitudinal eye-tracking data, where the questions of interest concern differences between individuals with and without brain injury in their real-time language comprehension and how this affects their learning over time. The results of the simulation study show that the model parameters are recovered well and the by-variable smooth functions are adequately predicted in the same condition as those found in the application.

Memory for Conversation in Traumatic Brain Injury: A Feasibility Study and Preliminary Findings.

PURPOSE: Despite common clinical complaints about memory for conversation after traumatic brain injury (TBI), the nature and severity of this deficit are unknown. In this research note, we report feasibility and preliminary data from a new conversation memory study protocol. METHOD: Participants in this feasibility study were 10 pairs, each including an adult with chronic, moderate-to-severe TBI and their chosen familiar conversation partner. The experiment began with a naturalistic conversation between participants with TBI and their conversation partners. After a filled delay, participants next completed verbal recall for the conversation, which we transcribed and coded for their accuracy relative to the original conversation. Participants also read chosen statements from their original conversation and predicted what each partner would remember in a week. One week later, participants completed a posttest about who said each of the chosen statements, allowing direct comparison to their predictions. RESULTS: We successfully collected conversation memory data from all 10 pairs, suggesting that this protocol is feasible for future study. In this preliminary sample, people with TBI and their conversation partners did not differ in the accuracy of their recall for the conversation about 20 min after it occurred. When asked to predict their partner's delayed memory, conversation partners were less accurate than participants with TBI because they underestimated how much their partners with TBI would remember. CONCLUSION: Measuring memory for conversation in TBI is feasible and may advance the characterization of cognitive-communication impairment in TBI, and its heterogeneity, in everyday contexts. SUPPLEMENTAL MATERIAL: https://doi.org/10.23641/asha.25927513.

Attentional Orienting and Disfluency-Related Memory Boost Are Intact in Adults With Moderate-Severe Traumatic Brain Injury.

PURPOSE: Traumatic brain injury (TBI) is associated with a range of cognitive-communicative deficits that interfere with everyday communication and social interaction. Considerable effort has been directed at characterizing the nature and scope of cognitive-communication disorders in TBI, yet the underlying mechanisms of impairment are largely unspecified. The present research examines sensitivity to a common communicative cue, disfluency, and its impact on memory for spoken language in TBI. METHOD: Fifty-three participants with moderate-severe TBI and 53 noninjured comparison participants listened to a series of sentences, some of which contained disfluencies. A subsequent memory test probed memory for critical words in the sentences. RESULTS: Participants with TBI successfully remembered the spoken words (b = 1.57, p < .0001) at a similar level to noninjured comparison participants. Critically, participants with TBI also exhibited better recognition memory for words preceded by disfluency compared to words from fluent sentences (b = 0.57, p = .02). CONCLUSIONS: These findings advance mechanistic accounts of cognitive-communication disorder by revealing that, when isolated for experimental study, individuals with moderate-severe TBI are sensitive to attentional orienting cues in speech and exhibit enhanced recognition of individual words preceded by disfluency. These results suggest that some aspects of cognitive-communication disorders may not emerge from an inability to perceive and use individual communication cues, but rather from disruptions in managing (i.e., attending, weighting, integrating) multiple cognitive, communicative, and social cues in complex and dynamic interactions. This hypothesis warrants further investigation.

Linguistic features of spontaneous speech predict conversational recall.

Empirical studies of conversational recall show that the amount of conversation that can be recalled after a delay is limited and biased in favor of one's own contributions. What aspects of a conversational interaction shape what will and will not be recalled? This study aims to predict the contents of conversation that will be recalled based on linguistic features of what was said. Across 59 conversational dyads, we observed that two linguistic features that are hallmarks of interactive language use-disfluency (um/uh) and backchannelling (ok, yeah)-promoted recall. Two other features-disagreements between the interlocutors and use of "like"-were not predictive of recall. While self-generated material was better remembered overall, both hearing and producing disfluency and backchannels improved memory for the associated utterances. Finally, the disfluency-related memory boost was similar regardless of the number of disfluencies in the utterance. Overall, we conclude that interactional linguistic features of conversation are predictive of what is and is not recalled following conversation.

Alcohol and common ground: The effects of intoxication on linguistic markers of shared understanding during social exchange.

OBJECTIVE: Most alcohol consumption takes place in social contexts, and the belief that alcohol enhances social interactions has been identified as among the more robust predictors of alcohol use disorder (AUD) development. Yet, we know little of how alcohol affects mental representations of others-what we share and do not share-nor the extent to which intoxication might impact the development of shared understanding (i.e., common ground) between interaction partners. Employing a randomized experimental design and objective linguistic outcome measures, we present two studies examining the impact of alcohol consumption on the development and use of common ground. METHOD: In Study 1, groups of strangers or friends were administered either alcohol (target Breath Alcohol Content = .08%) or a control beverage, following which they completed a task requiring them to develop a shared language to describe ambiguous images and then describe those images to either a knowledgeable or a naïve partner. The same procedures were completed in Study 2 using a within-subjects alcohol administration design and all-stranger groups. RESULTS: Study 1 findings did not reach significance but suggested that alcohol may facilitate common ground development selectively among stranger groups. This effect emerged as significant in the context of the within-subjects design of Study 2, b = -0.19, p = .007, with participants demonstrating greater facility in establishing common ground during alcohol versus control sessions. CONCLUSIONS: Results suggest that alcohol facilitates the development of shared linguistic understanding in novel social spaces, indicating common ground as one potential mechanism to consider in our broader examination of alcohol reinforcement and AUD etiology. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Keeping track of who knows what in multiparty conversation despite severe memory impairment.

Language use has long been understood to be tailored to the intended addressee, a process termed audience design. Audience design is reflected in multiple aspects of language use, including adjustments based on the addressee's knowledge about the topic at hand. In group settings, audience design depends on representations of multiple individuals, each of whom may have different knowledge about the conversational topic. A central question, then, concerns how these representations are encoded and retrieved in multiparty conversation where successful conversation requires keeping track of who knows what. In the present research, we probe the biological memory systems that are involved in this process of multiparty audience design. We present the results of two experiments that compare language use in persons with bilateral hippocampal damage and severe declarative memory impairment (amnesia), and demographically matched neurotypical comparison participants. Participants played a game in which they discussed abstract images with one partner in conversation, and then discussed the images again with the same partner or with a new partner in a three-party conversation. Neurotypical participants' language use reflected newly formed representations of which partner was familiar with which images. Participants with amnesia showed evidence of partner-specific audience design in multiparty conversation but it was attenuated, especially when success required rapid alternations between representations of common ground. The findings suggest partial independence of the formation and use of partner-specific representations from the hippocampal-dependent declarative memory system and highlight the unique contributions of the declarative memory system to flexible and dynamic language use.

Memory for social media images following traumatic brain injury.

PRIMARY OBJECTIVE: An emerging body of research examines the role of computer-mediated communication in supporting social connection in persons with traumatic brain injury (TBI). We examine the cognitive impacts of engaging with images posted to social media for persons with moderate-severe TBI. RESEARCH DESIGN: Prior work shows that after viewing social media posts, adults have better memory for posts when they generate a comment about the post. We examined if persons with TBI experience a memory benefit for commented-upon social media images similar to non-injured comparison participants. METHODS AND PROCEDURES: 53 persons with moderate-to-severe TBI and 52 non-injured comparison participants viewed arrays of real social media images and were prompted to comment on some of them. After a brief delay, a surprise two-alternative forced choice recognition memory test measured memory for these images. MAIN OUTCOMES AND RESULTS: Persons with TBI remembered social media images at above-chance levels and experienced a commenting-related memory boost much like non-injured comparison participants. CONCLUSIONS: These findings add to a growing literature on the potential benefits of social media use in individuals with TBI and point to the benefits of active engagement for memory in social media contexts in TBI.

Items Outperform Adjectives in a Computational Model of Binary Semantic Classification.

Semantic memory encompasses one's knowledge about the world. Distributional semantic models, which construct vector spaces with embedded words, are a proposed framework for understanding the representational structure of human semantic knowledge. Unlike some classic semantic models, distributional semantic models lack a mechanism for specifying the properties of concepts, which raises questions regarding their utility for a general theory of semantic knowledge. Here, we develop a computational model of a binary semantic classification task, in which participants judged target words for the referent's size or animacy. We created a family of models, evaluating multiple distributional semantic models, and mechanisms for performing the classification. The most successful model constructed two composite representations for each extreme of the decision axis (e.g., one averaging together representations of characteristically big things and another of characteristically small things). Next, the target item was compared to each composite representation, allowing the model to classify more than 1,500 words with human-range performance and to predict response times. We propose that when making a decision on a binary semantic classification task, humans use task prompts to retrieve instances representative of the extremes on that semantic dimension and compare the probe to those instances. This proposal is consistent with the principles of the instance theory of semantic memory.

Intact speech-gesture integration in narrative recall by adults with moderate-severe traumatic brain injury.

PURPOSE: Real-world communication is situated in rich multimodal contexts, containing speech and gesture. Speakers often convey unique information in gesture that is not present in the speech signal (e.g., saying "He searched for a new recipe" while making a typing gesture). We examine the narrative retellings of participants with and without moderate-severe traumatic brain injury across three timepoints over two online Zoom sessions to investigate whether people with TBI can integrate information from co-occurring speech and gesture and if information from gesture persists across delays. METHODS: 60 participants with TBI and 60 non-injured peers watched videos of a narrator telling four short stories. On key details, the narrator produced complementary gestures that conveyed unique information. Participants retold the stories at three timepoints: immediately after, 20-min later, and one-week later. We examined the words participants used when retelling these key details, coding them as a Speech Match (e.g., "He searched for a new recipe"), a Gesture Match (e.g., "He searched for a new recipe online), or Other ("He looked for a new recipe"). We also examined whether participants produced representative gestures themselves when retelling these details. RESULTS: Despite recalling fewer story details, participants with TBI were as likely as non-injured peers to report information from gesture in their narrative retellings. All participants were more likely to report information from gesture and produce representative gestures themselves one-week later compared to immediately after hearing the story. CONCLUSION: We demonstrated that speech-gesture integration is intact after TBI in narrative retellings. This finding has exciting implications for the utility of gesture to support comprehension and memory after TBI and expands our understanding of naturalistic multimodal language processing in this population.

The Multiple Perspectives Theory of Mental States in Communication.

Inspired by early proposals in philosophy, dominant accounts of language posit a central role for mutual knowledge, either encoded directly in common ground, or approximated through other cognitive mechanisms. Using existing empirical evidence from language and memory, we challenge this tradition, arguing that mutual knowledge captures only a subset of the mental states needed to support communication. In a novel theoretical proposal, we argue for a cognitive architecture that includes separate, distinct representations of the self and other, and a cognitive process that compares these representations continuously during conversation, outputting both similarities and differences in perspective. Our theory accounts for existing data, interfaces with findings from other cognitive domains, and makes novel predictions about the role of perspective in language use. We term this new account the Multiple Perspectives Theory of mental states in communication.

Where to Look? Alcohol, Affect, and Gaze Behavior During a Virtual Social Interaction.

COVID-19 forced social interactions to move online. Yet researchers have little understanding of the mental health consequences of this shift. Given pandemic-related surges in emotional disorders and problematic drinking, it becomes imperative to understand the cognitive and affective processes involved in virtual interactions and the impact of alcohol in virtual social spaces. Participants (N=246) engaged in an online video call while their gaze behavior was tracked. Prior to the interaction, participants were randomly assigned to receive an alcoholic or control beverage. Participants' affect was repeatedly assessed. Results indicated that a proportionally larger amount of time spent gazing at oneself (vs. one's interaction partner) predicted significantly higher negative affect after the exchange. Further, alcohol independently increased self-directed attention, failing to demonstrate its typically potent social-affective enhancement in this virtual context. Results carry potential implications for understanding factors that increase risk for hazardous drinking and negative affect in our increasingly virtual world.

MEMCONS: How Contemporaneous Note-Taking Shapes Memory for Conversation.

Written memoranda of conversations, or memcons, provide a near-contemporaneous record of what was said in conversation, and offer important insights into the activities of high-profile individuals. We assess the impact of writing a memcon on memory for conversation. Pairs of participants engaged in conversation and were asked to recall the contents of that conversation 1 week later. One participant in each pair memorialized the content of the interaction in a memcon shortly after the conversation. Participants who generated memcons recalled more details of the conversations than participants who did not, but the content of recall was equally and largely accurate for both participants. Remarkably, only 4.7% of the details of the conversation were recalled by both of the partners after a week delay. Contemporaneous note-taking appears to enhance memory for conversation by increasing the amount of information remembered but not the accuracy of that information. These findings have implications for evaluating the testimony of participants on conversations with major political or legal ramifications.

Incorporating Functional Response Time Effects into a Signal Detection Theory Model.

Signal detection theory (SDT; Tanner & Swets in Psychological Review 61:401-409, 1954) is a dominant modeling framework used for evaluating the accuracy of diagnostic systems that seek to distinguish signal from noise in psychology. Although the use of response time data in psychometric models has increased in recent years, the incorporation of response time data into SDT models remains a relatively underexplored approach to distinguishing signal from noise. Functional response time effects are hypothesized in SDT models, based on findings from other related psychometric models with response time data. In this study, an SDT model is extended to incorporate functional response time effects using smooth functions and to include all sources of variability in SDT model parameters across trials, participants, and items in the experimental data. The extended SDT model with smooth functions is formulated as a generalized linear mixed-effects model and implemented in the gamm4 R package. The extended model is illustrated using recognition memory data to understand how conversational language is remembered. Accuracy of parameter estimates and the importance of modeling variability in detecting the experimental condition effects and functional response time effects are shown in conditions similar to the empirical data set via a simulation study. In addition, the type 1 error rate of the test for a smooth function of response time is evaluated.

Inaugural editorial.

In this editorial, the new journal editor introduces herself and then describes her goals for the Journal of Experimental Psychology: General. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

The effect of disfluency on memory for what was said.

Disfluencies such as pauses, "um"s, and "uh"s are common interruptions in the speech stream. Previous work probing memory for disfluent speech shows memory benefits for disfluent compared to fluent materials. Complementary evidence from studies of language production and comprehension have been argued to show that different disfluency types appear in distinct contexts and, as a result, serve as a meaningful cue. If the disfluency-memory boost is a result of sensitivity to these form-meaning mappings, forms of disfluency that cue new upcoming information (fillers and pauses) may produce a stronger memory boost compared to forms that reflect speaker difficulty (repetitions). If the disfluency-memory boost is simply due to the attentional-orienting properties of a disruption to fluent speech, different disfluency forms may produce similar memory benefit. Experiments 1 and 2 compared the relative mnemonic benefit of three types of disfluent interruptions. Experiments 3 and 4 examined the scope of the disfluency-memory boost to probe its cognitive underpinnings. Across the four experiments, we observed a disfluency-memory boost for three types of disfluency that were tested. This boost was local and position dependent, only manifesting when the disfluency immediately preceded a critical memory probe word at the end of the sentence. Our findings reveal a short-lived disfluency-memory boost that manifests at the end of the sentence but is evoked by multiple types of disfluent forms, consistent with the idea that disfluencies bring attentional focus to immediately upcoming material. The downstream consequence of this localized memory benefit is better understanding and encoding of the speaker's message. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Evidence of Audience Design in Amnesia: Adaptation in Gesture but Not Speech.

Speakers design communication for their audience, providing more information in both speech and gesture when their listener is naïve to the topic. We test whether the hippocampal declarative memory system contributes to multimodal audience design. The hippocampus, while traditionally linked to episodic and relational memory, has also been linked to the ability to imagine the mental states of others and use language flexibly. We examined the speech and gesture use of four patients with hippocampal amnesia when describing how to complete everyday tasks (e.g., how to tie a shoe) to an imagined child listener and an adult listener. Although patients with amnesia did not increase their total number of words and instructional steps for the child listener, they did produce representational gestures at significantly higher rates for the imagined child compared to the adult listener. They also gestured at similar frequencies to neurotypical peers, suggesting that hand gesture can be a meaningful communicative resource, even in the case of severe declarative memory impairment. We discuss the contributions of multiple memory systems to multimodal audience design and the potential of gesture to act as a window into the social cognitive processes of individuals with neurologic disorders.

Space-time modeling of intensive binary time series eye-tracking data using a generalized additive logistic regression model.

Eye-tracking has emerged as a popular method for empirical studies of cognitive processes across multiple substantive research areas. Eye-tracking systems are capable of automatically generating fixation-location data over time at high temporal resolution. Often, the researcher obtains a binary measure of whether or not, at each point in time, the participant is fixating on a critical interest area or object in the real world or in a computerized display. Eye-tracking data are characterized by spatial-temporal correlations and random variability, driven by multiple fine-grained observations taken over small time intervals (e.g., every 10 ms). Ignoring these data complexities leads to biased inferences for the covariates of interest such as experimental condition effects. This article presents a novel application of a generalized additive logistic regression model for intensive binary time series eye-tracking data from a between- and within-subjects experimental design. The model is formulated as a generalized additive mixed model (GAMM) and implemented in the mgcv R package. The generalized additive logistic regression model was illustrated using an empirical data set aimed at understanding the accommodation of regional accents in spoken language processing. Accuracy of parameter estimates and the importance of modeling the spatial-temporal correlations in detecting the experimental condition effects were shown in conditions similar to our empirical data set via a simulation study. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Temporary ambiguity and memory for the context of spoken language.

Spoken language is interpreted incrementally, with listeners considering multiple candidate meanings as words unfold over time. Due to incremental interpretation, when a speaker refers to something in the world, there is often temporary ambiguity regarding which of several candidate items in the referential context the speaker is referring to. Subsequent tests of recognition memory show that listeners have good memory for referenced items, but that listeners also sometimes recognize non-referenced items from the referential context that share features with items that were mentioned. Predicted or inferred (but not experienced) interpretations of what was said are also sometimes retained in memory. While these findings indicate that multiple items from the referential context may be encoded in memory, the mechanisms supporting memory for the context of language use remain poorly understood. This paper tests the hypothesis that a consequence of temporary ambiguity in spoken language is enhanced memory for the items in the referential context. Two experiments demonstrate that periods of temporary referential ambiguity boost memory for non-referenced items in the referential context. Items that temporarily matched the unfolding referring expression were better remembered than those that did not. The longer the period of ambiguity, the stronger the memory boost, particularly for items activated early in the expression. In sum, the fact that spoken language unfolds over time creates momentary ambiguity about the speaker's intention; this ambiguity, in turn, allows the listener to later remember not only what the speaker did say, but also what they could have, but did not.

Referential Form and Memory for the Discourse History.

The way we refer to things in the world is shaped by the immediate physical context as well as the discourse history. But what part of the discourse history is relevant to language use in the present? In four experiments, we combine the study of task-based conversation with measures of recognition memory to examine the role of physical contextual cues that shape what speakers perceive to be a part of the relevant discourse history. Our studies leverage the differentiation effect, a phenomenon in which speakers are more likely to use a modified expression to refer to an object (e.g., dotted sock) if they had previously described a similar object (e.g., striped sock) than when they had not described a similar object. Two physical cues-the background that framed the to-be-described pictures and the position of the pictures in the display-were manipulated to alter perceptions about the relevant discourse context. We measured the rate with which speakers modify referring expressions to differentiate current from past referents. Recognition memory measures following the conversation probed what was and was not remembered about past discourse referents and contexts. Analysis of modification rates indicated that these contextual grouping cues shaped perceptions about the relevant discourse context. The contextual cues did not affect memory for the referents, but the memory for past referents was better for speakers than for listeners. Our findings show that perceptions about the relevant discourse history are a key determinant of how language is used in the moment but also that conversational partners form asymmetric representations of the discourse history.