Memory for social media images following traumatic brain injury.

PRIMARY OBJECTIVE: An emerging body of research examines the role of computer-mediated communication in supporting social connection in persons with traumatic brain injury (TBI). We examine the cognitive impacts of engaging with images posted to social media for persons with moderate-severe TBI. RESEARCH DESIGN: Prior work shows that after viewing social media posts, adults have better memory for posts when they generate a comment about the post. We examined if persons with TBI experience a memory benefit for commented-upon social media images similar to non-injured comparison participants. METHODS AND PROCEDURES: 53 persons with moderate-to-severe TBI and 52 non-injured comparison participants viewed arrays of real social media images and were prompted to comment on some of them. After a brief delay, a surprise two-alternative forced choice recognition memory test measured memory for these images. MAIN OUTCOMES AND RESULTS: Persons with TBI remembered social media images at above-chance levels and experienced a commenting-related memory boost much like non-injured comparison participants. CONCLUSIONS: These findings add to a growing literature on the potential benefits of social media use in individuals with TBI and point to the benefits of active engagement for memory in social media contexts in TBI.

The Necessity of the Hippocampus for Statistical Learning.

Converging evidence points to a role for the hippocampus in statistical learning, but open questions about its necessity remain. Evidence for necessity comes from Schapiro and colleagues who report that a single patient with damage to hippocampus and broader medial temporal lobe cortex was unable to discriminate new from old sequences in several statistical learning tasks. The aim of the current study was to replicate these methods in a larger group of patients who have either damage localized to hippocampus or broader medial temporal lobe damage, to ascertain the necessity of the hippocampus in statistical learning. Patients with hippocampal damage consistently showed less learning overall compared with healthy comparison participants, consistent with an emerging consensus for hippocampal contributions to statistical learning. Interestingly, lesion size did not reliably predict performance. However, patients with hippocampal damage were not uniformly at chance and demonstrated above-chance performance in some task variants. These results suggest that hippocampus is necessary for statistical learning levels achieved by most healthy comparison participants but significant hippocampal pathology alone does not abolish such learning.

Memory for conversation and the development of common ground.

Efficient conversation is guided by the mutual knowledge, or common ground, that interlocutors form as a conversation progresses. Characterized from the perspective of commonly used measures of memory, efficient conversation should be closely associated with item memory-what was said-and context memory-who said what to whom. However, few studies have explicitly probed memory to evaluate what type of information is maintained following a communicative exchange. The current study examined how item and context memory relate to the development of common ground over the course of a conversation, and how these forms of memory vary as a function of one's role in a conversation as speaker or listener. The process of developing common ground was positively related to both item and context memory. In addition, content that was spoken was remembered better than content that was heard. Our findings illustrate how memory assessments can complement language measures by revealing the impact that basic conversational processes have on memory for what has been discussed. By taking this approach, we show that not only does the process of forming common ground facilitate communication in the present, but it also promotes an enduring record of that event, facilitating conversation into the future.

The malleability of linguistic representations poses a challenge to the priming-based experimental approach.

Recent findings show that experience with a syntactic structure has long-term consequences for how that structure will be processed in the future, which suggests that linguistic representations are not static entities that can be probed reliably without alteration. Thus, leveraging the effect of previous exposure to a syntactic structure appears to be an inappropriate method for studying invariant properties of language.

Linguistic features of spontaneous speech predict conversational recall.

Empirical studies of conversational recall show that the amount of conversation that can be recalled after a delay is limited and biased in favor of one's own contributions. What aspects of a conversational interaction shape what will and will not be recalled? This study aims to predict the contents of conversation that will be recalled based on linguistic features of what was said. Across 59 conversational dyads, we observed that two linguistic features that are hallmarks of interactive language use-disfluency (um/uh) and backchannelling (ok, yeah)-promoted recall. Two other features-disagreements between the interlocutors and use of "like"-were not predictive of recall. While self-generated material was better remembered overall, both hearing and producing disfluency and backchannels improved memory for the associated utterances. Finally, the disfluency-related memory boost was similar regardless of the number of disfluencies in the utterance. Overall, we conclude that interactional linguistic features of conversation are predictive of what is and is not recalled following conversation.

Attentional Orienting and Disfluency-Related Memory Boost Are Intact in Adults With Moderate-Severe Traumatic Brain Injury.

PURPOSE: Traumatic brain injury (TBI) is associated with a range of cognitive-communicative deficits that interfere with everyday communication and social interaction. Considerable effort has been directed at characterizing the nature and scope of cognitive-communication disorders in TBI, yet the underlying mechanisms of impairment are largely unspecified. The present research examines sensitivity to a common communicative cue, disfluency, and its impact on memory for spoken language in TBI. METHOD: Fifty-three participants with moderate-severe TBI and 53 noninjured comparison participants listened to a series of sentences, some of which contained disfluencies. A subsequent memory test probed memory for critical words in the sentences. RESULTS: Participants with TBI successfully remembered the spoken words (b = 1.57, p < .0001) at a similar level to noninjured comparison participants. Critically, participants with TBI also exhibited better recognition memory for words preceded by disfluency compared to words from fluent sentences (b = 0.57, p = .02). CONCLUSIONS: These findings advance mechanistic accounts of cognitive-communication disorder by revealing that, when isolated for experimental study, individuals with moderate-severe TBI are sensitive to attentional orienting cues in speech and exhibit enhanced recognition of individual words preceded by disfluency. These results suggest that some aspects of cognitive-communication disorders may not emerge from an inability to perceive and use individual communication cues, but rather from disruptions in managing (i.e., attending, weighting, integrating) multiple cognitive, communicative, and social cues in complex and dynamic interactions. This hypothesis warrants further investigation.

Memory for Conversation in Traumatic Brain Injury: A Feasibility Study and Preliminary Findings.

PURPOSE: Despite common clinical complaints about memory for conversation after traumatic brain injury (TBI), the nature and severity of this deficit are unknown. In this research note, we report feasibility and preliminary data from a new conversation memory study protocol. METHOD: Participants in this feasibility study were 10 pairs, each including an adult with chronic, moderate-to-severe TBI and their chosen familiar conversation partner. The experiment began with a naturalistic conversation between participants with TBI and their conversation partners. After a filled delay, participants next completed verbal recall for the conversation, which we transcribed and coded for their accuracy relative to the original conversation. Participants also read chosen statements from their original conversation and predicted what each partner would remember in a week. One week later, participants completed a posttest about who said each of the chosen statements, allowing direct comparison to their predictions. RESULTS: We successfully collected conversation memory data from all 10 pairs, suggesting that this protocol is feasible for future study. In this preliminary sample, people with TBI and their conversation partners did not differ in the accuracy of their recall for the conversation about 20 min after it occurred. When asked to predict their partner's delayed memory, conversation partners were less accurate than participants with TBI because they underestimated how much their partners with TBI would remember. CONCLUSION: Measuring memory for conversation in TBI is feasible and may advance the characterization of cognitive-communication impairment in TBI, and its heterogeneity, in everyday contexts. SUPPLEMENTAL MATERIAL: https://doi.org/10.23641/asha.25927513.

Keeping track of who knows what in multiparty conversation despite severe memory impairment.

Language use has long been understood to be tailored to the intended addressee, a process termed audience design. Audience design is reflected in multiple aspects of language use, including adjustments based on the addressee's knowledge about the topic at hand. In group settings, audience design depends on representations of multiple individuals, each of whom may have different knowledge about the conversational topic. A central question, then, concerns how these representations are encoded and retrieved in multiparty conversation where successful conversation requires keeping track of who knows what. In the present research, we probe the biological memory systems that are involved in this process of multiparty audience design. We present the results of two experiments that compare language use in persons with bilateral hippocampal damage and severe declarative memory impairment (amnesia), and demographically matched neurotypical comparison participants. Participants played a game in which they discussed abstract images with one partner in conversation, and then discussed the images again with the same partner or with a new partner in a three-party conversation. Neurotypical participants' language use reflected newly formed representations of which partner was familiar with which images. Participants with amnesia showed evidence of partner-specific audience design in multiparty conversation but it was attenuated, especially when success required rapid alternations between representations of common ground. The findings suggest partial independence of the formation and use of partner-specific representations from the hippocampal-dependent declarative memory system and highlight the unique contributions of the declarative memory system to flexible and dynamic language use.

Alcohol and common ground: The effects of intoxication on linguistic markers of shared understanding during social exchange.

OBJECTIVE: Most alcohol consumption takes place in social contexts, and the belief that alcohol enhances social interactions has been identified as among the more robust predictors of alcohol use disorder (AUD) development. Yet, we know little of how alcohol affects mental representations of others-what we share and do not share-nor the extent to which intoxication might impact the development of shared understanding (i.e., common ground) between interaction partners. Employing a randomized experimental design and objective linguistic outcome measures, we present two studies examining the impact of alcohol consumption on the development and use of common ground. METHOD: In Study 1, groups of strangers or friends were administered either alcohol (target Breath Alcohol Content = .08%) or a control beverage, following which they completed a task requiring them to develop a shared language to describe ambiguous images and then describe those images to either a knowledgeable or a naïve partner. The same procedures were completed in Study 2 using a within-subjects alcohol administration design and all-stranger groups. RESULTS: Study 1 findings did not reach significance but suggested that alcohol may facilitate common ground development selectively among stranger groups. This effect emerged as significant in the context of the within-subjects design of Study 2, b = -0.19, p = .007, with participants demonstrating greater facility in establishing common ground during alcohol versus control sessions. CONCLUSIONS: Results suggest that alcohol facilitates the development of shared linguistic understanding in novel social spaces, indicating common ground as one potential mechanism to consider in our broader examination of alcohol reinforcement and AUD etiology. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

What is the context of prediction?

We agree with Pickering & Garrod's (P&G's) claim that theories of language processing must address the interconnection of language production and comprehension. However, we have two concerns: First, the central notion of context when predicting what another person will say is underspecified. Second, it is not clear that P&G's dual-mechanism model captures the data better than a single-mechanism model would.

Inaugural editorial.

In this editorial, the new journal editor introduces herself and then describes her goals for the Journal of Experimental Psychology: General. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

The effect of disfluency on memory for what was said.

Disfluencies such as pauses, "um"s, and "uh"s are common interruptions in the speech stream. Previous work probing memory for disfluent speech shows memory benefits for disfluent compared to fluent materials. Complementary evidence from studies of language production and comprehension have been argued to show that different disfluency types appear in distinct contexts and, as a result, serve as a meaningful cue. If the disfluency-memory boost is a result of sensitivity to these form-meaning mappings, forms of disfluency that cue new upcoming information (fillers and pauses) may produce a stronger memory boost compared to forms that reflect speaker difficulty (repetitions). If the disfluency-memory boost is simply due to the attentional-orienting properties of a disruption to fluent speech, different disfluency forms may produce similar memory benefit. Experiments 1 and 2 compared the relative mnemonic benefit of three types of disfluent interruptions. Experiments 3 and 4 examined the scope of the disfluency-memory boost to probe its cognitive underpinnings. Across the four experiments, we observed a disfluency-memory boost for three types of disfluency that were tested. This boost was local and position dependent, only manifesting when the disfluency immediately preceded a critical memory probe word at the end of the sentence. Our findings reveal a short-lived disfluency-memory boost that manifests at the end of the sentence but is evoked by multiple types of disfluent forms, consistent with the idea that disfluencies bring attentional focus to immediately upcoming material. The downstream consequence of this localized memory benefit is better understanding and encoding of the speaker's message. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

The Multiple Perspectives Theory of Mental States in Communication.

Inspired by early proposals in philosophy, dominant accounts of language posit a central role for mutual knowledge, either encoded directly in common ground, or approximated through other cognitive mechanisms. Using existing empirical evidence from language and memory, we challenge this tradition, arguing that mutual knowledge captures only a subset of the mental states needed to support communication. In a novel theoretical proposal, we argue for a cognitive architecture that includes separate, distinct representations of the self and other, and a cognitive process that compares these representations continuously during conversation, outputting both similarities and differences in perspective. Our theory accounts for existing data, interfaces with findings from other cognitive domains, and makes novel predictions about the role of perspective in language use. We term this new account the Multiple Perspectives Theory of mental states in communication.

Items Outperform Adjectives in a Computational Model of Binary Semantic Classification.

Semantic memory encompasses one's knowledge about the world. Distributional semantic models, which construct vector spaces with embedded words, are a proposed framework for understanding the representational structure of human semantic knowledge. Unlike some classic semantic models, distributional semantic models lack a mechanism for specifying the properties of concepts, which raises questions regarding their utility for a general theory of semantic knowledge. Here, we develop a computational model of a binary semantic classification task, in which participants judged target words for the referent's size or animacy. We created a family of models, evaluating multiple distributional semantic models, and mechanisms for performing the classification. The most successful model constructed two composite representations for each extreme of the decision axis (e.g., one averaging together representations of characteristically big things and another of characteristically small things). Next, the target item was compared to each composite representation, allowing the model to classify more than 1,500 words with human-range performance and to predict response times. We propose that when making a decision on a binary semantic classification task, humans use task prompts to retrieve instances representative of the extremes on that semantic dimension and compare the probe to those instances. This proposal is consistent with the principles of the instance theory of semantic memory.

Intact speech-gesture integration in narrative recall by adults with moderate-severe traumatic brain injury.

PURPOSE: Real-world communication is situated in rich multimodal contexts, containing speech and gesture. Speakers often convey unique information in gesture that is not present in the speech signal (e.g., saying "He searched for a new recipe" while making a typing gesture). We examine the narrative retellings of participants with and without moderate-severe traumatic brain injury across three timepoints over two online Zoom sessions to investigate whether people with TBI can integrate information from co-occurring speech and gesture and if information from gesture persists across delays. METHODS: 60 participants with TBI and 60 non-injured peers watched videos of a narrator telling four short stories. On key details, the narrator produced complementary gestures that conveyed unique information. Participants retold the stories at three timepoints: immediately after, 20-min later, and one-week later. We examined the words participants used when retelling these key details, coding them as a Speech Match (e.g., "He searched for a new recipe"), a Gesture Match (e.g., "He searched for a new recipe online), or Other ("He looked for a new recipe"). We also examined whether participants produced representative gestures themselves when retelling these details. RESULTS: Despite recalling fewer story details, participants with TBI were as likely as non-injured peers to report information from gesture in their narrative retellings. All participants were more likely to report information from gesture and produce representative gestures themselves one-week later compared to immediately after hearing the story. CONCLUSION: We demonstrated that speech-gesture integration is intact after TBI in narrative retellings. This finding has exciting implications for the utility of gesture to support comprehension and memory after TBI and expands our understanding of naturalistic multimodal language processing in this population.

MEMCONS: How Contemporaneous Note-Taking Shapes Memory for Conversation.

Written memoranda of conversations, or memcons, provide a near-contemporaneous record of what was said in conversation, and offer important insights into the activities of high-profile individuals. We assess the impact of writing a memcon on memory for conversation. Pairs of participants engaged in conversation and were asked to recall the contents of that conversation 1 week later. One participant in each pair memorialized the content of the interaction in a memcon shortly after the conversation. Participants who generated memcons recalled more details of the conversations than participants who did not, but the content of recall was equally and largely accurate for both participants. Remarkably, only 4.7% of the details of the conversation were recalled by both of the partners after a week delay. Contemporaneous note-taking appears to enhance memory for conversation by increasing the amount of information remembered but not the accuracy of that information. These findings have implications for evaluating the testimony of participants on conversations with major political or legal ramifications.

Where to Look? Alcohol, Affect, and Gaze Behavior During a Virtual Social Interaction.

COVID-19 forced social interactions to move online. Yet researchers have little understanding of the mental health consequences of this shift. Given pandemic-related surges in emotional disorders and problematic drinking, it becomes imperative to understand the cognitive and affective processes involved in virtual interactions and the impact of alcohol in virtual social spaces. Participants (N=246) engaged in an online video call while their gaze behavior was tracked. Prior to the interaction, participants were randomly assigned to receive an alcoholic or control beverage. Participants' affect was repeatedly assessed. Results indicated that a proportionally larger amount of time spent gazing at oneself (vs. one's interaction partner) predicted significantly higher negative affect after the exchange. Further, alcohol independently increased self-directed attention, failing to demonstrate its typically potent social-affective enhancement in this virtual context. Results carry potential implications for understanding factors that increase risk for hazardous drinking and negative affect in our increasingly virtual world.

Incorporating Functional Response Time Effects into a Signal Detection Theory Model.

Signal detection theory (SDT; Tanner & Swets in Psychological Review 61:401-409, 1954) is a dominant modeling framework used for evaluating the accuracy of diagnostic systems that seek to distinguish signal from noise in psychology. Although the use of response time data in psychometric models has increased in recent years, the incorporation of response time data into SDT models remains a relatively underexplored approach to distinguishing signal from noise. Functional response time effects are hypothesized in SDT models, based on findings from other related psychometric models with response time data. In this study, an SDT model is extended to incorporate functional response time effects using smooth functions and to include all sources of variability in SDT model parameters across trials, participants, and items in the experimental data. The extended SDT model with smooth functions is formulated as a generalized linear mixed-effects model and implemented in the gamm4 R package. The extended model is illustrated using recognition memory data to understand how conversational language is remembered. Accuracy of parameter estimates and the importance of modeling variability in detecting the experimental condition effects and functional response time effects are shown in conditions similar to the empirical data set via a simulation study. In addition, the type 1 error rate of the test for a smooth function of response time is evaluated.

Temporary ambiguity and memory for the context of spoken language.

Spoken language is interpreted incrementally, with listeners considering multiple candidate meanings as words unfold over time. Due to incremental interpretation, when a speaker refers to something in the world, there is often temporary ambiguity regarding which of several candidate items in the referential context the speaker is referring to. Subsequent tests of recognition memory show that listeners have good memory for referenced items, but that listeners also sometimes recognize non-referenced items from the referential context that share features with items that were mentioned. Predicted or inferred (but not experienced) interpretations of what was said are also sometimes retained in memory. While these findings indicate that multiple items from the referential context may be encoded in memory, the mechanisms supporting memory for the context of language use remain poorly understood. This paper tests the hypothesis that a consequence of temporary ambiguity in spoken language is enhanced memory for the items in the referential context. Two experiments demonstrate that periods of temporary referential ambiguity boost memory for non-referenced items in the referential context. Items that temporarily matched the unfolding referring expression were better remembered than those that did not. The longer the period of ambiguity, the stronger the memory boost, particularly for items activated early in the expression. In sum, the fact that spoken language unfolds over time creates momentary ambiguity about the speaker's intention; this ambiguity, in turn, allows the listener to later remember not only what the speaker did say, but also what they could have, but did not.

Space-time modeling of intensive binary time series eye-tracking data using a generalized additive logistic regression model.

Eye-tracking has emerged as a popular method for empirical studies of cognitive processes across multiple substantive research areas. Eye-tracking systems are capable of automatically generating fixation-location data over time at high temporal resolution. Often, the researcher obtains a binary measure of whether or not, at each point in time, the participant is fixating on a critical interest area or object in the real world or in a computerized display. Eye-tracking data are characterized by spatial-temporal correlations and random variability, driven by multiple fine-grained observations taken over small time intervals (e.g., every 10 ms). Ignoring these data complexities leads to biased inferences for the covariates of interest such as experimental condition effects. This article presents a novel application of a generalized additive logistic regression model for intensive binary time series eye-tracking data from a between- and within-subjects experimental design. The model is formulated as a generalized additive mixed model (GAMM) and implemented in the mgcv R package. The generalized additive logistic regression model was illustrated using an empirical data set aimed at understanding the accommodation of regional accents in spoken language processing. Accuracy of parameter estimates and the importance of modeling the spatial-temporal correlations in detecting the experimental condition effects were shown in conditions similar to our empirical data set via a simulation study. (PsycInfo Database Record (c) 2022 APA, all rights reserved).