Using mouse tracking to investigate auditory taboo effects in first and second language speakers of American English.

Researchers have argued that bilingual speakers experience less emotion in their second language. However, some studies have failed to find differences in emotionality between first and second language speakers. We used computer mouse tracking in an auditory lexical decision task to examine taboo effects - more efficient processing of taboo than neutral words - in first (L1) and second (L2) language speakers of American English. As predicted, we found an effect of language (L1 participants processed words more efficiently than L2 participants did) and a taboo effect (taboo words were processed more efficiently than neutral words). Interestingly, the language by taboo interaction (less emotionality in second language) emerged in number of errors and in the mouse trajectories, but it did not emerge in reaction times. We discuss how different aspects of participants' responses are likely to capture different underlying cognitive processes. We conclude, as other researchers have reported and many bilinguals experience, that language processing in second language is less emotional.

Are There Age Differences in Consolidated Episodic Memory?

Background/Study Context: While most aging research on memory uses a retention interval of one hour or less, episodic consolidation takes longer (e.g., 6-24 hours for synaptic consolidation). In three experiments, we examined age differences in recall followed by recognition in which the retention interval was varied in younger and older adults. METHODS: In Experiment 1 (n = 24 for both age groups), zero-, 1- and 24-hour retention intervals were used for recall for all participants, and a 24-hour retention interval was used for recognition. In Experiment 2 (n = 24 for both age groups), just a 24-hour retention interval was used. In Experiment 3 (n = 20 for both age groups), a within-subjects design was used in which participants recalled one word list after one hour and again after 24 hours, and recalled another word list just after 24 hours (with recognition for both conditions after the 24-hour recall). RESULTS: In Experiment 1, older adults recalled fewer words at both the 1- and 24-hour retention intervals, but the magnitude of the age difference did not differ. In Experiment 2 (just 24-hour retention interval), there were no age differences in recall. In Experiment 3, in the two-recall condition, older adults showed lower recall at both 1-hour and 24-hour retention intervals (but the magnitude of the age difference remained constant across retention interval). In the single-recall just 24-hour retention condition, there were no age differences. There were no age differences in recognition in any of the three experiments. CONCLUSION: These results suggest that recall declines for a 24-hour retention interval relative to a zero or one-hour retention interval (Experiments 1 and 3) for both age groups. However, when the first recall attempt occurs after a 24-hour retention interval, there are no age differences. These replicated results suggest that older adults do not benefit as much as younger adults from pre-consolidated rehearsal, but that rehearsal-based age differences do not increase in magnitude from the last rehearsal to memory consolidation. Furthermore, (along with), the present results indicate that there are no age differences in recall when the first recall attempt occurs after a long retention interval - when memory consolidation is likely to have occurred before the first retrieval attempt.

Examining listeners' perception of spoken words with different face masks.

The COVID-19 pandemic made face masks part of daily life. While masks protect against the virus, it is important to understand the impact masks have on listeners' recognition of spoken words. We examined spoken word recognition under three different mask conditions (no mask; cloth mask; Kn95 mask) and in both easy (low density, high phonotactic probability) and hard (high density, low phonotactic probability) words in a lexical decision task. In Experiment 1, participants heard all words and nonwords under all three mask conditions. In Experiment 2, participants heard each word and nonword only once under one of the mask conditions. The reaction time and accuracy results were consistent between Experiments 1 and 2. The pattern of results was such that the no mask condition produced the fastest and most accurate responses followed by the Kn95 mask condition and the cloth mask condition, respectively. Furthermore, there was a trend towards a speed-accuracy trade-off with Word Type. Easy words produced faster but less accurate responses relative to hard words. The finding that cloth masks had a more detrimental impact on spoken word recognition than Kn95 masks is consistent with previous research, and the current results further demonstrate that this effect extends to individual word recognition tasks with only audio presentation.

Hemispheric differences in the recognition of environmental sounds.

Recent work has found support for two dissociable and parallel neural subsystems underlying object and shape recognition in the visual domain: an abstract-category subsystem that operates more effectively in the left cerebral hemisphere than in the right, and a specific-exemplar subsystem that operates more effectively in the right hemisphere than in the left. Evidence of this asymmetry has been observed for linguistic stimuli (words, pseudoword forms) and nonlinguistic stimuli (objects). In the auditory domain, we previously found hemispheric asymmetries in priming effects using linguistic stimuli (spoken words). In the present study, we conducted four long-term repetition-priming experiments to investigate whether such hemispheric asymmetries would be observed for nonlinguistic auditory stimuli (environmental sounds) as well. The results support the dissociable-subsystems theory. Specificity effects were obtained when sounds were presented to the left ear (right hemisphere), but not when sounds were presented to the right ear (left hemisphere). Theoretical implications are discussed.

Responses to Semantically Neutral Words in Varying Emotional Intonations.

Purpose Recent research on perception of emotionally charged material has found both an "emotionality effect" in which participants respond differently to emotionally charged stimuli relative to neutral stimuli in some cognitive-linguistic tasks and a "negativity bias" in which participants respond differently to negatively charged stimuli relative to neutral and positively charged stimuli. The current study investigated young adult listeners' bias when responding to neutral-meaning words in 2 tasks that varied attention to emotional intonation. Method Half the participants completed a word identification task in which they were instructed to type a word they had heard presented binaurally through Sony stereo MDR-ZX100 headphones. The other half of the participants completed an intonation identification task in which they were instructed to use a SuperLab RB-740 button box to identify the emotional prosody of the same words over headphones. For both tasks, all auditory stimuli were semantically neutral words spoken in happy, sad, and neutral emotional intonations. Researchers measured percent correct and reaction time (RT) for each word in both tasks. Results In the word identification task, when identifying semantically neutral words spoken in happy, sad, and neutral intonations, listeners' RTs to words in a sad intonation were longer than RTs to words in a happy intonation. In the intonation identification task, when identifying the emotional intonation of the same words spoken in the same emotional tones of voice, listeners' RTs to words in a sad intonation were significantly faster than those in a neutral intonation. Conclusions Results demonstrate a potential attentional negativity bias for neutral words varying in emotional intonation. Such results support an attention-based theoretical account. In an intonation identification task, an advantage emerged for words in a negative (sad) intonation relative to words in a neutral intonation. Thus, current models of emotional speech should acknowledge the amount of attention to emotional content (i.e., prosody) necessary to complete a cognitive task, as it has the potential to bias processing.

Bilingualism and age are continuous variables that influence executive function.

We analyzed the effects of bilingualism and age on executive function. We examined these variables along a continuum, as opposed to dichotomizing them. We investigated the impact that bilingualism and age have on two measures of executive control (Stroop and Flanker). The mouse-tracking paradigm allowed us to examine the continuous dynamics of the responses as participants completed each trial. First, we found that the Stroop effect was reduced with younger age and higher levels of bilingualism; however, no Bilingualism by Age interaction emerged. Second, after controlling for baseline, the Flanker effect was not influenced by bilingualism or age. These results support the notion that bilingualism is one way of enhancing some aspects of executive function - specifically those related to the Stroop task - across the adult life span. In sum, different levels of bilingualism, and different ages, result in varying degrees of executive function as measured by the Stroop task.

Hemispheric differences in indexical specificity effects in spoken word recognition.

Variability in talker identity, one type of indexical variation, has demonstrable effects on the speed and accuracy of spoken word recognition. Furthermore, neuropsychological evidence suggests that indexical and linguistic information may be represented and processed differently in the 2 cerebral hemispheres, and is consistent with findings from the visual domain. For example, in visual word recognition, changes in font affect processing differently depending on which hemisphere initially processes the input. The present study examined whether hemispheric differences exist in spoken language as well. In 4 long-term repetition-priming experiments, the authors examined responses to stimuli that were primed by stimuli that matched or mismatched in talker identity. The results demonstrate that indexical variability can affect participants' perception of spoken words differently in the 2 hemispheres.

Sentence context influences the subjective perception of foreign accents.

We examined whether sentence context (the predictability of the final word) influences listeners' ratings of foreign-accented words. Previous work has demonstrated that accent manipulations affect listeners' processing of spoken language. We examined the converse of this relationship; whether context manipulations affect listeners' perceptions of accents. If there is a bidirectional relationship, listeners should be more likely to rate an accent as strong when the accented word is not predicted by the sentence. In Experiment 1, the results revealed that participants were significantly more likely to rate words spoken by foreign-accented speakers as "Strong Accent" in the unpredictable sentences when compared to the predictable sentences. Moreover, in Experiment 2, this effect was replicated and extended to a native speaker. These results support the idea that there is a bidirectional relationship between language processing and perceptions of accents. We discuss the practical implications for foreign-accented speakers.

The time course of variability effects in the perception of spoken language: changes across the lifespan.

Although spoken language is communicated via a rapidly varying signal, human listeners recognize spoken words both quickly and accurately. Nonetheless, variability in speech does have implications for both the processes and representations involved in spoken language perception. Moreover, variability effects have been observed across the lifespan, ranging from infants to older adults. Many factors could potentially modulate the degree to which variability affects spoken language perception. In particular, recent findings demonstrate that variability effects follow a time course, manifesting themselves at predictable points during perceptual processing. However, time course investigations are currently limited to young adults. Therefore, the current paper explores how the time course of variability effects might differ throughout the lifespan, based on predictions derived from an adaptive resonance framework.

A Reverse Stroop Task with Mouse Tracking.

In a reverse Stroop task, observers respond to the meaning of a color word irrespective of the color in which the word is printed-for example, the word red may be printed in the congruent color (red), an incongruent color (e.g., blue), or a neutral color (e.g., white). Although reading of color words in this task is often thought to be neither facilitated by congruent print colors nor interfered with incongruent print colors, this interference has been detected by using a response method that does not give any bias in favor of processing of word meanings or processing of print colors. On the other hand, evidence for the presence of facilitation in this task has been scarce, even though this facilitation is theoretically possible. By modifying the task such that participants respond to a stimulus color word by pointing to a corresponding response word on a computer screen with a mouse, the present study investigated the possibility that not only interference but also facilitation would take place in a reverse Stroop task. Importantly, in this study, participants' responses were dynamically tracked by recording the entire trajectories of the mouse. Arguably, this method provided richer information about participants' performance than traditional measures such as reaction time and accuracy, allowing for more detailed (and thus potentially more sensitive) investigation of facilitation and interference in the reverse Stroop task. These trajectories showed that the mouse's approach toward correct response words was significantly delayed by incongruent print colors but not affected by congruent print colors, demonstrating that only interference, not facilitation, was present in the current task. Implications of these findings are discussed within a theoretical framework in which the strength of association between a task and its response method plays a critical role in determining how word meanings and print colors interact in reverse Stroop tasks.

Representation of lexical form: evidence from studies of sublexical ambiguity.

The authors examined the role of intermediate, sublexical representations in spoken word perception. In particular, they tested whether flaps, which are neutralized allophones of intervocalic /t/s and /d/s, map onto their underlying phonemic counterparts. In 2 shadowing tasks, the authors found that flaps primed their carefully articulated counterparts, and vice versa. Because none of the flapped stimuli were lexically ambiguous (e.g., between rater and raider), these results provide evidence that such priming is sublexically mediated. Therefore, the current study provides further insights into when underlying form-based representations are activated during spoken word processing. In particular, the authors argue that phonological ambiguity, inherent in their flapped stimuli, is one of the conditions leading to the activation of underlying representations.

Examining the time course of indexical specificity effects in spoken word recognition.

Variability in talker identity and speaking rate, commonly referred to as indexical variation, has demonstrable effects on the speed and accuracy of spoken word recognition. The present study examines the time course of indexical specificity effects to evaluate the hypothesis that such effects occur relatively late in the perceptual processing of spoken words. In 3 long-term repetition priming experiments, the authors examined reaction times to targets that were primed by stimuli that matched or mismatched on the indexical variable of interest (either talker identity or speaking rate). Each experiment was designed to manipulate the speed with which participants processed the stimuli. The results demonstrate that indexical variability affects participants' perception of spoken words only when processing is relatively slow and effortful.

Representation of lexical form.

The authors attempted to determine whether surface representations of spoken words are mapped onto underlying, abstract representations. In particular, they tested the hypothesis that flaps--neutralized allophones of intervocalic /t/s and /d/s--are mapped onto their underlying phonemic counterparts. In 6 repetition priming experiments, participants responded to stimuli in 2 blocks of trials. Stimuli in the 1st block served as primes and those in the 2nd as targets. Primes and targets consisted of English words containing intervocalic /t/s and /d/s that, when produced casually, were flapped. In all 6 experiments, reaction times to target items were measured as a function of prime type. The results provide evidence for both surface and underlying form-based representations.

Famous talker effects in spoken word recognition.

Previous work has demonstrated that talker-specific representations affect spoken word recognition relatively late during processing. However, participants in these studies were listening to unfamiliar talkers. In the present research, we used a long-term repetition-priming paradigm and a speeded-shadowing task and presented listeners with famous talkers. In Experiment 1, half the words were spoken by Barack Obama, and half by Hillary Clinton. Reaction times (RTs) to repeated words were shorter than those to unprimed words only when repeated by the same talker. However, in Experiment 2, using nonfamous talkers, RTs to repeated words were shorter than those to unprimed words both when repeated by the same talker and when repeated by a different talker. Taken together, the results demonstrate that talker-specific details can affect the perception of spoken words relatively early during processing when words are spoken by famous talkers.

Examining the effects of variation in emotional tone of voice on spoken word recognition.

Emotional tone of voice (ETV) is essential for optimal verbal communication. Research has found that the impact of variation in nonlinguistic features of speech on spoken word recognition differs according to a time course. In the current study, we investigated whether intratalker variation in ETV follows the same time course in two long-term repetition priming experiments. We found that intratalker variability in ETVs affected reaction times to spoken words only when processing was relatively slow and difficult, not when processing was relatively fast and easy. These results provide evidence for the use of both abstract and episodic lexical representations for processing within-talker variability in ETV, depending on the time course of spoken word recognition.

Examining talker effects in the perception of native- and foreign-accented speech.

Understanding the circumstances under which talker (and other types of) variability affects language perception represents an important area of research in the field of spoken word recognition. Previous work has demonstrated that talker effects are more likely when processing is relatively slow (McLennan & Luce, 2005). Given that listeners may take longer to process foreign-accented speech than native-accented speech (Munro & Derwing, Language and Speech, 38, 289-306 1995), talker effects should be more likely when listeners are presented with words spoken in a foreign accent than when they are presented with those same words spoken in a native accent. The results of two experiments, conducted in two different countries and in two different languages, are consistent with this prediction.

The effect of priming a thin ideal on the subsequent perception of conceptually related body image words.

Our research examined the effects of thin ideal priming on the perception of body image words in participants without an eating disorder. Half of the participants were primed by viewing thin models, and half were primed with gender-neutral shoes. Subsequently, all participants (N=56) completed a Stroop task for three categories of words: neutral (BOOKS), shoe (CLOGS), and body (THIGHS). Lastly, all participants completed a body dissatisfaction questionnaire. We predicted that body dissatisfaction scores would be correlated with the Stroop effect. We found a significant correlation between body dissatisfaction and the body effect of slower color naming times for the body related words compared to the neutral words. Our study demonstrates that body dissatisfaction and a brief priming with thin models results in subsequent differences in performing a Stroop task in a non clinical population of female participants.

Hemispheric differences in specificity effects in talker identification.

In the visual domain, Marsolek and colleagues (1999, 2008) have found support for two dissociable and parallel neural subsystems underlying object and shape recognition: an abstract-category subsystem that operates more effectively in the left cerebral hemisphere (LH), and a specific-exemplar subsystem that operates more effectively in the right cerebral hemisphere (RH). Evidence of this asymmetry has been observed in priming specificity for linguistic (words, pseudoword forms) and nonlinguistic (objects) stimuli. In the auditory domain, the authors previously found hemispheric asymmetries in priming effects for linguistic (spoken words) and nonlinguistic (environmental sounds) stimuli. In the present study, the same asymmetrical pattern was observed in talker identification by means of two long-term repetition-priming experiments. Both experiments consisted of a familiarization phase and a final talker identification test phase, using sentences as stimuli. The results showed that specificity effects (an advantage for same-sentence priming, relative to different-sentence priming) emerged when the target stimuli were presented to the left ear (RH), but not when the target stimuli were presented to the right ear (LH). Taken together, this consistent asymmetrical pattern of data from both domains-visual and auditory-may be indicative of a more general property of the human perceptual processing system. Theoretical implications are discussed.

Listen carefully: the risk of error in spoken medication orders.

Clinicians and patients often confuse drug names that sound alike. We conducted auditory perception experiments in the United States to assess the impact of similarity, familiarity, background noise and other factors on clinicians' (physicians, family pharmacists, nurses) and laypersons' ability to identify spoken drug names. We found that accuracy increased significantly as the signal-to-noise (S/N) ratio increased, as subjective familiarity with the name increased and as the national prescribing frequency of the name increased. For clinicians only, similarity to other drug names reduced identification accuracy, especially when the neighboring names were frequently prescribed. When one name was substituted for another, the substituted name was almost always a more frequently prescribed drug. Objectively measurable properties of drug names can be used to predict confusability. The magnitude of the noise and familiarity effects suggests that they may be important targets for intervention. We conclude that the ability of clinicians and lay people to identify spoken drug names is influenced by signal-to-noise ratio, subjective familiarity, prescribing frequency, and the similarity neighborhoods of drug names.