Erroneous saccade co-execution during manual action control is independent of oculomotor stimulus-response translation ease.

Recent multiple action control studies have demonstrated difficulties with single-action (vs. dual-action) execution when accompanied by the requirement to inhibit a prepotent additional response (e.g., a highly automatic eye movement). Such a dual-action performance benefit is typically characterized by frequent false-positive executions of the currently unwarranted response. Here, we investigated whether the frequency of false-positive saccades is affected by the ease of translating a stimulus into a spatial oculomotor response (S-R translation ease): Is it harder to inhibit a saccade that is more automatically triggered via the stimulus? Participants switched on a trial-by-trial basis between executing a single saccade, a single manual button press, and a saccadic-manual dual action in response to a single visual stimulus. Importantly, we employed three different stimulus modes that varied in oculomotor S-R translation ease (peripheral square > central arrow > central shape). The hierarchy of S-R translation ease was reflected by increasing saccade and manual reaction times. Critically, however, the frequency of false-positive saccades in single manual trials was not substantially affected by the stimulus mode. Our results rule out explanations related to limited capacity sharing (between inhibitory control and S-R translation demands) as well as accounts related to the time available for the completion of saccade inhibition. Instead, the findings suggest that the erroneous co-activation of the oculomotor system was elicited by the mere execution of a (frequently associated) manual response (action-based co-activation).

Dual-action benefits: global (action-inherent) and local (transient) sources of action prepotency underlying inhibition failures in multiple action control.

Previous research has shown that the simultaneous execution of two actions (instead of only one) is not necessarily more difficult but can actually be easier (less error-prone), in particular when executing one action requires the simultaneous inhibition of another action. Corresponding inhibitory demands are particularly challenging when the to-be-inhibited action is highly prepotent (i.e., characterized by a strong urge to be executed). Here, we study a range of important potential sources of such prepotency. Building on a previously established paradigm to elicit dual-action benefits, participants responded to stimuli with single actions (either manual button press or saccade) or dual actions (button press and saccade). Crucially, we compared blocks in which these response demands were randomly intermixed (mixed blocks) with pure blocks involving only one type of response demand. The results highlight the impact of global (action-inherent) sources of action prepotency, as reflected in more pronounced inhibitory failures in saccade vs. manual control, but also more local (transient) sources of influence, as reflected in a greater probability of inhibition failures following trials that required the to-be-inhibited type of action. In addition, sequential analyses revealed that inhibitory control (including its failure) is exerted at the level of response modality representations, not at the level of fully specified response representations. In sum, the study highlights important preconditions and mechanisms underlying the observation of dual-action benefits.

Gaze interaction: anticipation-based control of the gaze of others.

Gaze control is an important component of social communication, e.g. to direct someone's attention. While previous research on gaze interaction has mainly focused on the gaze recipient by asking how humans respond to perceived gaze (gaze cueing), we address the actor's point of view by asking how actors control their own eye movements to trigger a gaze response in others. Specifically, we investigate whether gaze responses of a (virtual) interaction partner are anticipated and thereby affect oculomotor control. Building on a pre-established paradigm for addressing anticipation-based motor control in non-social contexts, participants were instructed to alternately look at two faces on the screen, which consistently responded to the participant's gaze with either direct or averted gaze. We tested whether this gaze response of the targeted face is already anticipated prior to the participant's eye movement by displaying a task-irrelevant visual stimulus (prior to the execution of the target saccade), which was either congruent, incongruent, or unrelated to the subsequently perceived gaze. In addition to schematic and photographic faces, we included conditions involving changes in non-social objects. Overall, we observed congruency effects (as an indicator of anticipation of the virtual other's gaze response to one's own gaze) for both social and non-social stimuli, but only when the perceived changes were sufficiently salient. Temporal dynamics of the congruency effects were comparable for social and non-social stimuli, suggesting that similar mechanisms underlie anticipation-based oculomotor control. The results support recent theoretical claims emphasizing the role of anticipation-based action control in social interaction.

Aesthetic appreciation of poetry correlates with ease of processing in event-related potentials.

Rhetorical theory suggests that rhythmic and metrical features of language substantially contribute to persuading, moving, and pleasing an audience. A potential explanation of these effects is offered by "cognitive fluency theory," which stipulates that recurring patterns (e.g., meter) enhance perceptual fluency and can lead to greater aesthetic appreciation. In this article, we explore these two assertions by investigating the effects of meter and rhyme in the reception of poetry by means of event-related brain potentials (ERPs). Participants listened to four versions of lyrical stanzas that varied in terms of meter and rhyme, and rated the stanzas for rhythmicity and aesthetic liking. The behavioral and ERP results were in accord with enhanced liking and rhythmicity ratings for metered and rhyming stanzas. The metered and rhyming stanzas elicited smaller N400/P600 ERP responses than their nonmetered, nonrhyming, or nonmetered and nonrhyming counterparts. In addition, the N400 and P600 effects for the lyrical stanzas correlated with aesthetic liking effects (metered-nonmetered), implying that modulation of the N400 and P600 has a direct bearing on the aesthetic appreciation of lyrical stanzas. We suggest that these effects are indicative of perceptual-fluency-enhanced aesthetic liking, as postulated by cognitive fluency theory.

Explaining dual-action benefits: Inhibitory control and redundancy gains as complementary mechanisms.

Performing two actions at the same time usually results in performance costs. However, recent studies have also reported dual-action benefits: performing only one of two possible actions may necessitate the inhibition of the initially activated, but unwarranted second action, leading to single-action costs. Presumably, two preconditions determine the occurrence and strength of such inhibition-based dual-action benefits: (a) response set reductivity and (b) action prepotency. A nonreductive response set (given when all possible responses have to be kept in working memory) creates inhibitory action control demands in single-, but not in dual-action trials, and the ensuing inhibitory costs are proportional to the level of action prepotency (i.e., an action that is easy to initiate is hard to inhibit). Here, we set out to test this hypothesis by varying representational characteristics in working memory (namely response set reductivity and action prepotency) across four experiments. In Experiments 1 to 3, we compared (a) a randomized mode of trial presentation to (b) intermixed, but predictable fixed sequences of trial types and (c) a completely blocked mode of presentation. As expected, dual-action benefits were strongly present in Experiment 1, significantly reduced in Experiment 2, and absent in Experiment 3. This pattern of results matches our predictions derived from the assumption that differential inhibitory costs in single-action trials are the root cause of dual-action benefits. Crucially, however, the results of Experiment 4 (in which response conditions were only partially blocked) pointed to a secondary source of dual-action benefits that was inseparable from inhibition-based effects in previous experimental designs: semantic redundancy gains. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Flipping the script: Action-plan modification during single- and multiple-action control.

In this paper, we tested the idea that local changes in action demands (e.g., due to an invalid cue or trial-by-trial) result in frugal modifications of existing action plans via action-plan-modification operations. We implemented an experimental procedure making use of a cue that indicates the action requirements for an upcoming signal with a certain degree of reliability. Crucially, incongruent cue-stimulus pairs either require action-plan modification or "resetting" the prepared action plan and reselecting a new response from scratch. We systematically varied the proportion of valid cues over four experiments. There were four most basic response conditions: left button press, right button press, dual button presses, no action. Results support the concept of action-plan modification rather than reset-reselect: switching between a left and a right response was faster and less error-prone than any other type of switch, both between trials and between cue and signal. Thus, it appears that given two responses that can be conceived of as polar opposites (within the same single-action category), there is an action-plan-modification operation ("invert") that transforms one into the other at a comparatively low cost. Furthermore, we observed a mixed pattern of dual-action costs and benefits. This indicates that participants represented dual actions holistically, that is, not based on a conjunction of single-action plans as building blocks. In addition, switching from null actions to overt actions appeared to require very similar action-plan-modification operations as other types of switches - thus, null actions are apparently not coded as empty sets, but rather represent actions in their own right. Finally, we observed strikingly similar patterns of results for trial-by-trial changes in action demands and intra-trial cue-signal incongruency. This implies that the mere cue-based formulation of an action plan - which is not actually executed - is sufficient to produce action-switching-like effects.

Dual-Action Costs and Benefits in a Uni-Modal Single-Onset Paradigm.

While performing two actions at the same time has mostly been associated with reduced performance, several recent studies have observed the opposite effect, that is, dual-action benefits. Previous evidence suggests that dual-action benefits result from single-action inhibitory costs - more specifically, it appears that under certain circumstances, single-action representations are derived from dual-action representations by removing (i.e., inhibiting) one of the component actions. In the present paper, we investigated if this is tied to the presence of multi-modal response demands (i.e., responses making use of two different effector systems). We implemented a very simple experimental paradigm where participants responded to a single stimulus with zero, one, or two uni-modal responses. As predicted, we did not observe dual-action benefits, but rather significant dual-action costs. Furthermore, a trial-by-trial sequence analysis revealed that alternations between both single-action responses were associated with significantly better performance than all other types of action switches. This can be accounted for by assuming that actions are represented as "feature bundles" and that switching a single, binary distinctive feature of an action to its opposite is relatively easy.

Preparing for simultaneous action and inaction: Temporal dynamics and target levels of inhibitory control.

When a single action is required, along with the simultaneous inhibition of another action, this typically results in frequent false-positive executions of the latter (inhibition failures). The absence of inhibitory demands in dual-action trials can render performance less error-prone (and sometimes faster) than in single-action trials. In the present study, we investigated the temporal dynamics of inhibitory control difficulties by varying the preparation time (for simultaneous action execution and inhibition). In two experiments, participants responded to a single peripheral visual target either with an eye movement toward it (Single Saccade), with a spatially corresponding button press (Single Manual), or with both responses simultaneously (Dual Action) as indicated by a color cue. Preparation time was manipulated via the cue-stimulus interval within blocks (Experiment 1) and between blocks (Experiment 2). Overall, responses were faster with longer (vs. shorter) preparation time. Crucially, however, our results reveal the exact dynamics of how inhibition failures (and thus dual-action benefits) in both response modalities substantially decrease with longer preparation, even though the cue did not contain information regarding the fully specified response that needed to be inhibited (i.e., its direction). These results highlight the role of sufficient preparation time not only for efficient action execution but also for concurrent inhibitory performance. The study contradicts the idea that inhibition can only be exerted globally or on the level of a fully specified response. Instead, it may also be directed at effector system representations or all associated responses, suggesting a highly flexible targeting of inhibitory control in cognition. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Don't look at me like that: Integration of gaze direction and facial expression.

Efficient decoding of facial expressions and gaze direction supports reactions to social environments. Although both cues are processed fast and accurately, when and how these cues are integrated is still debated. We investigated the temporal integration of gaze and emotion cues. Participants responded to letters that were randomly presented on four faces. Two of these faces initially showed direct gaze, two showed averted gaze. Upon target presentation, two faces changed gaze direction (from averted to direct and vice versa). Simultaneously, facial expressions changed from neutral to either an approach- or an avoidance-oriented emotion expression (Experiment 1a: angry/fearful; Experiment 1b: happy/disgusted). Although angry and fearful expressions diminished any effects of gaze direction (Experiment 1a), a direct gaze advantage was found for happy and an averted gaze advantage for disgusted faces (Experiment 1b). This pattern is consistent with hypotheses suggesting a processing benefit when emotion expression and gaze information are congruent in terms of approach- or avoidance-orientation. In Experiment 2, we tracked eye movements and, again, found evidence for an approach-avoidance-congruency advantage for happy and disgusted faces both in performance and gaze behavior. Gaze behavior analyses suggested an integration of gaze and emotion information that was already visible from 300 ms after target onset. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Representing action in terms of what not to do: Evidence for inhibitory coding during multiple action control.

Performing two actions at the same time (vs. in isolation) usually results in performance costs. However, recent studies have reported that it is also possible to observe dual-action benefits, a finding that challenges standard theories of multiple action control. This issue is typically resolved by assuming that under certain circumstances, performing only one of two possible actions-cognitively represented in terms of what to do-necessitates the costly stopping of the initially activated but unwarranted second action. Here, we test this hypothesis against an alternative inhibitory coding account which rests on the assumption that actions might be cognitively represented in terms of what not to do. Across four experiments, participants responded to a single stimulus with either single or dual responses in the manual and vocal domains, while the relative frequency of response types was systematically manipulated. The results revealed robust dual-action benefits in manual response times and error rates, and the pattern across experiments clearly supported the novel inhibitory coding framework. Crucially, this implies that even though the motor actions required for single and dual responses are physically the same, they are represented very differently. Specifically, dual responses can be represented holistically (noncompositionally). Overall, these findings demonstrate an astonishing flexibility in the mental representation of behavior demands. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Crossing Gender Borders: Bidirectional Dynamic Interaction Between Face-Based and Voice-Based Gender Categorization.

The processing of voices and faces is known to interact, for example, when recognizing other persons. However, few studies focus on both directions of this interaction, including the influence of incongruent visual stimulation on voice perception. In the present study, we implemented an interference paradigm involving 1152 videos of faces with either gender-congruent or gender-incongruent voices. Participants were asked to categorize the gender of either the face or the voice via key press. Task (face-based vs. voice-based gender categorization task) was manipulated both block-wise (relatively low executive control demands) and in a mixed block (relatively high executive control demands due to trial-by-trial task switches). We aimed at testing whether and how gender-incongruent stimuli negatively affected gender categorization speed and accuracy. The results indicate significant congruency effects in both directions - gender-incongruent visual information negatively affected voice categorization time and errors, and gender-incongruent voices affected visual face categorization. However, the former effect was stronger, supporting theories postulating visual dominance in face-voice integration. Congruency effects, which were not significantly reduced over the course of the experiment, were larger under high executive control demands (task switches), suggesting the availability of fewer attentional resources for incongruency resolution. Overall, voices generally appear to be processed in conjunction with facial information, which yields enhanced processing for more authentic voices, that is, voices that do not violate face-based expectancies. The data strengthen theories of face-voice processing emphasizing strong interaction between both processing channels.

Are Face-Incongruent Voices Harder to Process?

Based on current integration theories of face-voice processing, the present study had participants process 1,152 videos of faces uttering digits. Half of the videos contained face-voice gender-incongruent stimuli (vs. congruent stimuli in the other half). Participants indicated digit magnitude or parity. Tasks were presented in pure blocks (only 1 task) and in task switching blocks (using colored cues to specify task). The results indicate significant congruency effects in pure blocks, but partially reversed congruency effects in task switching, probably due to enhanced assignment of capacity toward resolving difficult situational demands. Congruency effects did not dissipate over time, ruling out that initial surprise associated with incongruent stimuli drove the effects. The results show that interference between two task-irrelevant person-related dimensions (face/voice gender) can affect processing of a third, task-relevant dimension (digit identity), suggesting greater processing ease associated with more authentic voices (i.e., voices that do not violate face-based expectancies).

The hard work of doing nothing: Accounting for inhibitory costs during multiple action control.

Performing many actions at the same time is usually associated with performance costs. However, recent eye-tracking evidence indicates that under specific conditions, inhibiting a secondary response can be more costly than executing it, resulting in dual-action benefits. Here, we show that performance gains due to the absence of inhibitory control demands in dual-action trials are not limited to saccades as a response modality. In our study, participants had to react to a visually presented directional word by either reading the stimulus aloud (vocal modality), pressing the corresponding arrow key on a keyboard (manual modality), or both. Crucially, manual error rates were significantly lower when participants had to respond with both a button press and naming than when they had to respond with naming only. More specifically, in vocal-only conditions we observed a significant percentage of false-positive manual responses, suggesting difficulties with inhibiting an unwarranted manual action. Thus, our results indicate that difficulties associated with single- (vs. dual-) action control are a stable, domain-general phenomenon that likely arises whenever execution-related demands are accompanied by substantial additional inhibitory control demands.

Aesthetic and emotional effects of meter and rhyme in poetry.

Metrical patterning and rhyme are frequently employed in poetry but also in infant-directed speech, play, rites, and festive events. Drawing on four line-stanzas from nineteenth and twentieth German poetry that feature end rhyme and regular meter, the present study tested the hypothesis that meter and rhyme have an impact on aesthetic liking, emotional involvement, and affective valence attributions. Hypotheses that postulate such effects have been advocated ever since ancient rhetoric and poetics, yet they have barely been empirically tested. More recently, in the field of cognitive poetics, these traditional assumptions have been readopted into a general cognitive framework. In the present experiment, we tested the influence of meter and rhyme as well as their interaction with lexicality in the aesthetic and emotional perception of poetry. Participants listened to stanzas that were systematically modified with regard to meter and rhyme and rated them. Both rhyme and regular meter led to enhanced aesthetic appreciation, higher intensity in processing, and more positively perceived and felt emotions, with the latter finding being mediated by lexicality. Together these findings clearly show that both features significantly contribute to the aesthetic and emotional perception of poetry and thus confirm assumptions about their impact put forward by cognitive poetics. The present results are explained within the theoretical framework of cognitive fluency, which links structural features of poetry with aesthetic and emotional appraisal.

Neural correlates of morphosyntactic and verb-argument structure processing: an EfMRI study.

In the current study, we investigated the processing of ungrammatical sentences containing morphosyntactic and verb-argument structure violations in an fMRI paradigm. In the morphosyntactic condition, participants listened to German perfect tense sentences with morphosyntactic violations which were neither related to finiteness nor to agreement but which were based on a syntactic feature mismatch between two verbal elements. When compared to correct sentences, morphosyntactically ungrammatical sentences elicited an increase in brain activity in the left middle to posterior superior temporal gyrus (STG). In the verb-argument structure condition, sentences were either correct or contained an intransitive verb with an unlicensed direct object. Ungrammatical sentences of this type elicited brain activations in the left inferior frontal gyrus (IFG) (BA 44). Thus, we found evidence for different brain activity patterns as a function of violation type. The left posterior STG, an area known to support lexical-syntactic integration was strongly implicated in morphosyntactic processing whereas the left dorsal IFG (BA 44) was seen to be involved in the processing of verb-argument structure. Our results suggest that lexical, syntactic and semantic features of verbal stimuli interact in a complex fashion during language comprehension.

Auditory processing of different types of pseudo-words: an event-related fMRI study.

Imaging results on real word and pseudo-word processing have been heterogeneous, allowing only cautious claims about the neuroanatomical loci of lexico-semantic processing. In order to shed more light on this issue, we examined the impact of different structures of non-lexical stimuli on the outcome of comparisons between such items and matched real words. We anticipated that the degree to which a pseudo-word still resembles a particular real word template determines how word-like it is processed. To verify this idea, we tested different types of pseudo-words (either phonotactically legal and transparently or opaquely derived from real words or phonotactically illegal) in an event-related fMRI paradigm utilizing a lexical decision task. All types of pseudo-words elicited a stronger hemodynamic brain response than real words in the bilateral superior temporal gyri. Real words produced stronger brain activations than pseudo-words in the left posterior middle temporal and angular gyri, the rostral and caudal cingulate gyrus, the precuneus and the right inferior temporal gyrus. When contrasted to opaque pseudo-words transparent pseudo-words elicited a stronger brain response in a temporo-parietal region adjacent to the one observed for real words. Our results provide further support for the involvement of the left posterior middle temporal and angular gyri in lexical-semantic processing. The data also indicate that transparently derived pseudo-words are processed similarly to real words. In contrast, semantic operations are blocked when opaquely derived pseudo-words are processed.