How do irrelevant stimuli from another modality influence responses to the targets in a same-different task.

It remains unclear whether multisensory interaction can implicitly occur at the abstract level. To address this issue, a same-different task was used to select comparable images and sounds in Experiment 1. Then, the stimuli with various levels of discrimination difficulty were adopted in a modified same-different task in Experiments 2, 3, and 4. The resultsshowed that only when the irrelevant stimuli were easily distinguishable, aconsistency effectcould beobservedin the testing phase. Moreover, when easily distinguishableirrelevant stimuliwere simultaneously presented with difficulttarget stimuli, irrelevant auditorystimuli facilitated responses to visual targets whereas irrelevant visual stimuli interfered with responses to auditorytargetsin the training phase,indicating an asymmetry in the role of visual and auditory in abstract multisensory integration. The results suggested that abstract multisensory information could be implicitly integrated and the inverse effectiveness principle might not apply to high-level processing of abstract multisensory integration.

Contextual Features of the Cue Enter Episodic Bindings in Task Switching.

Evidence suggests that the features of a stimulus and the actions performed on it are bound together into a coherent mental representation of the episode, which is retrieved from memory upon reencountering at least one of these features. Effects of such binding and retrieval processes emerge in action control, such as in multitasking situations like task switching. In the task-switching paradigm, response-repetition benefits are observed in task repetitions, but response-repetition costs in task switches. This interaction of task repetition (vs. switch) with response repetition (vs. switch) may be explained in terms of task-response binding. In two experiments, we included a task-irrelevant contextual feature in a cued task-switching paradigm using word identification tasks. In Experiment 1, the cue modality could vary between visual and auditory; in Experiment 2, the cue language could vary between English and Spanish, while the target stimulus was always presented visually and in German. We predicted that repeating the contextual feature in the subsequent trial would retrieve the features of the previous trial, even though cue modality or cue language did not afford any response and were not associated with either task. The results showed that response repetition-benefits in task repetitions were observable when the context (i.e., the modality or the language of the cue) repeated but disappeared when the context switched from the previous trial. These results are consistent with context-specific binding and retrieval processes in task switching.

Individual differences in mental imagery in different modalities and levels of intentionality.

Mental imagery is a highly common component of everyday cognitive functioning. While substantial progress is being made in clarifying this fundamental human function, much is still unclear or unknown. A more comprehensive account of mental imagery aspects would be gained by examining individual differences in age, sex, and background experience in an activity and their association with imagery in different modalities and intentionality levels. The current online study combined multiple imagery self-report measures in a sample (n = 279) with a substantial age range (18-65 years), aiming to identify whether age, sex, or background experience in sports, music, or video games were associated with aspects of imagery in the visual, auditory, or motor stimulus modality and voluntary or involuntary intentionality level. The findings show weak positive associations between age and increased vividness of voluntary auditory imagery and decreased involuntary musical imagery frequency, weak associations between being female and more vivid visual imagery, and relations of greater music and video game experience with higher involuntary musical imagery frequency. Moreover, all imagery stimulus modalities were associated with each other, for both intentionality levels, except involuntary musical imagery frequency, which was only related to higher voluntary auditory imagery vividness. These results replicate previous research but also contribute new insights, showing that individual differences in age, sex, and background experience are associated with various aspects of imagery such as modality, intentionality, vividness, and frequency. The study's findings can inform the growing domain of applications of mental imagery to clinical and pedagogical settings.

The Potential Clinical Utility of Pressure-Based vs. Heat-Based Paradigms to Measure Conditioned Pain Modulation in Healthy Individuals and Those With Chronic Pain.

Conditioned pain modulation (CPM) is a physiological measure thought to reflect an individual's endogenous pain modulation system. CPM varies across individuals and provides insight into chronic pain pathophysiology. There is growing evidence that CPM may help predict individual pain treatment outcome. However, paradigm variabilities and practical issues have impeded widespread clinical adoption of CPM assessment. This study aimed to compare two CPM paradigms in people with chronic pain and healthy individuals. A total of 30 individuals (12 chronic pain, 18 healthy) underwent two CPM paradigms. The heat CPM paradigm acquired pain intensity ratings evoked by a test stimulus (TS) applied before and during the conditioning stimulus (CS). The pressure CPM paradigm acquired continuous pain intensity ratings of a gradually increasing TS, before and during CS. Pain intensity was rated from 0 (no pain) to 100 (worst pain imaginable); Pain50 is the stimulus level for a response rated 50. Heat and pressure CPM were calculated as a change in TS pain intensity ratings at Pain50, where negative CPM scores indicate pain inhibition. We also determined CPM in the pressure paradigm as change in pressure pain detection threshold (PDT). We found that in healthy individuals the CPM effect was significantly more inhibitory using the pressure paradigm than the heat paradigm. The pressure CPM effect was also significantly more inhibitory when based on changes at Pain50 than at PDT. However, in individuals with chronic pain there was no significant difference in pressure CPM compared to heat or PDT CPM. There was no significant correlation between clinical pain measures (painDETECT and Brief Pain Inventory) and paradigm type (heat vs. pressure), although heat-based CPM and painDETECT scores showed a trend. Importantly, the pressure paradigm could be administered in less time than the heat paradigm. Thus, our study indicates that in healthy individuals, interpretation of CPM findings should consider potential modality-dependent effects. However, in individuals with chronic pain, either heat or pressure paradigms can similarly be used to assess CPM. Given the practical advantages of the pressure paradigm (e.g., short test time, ease of use), we propose this approach to be well-suited for clinical adoption.

Predicting Stimulus Modality and Working Memory Load During Visual- and Audiovisual-Acquired Equivalence Learning.

Scholars have extensively studied the electroencephalography (EEG) correlates of associative working memory (WM) load. However, the effect of stimulus modality on EEG patterns within this process is less understood. To fill this research gap, the present study re-analyzed EEG datasets recorded during visual and audiovisual equivalence learning tasks from earlier studies. The number of associations required to be maintained (WM load) in WM was increased using the staircase method during the acquisition phase of the tasks. The support vector machine algorithm was employed to predict WM load and stimulus modality using the power, phase connectivity, and cross-frequency coupling (CFC) values obtained during time segments with different WM loads in the visual and audiovisual tasks. A high accuracy (>90%) in predicting stimulus modality based on power spectral density and from the theta-beta CFC was observed. However, accuracy in predicting WM load was higher (≥75% accuracy) than that in predicting stimulus modality (which was at chance level) using theta and alpha phase connectivity. Under low WM load conditions, this connectivity was highest between the frontal and parieto-occipital channels. The results validated our findings from earlier studies that dissociated stimulus modality based on power-spectra and CFC during equivalence learning. Furthermore, the results emphasized the importance of alpha and theta frontoparietal connectivity in WM load.

Stimulus modality influences the acquisition and use of the rule-based strategy and the similarity-based strategy in category learning.

This study aimed to investigate whether stimulus modality influenced the acquisition and use of the rule-based strategy and the similarity-based strategy in category learning and whether the use of the two strategies was supported by shared or separate neural substrates. To address these issues, we combined behavioral and fNIRS methods in a modified prototype distortion task in which each category member has one rule feature and ten similarity features, and each type of feature can be presented in either the visual modality or the auditory modality. The results in Experiment 1 revealed that the learning effect in the "auditory rule-visual similarity" condition was the highest among all four conditions; further analysis revealed that in the "auditory rule-visual similarity" condition, the number of participants who used the rule-based strategy was more than the number of participants who used the similarity-based strategy, and the learning effect was always much higher for the rule-based strategy than for the similarity-based strategy. The behavioral results in Experiment 2 replicated the main findings in Experiment 1, and the fNIRS results showed that the use of the visual rule-based strategy was mediated by the dorsolateral prefrontal cortex, whereas the use of the auditory similarity-based strategy mainly engaged in the superior temporal gyrus, and the use of the visual similarity-based strategy mainly engaged in the inferior temporal gyrus. The results in Experiment 3 revealed that when the stimuli had only one type of feature, the visual rule rather than the auditory rule was learned more easily. The results provide new evidence that the stimulus modality can influence the acquisition and use of the rule-based strategy and the similarity-based strategy in category learning and that the use of the two types of strategies is supported by separate neural substrates both in the auditory modality and the visual modality.

Examining binding effects on task switch costs and response-repetition effects: Variations of the cue modality and stimulus modality in task switching.

Typically, response-repetition effects are obtained in task-switching experiments: In task repetitions, performance is enhanced when the response, too, repeats (response-repetition benefits), whereas in task switches, performance is impaired when the response repeats (response-repetition costs). A previous study introduced cue modality switches in a cued task-switching paradigm with visual stimuli and obtained enhanced response-repetition benefits when the cue modality repeated (Koch, Frings, & Schuch Psychological Research, 82, 570-579, 2018). In the present study, we aimed to replicate this finding with auditory stimuli (Exp. 1), and further examined whether response-repetition effects could be modulated by introducing stimulus modality switches (Exp. 2). We found clear evidence that the cue modality and stimulus modality affect task switch costs. The task switch costs were higher with a repeated cue modality or stimulus modality. However, cue modality switches or stimulus modality switches did not affect the response-repetition effects. We suggest that response-repetition effects are elicited by response-associated bindings, which are not necessarily affected by all episodic task features to the same extent. Our results are also in line with theoretical accounts that assume a hierarchical organization of task selection and response selection.

Social perceptual function in parkinson's disease: A meta-analysis.

Social perceptual impairment is a common presenting feature of Parkinson's disease (PD) that has the potential to contribute considerably to disease burden. The current study reports a meta-analytic integration of 79 studies which shows that, relative to controls, PD is associated with a moderate emotion recognition deficit (g = -0.57, K = 73), and that this deficit is robust and almost identical across facial and prosodic modalities. However, the magnitude of this impairment does appear to vary as a function of task and emotion type, with deficits generally greatest for identification tasks (g = -0.65, K = 54), and for negative relative to other basic emotions. With respect to clinical variables, dopaminergic medication, deep brain stimulation, and a predominant left side onset of motor symptoms are each associated with greater social perceptual difficulties. However, the magnitude of social perceptual impairment seen for the four atypical parkinsonian conditions is broadly comparable to that associated with PD. The theoretical and practical implications of these findings are discussed.

Effect of the stop-signal modality on brain electrical activity associated with suppression of ongoing actions.

To clarify how the modality of stop signals affects the ability to suppress ongoing actions, we compared behavioural indices and event-related potentials (ERPs) recorded in healthy volunteers performing visual and auditory stop-signal tasks. Auditory stop signals were associated with faster reaction times and shorter stop-N2 and stop-P3 latencies. Given that the tasks did not differ in attentional/arousal processes (go-P3 or stop-P3 amplitudes) or motor preparation (LRP amplitude, onset or latency), our results suggest that stop signal modality mainly affects bottom-up sensory processes (faster auditory processing). The ERP waveform obtained by subtracting successfully stopped from unsuccessfully stopped trials showed similar amplitude and topography in both tasks, indicating that the strength of top-down processes related to inhibition was independent of modality. The findings contribute further knowledge about the variables associated with efficient inhibition and have practical implications for the design of settings or interventions to improve reactive inhibition.

Stimulus Modality and Smoking Behavior: Moderating Role of Implicit Attitudes.

This study investigated whether stimulus modality influences smoking behavior among smokers in South Eastern Nigeria and also whether implicit attitudes moderate the relationship between stimulus modality and smoking behavior. 60 undergraduate students of University of Nigeria, Nsukka were used. Participants were individually administered the IAT task as a measure of implicit attitude toward smoking and randomly assigned into either image condition that paired images of cigarette with aversive images of potential health consequences or text condition that paired images of cigarette with aversive texts of potential health consequences. A one- predictor and one-moderator binary logistic analysis indicates that stimulus modality significantly predicts smoking behavior (p = < .05) with those in the image condition choosing not to smoke with greater probability than the text condition. The interaction between stimulus modality and IAT scores was also significant (p = < .05). Specifically, the modality effect was larger for participants in the image group who held more negative implicit attitudes towards smoking. The finding shows the urgent need to introduce the use of aversive images of potential health consequences on cigarette packs in Nigeria.

Effects of combining tactile with visual and spatial cues in conditioned place preference.

Previous research provides little information about variables that determine which elements of contextual cues gain associative control over behavior in the conditioned place preference (CPP) procedure. These studies examined the effect of external visual-spatial cues on CPP when tactile cues served as the conditioned stimuli. DBA/2J mice were trained in the dark (Experiment 1) or light (Experiment 2) using unbiased procedures in which the spatial location of an ethanol-paired tactile cue during training was relevant (two-compartment procedure) or irrelevant (one-compartment procedure). All groups developed CPP, but it was weakest after one-compartment training in the light. In Experiment 3, tactile cues were tested either in the same locations used during training or reversed after two-compartment training in either the dark or light. CPP was unaffected by cue location reversal in the dark, but it was reduced when cue locations changed in the light. Mice in Experiment 4 also received two-compartment training in either the light or dark, but the spatial locations of the drug- and vehicle-paired cues alternated over trials, making external visual-spatial cues irrelevant. In this case, lighting had no effect on CPP. These studies show that cue location does not affect CPP when tactile cue training occurs in the dark. Moreover, they suggest that external visual-spatial cues might enhance CPP when those cues are relevant, but not when an alternating two-compartment procedure is used. The cue reversal effect suggests that relevant external visual-spatial cues acquire associative strength when combined with tactile cues in a two-compartment procedure in the light. Overall, these studies improve our understanding of how external visual-spatial cues interact with tactile cues during drug-induced conditioning, which could have important implications for studies that use CPP to study the neurobiological bases of drug seeking and drug reward.

What's so special about verbal imitation? Investigating the effect of modality on automaticity in children.

Young children experience difficulty across a wide variety of situations that require them to suppress automatic responses. Verbal imitation, in contrast, is easy for children to suppress. This is all the more surprising because data from adult studies appear to be at odds with this observation. In two experiments, we investigated whether this surprising developmental finding with verbal imitation reflects a more general phenomenon-relating either to verbal responses or to auditory stimuli-or whether verbal imitation itself represents a unique case. In Experiment 1 (N=24), it was found that verbal responses were not inherently easier for 3-year-olds to inhibit than manual responses. Experiment 2 (N=24) showed that auditory stimuli did not evoke less automatic activation than visual stimuli. Taken together, these data suggest that verbal imitation is unique, or at least unusual, in being particularly easy for children to resist. It is suggested that the automaticity of verbal imitation may develop slowly and that the relation between word complexity and automaticity is likely to be a fruitful topic of further investigation.

Modality-specific organization in the representation of sensorimotor sequences.

Sensorimotor representations of movement sequences are hierarchically organized. Here we test the effects of different stimulus modalities on such organizations. In the visual group, participants responded to a repeated sequence of visually presented stimuli by depressing spatially compatible keys on a response pad. In the auditory group, learners were required to respond to auditorily presented stimuli, which had no direct spatial correspondence with the response keys: the lowest pitch corresponded to the leftmost key and the highest pitch to the rightmost key. We demonstrate that hierarchically and auto-organized sensorimotor representations are developed through practice, which are specific both to individuals and stimulus modalities. These findings highlight the dynamic and sensory-specific modulation of chunk processing during sensorimotor learning - sensorimotor chunking - and provide evidence that modality-specific mechanisms underlie the hierarchical organization of sequence representations.

Stimulus modality and working memory performance in Greek children with reading disabilities: additional evidence for the pictorial superiority hypothesis.

This study investigated the effects of stimulus presentation modality on working memory performance in children with reading disabilities (RD) and in typically developing children (TDC), all native speakers of Greek. It was hypothesized that the visual presentation of common objects would result in improved learning and recall performance as compared to the auditory presentation of stimuli. Twenty children, ages 10-12, diagnosed with RD were matched to 20 TDC age peers. The experimental tasks implemented a multitrial verbal learning paradigm incorporating three modalities: auditory, visual, and auditory plus visual. Significant group differences were noted on language, verbal and nonverbal memory, and measures of executive abilities. A mixed-model MANOVA indicated that children with RD had a slower learning curve and recalled fewer words than TDC across experimental modalities. Both groups of participants benefited from the visual presentation of objects; however, children with RD showed the greatest gains during this condition. In conclusion, working memory for common verbal items is impaired in children with RD; however, performance can be facilitated, and learning efficiency maximized, when information is presented visually. The results provide further evidence for the pictorial superiority hypothesis and the theory that pictorial presentation of verbal stimuli is adequate for dual coding.