Dissociable neuronal mechanism for different crossmodal correspondence effects in humans.

Crossmodal correspondences (CMCs) refer to associations between seemingly arbitrary stimulus features in different sensory modalities. Pitch­size correspondences refer to the strong association of e.g., small objects with high pitches. Pitch­elevation correspondences refer to the strong association of e.g., visuospatial elevated objects with high pitches. We used functional magnetic resonance imaging (fMRI) to study the neural components, which underlie the CMCs in pitch­size and spatial pitch­elevation. This study focuses on answering the question of whether or not different CMCs are driven by similar neural mechanisms. The comparison of congruent against incongruent trials allows the estimation of CMC effects across different CMCs. The analysis of the measured neural activity in different CMCs strongly pointed toward different mechanisms which are involved in the processing of pitch­size and pitch­elevation correspondences. Differential, whole brain effects were observed within the superior parietal lobule (SPL), cerebellum and Heschls' gyrus (HG). Further, the angular gyrus (AnG), the intraparietal sulcus (IPS) and anterior cingulate cortex (ACC) were engaged in processing the CMCs but showed different effects for processing congruent compared to incongruent stimulus presentations. Within pitch­size significant effects in the AnG and ACC were found for congruent stimulus presentations whereas for pitch­elevation, significant effects in the ACC and IPS were found for incongruent stimulus presentations. In summary, the present results indicated differential neural processing in different simple audio­visual CMCs.

Relevance of pre-stimulus oscillatory activity for the perceived valence of emotional facial expressions.

The interpretation of emotional facial expressions is crucial in everyday social interactions, and rapid processing of these expressions is necessary. Although extensive research has shed light on the mechanisms involved in facial expression processing, there is limited research on the potential role of the state of neural activity that directly precedes the occurrence of a face. Here, we investigated the potential modulatory role of pre-stimulus oscillatory activity in emotional facial expression processing. We tested emotional facial processing in two experiments, one utilizing artificial and the other natural facial expressions. The participants had to evaluate the emotional valence of the presented ambiguous facial expressions. In a univariate analysis, differences in the oscillation activity of the later rated valence of the faces were observed in both experiments, and these differences were observed even before the presentation of the facial expressions. Importantly, two different multivariate approaches directly supported the relevance of pre-stimulus oscillatory activity by exclusively using pre-stimulus oscillatory data to predict the perceived valence of the latter rated facial expression across the two experiments within as well as across subjects. The behavioral data shows the often observed negativity bias, i.e. ambiguous faces resulted in the tendency to rate them as negative. This negativity bias was related to neural activity modulations in the pre-stimulus period and also within post-stimulus processing related activity. These findings underscore the significance of pre-stimulus oscillatory activity in facial expression processing, indicating a functional role of ongoing neural states that affects the processing of facial expressions and constitute a basis for the well described negativity bias.

Enriched environments enhance the development of explicit memory in an incidental learning task.

Learning, rendered in an implicit (unconscious) or explicit (conscious) way, is a crucial part of our daily life. Different factors, like attention or motivation, influence the transformation from implicit to explicit memory. Via virtual reality a lively and engaging surrounding can be created, whereby motivational processes are assumed to be a vital part of the transition from implicit to explicit memory. In the present study, we tested the impact of an enriched virtual reality compared to two conventional, non-enriched 2D-computer-screen based tasks on implicit to explicit memory transformation, using an audio-visual sequential association task. We hypothesized, that the immersive nature of the VR surrounding enhances the transfer from implicit to explicit memory. Notably, the overall amount of learned sequence pairs were not significantly different between experimental groups, but the degree of awareness was affected by the different settings. However, we observed an increased level of explicitly remembered pairs within the VR group compared to two screen-based groups. This finding clearly demonstrates that a near-natural experimental setting affects the transformation process from implicit to explicit memory.