Vienna Talking Faces (ViTaFa): A multimodal person database with synchronized videos, images, and voices.

Social perception relies on different sensory channels, including vision and audition, which are specifically important for judgements of appearance. Therefore, to understand multimodal integration in person perception, it is important to study both face and voice in a synchronized form. We introduce the Vienna Talking Faces (ViTaFa) database, a high-quality audiovisual database focused on multimodal research of social perception. ViTaFa includes different stimulus modalities: audiovisual dynamic, visual dynamic, visual static, and auditory dynamic. Stimuli were recorded and edited under highly standardized conditions and were collected from 40 real individuals, and the sample matches typical student samples in psychological research (young individuals aged 18 to 45). Stimuli include sequences of various types of spoken content from each person, including German sentences, words, reading passages, vowels, and language-unrelated pseudo-words. Recordings were made with different emotional expressions (neutral, happy, angry, sad, and flirtatious). ViTaFa is freely accessible for academic non-profit research after signing a confidentiality agreement form via https://osf.io/9jtzx/ and stands out from other databases due to its multimodal format, high quality, and comprehensive quantification of stimulus features and human judgements related to attractiveness. Additionally, over 200 human raters validated emotion expression of the stimuli. In summary, ViTaFa provides a valuable resource for investigating audiovisual signals of social perception.

Dynamics of aesthetic experience are reflected in the default-mode network.

Neuroaesthetics is a rapidly developing interdisciplinary field of research that aims to understand the neural substrates of aesthetic experience: While understanding aesthetic experience has been an objective of philosophers for centuries, it has only more recently been embraced by neuroscientists. Recent work in neuroaesthetics has revealed that aesthetic experience with static visual art engages visual, reward and default-mode networks. Very little is known about the temporal dynamics of these networks during aesthetic appreciation. Previous behavioral and brain imaging research suggests that critical aspects of aesthetic experience have slow dynamics, taking more than a few seconds, making them amenable to study with fMRI. Here, we identified key aspects of the dynamics of aesthetic experience while viewing art for various durations. In the first few seconds following image onset, activity in the DMN (and high-level visual and reward regions) was greater for very pleasing images; in the DMN this activity counteracted a suppressive effect that grew longer and deeper with increasing image duration. In addition, for very pleasing art, the DMN response returned to baseline in a manner time-locked to image offset. Conversely, for non-pleasing art, the timing of this return to baseline was inconsistent. This differential response in the DMN may therefore reflect the internal dynamics of the participant's state: The participant disengages from art-related processing and returns to stimulus-independent thought. These dynamics suggest that the DMN tracks the internal state of a participant during aesthetic experience.

Art looks different - Semantic and syntactic processing of paintings and associated neurophysiological brain responses.

The concept of semantics (meaning) and syntax (structure) seems to be an integral way of how humans perceive and order their environment. Processing natural scenes with semantic or syntactic inconsistencies evokes distinct Event-Related Potentials, ERPs, in the N300/400 and P600, respectively (Vo & Wolfe, 2013). Artworks, however, can by definition use violations of natural relationships as a means of style, especially in surrealist art. To test whether inconsistencies are processed differently in artworks, we presented participants with surrealist paintings containing semantic or syntactic inconsistencies, edited versions without inconsistencies, and as control real photographic versions of each painting. Photographs elicited more pronounced negative ERP amplitudes than paintings in all time windows, N300, N400 and P600. However, the lack of an interaction between image type and inconsistency type indicates that all presented images were processed as artworks, probably due to context effects. The ERPs were largely opposite to those reported previously with everyday life pictures, with syntactic inconsistencies driving the earlier components and eliciting higher amplitudes than semantic ones in the N400, and semantic inconsistencies eliciting a higher amplitude in the P600. We conclude that viewing artworks includes a specific processing mode, entailing syntactic and semantic expectations different from those in natural scenes.

Parkinson's disease and changes in the appreciation of art: A comparison of aesthetic and formal evaluations of paintings between PD patients and healthy controls.

Parkinson's disease (PD) is a progressing neurodegenerative disease predominantly involving the loss of dopamine producing neurons with hallmark symptoms of motor disorders and cognitive, motivational, emotional, and perceptual impairments. Intriguingly, PD can also be connected-often anecdotally-with a sudden burst of artistic creativity, motivation, or changed quality/style of produced art. This has led to growing empirical interest, promising a window into brain function and the unique neurological signature of artists. This topic also fits a growing interest from researchers in other areas, including Alzheimer's or other dementia, which have suggested that specific changes in art production/appraisal may provide a unique basis for therapy, diagnosis, or understanding of these diseases. However, whether PD also shows similar impacts on how we perceive and evaluate art has never been systematically addressed. We compared a cohort of PD patients against age-matched healthy controls, asking participants to rate paintings using scales of liking and beauty and terms pertaining to artworks' formal and conceptual qualities previously designed to provide a rubric for symptom identification. We found no evidence for PD-related differences in liking or beauty. However, PD patients showed higher ratings on assessed "emotionality," potentially relating to the tie between PD, dopamine pathways, and emotion/reward.

Anchoring Effects in Facial Attractiveness.

First impressions from faces emerge quickly and shape subsequent behaviour. Given that different pictures of the same face evoke different impressions, we asked whether presentation order affects the overall impression of the person. In three experiments, we presented naturally varying photos of a person's face in ascending (low-to-high) or descending (high-to-low) order of attractiveness. We found that attractiveness ratings for a subsequent test item were higher for the descending condition than for the ascending condition (Experiment 1), consistent with anchoring effects. In Experiment 2, we ruled out contrast between the final item and the test item as the cause of the effect by demonstrating anchoring within the sequence itself. In Experiment 3, we found that order of image presentation also affected dating decisions. Our findings demonstrate that first impressions from faces depend not only on visual information but also on the order in which that information is received. We suggest that models of impression formation and learning of individual faces could be improved by considering temporal order of encounters.

Empathy, Einfühlung, and aesthetic experience: the effect of emotion contagion on appreciation of representational and abstract art using fEMG and SCR.

Since the advent of the concept of empathy in the scientific literature, it has been hypothesized, although not necessarily empirically verified, that empathic processes are essential to aesthetic experiences of visual art. We tested how the ability to "feel into" ("Einfühlung") emotional content-a central aspect of art empathy theories-affects the bodily responses to and the subjective judgments of representational and abstract paintings. The ability to feel into was measured by a standardized pre-survey on "emotional contagion"-the ability to pick up and mirror, or in short to "feel into", emotions, which often overlaps with higher general or interpersonal empathetic abilities. Participants evaluated the artworks on several aesthetic dimensions (liking, valence, moving, and interest), while their bodily reactions indicative of empathetic engagement (facial electromyography-EMG, and skin conductance responses-SCR) were recorded. High compared to low emotion contagion participants showed both more congruent and more intense bodily reactions (EMG and SCR) and aesthetic evaluations (higher being moved, valence, and interest) and also liked the art more. This was largely the case for both representational and abstract art, although stronger with the representational category. Our findings provide tentative evidence for recent arguments by art theorists for a close "empathic" mirroring of emotional content. We discuss this interpretation, as well as a potential tie between emotion contagion and a general increase in emotion intensity, both of which may impact, in tandem, the experience and evaluation of art.

Does art expertise facilitate distancing?

With respect to the Distancing-Embracing model, we discuss whether experts with well-developed and highly accessible schemata that lend themselves to distancing have initial affective reactions similar to those of novices, who lack access to well-developed distancing mechanisms, and whether differences between experts' and novices' responses are apparent only after distancing mechanisms have had a chance to do their work. We revisit findings from Leder et al. (2014) and discuss the role of mixed emotions and fluency.

Trusting the Looks of Others: Gaze Effects of Faces in Social Settings.

Eye gaze is an important social cue in human communication that serves as a predictor of changes in attention, indicates social interest, and even affects the evaluation of objects that have been looked at. However, it needs to be shown how this strong nonverbal signal affects social and aesthetic evaluations in social settings. In this study, we presented natural scenes with two faces in three gaze conditions showing different directions of gaze. Participants evaluated faces that were looked at or not, that showed direct or averted gaze, for attractiveness (aesthetic) as well as trustworthiness (social). In Experiment 1, faces looking directly at the perceiver were rated as more attractive and as more trustworthy. In Experiment 2, when the direct gaze condition was omitted, faces that were looked at by another face were judged as more trustworthy. In Experiment 3a, participants did not remember the directions of gaze of two faces, demonstrating the dependence of the judgement on the actual situation and excluding a memory explanation. In Experiment 3b, we confirmed that these gaze effects depend on the direction of gaze and not the mere presence of another person. Our findings show how gazing in real world settings affects social and aesthetic evaluations.

Impact of contour on aesthetic judgments and approach-avoidance decisions in architecture.

On average, we urban dwellers spend about 90% of our time indoors, and share the intuition that the physical features of the places we live and work in influence how we feel and act. However, there is surprisingly little research on how architecture impacts behavior, much less on how it influences brain function. To begin closing this gap, we conducted a functional magnetic resonance imaging study to examine how systematic variation in contour impacts aesthetic judgments and approach-avoidance decisions, outcome measures of interest to both architects and users of spaces alike. As predicted, participants were more likely to judge spaces as beautiful if they were curvilinear than rectilinear. Neuroanatomically, when contemplating beauty, curvilinear contour activated the anterior cingulate cortex exclusively, a region strongly responsive to the reward properties and emotional salience of objects. Complementing this finding, pleasantness--the valence dimension of the affect circumplex--accounted for nearly 60% of the variance in beauty ratings. Furthermore, activation in a distributed brain network known to underlie the aesthetic evaluation of different types of visual stimuli covaried with beauty ratings. In contrast, contour did not affect approach-avoidance decisions, although curvilinear spaces activated the visual cortex. The results suggest that the well-established effect of contour on aesthetic preference can be extended to architecture. Furthermore, the combination of our behavioral and neural evidence underscores the role of emotion in our preference for curvilinear objects in this domain.

What makes an art expert? Emotion and evaluation in art appreciation.

Why do some people like negative, or even disgusting and provocative artworks? Art expertise, believed to influence the interplay among cognitive and emotional processing underlying aesthetic experience, could be the answer. We studied how art expertise modulates the effect of positive-and negative-valenced artworks on aesthetic and emotional responses, measured with self-reports and facial electromyography (EMG). Unsurprisingly, emotionally-valenced art evoked coherent valence as well as corrugator supercilii and zygamoticus major activations. However, compared to non-experts, experts showed attenuated reactions, with less extreme valence ratings and corrugator supercilii activations and they liked negative art more. This pattern was also observed for a control set of International Affective Picture System (IAPS) pictures suggesting that art experts show general processing differences for visual stimuli. Thus, much in line with the Kantian notion that an aesthetic stance is emotionally distanced, art experts exhibited a distinct pattern of attenuated emotional responses.

Metaphors or mechanism? Predictive coding and a (brief) history of empirical study of the arts.

Predictive processing (PP) offers an intriguing approach to perception, cognition, but also to appreciation of the arts. It does this by positing both a theoretical basis-one might say a 'metaphor'-for how we engage and respond, placing emphasis on mismatches rather than fluent overlap between schema and environment. Even more, it holds the promise for translating metaphor into neurobiological bases, suggesting a means for considering mechanisms-from basic perceptions to possibly even our complex, aesthetic experiences. However, while we share the excitement of this promise, the history of empirical or psychological aesthetics is also permeated by metaphors that have progressed our understanding but which also tend to elude translation into concrete, mechanistic operationalization-a challenge that can also be made to PP. We briefly consider this difficulty of convincing implementation of PP via a brief historical outline of some developments in the psychological study of aesthetics and art in order to show how these ideas have often anticipated PP but also how they have remained at the level of rather metaphorical and difficult-to-measure concepts. Although theoretical in scope, we hope that this commentary will spur researchers to reflect on PP with the aim of translating metaphorical explanations into well-defined mechanisms in future empirical study. This article is part of the theme issue 'Art, aesthetics and predictive processing: theoretical and empirical perspectives'.

Aesthetics and predictive processing: grounds and prospects of a fruitful encounter.

In the last few years, a remarkable convergence of interests and results has emerged between scholars interested in the arts and aesthetics from a variety of perspectives and cognitive scientists studying the mind and brain within the predictive processing (PP) framework. This convergence has so far proven fruitful for both sides: while PP is increasingly adopted as a framework for understanding aesthetic phenomena, the arts and aesthetics, examined under the lens of PP, are starting to be seen as important windows into our mental functioning. The result is a vast and fast-growing research programme that promises to deliver important insights into our aesthetic encounters as well as a wide range of psychological phenomena of general interest. Here, we present this developing research programme, describing its grounds and highlighting its prospects. We start by clarifying how the study of the arts and aesthetics encounters the PP picture of mental functioning (§1). We then go on to outline the prospects of this encounter for the fields involved: philosophy and history of art (§2), psychology of aesthetics and neuroaesthetics (§3) and psychology and neuroscience more generally (§4). The upshot is an ambitious but well-defined framework within which aesthetics and cognitive science can partner up to illuminate crucial aspects of the human mind. This article is part of the theme issue 'Art, aesthetics and predictive processing: theoretical and empirical perspectives'.

The dynamics of experiencing Gestalt and Aha in cubist art: pupil responses and art evaluations show a complex interplay of task, stimuli content, and time course.

Introduction: Gestalt perception refers to the cognitive ability to perceive various elements as a unified whole. In our study, we delve deeper into the phenomenon of Gestalt recognition in visual cubist art, a transformative process culminating in what is often described as an Aha moment. This Aha moment signifies a sudden understanding of what is seen, merging seemingly disparate elements into a coherent meaningful picture. The onset of this Aha moment can vary, either appearing almost instantaneously, which is in line with theories of hedonic fluency, or manifesting after a period of time, supporting the concept of delayed but more in-depth meaningful insight. Methods: We employed pupillometry to measure cognitive and affective shifts during art interaction, analyzing both maximum pupil dilation and average dilation across the trial. The study consisted of two parts: in the first, 84 participants identified faces in cubist paintings under various conditions, with Aha moments and pupil dilation measured. In part 2, the same 84 participants assessed the artworks through ratings in a no-task free-viewing condition. Results: Results of part 1 indicate a distinctive pattern of pupil dilation, with maximum dilation occurring at both trial onset and end. Longer response times were observed for high-fluent, face-present stimuli, aligning with a delayed but accurate Aha-moment through recognition. Additionally, the time of maximum pupil dilation, rather than average dilation, exhibited significant associations, being later for high-fluent, face-present stimuli and correct detections. In part 2, average, not the time of maximum pupil dilation emerged as the significant factor. Face-stimuli and highly accessible art evoked stronger dilations, also reflecting high clearness and negative valence ratings. Discussion: The study underscores a complex relationship between the timing of recognition and the Aha moment, suggesting nuanced differences in emotional and cognitive responses during art viewing. Pupil dilation measures offer insight into these processes especially for moments of recognition, though their application in evaluating emotional responses through artwork ratings warrants further exploration.

Experiencing beauty in everyday life.

Beauty surrounds us in many ways every day. In three experience sampling (ESM) studies we investigated frequency, category of eliciting stimuli (natural vs human-made) and, the potential moderating role of several individual difference measures on such everyday experiences of beauty in an ecologically valid manner. Further, we explored the impact of such experiences on valence & arousal. Study 1 re-analysed data from a previous study, in line with the current aims. In Studies 2 and 3, we asked participants to report daily experiences of beauty using a mixed random and event-contingent sampling schedule. Mobile notifications (random sampling) prompted participants to take a photo and rate the beauty of their surroundings. Further, current valence and arousal were assessed. Notification frequency and total days of participation differed between these two studies. Participants were able to report additional experiences outside of the notification windows (event-contingent sampling). Our results indicate that we frequently encounter beauty in everyday life and that we find it in nature, in particular. Our results further suggest a mood-boosting effect of encounters with beauty. Lastly, our results indicate influences of individual differences however, these were inconclusive and require further attention.

Cross-cultural comparison of beauty judgments in visual art using machine learning analysis of art attribute predictors among Japanese and German speakers.

In empirical art research, understanding how viewers judge visual artworks as beautiful is often explored through the study of attributes-specific inherent characteristics or artwork features such as color, complexity, and emotional expressiveness. These attributes form the basis for subjective evaluations, including the judgment of beauty. Building on this conceptual framework, our study examines the beauty judgments of 54 Western artworks made by native Japanese and German speakers, utilizing an extreme randomized trees model-a data-driven machine learning approach-to investigate cross-cultural differences in evaluation behavior. Our analysis of 17 attributes revealed that visual harmony, color variety, valence, and complexity significantly influenced beauty judgments across both cultural cohorts. Notably, preferences for complexity diverged significantly: while the native Japanese speakers found simpler artworks as more beautiful, the native German speakers evaluated more complex artworks as more beautiful. Further cultural distinctions were observed: for the native German speakers, emotional expressiveness was a significant factor, whereas for the native Japanese speakers, attributes such as brushwork, color world, and saturation were more impactful. Our findings illuminate the nuanced role that cultural context plays in shaping aesthetic judgments and demonstrate the utility of machine learning in unravelling these complex dynamics. This research not only advances our understanding of how beauty is judged in visual art-considering self-evaluated attributes-across different cultures but also underscores the potential of machine learning to enhance our comprehension of the aesthetic evaluation of visual artworks.

Acknowledging the diversity of aesthetic experiences: effects of style, meaning, and context.

Art can be experienced in numerous ways, ranging from sensory pleasure to elaborated ways of finding meaning (Leder et al. 2004). However, rather ignored by Bullot & Reber (B&R), in empirical aesthetics several lines of research have studied how knowledge of artistic style, descriptive and elaborate information, expertise, and context all affect aesthetic experiences from art. Limiting aesthetics to rather rare experiences unnecessarily narrows the scope of a science of art.

Reading in the city: mobile eye-tracking and evaluation of text in an everyday setting.

Reading is often regarded as a mundane aspect of everyday life. However, little is known about the natural reading experiences in daily activities. To fill this gap, this study presents two field studies (N = 39 and 26, respectively), where we describe how people explore visual environments and divide their attention toward text elements in highly ecological settings, i.e., urban street environments, using mobile eye-tracking glasses. Further, the attention toward the text elements (i.e., shop signs) as well as their memorability, measured via follow-up recognition test, were analysed in relation to their aesthetic quality, which is assumed to be key for attracting visual attention and memorability. Our results revealed that, within these urban streets, text elements were looked at most, and looking behaviour was strongly directed, especially toward shop signs, across both street contexts; however, aesthetic values were not correlated either with the most looked at signs or the viewing time for the signs. Aesthetic ratings did however have an effect on memorability, with signs rated higher being better recognised. The results will be discussed in terms aesthetic reading experiences and implications for future field studies.

Let's put a smile on that face-A positive facial expression improves aesthetics of portrait photographs.

In today's age of social media and smartphones, portraits-such as selfies or pictures of friends and family-are very frequently produced, shared and viewed images. Despite their prevalence, the psychological factors that characterize a 'good' photo-one that people will generally like, keep, and think is especially aesthetically pleasing-are not well understood. Here, we studied how a subtle change in facial expression (smiling) in portraits determines their aesthetic image value (beyond a more positive appearance of the depicted person). We used AI-based image processing tools in a broad set of portrait photographs and generated neutral and slightly smiling versions of the same pictures. Consistent across two experiments, portraits with a subtle smile increased both spontaneous aesthetic preferences in a swiping task as well as improving more explicit aesthetic ratings after prolonged viewing. Participants distinguished between aspects associated with image beauty and the depicted person's attractiveness, resulting in specific interactions between variables related to participant traits, image content, and task. Our study confirms that a subtle-and in this case fully artificial-smile reliably increases the aesthetic quality of portraits, illustrating how current image processing methods can target psychologically important variables and thereby increase the aesthetic value of photographs.

Machine learning revealed symbolism, emotionality, and imaginativeness as primary predictors of creativity evaluations of western art paintings.

Creativity is a compelling yet elusive phenomenon, especially when manifested in visual art, where its evaluation is often a subjective and complex process. Understanding how individuals judge creativity in visual art is a particularly intriguing question. Conventional linear approaches often fail to capture the intricate nature of human behavior underlying such judgments. Therefore, in this study, we employed interpretable machine learning to probe complex associations between 17 subjective art-attributes and creativity judgments across a diverse range of artworks. A cohort of 78 non-art expert participants assessed 54 artworks varying in styles and motifs. The applied Random Forests regressor models accounted for 30% of the variability in creativity judgments given our set of art-attributes. Our analyses revealed symbolism, emotionality, and imaginativeness as the primary attributes influencing creativity judgments. Abstractness, valence, and complexity also had an impact, albeit to a lesser degree. Notably, we observed non-linearity in the relationship between art-attribute scores and creativity judgments, indicating that changes in art-attributes did not consistently correspond to changes in creativity judgments. Employing statistical learning, this investigation presents the first attribute-integrating quantitative model of factors that contribute to creativity judgments in visual art among novice raters. Our research represents a significant stride forward building the groundwork for first causal models for future investigations in art and creativity research and offering implications for diverse practical applications. Beyond enhancing comprehension of the intricate interplay and specificity of attributes used in evaluating creativity, this work introduces machine learning as an innovative approach in the field of subjective judgment.