Play it again, but more sadly: Influence of timbre, mode, and musical experience in melody processing.

The emotional properties of music are influenced by a host of factors, such as timbre, mode, harmony, and tempo. In this paper, we consider how two of these factors, mode (major vs. minor) and timbre interact to influence ratings of perceived valence, reaction time, and recognition memory. More specifically, we considered the notion of congruence-that is, we used a set of melodies that crossed modes typically perceived as happy and sad (i.e., major and minor) in Western cultures with instruments typically perceived as happy and sad (i.e., marimba and viola). In a reaction-time experiment, participants were asked to classify melodies as happy or sad as quickly as possible. There was a clear congruency effect-that is, when the mode and timbre were congruent (major/marimba or minor/viola), reaction times were shorter than when the mode and timbre were incongruent (major/viola or minor/marimba). In Experiment 2, participants first rated the melodies for valence, before completing a recognition task. Melodies that were initially presented in incongruent conditions in the rating task were subsequently recognized better in the recognition task. The recognition advantage for melodies presented in incongruent conditions is discussed in the context of desirable difficulty.

SealID: Saimaa Ringed Seal Re-Identification Dataset.

Wildlife camera traps and crowd-sourced image material provide novel possibilities to monitor endangered animal species. The massive data volumes call for automatic methods to solve various tasks related to population monitoring, such as the re-identification of individual animals. The Saimaa ringed seal (Pusa hispida saimensis) is an endangered subspecies only found in Lake Saimaa, Finland, and is one of the few existing freshwater seal species. Ringed seals have permanent pelage patterns that are unique to each individual and that can be used for the identification of individuals. A large variation in poses, further exacerbated by the deformable nature of seals, together with varying appearance and low contrast between the ring pattern and the rest of the pelage makes the Saimaa ringed seal re-identification task very challenging, providing a good benchmark by which to evaluate state-of-the-art re-identification methods. Therefore, we make our Saimaa ringed seal image (SealID) dataset (N = 57) publicly available for research purposes. In this paper, the dataset is described, the evaluation protocol for re-identification methods is proposed, and the results for two baseline methods-HotSpotter and NORPPA-are provided. The SealID dataset has been made publicly available.

Automatic responses to musical intervals: Contrasts in acoustic roughness predict affective priming in Western listeners.

The aim of the present study is to determine which acoustic components of harmonic consonance and dissonance influence automatic responses in a simple cognitive task. In a series of affective priming experiments, eight pairs of musical intervals were used to measure the influence of acoustic roughness and harmonicity on response times in a word-classification task conducted online. Interval pairs that contrasted in roughness induced a greater degree of affective priming than pairs that did not contrast in terms of their roughness. Contrasts in harmonicity did not induce affective priming. A follow-up experiment used detuned intervals to create higher levels of roughness contrasts. However, the detuning did not lead to any further increase in the size of the priming effect. More detailed analysis suggests that the presence of priming in intervals is binary: in the negative primes that create congruency effects the intervals' fundamentals and overtones coincide within the same equivalent rectangular bandwidth (i.e., the minor and major seconds). Intervals that fall outside this equivalent rectangular bandwidth do not elicit priming effects, regardless of their dissonance or negative affect. The results are discussed in the context of recent developments in consonance/dissonance research and vocal similarity.

Explaining the enjoyment of negative emotions evoked by the arts: The need to consider empathy and other underlying mechanisms of emotion induction.

Any model aiming to explain the enjoyment of negative emotions in the context of the arts should consider how works of art are able to induce emotional responses in the first place. For instance, research on empathy and the arts suggests that the psychological processes that mediate the enjoyment of sadness and horror may be fundamentally different.

Music-induced changes in functional cerebral asymmetries.

After decades of research, it remains unclear whether emotion lateralization occurs because one hemisphere is dominant for processing the emotional content of the stimuli, or whether emotional stimuli activate lateralised networks associated with the subjective emotional experience. By using emotion-induction procedures, we investigated the effect of listening to happy and sad music on three well-established lateralization tasks. In a prestudy, Mozart's piano sonata (K. 448) and Beethoven's Moonlight Sonata were rated as the most happy and sad excerpts, respectively. Participants listened to either one emotional excerpt, or sat in silence before completing an emotional chimeric faces task (Experiment 1), visual line bisection task (Experiment 2) and a dichotic listening task (Experiment 3 and 4). Listening to happy music resulted in a reduced right hemispheric bias in facial emotion recognition (Experiment 1) and visuospatial attention (Experiment 2) and increased left hemispheric bias in language lateralization (Experiments 3 and 4). Although Experiments 1-3 revealed an increased positive emotional state after listening to happy music, mediation analyses revealed that the effect on hemispheric asymmetries was not mediated by music-induced emotional changes. The direct effect of music listening on lateralization was investigated in Experiment 4 in which tempo of the happy excerpt was manipulated by controlling for other acoustic features. However, the results of Experiment 4 made it rather unlikely that tempo is the critical cue accounting for the effects. We conclude that listening to music can affect functional cerebral asymmetries in well-established emotional and cognitive laterality tasks, independent of music-induced changes in the emotion state.

From Sound to Significance: Exploring the Mechanisms Underlying Emotional Reactions to Music.

A common approach to studying emotional reactions to music is to attempt to obtain direct links between musical surface features such as tempo and a listener's responses. However, such an analysis ultimately fails to explain why emotions are aroused in the listener. In this article we explore an alternative approach, which aims to account for musical emotions in terms of a set of psychological mechanisms that are activated by different types of information in a musical event. This approach was tested in 4 experiments that manipulated 4 mechanisms (brain stem reflex, contagion, episodic memory, musical expectancy) by selecting existing musical pieces that featured information relevant for each mechanism. The excerpts were played to 60 listeners, who were asked to rate their felt emotions on 15 scales. Skin conductance levels and facial expressions were measured, and listeners reported subjective impressions of relevance to specific mechanisms. Results indicated that the target mechanism conditions evoked emotions largely as predicted by a multimechanism framework and that mostly similar effects occurred across the experiments that included different pieces of music. We conclude that a satisfactory account of musical emotions requires consideration of how musical features and responses are mediated by a range of underlying mechanisms.

Rhythmic engagement with music in infancy.

Humans have a unique ability to coordinate their motor movements to an external auditory stimulus, as in music-induced foot tapping or dancing. This behavior currently engages the attention of scholars across a number of disciplines. However, very little is known about its earliest manifestations. The aim of the current research was to examine whether preverbal infants engage in rhythmic behavior to music. To this end, we carried out two experiments in which we tested 120 infants (aged 5-24 months). Infants were exposed to various excerpts of musical and rhythmic stimuli, including isochronous drumbeats. Control stimuli consisted of adult- and infant-directed speech. Infants' rhythmic movements were assessed by multiple methods involving manual coding from video excerpts and innovative 3D motion-capture technology. The results show that (i) infants engage in significantly more rhythmic movement to music and other rhythmically regular sounds than to speech; (ii) infants exhibit tempo flexibility to some extent (e.g., faster auditory tempo is associated with faster movement tempo); and (iii) the degree of rhythmic coordination with music is positively related to displays of positive affect. The findings are suggestive of a predisposition for rhythmic movement in response to music and other metrically regular sounds.

Culture influences conscious appraisal of, but not automatic aversion to, acoustically rough musical intervals.

There is debate whether the foundations of consonance and dissonance are rooted in culture or in psychoacoustics. In order to disentangle the contribution of culture and psychoacoustics, we considered automatic responses to the perfect fifth and the major second (flattened by 25 cents) intervals alongside conscious evaluations of the same intervals across two cultures and two levels of musical expertise. Four groups of participants completed the tasks: expert performers of Lithuanian Sutartines, English speaking musicians in Western diatonic genres, Lithuanian non-musicians and English-speaking non-musicians. Sutartines singers were chosen as this style of singing is an example of 'beat diaphony' where intervals of parts form predominantly rough sonorities and audible beats. There was no difference in automatic responses to intervals, suggesting that an aversion to acoustically rough intervals is not governed by cultural familiarity but may have a physical basis in how the human auditory system works. However, conscious evaluations resulted in group differences with Sutartines singers rating both the flattened major as more positive than did other groups. The results are discussed in the context of recent developments in consonance and dissonance research.

Register impacts perceptual consonance through roughness and sharpness.

The perception of consonance and dissonance in intervals and chords is influenced by psychoacoustic and cultural factors. Past research has provided conflicting observations about the role of frequency in assessing musical consonance that may stem from comparisons of limited frequency bands without much theorizing or modeling. Here we examine the effect of register on perceptual consonance of chords. Based on two acoustic principles, we predict a decrease in consonance at low frequencies (roughness) and a decrease of consonance at high frequencies (sharpness). Due to these two separate principles, we hypothesize that frequency will have a curvilinear impact on consonance. A selection of tetrads varying in consonance were presented in seven registers spanning 30 to 2600 Hz. Fifty-five participants rated the stimuli in an online experiment. The effect of register on consonance ratings was clear and largely according to the predictions; The low registers impacted consonance negatively and the highest two registers also received significantly lower consonance ratings than the middle registers. The impact of register on consonance could be accurately described with a cubic relationship. Overall, the influence of roughness was more pronounced on consonance ratings than sharpness. Together, these findings clarify previous empirical efforts to model the effect of frequency on consonance through basic acoustic principles. They further suggest that a credible account of consonance and dissonance in music needs to incorporate register.

Musical Enjoyment and Reward: From Hedonic Pleasure to Eudaimonic Listening.

This article is a hypothesis and theory paper. It elaborates on the possible relation between music as a stimulus and its possible effects, with a focus on the question of why listeners are experiencing pleasure and reward. Though it is tempting to seek for a causal relationship, this has proven to be elusive given the many intermediary variables that intervene between the actual impingement on the senses and the reactions/responses by the listener. A distinction can be made, however, between three elements: (i) an objective description of the acoustic features of the music and their possible role as elicitors; (ii) a description of the possible modulating factors-both external/exogenous and internal/endogenous ones; and (iii) a continuous and real-time description of the responses by the listener, both in terms of their psychological reactions and their physiological correlates. Music listening, in this broadened view, can be considered as a multivariate phenomenon of biological, psychological, and cultural factors that, together, shape the overall, full-fledged experience. In addition to an overview of the current and extant research on musical enjoyment and reward, we draw attention to some key methodological problems that still complicate a full description of the musical experience. We further elaborate on how listening may entail both adaptive and maladaptive ways of coping with the sounds, with the former allowing a gentle transition from mere hedonic pleasure to eudaimonic enjoyment.

Emotional expression through musical cues: A comparison of production and perception approaches.

Multiple approaches have been used to investigate how musical cues are used to shape different emotions in music. The most prominent approach is a perception study, where musical stimuli varying in cue levels are assessed by participants in terms of their conveyed emotion. However, this approach limits the number of cues and combinations simultaneously investigated, since each variation produces another musical piece to be evaluated. Another less used approach is a production approach, where participants use cues to change the emotion conveyed in music, allowing participants to explore a larger number of cue combinations than the former approach. These approaches provide different levels of accuracy and economy for identifying how cues are used to convey different emotions in music. However, do these approaches provide converging results? This paper's aims are two-fold. The role of seven musical cues (tempo, pitch, dynamics, brightness, articulation, mode, and instrumentation) in communicating seven emotions (sadness, joy, calmness, anger, fear, power, and surprise) in music is investigated. Additionally, this paper explores whether the two approaches will yield similar findings on how the cues are used to shape different emotions in music. The first experiment utilises a production approach where participants adjust the cues in real-time to convey target emotions. The second experiment uses a perception approach where participants rate pre-rendered systematic variations of the stimuli for all emotions. Overall, the cues operated similarly in the majority (32/49) of cue-emotion combinations across both experiments, with the most variance produced by the dynamics and instrumentation cues. A comparison of the prediction accuracy rates of cue combinations representing the intended emotions found that prediction rates in Experiment 1 were higher than the ones obtained in Experiment 2, suggesting that a production approach may be a more efficient method to explore how cues are used to shape different emotions in music.

The CODA Model: A Review and Skeptical Extension of the Constructionist Model of Emotional Episodes Induced by Music.

This paper discusses contemporary advancements in the affective sciences (described together as skeptical theories) that can inform the music-emotion literature. Key concepts in these theories are outlined, highlighting their points of agreement and disagreement. This summary shows the importance of appraisal within the emotion process, provides a greater emphasis upon goal-directed accounts of (emotion) behavior, and a need to move away from discrete emotion "folk" concepts and toward the study of an emotional episode and its components. Consequently, three contemporary music emotion theories (BRECVEMA, Multifactorial Process Approach, and a Constructionist Account) are examined through a skeptical lens. This critique highlights the over-reliance upon categorization and a lack of acknowledgment of appraisal processes, specifically goal-directed appraisal, in examining how individual experiences of music emerge in different contexts. Based on this critique of current music-emotion models, we present our skeptically informed CODA model - Constructivistly-Organised Dimensional-Appraisal model. This model addresses skeptical limitations of existing theories, reinstates the role of goal-directed appraisal as central to what makes music relevant and meaningful to an individual in different contexts and brings together different theoretical frameworks into a single model. From the development of the CODA model, several hypotheses are proposed and applied to musical contexts. These hypotheses address theoretical issues such as acknowledging individual and contextual differences in emotional intensity and valence, as well as differentiating between induced and perceived emotions, and utilitarian and aesthetic emotions. We conclude with a sections of recommendations for future research. Altogether, this theoretical critique and proposed model points toward a positive future direction for music-emotion science. One where researchers can take forward testable predictions about what makes music relevant and meaningful to an individual.

Correction: Harmonic organisation conveys both universal and culture-specific cues for emotional expression in music.

[This corrects the article DOI: 10.1371/journal.pone.0244964.].

Sweetness is in the ear of the beholder: chord preference across United Kingdom and Pakistani listeners.

The majority of research in the field of music perception has been conducted with Western participants, and it has remained unclear which aspects of music perception are culture dependent, and which are universal. The current study compared how participants unfamiliar with Western music (people from the Khowar and Kalash tribes native to Northwest Pakistan with minimal exposure to Western music) perceive affect (positive versus negative) in musical chords compared with United Kingdom (UK) listeners, as well as the overall preference for these chords. The stimuli consisted of four distinct chord types (major, minor, augmented, and chromatic) and were played as both vertical blocks (pitches presented concurrently) and arpeggios (pitches presented successively). The results suggest that the Western listener major-positive minor-negative affective distinction is opposite for Northwest Pakistani listeners, arguably because of the reversed prevalence of these chords in the two music cultures. The aversion to the harsh dissonance of the chromatic cluster is present cross-culturally, but the preference for the consonance of the major triad varies between UK and Northwest Pakistani listeners, depending on cultural familiarity. Our findings imply not only notable cultural variation but also commonalities in chord perception across Western and non-Western listeners.

Harmonic organisation conveys both universal and culture-specific cues for emotional expression in music.

Previous research conducted on the cross-cultural perception of music and its emotional content has established that emotions can be communicated across cultures at least on a rudimentary level. Here, we report a cross-cultural study with participants originating from two tribes in northwest Pakistan (Khow and Kalash) and the United Kingdom, with both groups being naïve to the music of the other respective culture. We explored how participants assessed emotional connotations of various Western and non-Western harmonisation styles, and whether cultural familiarity with a harmonic idiom such as major and minor mode would consistently relate to emotion communication. The results indicate that Western concepts of harmony are not relevant for participants unexposed to Western music when other emotional cues (tempo, pitch height, articulation, timbre) are kept relatively constant. At the same time, harmonic style alone has the ability to colour the emotional expression in music if it taps the appropriate cultural connotations. The preference for one harmonisation style over another, including the major-happy/minor-sad distinction, is influenced by culture. Finally, our findings suggest that although differences emerge across different harmonisation styles, acoustic roughness influences the expression of emotion in similar ways across cultures; preference for consonance however seems to be dependent on cultural familiarity.

Being moved by listening to unfamiliar sad music induces reward-related hormonal changes in empathic listeners.

Many people enjoy sad music, and the appeal for tragedy is widespread among the consumers of film and literature. The underlying mechanisms of such aesthetic experiences are not well understood. We tested whether pleasure induced by sad, unfamiliar instrumental music is explained with a homeostatic or a reward theory, each of which is associated with opposite patterns of changes in the key hormones. Sixty-two women listened to sad music (or nothing) while serum was collected for subsequent measurement of prolactin (PRL) and oxytocin (OT) and stress marker (cortisol and adrenocorticotropic hormone) concentrations. Two groups of participants were recruited on the basis of low and high trait empathy. In the high empathy group, PRL and OT levels were significantly lower with music compared with no music. And compared to the low empathy group, the high empathy individuals reported an increase of positive mood and higher ratings of being moved with music. None of the stress markers showed any changes across the conditions or the groups. These hormonal changes, inconsistent with the homeostatic theory proposed by Huron, exhibit a pattern expected of general reward. Our findings illuminate how unfamiliar and low arousal music may give rise to pleasurable experiences.

Cultural familiarity and musical expertise impact the pleasantness of consonance/dissonance but not its perceived tension.

The contrast between consonance and dissonance is vital in making music emotionally meaningful. Consonance typically denotes perceived agreeableness and stability, while dissonance disagreeableness and a need of resolution. This study addresses the perception of consonance/dissonance in single intervals and chords with two empirical experiments conducted online. Experiment 1 explored the perception of a representative sample of intervals and chords to investigate the overlap between the seven most used concepts (Consonance, Smoothness, Purity, Harmoniousness, Tension, Pleasantness, Preference) denoting consonance/dissonance in all the available (60) empirical studies published since 1883. The results show that the concepts exhibit high correlations, albeit these are somewhat lower for non-musicians compared to musicians. In Experiment 2 the stimuli's cultural familiarity was divided into three levels, and the correlations between the key concepts of Consonance, Tension, Harmoniousness, Pleasantness, and Preference were further examined. Cultural familiarity affected the correlations drastically across both musicians and non-musicians, but in different ways. Tension maintained relatively high correlations with Consonance across musical expertise and cultural familiarity levels, making it a useful concept for studies addressing both musicians and non-musicians. On the basis of the results a control for cultural familiarity and musical expertise is recommended for all studies investigating consonance/dissonance perception.

Coupled whole-body rhythmic entrainment between two chimpanzees.

Dance is an icon of human expression. Despite astounding diversity around the world's cultures and dazzling abundance of reminiscent animal systems, the evolution of dance in the human clade remains obscure. Dance requires individuals to interactively synchronize their whole-body tempo to their partner's, with near-perfect precision. This capacity is motorically-heavy, engaging multiple neural circuitries, but also dependent on an acute socio-emotional bond between partners. Hitherto, these factors helped explain why no dance forms were present amongst nonhuman primates. Critically, evidence for conjoined full-body rhythmic entrainment in great apes that could help reconstruct possible proto-stages of human dance is still lacking. Here, we report an endogenously-effected case of ritualized dance-like behaviour between two captive chimpanzees - synchronized bipedalism. We submitted video recordings to rigorous time-series analysis and circular statistics. We found that individual step tempo was within the genus' range of "solo" bipedalism. Between-individual analyses, however, revealed that synchronisation between individuals was non-random, predictable, phase concordant, maintained with instantaneous centi-second precision and jointly regulated, with individuals also taking turns as "pace-makers". No function was apparent besides the behaviour's putative positive social affiliation. Our analyses show a first case of spontaneous whole-body entrainment between two ape peers, thus providing tentative empirical evidence for phylogenies of human dance. Human proto-dance, we argue, may have been rooted in mechanisms of social cohesion among small groups that might have granted stress-releasing benefits via gait-synchrony and mutual-touch. An external sound/musical beat may have been initially uninvolved. We discuss dance evolution as driven by ecologically-, socially- and/or culturally-imposed "captivity".

The role of hedonics in the Human Affectome.

Experiencing pleasure and displeasure is a fundamental part of life. Hedonics guide behavior, affect decision-making, induce learning, and much more. As the positive and negative valence of feelings, hedonics are core processes that accompany emotion, motivation, and bodily states. Here, the affective neuroscience of pleasure and displeasure that has largely focused on the investigation of reward and pain processing, is reviewed. We describe the neurobiological systems of hedonics and factors that modulate hedonic experiences (e.g., cognition, learning, sensory input). Further, we review maladaptive and adaptive pleasure and displeasure functions in mental disorders and well-being, as well as the experience of aesthetics. As a centerpiece of the Human Affectome Project, language used to express pleasure and displeasure was also analyzed, and showed that most of these analyzed words overlap with expressions of emotions, actions, and bodily states. Our review shows that hedonics are typically investigated as processes that accompany other functions, but the mechanisms of hedonics (as core processes) have not been fully elucidated.

Suppressing the Chills: Effects of Musical Manipulation on the Chills Response.

Research on musical chills has linked the response to multiple musical features; however, there exists no study that has attempted to manipulate musical stimuli to enable causal inferences, meaning current understanding is based mainly on correlational evidence. In the current study, participants who regularly experience chills (N = 24) listened to an original and manipulated version of three pieces reported to elicit chills in a previous survey. Predefined chills sections were removed to create manipulated conditions. The effects of these manipulations on the chills response were assessed through continuous self-reports, and skin conductance measurements. Results show that chills were significantly less frequent following stimulus manipulation across all three pieces. Continuous measurements of chills intensity were significantly higher in the chills sections compared with control sections in the pieces; similar patterns were found for phasic skin conductance, although some differences emerged. Continuous measurements also correlated with psychoacoustic features such as loudness, brightness and roughness in two of the three pieces. Findings are discussed in terms of understanding structural and acoustic features and chills experiences within their local music contexts, the necessity of experimental approaches to musical chills, and the possibility of different features activating different underlying mechanisms.