Feeling the Beat: Temporal Predictability is Associated with Ongoing Changes in Music-Induced Pleasantness.

Music is a complex phenomenon that elicits a range of emotional responses, influenced by numerous variables, such as rhythm, melody and harmony. One interesting aspect of music is listeners' ability to predict its continuation as it unfolds - an inherent attribute hypothesized to contribute to our emotional response to music. In this study, we investigated this link by examining the relationship between temporal predictability - the ability to predict the timing of the next event - and the ongoing changes in music-induced pleasantness. Temporal predictability was operationalized as the degree to which taps of 20 musically trained participants, who tapped to the beat along three naturalistic and highly contrastive musical pieces, were aligned. We then examined the degree to which this measure could explain the ongoing emotional experience, as reflected in continuous measures of arousal and valence, in a separate group of 40 participants that listened to these pieces. Our findings reveal a positive correlation between fluctuations in reported valence and temporal predictability, even when controlling for a set of other musical features, in four out of five musical sections. The only exception being a lyrical slow section. These findings were further supported by a large online database of annotated musical emotions (n = 1780 songs), where a consistent and robust correlation between valence ratings and an automatically extracted feature of pulse clarity was demonstrated. Overall, our findings shed light on the significance of temporal predictability as a contributing factor to the hedonic experience of music, especially within the tempo range of salient beat perception.

Development and validation of an fMRI-informed EEG model of reward-related ventral striatum activation.

Reward processing is essential for our mental-health and well-being. In the current study, we developed and validated a scalable, fMRI-informed EEG model for monitoring reward processing related to activation in the ventral-striatum (VS), a significant node in the brain's reward system. To develop this EEG-based model of VS-related activation, we collected simultaneous EEG/fMRI data from 17 healthy individuals while listening to individually-tailored pleasurable music - a highly rewarding stimulus known to engage the VS. Using these cross-modal data, we constructed a generic regression model for predicting the concurrently acquired Blood-Oxygen-Level-Dependent (BOLD) signal from the VS using spectro-temporal features from the EEG signal (termed hereby VS-related-Electrical Finger Print; VS-EFP). The performance of the extracted model was examined using a series of tests that were applied on the original dataset and, importantly, an external validation dataset collected from a different group of 14 healthy individuals who underwent the same EEG/FMRI procedure. Our results showed that the VS-EFP model, as measured by simultaneous EEG, predicted BOLD activation in the VS and additional functionally relevant regions to a greater extent than an EFP model derived from a different anatomical region. The developed VS-EFP was also modulated by musical pleasure and predictive of the VS-BOLD during a monetary reward task, further indicating its functional relevance. These findings provide compelling evidence for the feasibility of using EEG alone to model neural activation related to the VS, paving the way for future use of this scalable neural probing approach in neural monitoring and self-guided neuromodulation.

Music engagement is negatively correlated with depressive symptoms during the COVID-19 pandemic via reward-related mechanisms.

The COVID-19 pandemic has deeply affected the mental health of millions of people. We assessed which of many leisure activities correlated with positive mental health outputs, with particular attention to music, which has been reported to be important for coping with the psychological burden of the pandemic. Questionnaire data from about 1000 individuals primarily from Italy, Spain, and the United States during May-June 2020 show that people picked music activities (listening to, playing, singing, etc.) most often as the leisure experiences that helped them the most to cope with psychological distress related with the pandemic. During the pandemic, hours of engagement in music and food-related activities were associated with lower depressive symptoms. The negative correlation between music and depression was mediated by individual differences in sensitivity to reward, whereas the correlation between food-related activities and improved mental health outputs was explained by differences in emotion suppression strategies. Our results, while correlational, suggest that engaging in music activities could be related to improved well-being with the underlying mechanism being related to reward, consistent with neuroscience findings. Our data have practical significance in pointing to effective strategies to cope with mental health issues beyond those related to the COVID-19 pandemic.

Engagement in Music-Related Activities During the COVID-19 Pandemic as a Mirror of Individual Differences in Musical Reward and Coping Strategies.

The COVID-19 pandemic and the measures taken to mitigate its impact (e.g., confinement orders) have affected people's lives in profound ways that would have been unimagable only months before the pandemic began. Media reports from the height of the pandemic's initial international surge frequently highlighted that many people were engaging in music-related activities (from singing and dancing to playing music from balconies and attending virtual concerts) to help them cope with the strain of the pandemic. Our first goal in this study was to investigate changes in music-related habits due to the pandemic. We also investigated whether engagement in distinct music-related activities (singing, listening, dancing, etc.) was associated with individual differences in musical reward, music perception, musical training, or emotional regulation strategies. To do so, we collected detailed (~1 h-long) surveys during the initial peak of shelter-in-place order implementation (May-June 2020) from over a thousand individuals across different Countries in which the pandemic was especially devastating at that time: the USA, Spain, and Italy. Our findings indicate that, on average, people spent more time in music-related activities while under confinement than they had before the pandemic. Notably, this change in behavior was dependent on individual differences in music reward sensitivity, and in emotional regulation strategies. Finally, the type of musical activity with which individuals engaged was further associated with the degree to which they used music as a way to regulate stress, to address the lack of social interaction (especially the individuals more concerned about the risk of contracting the virus), or to cheer themselves up (especially those who were more worried about the pandemic consequences). Identifying which music-related activities have been particularly sought for by the population as a means for coping with such heightened uncertainty and stress, and understanding the individual differences that underlie said propensities are crucial to implementing personalized music-based interventions that aim to reduce stress, anxiety, and depression symptoms.

From apathy to addiction: Insights from neurology and psychiatry.

The tendency to engage in addictive behaviors has long been tied to the actions of the dopamine system. Early theories were based on the fact that all addictive drugs and behaviors (such as gambling) increase dopamine levels in the striatum, and the evidence that dopamine signaled reward or reward prediction error. However, with a changing emphasis of addiction away from purely pharmacological models that emphasize tolerance and withdrawal, towards one of behavioral dyscontrol, is there still a place for abnormal dopamine signaling in addiction? Here we recast the dopamine theory of addiction based on the idea that tonic dopamine may index a continuous phenotype that goes from apathy to impulsivity and compulsivity. Higher tonic dopamine signaling would make individuals vulnerable to drug reinforcement and cue-induced craving. We relate this to computational models of dopamine signaling, and review clinical and neuroimaging evidence from Parkinson's Disease, schizophrenia and bipolar disorder in support of this model.

Is there a prediction network? Meta-analytic evidence for a cortical-subcortical network likely subserving prediction.

Predictive coding is an increasingly influential and ambitious concept in neuroscience viewing the brain as a 'hypothesis testing machine' that constantly strives to minimize prediction error, the gap between its predictions and the actual sensory input. Despite the invaluable contribution of this framework to the formulation of brain function, its neuroanatomical foundations have not been fully defined. To address this gap, we conducted activation likelihood estimation (ALE) meta-analysis of 39 neuroimaging studies of three functional domains (action perception, language and music) inherently involving prediction. The ALE analysis revealed a widely distributed brain network encompassing regions within the inferior and middle frontal gyri, anterior insula, premotor cortex, pre-supplementary motor area, temporoparietal junction, striatum, thalamus/subthalamus and the cerebellum. This network is proposed to subserve domain-general prediction and its relevance to motor control, attention, implicit learning and social cognition is discussed in light of the predictive coding scheme. Better understanding of the presented network may help advance treatments of neuropsychiatric conditions related to aberrant prediction processing and promote cognitive enhancement in healthy individuals.

Publisher Correction: Process-based framework for precise neuromodulation.

The original and corrected figures, and the Editorial Summary, are shown in the accompanying Publisher Correction.An amendment to this paper has been published and can be accessed via a link at the top of the paper.

Publisher Correction: Process-based framework for precise neuromodulation.

The original and corrected text is shown in the accompanying Publisher Correction.

Process-based framework for precise neuromodulation.

Functional MRI neurofeedback (NF) allows humans to self-modulate neural patterns in specific brain areas. This technique is regarded as a promising tool to translate neuroscientific knowledge into brain-guided psychiatric interventions. However, its clinical implementation is restricted by unstandardized methodological practices, by clinical definitions that are poorly grounded in neurobiology, and by lack of a unifying framework that dictates experimental choices. Here we put forward a new framework, termed 'process-based NF', which endorses a process-oriented characterization of mental dysfunctions to form precise and effective psychiatric treatments. This framework relies on targeting specific dysfunctional mental processes by modifying their underlying neural mechanisms and on applying process-specific contextual feedback interfaces. Finally, process-based NF offers designs and a control condition that address the methodological shortcomings of current approaches, thus paving the way for a precise and personalized neuromodulation.

Surprise-related activation in the nucleus accumbens interacts with music-induced pleasantness.

How can music-merely a stream of sounds-be enjoyable for so many people? Recent accounts of this phenomenon are inspired by predictive coding models, hypothesizing that both confirmation and violations of musical expectations associate with the hedonic response to music via recruitment of the mesolimbic system and its connections with the auditory cortex. Here we provide support for this model, by revealing associations of music-induced pleasantness with musical surprises in the activity and connectivity patterns of the nucleus accumbens (NAcc)-a central component of the mesolimbic system. We examined neurobehavioral responses to surprises in three naturalistic musical pieces using fMRI and subjective ratings of valence and arousal. Surprises were associated with changes in reported valence and arousal, as well as with enhanced activations in the auditory cortex, insula and ventral striatum, relative to unsurprising events. Importantly, we found that surprise-related activation in the NAcc was more pronounced among individuals who experienced greater music-induced pleasantness. These participants also exhibited stronger surprise-related NAcc-auditory cortex connectivity during the most pleasant piece, relative to participants who found the music less pleasant. These findings provide a novel demonstration of a direct link between musical surprises, NAcc activation and music-induced pleasantness.

Robust inter-subject audiovisual decoding in functional magnetic resonance imaging using high-dimensional regression.

Major methodological advancements have been recently made in the field of neural decoding, which is concerned with the reconstruction of mental content from neuroimaging measures. However, in the absence of a large-scale examination of the validity of the decoding models across subjects and content, the extent to which these models can be generalized is not clear. This study addresses the challenge of producing generalizable decoding models, which allow the reconstruction of perceived audiovisual features from human magnetic resonance imaging (fMRI) data without prior training of the algorithm on the decoded content. We applied an adapted version of kernel ridge regression combined with temporal optimization on data acquired during film viewing (234 runs) to generate standardized brain models for sound loudness, speech presence, perceived motion, face-to-frame ratio, lightness, and color brightness. The prediction accuracies were tested on data collected from different subjects watching other movies mainly in another scanner. Substantial and significant (QFDR<0.05) correlations between the reconstructed and the original descriptors were found for the first three features (loudness, speech, and motion) in all of the 9 test movies (R¯=0.62, R¯ = 0.60, R¯ = 0.60, respectively) with high reproducibility of the predictors across subjects. The face ratio model produced significant correlations in 7 out of 8 movies (R¯=0.56). The lightness and brightness models did not show robustness (R¯=0.23, R¯ = 0). Further analysis of additional data (95 runs) indicated that loudness reconstruction veridicality can consistently reveal relevant group differences in musical experience. The findings point to the validity and generalizability of our loudness, speech, motion, and face ratio models for complex cinematic stimuli (as well as for music in the case of loudness). While future research should further validate these models using controlled stimuli and explore the feasibility of extracting more complex models via this method, the reliability of our results indicates the potential usefulness of the approach and the resulting models in basic scientific and diagnostic contexts.

Common modulation of limbic network activation underlies musical emotions as they unfold.

Music is a powerful means for communicating emotions among individuals. Here we reveal that this continuous stream of affective information is commonly represented in the brains of different listeners and that particular musical attributes mediate this link. We examined participants' brain responses to two naturalistic musical pieces using functional Magnetic Resonance imaging (fMRI). Following scanning, as participants listened to the musical pieces for a second time, they continuously indicated their emotional experience on scales of valence and arousal. These continuous reports were used along with a detailed annotation of the musical features, to predict a novel index of Dynamic Common Activation (DCA) derived from ten large-scale data-driven functional networks. We found an association between the unfolding music-induced emotionality and the DCA modulation within a vast network of limbic regions. The limbic-DCA modulation further corresponded with continuous changes in two temporal musical features: beat-strength and tempo. Remarkably, this "collective limbic sensitivity" to temporal features was found to mediate the link between limbic-DCA and the reported emotionality. An additional association with the emotional experience was found in a left fronto-parietal network, but only among a sub-group of participants with a high level of musical experience (>5years). These findings may indicate two processing-levels underlying the unfolding of common music emotionality; (1) a widely shared core-affective process that is confined to a limbic network and mediated by temporal regularities in music and (2) an experience based process that is rooted in a left fronto-parietal network that may involve functioning of the 'mirror-neuron system'.

Distinct iEEG activity patterns in temporal-limbic and prefrontal sites induced by emotional intentionality.

Our emotions tend to be directed towards someone or something. Such emotional intentionality calls for the integration between two streams of information; abstract hedonic value and its associated concrete content. In a previous functional magnetic resonance imaging (fMRI) study we found that the combination of these two streams, as modeled by short emotional music excerpts and neutral film clips, was associated with synergistic activation in both temporal-limbic (TL) and ventral-lateral PFC (vLPFC) regions. This additive effect implies the integration of domain-specific 'affective' and 'cognitive' processes. Yet, the low temporal resolution of the fMRI limits the characterization of such cross-domain integration. To this end, we complemented the fMRI data with intracranial electroencephalogram (iEEG) recordings from twelve patients with intractable epilepsy. As expected, the additive fMRI activation in the amygdala and vLPFC was associated with distinct spatio-temporal iEEG patterns among electrodes situated within the vicinity of the fMRI activation foci. On the one hand, TL channels exhibited a transient (0-500 msec) increase in gamma power (61-69 Hz), possibly reflecting initial relevance detection or hedonic value tagging. On the other hand, vLPFC channels showed sustained (1-12 sec) suppression of low frequency power (2.3-24 Hz), possibly mediating changes in gating, enabling an on-going readiness for content-based processing of emotionally tagged signals. Moreover, an additive effect in delta-gamma phase-amplitude coupling (PAC) was found among the TL channels, possibly reflecting the integration between distinct domain specific processes. Together, this study provides a multi-faceted neurophysiological signature for computations that possibly underlie emotional intentionality in humans.

Cortex-based inter-subject analysis of iEEG and fMRI data sets: application to sustained task-related BOLD and gamma responses.

Linking regional metabolic changes with fluctuations in the local electromagnetic fields directly on the surface of the human cerebral cortex is of tremendous importance for a better understanding of detailed brain processes. Functional magnetic resonance imaging (fMRI) and intra-cranial electro-encephalography (iEEG) measure two technically unrelated but spatially and temporally complementary sets of functional descriptions of human brain activity. In order to allow fine-grained spatio-temporal human brain mapping at the population-level, an effective comparative framework for the cortex-based inter-subject analysis of iEEG and fMRI data sets is needed. We combined fMRI and iEEG recordings of the same patients with epilepsy during alternated intervals of passive movie viewing and music listening to explore the degree of local spatial correspondence and temporal coupling between blood oxygen level dependent (BOLD) fMRI changes and iEEG spectral power modulations across the cortical surface after cortex-based inter-subject alignment. To this purpose, we applied a simple model of the iEEG activity spread around each electrode location and the cortex-based inter-subject alignment procedure to transform discrete iEEG measurements into cortically distributed group patterns by establishing a fine anatomic correspondence of many iEEG cortical sites across multiple subjects. Our results demonstrate the feasibility of a multi-modal inter-subject cortex-based distributed analysis for combining iEEG and fMRI data sets acquired from multiple subjects with the same experimental paradigm but with different iEEG electrode coverage. The proposed iEEG-fMRI framework allows for improved group statistics in a common anatomical space and preserves the dynamic link between the temporal features of the two modalities.

Enhanced functional synchronization of medial and lateral PFC underlies internally-guided action planning.

Actions are often internally guided, reflecting our covert will and intentions. The dorsomedial prefrontal cortex, including the pre-Supplementary Motor Area (pre-SMA), has been implicated in the internally generated aspects of action planning, such as choice and intention. Yet, the mechanism by which this area interacts with other cognitive brain regions such as the dorsolateral prefrontal cortex, a central node in decision-making, is still unclear. To shed light on this mechanism, brain activity was measured via fMRI and intracranial EEG in two studies during the performance of visually cued repeated finger tapping in which the choice of finger was guided by either a presented number (external) or self-choice (internal). A functional-MRI (fMRI) study in 15 healthy participants demonstrated that the pre-SMA, compared to the SMA proper, was more active and also more functionally correlated with the dorsolateral prefrontal cortex during internally compared to externally guided action planning (p < 0.05, random effect). In a similar manner, an intracranial-EEG study in five epilepsy patients showed greater inter-regional gamma-related connectivity between electrodes situated in medial and lateral aspects of the prefrontal cortex for internally compared to externally guided actions. Although this finding was observed for groups of electrodes situated both in the pre-SMA and SMA-proper, increased intra-cluster gamma-related connectivity was only observed for the pre-SMA (sign-test, p < 0.0001). Overall our findings provide multi-scale indications for the involvement of the dorsomedial prefrontal cortex, and especially the pre-SMA, in generating internally guided motor planning. Our intracranial-EEG results further point to enhanced functional connectivity between decision-making- and motor planning aspects of the PFC, as a possible neural mechanism for internally generated action planning.

Through the eyes of anxiety: Dissecting threat bias via emotional-binocular rivalry.

An extensive body of research has demonstrated that anxious individuals abnormally process threat-related content. Yet, the manner in which clinical anxiety affects the selection of threatening signals and their maintenance within consciousness is yet to be explored. The present study used an emotional binocular rivalry (e-BR) procedure, in which pictures of faces depicting either fearful or neutral expressions competed with pictures of a house for conscious perception. We assumed that first- or cumulative-preferred perception of faces with fearful over neutral expression (i.e., initial or sustained threat bias, respectively) stand for preferential selection or maintenance of fear content in awareness, correspondingly. Unmedicated patients with social anxiety disorder (SAD) and panic disorder (PAD) were compared to healthy controls for threat-related perceptual biases in the e-BR. At first perception of face, both SAD and PAD patients showed a greater initial threat bias than healthy controls. In contrast, at cumulative dwell-time of face, patient groups demonstrated a diminished sustained threat bias relative to healthy controls, yet in a different manner. SAD patients showed a sustained threat bias, though it was smaller than in healthy controls. Furthermore, increased levels of reported anxiety among SAD patients were associated with enhanced sustained perception of neutral faces. PAD patients, on the other hand, showed no sustained threat bias and a diminished cumulative perception of fearful faces with increased levels of anxiety traits. These findings indicate that anxiety disorders commonly involve an initially enhanced selection of threat signals into awareness, followed by disorder-specific manifestation of diminished preferred maintenance of threat in awareness.

Feeling without seeing? Engagement of ventral, but not dorsal, amygdala during unaware exposure to emotional faces.

The ability to selectively perceive items in the environment may be modulated by the emotional content of those items. The neural mechanism that underlies the privileged processing of emotionally salient content is poorly understood. Here, using fMRI, we investigated this issue via a binocular rivalry procedure when face stimuli depicting fearful or neutral expressions competed for awareness with a house. Results revealed an interesting dissociation in the amygdala during rivalry condition: Whereas its dorsal component exhibited dominant activation to aware fearful faces, a ventral component was more active during the suppression of fearful faces. Moreover, during rivalry, the dorsal and ventral components of the amygdala were coupled with segregated cortical activations in the brainstem and medial PFC, respectively. In summary, this study points to a differential involvement of two clusters within the amygdala and their connected networks in naturally occurring perceptual biases of emotional content in faces.