Emotional activation in a cognitive behavioral setting: extending the tradition with embodiment.

The neuroscience-based concept of "embodied cognition" or "embodiment" highlights that body and psyche are closely intertwined, i.e., effects of body and psyche are bidirectional and reciprocal. This represents the view that cognitive processes are not possible without the direct participation of the body. Traditional Cognitive Behavioral Therapy (CBT) addresses emotional processes on a conceptual level (dysfunctional thoughts, beliefs, attributions, etc.). However recent findings suggest that these processes already start at the level of bodily sensations. This opens up a way of working in therapy that includes the level of bodily sensations, where the development of emotional meaning is supported by bottom-up processes. Bidirectionality of embodiment can be effectively exploited by using body postures and movements associated with certain emotions, which we refer to as embodiment techniques, to deepen the physical experience of poorly felt emotions and support the valid construction of emotional meaning. This embodied approach offers several advantages: Prelinguistic or hard-to-grasp aspects can be identified more easily before being processed verbally. It is also easier to work with clients who have limited access to their emotions. Thus, in this paper we describe a new embodied CBT approach to working on the dysfunctional schema, which is based on three modules: body focus, emotional field, and interaction focus. In addition, using specific zones in the space of the therapy-room allows the embodiment of problematic interactions, as well as of power and powerlessness, closeness and distance, etc. Directly experiencing these processes on one's own body in the protected space of therapy allows faster and deeper insights than would be possible with conversations alone. Finally, the vitalizing power of emotions is used to create coherent action plans and successful interactions. This working method is illustrated by means of a case from practice.

Unlocking the Emotional World of Visual Media: An Overview of the Science, Research, and Impact of Understanding Emotion: Drawing Insights From Psychology, Engineering, and the Arts, This Article Provides a Comprehensive Overview of the Field of Emotion Analysis in Visual Media and Discusses the Latest Research, Systems, Challenges, Ethical Implications, and Potential Impact of Artificial Emotional Intelligence on Society.

The emergence of artificial emotional intelligence technology is revolutionizing the fields of computers and robotics, allowing for a new level of communication and understanding of human behavior that was once thought impossible. While recent advancements in deep learning have transformed the field of computer vision, automated understanding of evoked or expressed emotions in visual media remains in its infancy. This foundering stems from the absence of a universally accepted definition of "emotion," coupled with the inherently subjective nature of emotions and their intricate nuances. In this article, we provide a comprehensive, multidisciplinary overview of the field of emotion analysis in visual media, drawing on insights from psychology, engineering, and the arts. We begin by exploring the psychological foundations of emotion and the computational principles that underpin the understanding of emotions from images and videos. We then review the latest research and systems within the field, accentuating the most promising approaches. We also discuss the current technological challenges and limitations of emotion analysis, underscoring the necessity for continued investigation and innovation. We contend that this represents a "Holy Grail" research problem in computing and delineate pivotal directions for future inquiry. Finally, we examine the ethical ramifications of emotion-understanding technologies and contemplate their potential societal impacts. Overall, this article endeavors to equip readers with a deeper understanding of the domain of emotion analysis in visual media and to inspire further research and development in this captivating and rapidly evolving field.

Bodily expressed emotion understanding through integrating Laban movement analysis.

Bodily expressed emotion understanding (BEEU) aims to automatically recognize human emotional expressions from body movements. Psychological research has demonstrated that people often move using specific motor elements to convey emotions. This work takes three steps to integrate human motor elements to study BEEU. First, we introduce BoME (body motor elements), a highly precise dataset for human motor elements. Second, we apply baseline models to estimate these elements on BoME, showing that deep learning methods are capable of learning effective representations of human movement. Finally, we propose a dual-source solution to enhance the BEEU model with the BoME dataset, which trains with both motor element and emotion labels and simultaneously produces predictions for both. Through experiments on the BoLD in-the-wild emotion understanding benchmark, we showcase the significant benefit of our approach. These results may inspire further research utilizing human motor elements for emotion understanding and mental health analysis.

Corrigendum: How Do We Recognize Emotion From Movement? Specific Motor Components Contribute to the Recognition of Each Emotion.

[This corrects the article DOI: 10.3389/fpsyg.2019.01389.].

How Do We Recognize Emotion From Movement? Specific Motor Components Contribute to the Recognition of Each Emotion.

Are there movement features that are recognized as expressing each basic emotion by most people, and what are they? In our previous study we identified sets of Laban movement components that, when moved, elicited the basic emotions of anger, sadness, fear, and happiness. Our current study aimed to investigate if movements composed from those sets would be recognized as expressing those emotions, regardless of any instruction to the mover to portray emotion. Our stimuli included 113 video-clips of five Certified Laban Movement Analysts (CMAs) moving combinations of two to four movement components from each set associated with only one emotion: happiness, sadness, fear, or anger. Each three second clip showed one CMA moving a single combination. The CMAs moved only the combination's required components. Sixty-two physically and mentally healthy men (n = 31) and women (n = 31), ages 19-48, watched the clips and rated the perceived emotion and its intensity. To confirm participants' ability to recognize emotions from movement and to compare our stimuli to existing validated emotional expression stimuli, participants rated 50 additional clips of bodily motor expressions of these same emotions validated by Atkinson et al. (2004). Results showed that for both stimuli types, all emotions were recognized far above chance level. Comparing recognition accuracy of the two clip types revealed better recognition of anger, fear, and neutral emotion from Atkinson's clips of actors expressing emotions, and similar levels of recognition accuracy for happiness and sadness. Further analysis was performed to determine the contribution of specific movement components to the recognition of the studied emotions. Our results indicated that these specific Laban motor components not only enhance feeling the associated emotions when moved, but also contribute to recognition of the associated emotions when being observed, even when the mover was not instructed to portray emotion, indicating that the presence of these movement components alone is sufficient for emotion recognition. This research-based knowledge regarding the relationship between Laban motor components and bodily emotional expressions can be used by dance-movement and drama therapists for better understanding of clients' emotional movements, for creating appropriate interventions, and for enhancing communication with other practitioners regarding bodily emotional expression.

The Relationship Between Caregiver Burden and Emotion Recognition Deficits in Persons With MCI and Early AD: The Mediating Role of Caregivers' Subjective Evaluations.

OBJECTIVES: Emotion recognition (ER) abilities change in people with early Alzheimer disease (AD) and mild cognitive impairment (MCI) and can influence their caregivers' lives and experiences. The aims of this study were: (1) to assess caregivers' awareness of ER deficits in care-receivers with early AD or MCI; (2) to examine the mediating role of caregivers' subjective evaluations on the relationship between caregiver burden and ER deficits in persons with MCI and early AD. METHODS: Persons with MCI (N=29) and with early AD (N=26) performed an ER task (objective emotion recognition, OER) of watching short clips of dynamic bodily and dynamic facial expressions of 6 basic emotions. In addition, their family caregivers (N=55) were interviewed to measure their evaluation of their relatives' ER ability (subjective emotion recognition, SER) as well as their own experience of burden. RESULTS: Two thirds of the caregivers either underestimated or overestimated the care-receivers' ER deficits. Regression results yielded a significant positive relationship between OER and SER, as well as a significant negative relationship between SER and caregiver burden. Moreover, SER was found to mediate the relationship between OER and caregiver burden. CONCLUSION: Caregivers' better awareness of ER deficits in people with MCI and early AD might mitigate the deleterious consequences of caregiving for persons with cognitive deterioration and might therefore allow better chances for people with dementia to age in a homecare setting.

How Shall I Count the Ways? A Method for Quantifying the Qualitative Aspects of Unscripted Movement With Laban Movement Analysis.

There is significant clinical evidence showing that creative and expressive movement processes involved in dance/movement therapy (DMT) enhance psycho-social well-being. Yet, because movement is a complex phenomenon, statistically validating which aspects of movement change during interventions or lead to significant positive therapeutic outcomes is challenging because movement has multiple, overlapping variables appearing in unique patterns in different individuals and situations. One factor contributing to the therapeutic effects of DMT is movement's effect on clients' emotional states. Our previous study identified sets of movement variables which, when executed, enhanced specific emotions. In this paper, we describe how we selected movement variables for statistical analysis in that study, using a multi-stage methodology to identify, reduce, code, and quantify the multitude of variables present in unscripted movement. We suggest a set of procedures for using Laban Movement Analysis (LMA)-described movement variables as research data. Our study used LMA, an internationally accepted comprehensive system for movement analysis, and a primary DMT clinical assessment tool for describing movement. We began with Davis's (1970) three-stepped protocol for analyzing movement patterns and identifying the most important variables: (1) We repeatedly observed video samples of validated (Atkinson et al., 2004) emotional expressions to identify prevalent movement variables, eliminating variables appearing minimally or absent. (2) We use the criteria repetition, frequency, duration and emphasis to eliminate additional variables. (3) For each emotion, we analyzed motor expression variations to discover how variables cluster: first, by observing ten movement samples of each emotion to identify variables common to all samples; second, by qualitative analysis of the two best-recognized samples to determine if phrasing, duration or relationship among variables was significant. We added three new steps to this protocol: (4) we created Motifs (LMA symbols) combining movement variables extracted in steps 1-3; (5) we asked participants in the pilot study to move these combinations and quantify their emotional experience. Based on the results of the pilot study, we eliminated more variables; (6) we quantified the remaining variables' prevalence in each Motif for statistical analysis that examined which variables enhanced each emotion. We posit that our method successfully quantified unscripted movement data for statistical analysis.

A Somatic Movement Approach to Fostering Emotional Resiliency through Laban Movement Analysis.

Although movement has long been recognized as expressing emotion and as an agent of change for emotional state, there was a dearth of scientific evidence specifying which aspects of movement influence specific emotions. The recent identification of clusters of Laban movement components which elicit and enhance the basic emotions of anger, fear, sadness and happiness indicates which types of movements can affect these emotions (Shafir et al., 2016), but not how best to apply this knowledge. This perspective paper lays out a conceptual groundwork for how to effectively use these new findings to support emotional resiliency through voluntary choice of one's posture and movements. We suggest that three theoretical principles from Laban Movement Analysis (LMA) can guide the gradual change in movement components in one's daily movements to somatically support shift in affective state: (A) Introduce new movement components in developmental order; (B) Use LMA affinities-among-components to guide the expansion of expressive movement range and (C) Sequence change among components based on Laban's Space Harmony theory to support the gradual integration of that new range. The methods postulated in this article have potential to foster resiliency and provide resources for self-efficacy by expanding our capacity to adapt emotionally to challenges through modulating our movement responses.

Using Movement to Regulate Emotion: Neurophysiological Findings and Their Application in Psychotherapy.

Emotion regulation is a person's active attempt to manage their emotional state by enhancing or decreasing specific feelings. Peripheral theories of emotion argue that the origins of emotions stem from bodily responses. This notion has been reformulated in neurophysiological terms by Damasio, who claimed that emotions are generated by conveying the current state of the body to the brain through interoceptive and proprioceptive afferent input. The resulting brain activation patterns represent unconscious emotions and correlate with conscious feelings. This proposition implies that through deliberate control of motor behavior and its consequent proprioception and interoception, one could regulate his emotions and affect his feelings. This concept is used in dance/movement (psycho)therapy where, by guiding to move in a certain way, the therapist helps the client to evoke, process, and regulate specific emotions. Exploration and practice of new and unfamiliar motor patterns can help the client to experience new unaccustomed feelings. The idea that certain motor qualities enhance specific emotions is utilized by the therapist also when she mirrors the client's movements or motor qualities in order to feel what the client feels, and empathize with them. Because of the mirror neurons, feeling what the client feels is enabled also through observation and imagination of their movements and posture. This principle can be used by verbal therapists as well, who should be aware of its bi-directionality: clients seeing the therapist's motor behavior are unconsciously affected by the therapist's bodily expressions. Additional implications for psychotherapy, of findings regarding mirror neurons activation, are discussed.

Thinking, Walking, Talking: Integratory Motor and Cognitive Brain Function.

In this article, we argue that motor and cognitive processes are functionally related and most likely share a similar evolutionary history. This is supported by clinical and neural data showing that some brain regions integrate both motor and cognitive functions. In addition, we also argue that cognitive processes coincide with complex motor output. Further, we also review data that support the converse notion that motor processes can contribute to cognitive function, as found by many rehabilitation and aerobic exercise training programs. Support is provided for motor and cognitive processes possessing dynamic bidirectional influences on each other.

Emotion Regulation through Movement: Unique Sets of Movement Characteristics are Associated with and Enhance Basic Emotions.

We have recently demonstrated that motor execution, observation, and imagery of movements expressing certain emotions can enhance corresponding affective states and therefore could be used for emotion regulation. But which specific movement(s) should one use in order to enhance each emotion? This study aimed to identify, using Laban Movement Analysis (LMA), the Laban motor elements (motor characteristics) that characterize movements whose execution enhances each of the basic emotions: anger, fear, happiness, and sadness. LMA provides a system of symbols describing its motor elements, which gives a written instruction (motif) for the execution of a movement or movement-sequence over time. Six senior LMA experts analyzed a validated set of video clips showing whole body dynamic expressions of anger, fear, happiness and sadness, and identified the motor elements that were common to (appeared in) all clips expressing the same emotion. For each emotion, we created motifs of different combinations of the motor elements common to all clips of the same emotion. Eighty subjects from around the world read and moved those motifs, to identify the emotion evoked when moving each motif and to rate the intensity of the evoked emotion. All subjects together moved and rated 1241 motifs, which were produced from 29 different motor elements. Using logistic regression, we found a set of motor elements associated with each emotion which, when moved, predicted the feeling of that emotion. Each emotion was predicted by a unique set of motor elements and each motor element predicted only one emotion. Knowledge of which specific motor elements enhance specific emotions can enable emotional self-regulation through adding some desired motor qualities to one's personal everyday movements (rather than mimicking others' specific movements) and through decreasing motor behaviors which include elements that enhance negative emotions.

Emotion regulation through execution, observation, and imagery of emotional movements.

According to Damasio's somatic marker hypothesis, emotions are generated by conveying the current state of the body to the brain through interoceptive and proprioceptive afferent input. The resulting brain activation patterns represent unconscious emotions and correlate with subjective feelings. This proposition implies a corollary that the deliberate control of motor behavior could regulate feelings. We tested this possibility, hypothesizing that engaging in movements associated with a certain emotion would enhance that emotion and/or the corresponding valence. Furthermore, because motor imagery and observation are thought to activate the same mirror-neuron network engaged during motor execution, they might also activate the same emotional processing circuits, leading to similar emotional effects. Therefore, we measured the effects of motor execution, motor imagery and observation of whole-body dynamic expressions of emotions (happiness, sadness, fear) on affective state. All three tasks enhanced the corresponding affective state, indicating their potential to regulate emotions.

Variation in the corticotropin-releasing hormone receptor 1 (CRHR1) gene influences fMRI signal responses during emotional stimulus processing.

The corticotropin-releasing hormone (CRH) system coordinates neuroendocrine and behavioral responses to stress and has been implicated in the development of major depressive disorder (MDD). Recent reports suggest that GG-homozygous individuals of a single nucleotide polymorphism (rs110402) in the CRH receptor 1 (CRHR1) gene show behavioral and neuroendocrine evidence of stress vulnerability. The present study explores whether those observations extend to the neuronal processing of emotional stimuli in humans. CRHR1 was genotyped in 83 controls and a preliminary sample of 16 unmedicated patients with MDD who completed a functional magnetic resonance imaging scan while viewing blocks of positive, negative, and neutral words. In addition, potential mediating factors such as early life stress, sex, personality traits, and negative memory bias were examined. Robust differences in blood oxygenation level-dependent (BOLD) signal were found in healthy controls (A allele carriers > GG-homozygotes) in the right middle temporal/angular gyrus while subjects were viewing negative versus neutral words. Among GG-homozygotes, BOLD signal in the subgenual cingulate was greater in MDD participants (n = 9) compared with controls (n = 33). Conversely, among A-carriers, BOLD signal was smaller in MDD (n = 7) compared with controls (n = 50) in the hypothalamus, bilateral amygdala, and left nucleus accumbens. Early life stress, personality traits, and levels of negative memory bias were associated with brain activity depending on genotype. Results from healthy controls and a preliminary sample of MDD participants show that CRHR1 single nucleotide polymorphism rs110402 moderates neural responses to emotional stimuli, suggesting a potential mechanism of vulnerability for the development of MDD.

Postmenopausal hormone use impact on emotion processing circuitry.

Despite considerable evidence for potential effects of estrogen on emotional processing, several studies of postmenopausal women who began hormone therapy (HT) remote from menopause report no effects of HT on emotional measures. As early HT initiation may preserve brain mechanisms, we examined effects of HT on emotional processing in postmenopausal women who started HT early after menopause. We performed a cross-sectional comparison of 52 postmenopausal women 66±5 years old, including 15 users of conjugated equine estrogen, 20 users of conjugated equine estrogen plus medroxyprogesterone acetate, and 17 who never used hormones (NT). All hormone users started therapy within two years of menopause, and received at least 10 years of continuous therapy. Outcomes were fMRI-detected brain activity and behavioral measures during an emotional processing picture rating task. During processing of positive pictures, NT women had greater activation than estrogen treated women in medial prefrontal cortex extending to the anterior cingulate, and more activation than estrogen plus progestin treated women in the insula. During processing of negative pictures, estrogen treated women had higher activation than NT women in the entorhinal cortex. Current compared to past HT users showed greater activation in the hippocampus and higher emotion recognition accuracy of neutral stimuli. Estrogen plus progestin treated women had slower response time than NT women when rating all pictures. In conclusion, hormone use was associated with differences in brain functional responses during emotional processing. These fMRI effects were more prominent than those observed for behavioral measures and involved brain regions implicated in cognitive-emotional integration.

Motor development in 9-month-old infants in relation to cultural differences and iron status.

Motor development, which allows infants to explore their environment, promoting cognitive, social, and perceptual development, can be influenced by cultural practices and nutritional factors, such as iron deficiency. This study compared fine and gross motor development in 209 9-month-old infants from urban areas of China, Ghana, and USA (African-Americans) and considered effects of iron status. Iron deficiency anemia was most common in the Ghana sample (55%) followed by USA and China samples. Controlling for iron status, Ghanaian infants displayed precocity in gross motor development and most fine-motor reach-and-grasp tasks. US African-Americans performed the poorest in all tasks except bimanual coordination and the large ball. Controlling for cultural site, iron status showed linear trends for gross motor milestones and fine motor skills with small objects. Our findings add to the sparse literature on infant fine motor development across cultures. The results also indicate the need to consider nutritional factors when examining cultural differences in infant development.

Emotion processing, major depression, and functional genetic variation of neuropeptide Y.

CONTEXT: Despite recent progress in describing the common neural circuitry of emotion and stress processing, the bases of individual variation are less well understood. Genetic variants that underlie psychiatric disease have proven particularly difficult to elucidate. Functional genetic variation of neuropeptide Y (NPY) was recently identified as a source of individual differences in emotion. Low NPY levels have been reported in major depressive disorder (MDD). OBJECTIVE: To determine whether low-expression NPY genotypes are associated with negative emotional processing at 3 levels of analysis. DESIGN: Cross-sectional, case-control study. SETTING: Academic medical center. PARTICIPANTS: Among 44 individuals with MDD and 137 healthy controls, 152 (84%) had an NPY genotype classified as low, intermediate, or high expression according to previously established haplotype-based expression data. MAIN OUTCOME MEASURES: Healthy subjects participated in functional magnetic resonance imaging while viewing negative (vs neutral) words (n = 58) and rated positive and negative affect during a pain-stress challenge (n = 78). Genotype distribution was compared between 113 control subjects and 39 subjects with MDD. RESULTS: Among healthy individuals, negatively valenced words activated the medial prefrontal cortex. Activation within this region was inversely related to genotype-predicted NPY expression (P = .03). Whole-brain regression of responses to negative words showed that the rostral anterior cingulate cortex activated in the low-expression group and deactivated in the high-expression group (P < .05). During the stress challenge, individuals with low-expression NPY genotypes reported more negative affective experience before and after pain (P = .002). Low-expression NPY genotypes were overrepresented in subjects with MDD after controlling for age and sex (P = .004). Population stratification did not account for the results. CONCLUSIONS: These findings support a model in which NPY genetic variation predisposes certain individuals to low NPY expression, thereby increasing neural responsivity to negative stimuli within key affective circuit elements, including the medial prefrontal and anterior cingulate cortices. These genetically influenced neural response patterns appear to mediate risk for some forms of MDD.

Timing and the control of rhythmic upper-limb movements.

Accurate timing of limb displacement is crucial for effective motor control. The authors examined the effects of movement velocity, duration, direction, added mass, and auditory cueing on timing, spatial, and trajectory variability of single- and multijoint rhythmic movements. During single-joint movements, increased velocity decreased timing and spatial variability, whereas increased movement duration increased timing variability but decreased spatial variability. For multijoint movements, regardless of condition, increasing velocity decreased joint timing, spatial, and trajectory variability, but all hand variabilities were unaffected by velocity, duration, load, or direction. Timing, spatial, and trajectory variability was greater at the shoulder compared with the elbow and minimal at the hand, supporting the notion that reaching movements are planned in hand space as opposed to joint space.

Iron deficiency anemia in infancy and reach and grasp development.

This study assessed 9 kinematic characteristics of infants' reach and grasp to test the hypothesis that iron deficiency anemia (IDA) delays upper extremity motor development. Reach and grasp movements, recorded with a 3D-motion capture system, were compared in 9- to 10-month-old infants (4 IDA vs. 5 iron-sufficient [IS]). Based on normative motor development data available for 6 characteristics, the results indicated poorer upper extremity control in IDA infants: 2 characteristics showed statistically significant group differences despite small n, and the other 4 had strong indications for such results (effect sizes [Cohen's d]>1.2). The remaining 3 measures, for which normative studies do not show developmental changes in this age period, showed significant or moderate-to-large effect differences. Poorer upper-extremity control in IDA infants in the short-term in this study and in the long-term despite iron therapy in other studies suggests that a motor intervention may be warranted when IDA is detected in infancy.

Iron deficiency and infant motor development.

BACKGROUND: Iron deficiency (ID) during early development impairs myelination and basal ganglia function in animal models. AIMS: To examine the effects of iron deficiency anemia (IDA) and iron deficiency (ID) without anemia on infant motor skills that are likely related to myelination and basal ganglia function. STUDY DESIGN: Observational study. SUBJECTS: Full-term inner-city African-American 9- to 10-month-old infants who were free of acute or chronic health problems with iron status indicators ranging from IDA to iron sufficiency (n=106). Criteria for final iron status classification were met by 77 of these infants: 28 IDA, 28 non-anemic iron-deficient (NA ID), and 21 iron-sufficient (IS). OUTCOME MEASURES: Gross motor developmental milestones, Peabody Developmental Motor Scale, Infant Neurological International Battery (INFANIB), motor quality factor of the Bayley Behavioral Rating Scale, and a sequential/bi-manual coordination toy retrieval task. General linear model analyses tested for linear effects of iron status group and thresholds for effects. RESULTS: There were linear effects of iron status on developmental milestones, Peabody gross motor (suggestive trend), INFANIB standing item, motor quality, and toy retrieval. The threshold for effects was ID with or without anemia for developmental milestones, INFANIB standing item, and motor quality and IDA for toy retrieval. CONCLUSIONS: Using a comprehensive and sensitive assessment of motor development, this study found poorer motor function in ID infants with and without anemia. Poorer motor function among non-anemic ID infants is particularly concerning, since ID without anemia is not detected by common screening procedures and is more widespread than IDA.