Detecting emotion in speech expressing incongruent emotional cues through voice and content: investigation on dominant modality and language.

This research investigated how we detect emotion in speech when the emotional cues in the sound of voice do not match the semantic content. It examined the dominance of the voice or semantics in the perception of emotion from incongruent speech and the influence of language on the interaction between the two modalities. Japanese participants heard a voice emoting anger, happiness or sadness while saying "I'm angry", "I'm pleased" or "I'm sad", which were in their native language, in their second language (English) and in unfamiliar languages (Khmer and Swedish). They reported how much they agree that the speaker is expressing each of the three emotions. Two experiments were conducted with different number of voice stimuli, and both found consistent results. Strong reliance on the voice was found for the speech in participants' second and unfamiliar languages but the dominance was weakened for the speech in their native language. Among the three emotions, voice was most important for perception of sadness. This research concludes that the impact of the emotional cues expressed by the voice and semantics varies depending on the expressed emotions and the language.

Properties of Central and Peripheral Concepts of Emotion in Japanese and Korean: An Examination Using a Multi-Dimensional Model.

The concept of emotion can be organized within a hypothetical space comprising a limited number of dimensions representing essential properties of emotion. The present study examined cultural influences on such conceptual structure by comparing the performance of emotion word classification between Japanese and Korean individuals. Two types of emotional words were used; central concepts, highly typical examples of emotion, and less typical peripheral concepts. Participants classified 30 words into groups based on conceptual similarity. MDS analyses revealed a three-dimensional structure with valence, social engagement, and arousal dimensions for both cultures, with the valence dimension being the most salient one. The Japanese prioritized the social engagement over the arousal while the Koreans showed sensitivities to the arousal dimension. Although the conceptual structure was similar for the two countries, the weight of importance among the three dimensions seems to be different, reflecting each culture's values and communication styles.