Emojis and affective priming in visual word recognition.

Emojis are frequently used in digital communication to supplement the lack of non-verbal cues, but their integration during reading has not been thoroughly examined. This study explores the interplay between language and emotion by testing the influence of emotional valence and face-status of emojis on visual word recognition. Two online experiments were conducted with 92 native English-speaking university students, examining priming effects between congruent (e.g. [Formula: see text] delicious) and incongruent (e.g. [Formula: see text] hate) prime-target pairs, varying the face-status of the emoji prime (face vs. non-face) and the valence (positive vs. negative) of the word target. Irrespective of valence, face emojis demonstrated a processing advantage over non-face emojis, implying automatic attention capture. Additionally, the results revealed an interaction between prime-target congruency and valence, with a facilitatory effect for positive, but not negative, items, suggesting a valence-specific mechanism of affective priming in the lexical decision task. The research suggests that the rapid integration of emoji content occurs during the early stages of visual word recognition, with heightened attentional sensitivity to both face-like and positive stimuli when reading digital communications.

Investigating the effect of emoji position on eye movements and subjective evaluations on Chinese sarcasm comprehension.

Evidence indicated that emojis could influence sarcasm comprehension and sentence processing in English. However, the effect of emojis on Chinese sarcasm comprehension remains unclear. Therefore, this study investigated the impact of the smiley emoji position and semantics on eye movements and subjective assessments during Chinese online communication. Our results showed that the presence of a smiley emoji improved participants' interpretation and perception of sarcasm. We also found shorter dwell times on sarcastic words compared to literal words under the comment-final emoji condition. Additionally, we clarified the time course of emojified sentence processing during Chinese reading: the presence of emoji initially decreased first fixation durations compared to the absence of emoji and then the comment-final emoji shortened dwell times on sarcastic words compared to literal words in the critical area of interest. Our findings suggested that the comment-final emoji was the preferable choice for avoiding semantic comprehension bias in China.

We studied how emoji position influenced Chinese semantic processing by combining the indices of eye movements and subjective assessments. Our results revealed that the comment-final smiley emoji was preferable for avoiding sarcasm comprehension bias. The corresponding time course and recommendations for improving Chinese online interpersonal interactions were discussed.

Affective, semantic, frequency, and descriptive norms for 107 face emojis.

We introduce a novel dataset of affective, semantic, and descriptive norms for all facial emojis at the point of data collection. We gathered and examined subjective ratings of emojis from 138 German speakers along five essential dimensions: valence, arousal, familiarity, clarity, and visual complexity. Additionally, we provide absolute frequency counts of emoji use, drawn from an extensive Twitter corpus, as well as a much smaller WhatsApp database. Our results replicate the well-established quadratic relationship between arousal and valence of lexical items, also known for words. We also report associations among the variables: for example, the subjective familiarity of an emoji is strongly correlated with its usage frequency, and positively associated with its emotional valence and clarity of meaning. We establish the meanings associated with face emojis, by asking participants for up to three descriptions for each emoji. Using this linguistic data, we computed vector embeddings for each emoji, enabling an exploration of their distribution within the semantic space. Our description-based emoji vector embeddings not only capture typical meaning components of emojis, such as their valence, but also surpass simple definitions and direct emoji2vec models in reflecting the semantic relationship between emojis and words. Our dataset stands out due to its robust reliability and validity. This new semantic norm for face emojis impacts the future design of highly controlled experiments focused on the cognitive processing of emojis, their lexical representation, and their linguistic properties.

Emotion recognition of faces and emoji in individuals with moderate-severe traumatic brain injury.

BACKGROUND: Facial emotion recognition deficits are common after moderate-severe traumatic brain injury (TBI) and linked to poor social outcomes. We examine whether emotion recognition deficits extend to facial expressions depicted by emoji. METHODS: Fifty-one individuals with moderate-severe TBI (25 female) and fifty-one neurotypical peers (26 female) viewed photos of human faces and emoji. Participants selected the best-fitting label from a set of basic emotions (anger, disgust, fear, sadness, neutral, surprise, happy) or social emotions (embarrassed, remorseful, anxious, neutral, flirting, confident, proud). RESULTS: We analyzed the likelihood of correctly labeling an emotion by group (neurotypical, TBI), stimulus condition (basic faces, basic emoji, social emoji), sex (female, male), and their interactions. Participants with TBI did not significantly differ from neurotypical peers in overall emotion labeling accuracy. Both groups had poorer labeling accuracy for emoji compared to faces. Participants with TBI (but not neurotypical peers) had poorer accuracy for labeling social emotions depicted by emoji compared to basic emotions depicted by emoji. There were no effects of participant sex. DISCUSSION: Because emotion representation is more ambiguous in emoji than human faces, studying emoji use and perception in TBI is an important consideration for understanding functional communication and social participation after brain injury.

Development of the Emoji Faces Pain Scale and Its Validation on Mobile Devices in Adult Surgery Patients: Longitudinal Observational Study.

BACKGROUND: Measuring pain on digital devices using classic unidimensional pain scales such as the visual analog scale (VAS), numerical rating scale (NRS), and faces pain scale (FPS) has been proven to be reliable and valid. Emoji are pictographs designed in colorful form following the Unicode standard. It could be more beneficial to use emoji as faces of FPS on digital devices because emoji can easily fit on most devices and emoji are open-source so no approval would be needed before use. With a concise and user-friendly design, the emoji faces pain scale (Emoji-FPS) might be more generalizable to a wider population and more preferred by digital device users. OBJECTIVE: This study was designed to develop an Emoji-FPS as well as to evaluate its reliability, validity, and preference on mobile devices in adult patients who underwent surgery. METHODS: A modified Delphi technique with 2 rounds of web-based surveys was applied to obtain panelists' consensus on the sequence of emoji that can best represent 6 levels of pain. The initial candidate sequences of emoji for the Delphi process were constructed referring to 2 well-validated FPSs (Wong-Baker FACES pain rating scale [Wong-Baker FACES] and faces pain scale-revised [FPS-R]). Then, a prospective cohort of patients scheduled to receive perianal surgery was recruited and asked to complete a web-based questionnaire on a mobile device at 5 time points (before surgery [T1], wake up after surgery [T2], 4 hours after surgery [T3], the second day after surgery [T4], and 15 minutes after T4 [T5]). The 4 well-validated pain scales (NRS, VAS, Wong-Baker FACES, and FPS-R) were used as reference scales. RESULTS: After 2 rounds of surveys on 40 Delphi panelists, an Emoji-FPS was finally determined to represent 6 pain levels (0, 2, 4, 6, 8, and 10) from "no hurt" to "hurts worst." For validation, 300 patients were recruited and 299 were analyzed, the mean age of whom was 38.5 (SD 10.5) years, and 106 (35.5%) were women. For concurrent validity, the Emoji-FPS was highly correlated with 4 reference scales with Spearman correlation coefficient ρ ranging from 0.91 to 0.95. Excellent agreements were observed between 4 versions of Emoji-FPS (iOS, Android, Microsoft, and OpenMoji), with weighted κ coefficients ranging from 0.96 to 0.97. For discriminant validity, patients' mean preoperative Emoji-FPS score (T1) was significantly higher than their postoperative Emoji-FPS score (T4) with a difference of 1.4 (95% CI 1.3-1.6; P<.001). For test-retest reliability, Emoji-FPS scores measured at T4 and T5 were highly correlated with a ρ of 0.91. The Emoji-FPS was mostly preferred, followed by the Wong-Baker FACES, FPS-R, NRS, and VAS. CONCLUSIONS: The Emoji-FPS is reliable and valid compared with traditional pain scales in adult surgery patients.

Emoji-SP, the Spanish emoji database: Visual complexity, familiarity, frequency of use, clarity, and emotional valence and arousal norms for 1031 emojis.

This article presents subjective norms for 1031 emojis in six dimensions: visual complexity, familiarity, frequency of use, clarity, emotional valence, and emotional arousal. This is the largest normative study conducted so far that relies on subjective ratings. Unlike the few existing normative studies, which mainly comprise face emojis, here we present a wide range of emoji categories. We also examine the correlations between the dimensions assessed. Our results show that, in terms of their affective properties, emojis are analogous to other stimuli, such as words, showing the expected U-shaped relationship between valence and arousal. The relationship between affective properties and other dimensions (e.g., between valence and familiarity) is also similar to the relationship observed in words, in the sense that positively valenced emojis are more familiar than negative ones. These findings suggest that emojis are suitable stimuli for studying affective processing. Emoji-SP will be highly valuable for researchers of various fields interested in emojis, including computer science, communication, linguistics, and psychology. The full set of norms is available at: https://osf.io/dtfjv/ .

Digital Visual Communication for Public Health: Design Proposal for a Vaccinated Emoji.

In the 21st century, the internet and particularly social media have become essential platforms for the spread of health information (including misinformation and disinformation). One of the distinguishing features of communication on these platforms is the widespread use of emojis. Though seemingly trivial emojis are now used by many if not most public health figures and organizations alongside important health updates. Much of that information has had to do with vaccination. Vaccines are a critical public health tool but one surrounded by falsehoods, phobias, and misinformation fueling vaccine hesitancy. Part of that has to do with their lack of positive representation on social media (eg, the syringe emoji is a plain needle, which for many people is an uncomfortable image). We thus argue that vaccination deserves an entirely new emoji to communicate vaccine confidence and discuss a design proposal for a vaccinated emoji that has gained traction in the global public health community.

The emoji current mood and experience scale: the development and initial validation of an ultra-brief, literacy independent measure of psychological health.

BACKGROUND: There is increasing interest in measuring wellbeing and mental health in a range of settings and services outside conventional mental health care settings. However, ensuring that measurement does not intrude on the primary service activity whilst promoting inclusion through minimizing literacy demands, requires ultra-brief and easy to use tools. AIMS: To develop and test a brief emoji-based tool to assess mental health, wellbeing, resilience and community connection. METHOD: In study 1, 672 adults completed an online questionnaire study comprising a new emoji measure and established questionnaires assessing mental health, resilience, community connection and wellbeing. In study 2, 415 participants completed a paper-and-pencil version of the emoji measure, mental health and community connection, with 212 individuals providing data at a second time point. RESULTS: Multidimensional scaling revealed a meaningful structure to the emoji measure with validity demonstrated through relationships to existing scales. Stability over time and sensitivity to change were also demonstrated. CONCLUSIONS: The emoji-based measure presented here provides an ultra-brief measure of mood and current experience, with minimal literacy demands on participants. Further research is now needed to test the properties and utility of the scale with other participant groups.

Emoji use in China: popularity patterns and changes due to COVID-19.

Emojis are small pictograms that are frequently embedded within micro-texts to more directly express emotional meanings. To understand the changes in the emoji usage of internet users during the COVID-19 outbreak, we analysed a large dataset collected from Weibo, the most popular Twitter-like social media platform in China, from December 1, 2019, to March 20, 2020. The data contained 38,183,194 microblog posts published by 2,239,472 unique users in Wuhan. We calculated the basic statistics of users' usage of emojis, topics, and sentiments and analysed the temporal patterns of emoji occurrence. After examining the emoji co-occurrence structure, we finally explored other factors that may affect individual emoji usage. We found that the COVID-19 outbreak greatly changed the pattern of emoji usage; i.e., both the proportion of posts containing emojis and the ratio of users using emojis declined substantially, while the number of posts remained the same. The daily proportion of Happy emojis significantly declined to approximately 32%, but the proportions of Sad- and Encouraging-related emojis rose to 24% and 34%, respectively. Despite a significant decrease in the number of nodes and edges in the emoji co-occurrence network, the average degree of the network increased from 34 to 39.8, indicating that the diversity of emoji usage increased. Most interestingly, we found that male users were more inclined towards using regular textual language with fewer emojis after the pandemic, suggesting that during public crises, male groups appeared to control their emotional display. In summary, the COVID-19 pandemic remarkably impacted individual sentiments, and the normal pattern of emoji usage tends to change significantly following a public emergency. Supplementary Information: The online version contains supplementary material available at 10.1007/s10489-022-03195-y.

Using Emoji Stickers to Understand End-User Opinions of the Dapivirine Vaginal Ring for HIV Prevention.

Globally, HIV affects women disproportionally to men, particularly in sub-Saharan Africa. While the monthly dapivirine vaginal ring (VR) is a promising female-initiated HIV prevention method, it is important to understand how well the ring is liked. With former participants of HOPE, an open-label extension trial of the ring, we used emoji stickers and a worksheet to explore female end-user's acceptability of and opinions about the VR. We aimed to understand these participants' opinions about the VR, and how they had changed over time, particularly in the context of known efficacy of the dapivirine VR. Most participants easily understood the exercise and how to use the emoji stickers, with a few exceptions. For those who had trouble understanding how to use the emoji, interviewer support and encouragement helped them to understand and continue with the exercise. Emoji interpretation varied widely with participants using the same emoji to express divergent opinions. Using the emoji stickers, participants expressed mostly positive opinions of the vaginal ring for HIV prevention, with some lingering concerns about the product's partial effectiveness. This paper contributes to the literature supporting the assertion that the dapivirine VR for HIV prevention is acceptable to women, and that acceptability increases with time and proper education. This analysis also provides evidence that emoji visual tools can enhance understanding of acceptability of an intervention when used in qualitative research.

Emoji-based semantic representations for abstract and concrete concepts.

An increasingly large body of converging evidence supports the idea that the semantic system is distributed across brain areas and that the information encoded therein is multimodal. Within this framework, feature norms are typically used to operationalize the various parts of meaning that contribute to define the distributed nature of conceptual representations. However, such features are typically collected as verbal strings, elicited from participants in experimental settings. If the semantic system is not only distributed (across features) but also multimodal, a cognitively sound theory of semantic representations should take into account different modalities in which feature-based representations are generated, because not all the relevant semantic information may be easily verbalized into classic feature norms, and different types of concepts (e.g., abstract vs. concrete concepts) may consist of different configurations of non-verbal features. In this paper we acknowledge the multimodal nature of conceptual representations and we propose a novel way of collecting non-verbal semantic features. In a crowdsourcing task we asked participants to use emoji to provide semantic representations for a sample of 300 English nouns referring to abstract and concrete concepts, which account for (machine readable) visual features. In a formal content analysis with multiple annotators we then classified the cognitive strategies used by the participants to represent conceptual content through emoji. The main results of our analyses show that abstract (vs. concrete) concepts are characterized by representations that: 1. consist of a larger number of emoji; 2. include more face emoji (expressing emotions); 3. are less stable and less shared among users; 4. use representation strategies based on figurative operations (e.g., metaphors) and strategies that exploit linguistic information (e.g. rebus); 5. correlate less well with the semantic representations emerging from classic features listed through verbal strings.

Lisbon Emoji and Emoticon Database (LEED): Norms for emoji and emoticons in seven evaluative dimensions.

The use of emoticons and emoji is increasingly popular across a variety of new platforms of online communication. They have also become popular as stimulus materials in scientific research. However, the assumption that emoji/emoticon users' interpretations always correspond to the developers'/researchers' intended meanings might be misleading. This article presents subjective norms of emoji and emoticons provided by everyday users. The Lisbon Emoji and Emoticon Database (LEED) comprises 238 stimuli: 85 emoticons and 153 emoji (collected from iOS, Android, Facebook, and Emojipedia). The sample included 505 Portuguese participants recruited online. Each participant evaluated a random subset of 20 stimuli for seven dimensions: aesthetic appeal, familiarity, visual complexity, concreteness, valence, arousal, and meaningfulness. Participants were additionally asked to attribute a meaning to each stimulus. The norms obtained include quantitative descriptive results (means, standard deviations, and confidence intervals) and a meaning analysis for each stimulus. We also examined the correlations between the dimensions and tested for differences between emoticons and emoji, as well as between the two major operating systems-Android and iOS. The LEED constitutes a readily available normative database (available at www.osf.io/nua4x ) with potential applications to different research domains.

Grammatical structures of emoji in Japanese-language text conversations.

Emojis have become a ubiquitous part of everyday text communication worldwide. Cohn et al. (Cognit Res Princ Implic 4(1):1-18, 2019) studied the grammatical structure of emoji usage among English speakers and found a correlation between the sequence of emojis used and English word order, tending towards an subject-verb-object (SVO) sequence. However, it remains unclear whether emoji usage follows a universal grammar or whether it is influenced by native language grammar. Therefore, this study explored the potential influence of Japanese grammar on emoji usage by Japanese speakers. Twenty adults, all native Japanese speakers, participated in pairs. In Experiment 1, participants engaged in conversations through Google Hangouts on iPads. The experiment consisted of four conversation rounds of approximately 8 min each. The first two rounds involved one participant using only written Japanese and the other using only emojis and punctuation, with roles reversed in the second round. The third round required both participants to use only emojis and punctuation. The results indicated that participants preferred subject-object-verb (SOV) or object-verb (OV) sequences, with OV patterns being more common. This pattern reflects a distinctive attribute of Japanese grammatical structure, marked by the frequent omission of the subject. Experiment 2 substituted emojis for words, showing nouns were more commonly replaced than verbs due to the difficulty in conveying complex meanings. Reduced subject replacements again emphasised Japanese grammatical structure. In essence, emoji usage reflects native language structures, but complexities are challenging to convey, resulting in simplified sequences. This study offers insights for enhancing emoji-based communication and interface design, with implications for translation and broader communication.

Effect of packaging label color on consumer perception of Greek protected designation of origin table olives "Kalamata".

Kalamata table olives are a widely exported Greek protected designation of origin (PDO) product with distinct organoleptic profile. This study aimed to evaluate the effect of label color on the flavor perception of pasteurized and unpasteurized Kalamata PDO olives. Consumer perception was assessed in two studies. First, four packaged products with green, blue, red, and purple labeling were assessed by participants (n = 106) for preference using rating scales, and emotional profiles were obtained using a check-all-that-apply list of 33 emotions developed in language native to the participants (Greek). The green label resulted to more positive emotion profiling of olive products (i.e., "healthy," "pleased," and "satisfied" with mean scores correspondingly equal to 2.99, 2.95, and 2.87), and red labeled olives resulted to willingness to pay more. In the second study, unpasteurized and pasteurized olives in red and green labeled glass jars were sensorially assessed by participants (n = 124) using rating scales, showing that green labeled products are liked most (mean scores; 5.12 and 5.12), whereas red labeled was scored less (mean scores; 4.96 and 4.67), along emotion profiles with emojis. Principal component analysis of emotional reactions revealed grouping of samples based only on pasteurization/no pasteurization, without been affected by the color of the label, and did not relate to the liking scores. The results showed that sensory perception of olives is significantly affected by the color of packaging (p-value <0.05) due to emotional reactions and color of packaging can enhance the perception of olives' quality as improvement of the processing is limited by the PDO status.

The neural mechanisms of the impact of emoji spatial metaphors on emotional perception.

Metaphors play a crucial role in language, thinking, and communication. Emoji, as modern metaphors, carry rich meanings and significantly impact emotional expression. While spatial metaphors in emotional lexicons are confirmed, empirical evidence for spatial metaphors in emoji is scarce, and their neural mechanisms are largely unexplored. This study used a spatial Stroop task to investigate emoji spatial metaphors and their effects on emotional perception and neural mechanisms. The results showed that when the positive emoji were in the upper visual field, compared with the middle and lower visual field, the ability to perceive positive emotions was significantly enhanced; Conversely, when the negative emotion emoji was in the lower visual field, the perception of negative emotion was significantly enhanced compared to the middle visual field. EEG data indicate that inconsistencies between Emoji spatial positions and emotional valence lead to increased amplitudes of the Late Positive Component (LPC), revealing heightened neural activity.

Facebook reactions in the context of politics and social issues: a systematic literature review.

In February 2016, Facebook expanded the original "Like" button by introducing five additional "Reactions"-Love, Haha, Wow, Sad, and Angry-using modified versions of Unicode emojis. These reactions enable users to express more nuanced emotions towards posts. This literature review investigates scholarly research on user behavior in response to these reactions, with a focus on a broad spectrum of socioeconomic and psychological issues. We conducted a systematic search across databases including Scopus and Google Scholar, using keywords such as "Facebook" and "Reaction," combined with various key phrases and Boolean operators. Our review synthesizes sixty-four articles published from 2016 to 2023, exploring diverse topics such as political news, far-right and extremist parties, racism, and hate speech during the COVID-19 pandemic. We organized these articles by theme and publication date. Our meta-analysis reveals that lifestyle and entertainment posts predominantly receive positive reactions, while sociopolitical content tends to elicit a broader spectrum of emotions, including negative sentiments. Furthermore, emotionally charged content consistently attracts higher volumes of reactions, regardless of sentiment. This research highlights the intricate relationship between user reactions and content characteristics, providing deeper insights into the dynamics of online engagement. By understanding these interaction patterns, we gain a better grasp of emotional responses and engagement levels, which ultimately shape online discourse and user interactions.

Congruent or conflicting? The interaction between emoji and textual sentence is not that simple!

As a Japanese graphic symbol widely used in the world, Emoji plays an important role in computer mediated communication. Despite its prevalent use, the interaction dynamics between emoji and textual sentences remain inadequately explored. Based on the emotional function of emoji, this study uses the indirect priming method to explore the emotional impact of emoji on subsequent text in computer mediated communication through two progressive behavioral experiments. The results show that: (1) Emoji positioned at the onset of a sentence induce an emotional priming effect; (2) The processing speed is slowest when emoji and text are emotionally conflicting, while in non-conflicting condition, the type of emoji moderates the processing of combined sentences; (3) The emotional influence of emoji plays an auxiliary role, and the valence of textual sentence plays a decisive role in emotional perception.

Experimental evidence for a semantic typology of emoji: Inferences of co-, pro-, and post-text emoji.

Emoji symbols are widely used in online communication, particularly in instant messaging and on social media platforms. Existing research draws comparisons between the functions of emoji and those of gestures, with recent work extending a proposed typology of gestures to emoji, arguing that different emoji types can be distinguished by their placement within the modified text and by their semantic contribution (the linguistic inferences that they give rise to). In this paper, we present four experiments designed to test the predictions of this extended typology, the results of which suggest that emoji symbols indeed trigger the hypothesised linguistic inferences. The findings provide support for a semantic typology of emoji and contribute further evidence of the parallels between gesture and emoji.

Attentional Differences Between Males and Females for Emojis During the Emotional Stroop Task.

Introduction Cognitive load can be intensified by emotional components such as emotive words or facial expressions. Sex differences influence both emotional and cognitive functions for emotional facial expressions. Emojis, in contrast to human faces, serve as digital cues conveying emotional nuances in communication. The present study aimed to compare attentional differences prompted by emojis. Methods This study aimed to compare attentional differences in males and females elicited by emojis in 100 healthy adults (50 males and 50 females) within the age group of 18 to 40 years (mean ± SD: 27.87 ± 5.37 years) while performing the emotional Stroop task (EST). The EST comprised emojis depicting four emotions (happy, fear, sad, and angry) and emotionally charged words conveying similar emotions. An independent sample t-test was used to compare the reaction times among males and females. Results Results showed males had significantly longer reaction times than females across all task conditions. Both genders exhibited significant differences in reaction times across task conditions, except inhibition. Overall, reaction times increased notably from neutral to incongruent conditions for both genders. This suggests that response times increased significantly from neutral to incongruent conditions. Conclusion Emojis introduced in the EST revealed gender-related differences in attentional processing. This study showed the greater proficiency of females in emotional processing during EST compared to males. These findings contribute to our understanding of how gender is associated with cognitive responses to emotional stimuli in digital communication contexts.