Encoding of multi-modal emotional information via personalized skin-integrated wireless facial interface.
Nat Commun
; 15(1): 530, 2024 Jan 15.
Article
en En
| MEDLINE
| ID: mdl-38225246
ABSTRACT
Human affects such as emotions, moods, feelings are increasingly being considered as key parameter to enhance the interaction of human with diverse machines and systems. However, their intrinsically abstract and ambiguous nature make it challenging to accurately extract and exploit the emotional information. Here, we develop a multi-modal human emotion recognition system which can efficiently utilize comprehensive emotional information by combining verbal and non-verbal expression data. This system is composed of personalized skin-integrated facial interface (PSiFI) system that is self-powered, facile, stretchable, transparent, featuring a first bidirectional triboelectric strain and vibration sensor enabling us to sense and combine the verbal and non-verbal expression data for the first time. It is fully integrated with a data processing circuit for wireless data transfer allowing real-time emotion recognition to be performed. With the help of machine learning, various human emotion recognition tasks are done accurately in real time even while wearing mask and demonstrated digital concierge application in VR environment.
Texto completo:
1
Base de datos:
MEDLINE
Asunto principal:
Emociones
/
Expresión Facial
Idioma:
En
Revista:
Nat Commun
Asunto de la revista:
BIOLOGIA
/
CIENCIA
Año:
2024
Tipo del documento:
Article