Dominant and complementary emotion recognition from still images of faces

Emotion recognition has a key role in affective computing. Recently, fine-grained emotion analysis, such as compound facial expression of emotions, has attracted high interest of researchers working on affective computing. A compound facial emotion includes dominant and complementary emotions (e.g.,...

Descripción completa

Detalles Bibliográficos
Autores: Guo, Jiazgu, Lei, Zhen, Wan, Jun, Avots, Egils, Hajarolasvadi, Noushin, Knyazev, Boris, Kuharenko, Artem, Silveira Jacques Junior, Julio Cezar, Baró, Xavier, Demirel, Hasan, Escalera, Sergio, Allik, Jüri, Anbarjafari, Gholamreza
Tipo de recurso: artículo
Estado:Versión publicada
Fecha de publicación:2018
País:España
Institución:Universitat Oberta de Catalunya (UOC)
Repositorio:O2, repositorio institucional de la UOC
OAI Identifier:oai:openaccess.uoc.edu:10609/93198
Acceso en línea:https://hdl.handle.net/10609/93198
Access Level:acceso abierto
Palabra clave:dominant and complementary emotion recognition
fine-grained face emotion dataset
compound emotions
conjunto de datos de emociones
emociones compuestas
reconocimiento de emociones dominantes y complementarias
conjunt de dades d'emocions
emocions compostes
reconeixement d'emocions dominants i complementàries
Biometry
Biometria
Biometría
Descripción
Sumario:Emotion recognition has a key role in affective computing. Recently, fine-grained emotion analysis, such as compound facial expression of emotions, has attracted high interest of researchers working on affective computing. A compound facial emotion includes dominant and complementary emotions (e.g., happily-disgusted and sadly-fearful), which is more detailed than the seven classical facial emotions (e.g., happy, disgust, and so on). Current studies on compound emotions are limited to use data sets with limited number of categories and unbalanced data distributions, with labels obtained automatically by machine learning-based algorithms which could lead to inaccuracies. To address these problems, we released the iCV-MEFED data set, which includes 50 classes of compound emotions and labels assessed by psychologists. The task is challenging due to high similarities of compound facial emotions from different categories. In addition, we have organized a challenge based on the proposed iCV-MEFED data set, held at FG workshop 2017. In this paper, we analyze the top three winner methods and perform further detailed experiments on the proposed data set. Experiments indicate that pairs of compound emotion (e.g., surprisingly-happy vs happily-surprised) are more difficult to be recognized if compared with the seven basic emotions. However, we hope the proposed data set can help to pave the way for further research on compound facial emotion recognition.