Two-stage Recognition and Beyond for Compound Facial Emotion Recognition

Facial emotion recognition is an inherently complex problem due to individual diversity in facial features and racial and cultural differences. Moreover, facial expressions typically reflect the mixture of people's emotional statuses, which can be expressed using compound emotions. Compound fac...

Full description

Bibliographic Details
Authors: Kaminska, Dorota, Aktas, Kadir, Rizhinashvili, Davit, Kuklyanov, Danila, Sham, Abdallah Hussein, Escalera Guerrero, Sergio, Nasrollahi, Kamal, Moeslund, Thomas, Anbarjafari, Gholamreza
Format: article
Status:Published version
Publication Date:2021
Country:España
Institution:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
Repository:Recercat. Dipósit de la Recerca de Catalunya
OAI Identifier:oai:recercat.cat:2445/190923
Online Access:https://hdl.handle.net/2445/190923
Access Level:Open access
Keyword:Reconeixement de formes (Informàtica)
Visió per ordinador
Aprenentatge automàtic
Expressió facial
Pattern recognition systems
Computer vision
Machine learning
Facial expression
Description
Summary:Facial emotion recognition is an inherently complex problem due to individual diversity in facial features and racial and cultural differences. Moreover, facial expressions typically reflect the mixture of people's emotional statuses, which can be expressed using compound emotions. Compound facial emotion recognition makes the problem even more difficult because the discrimination between dominant and complementary emotions is usually weak. We have created a database that includes 31,250 facial images with different emotions of 115 subjects whose gender distribution is almost uniform to address compound emotion recognition. In addition, we have organized a competition based on the proposed dataset, held at FG workshop 2020. This paper analyzes the winner's approach a two-stage recognition method (1st stage, coarse recognition; 2nd stage, fine recognition), which enhances the classification of symmetrical emotion labels.