Back
Full-text
Journal article

Naturalistic Emotion Decoding From Facial Action Sets.

  • Hyniewska S Kokoro Research Center, Kyoto University, Kyoto, Japan.
  • Sato W Kokoro Research Center, Kyoto University, Kyoto, Japan.
  • Kaiser S Swiss Center for Affective Sciences, University of Geneva, Geneva, Switzerland.
  • Pelachaud C Institut des Systèmes Intelligents et de Robotique (ISIR), Université Pierre et Marie Curie/Centre National de la Recherche Scientifique (CNRS), Paris, France.
  • 2019-02-05
Published in:
  • Frontiers in psychology. - 2018
cognitive appraisal
emotional facial expression
naturalistic
nonverbal behavior
spontaneous expressions
English Researchers have theoretically proposed that humans decode other individuals' emotions or elementary cognitive appraisals from particular sets of facial action units (AUs). However, only a few empirical studies have systematically tested the relationships between the decoding of emotions/appraisals and sets of AUs, and the results are mixed. Furthermore, the previous studies relied on facial expressions of actors and no study used spontaneous and dynamic facial expressions in naturalistic settings. We investigated this issue using video recordings of facial expressions filmed unobtrusively in a real-life emotional situation, specifically loss of luggage at an airport. The AUs observed in the videos were annotated using the Facial Action Coding System. Male participants (n = 98) were asked to decode emotions (e.g., anger) and appraisals (e.g., suddenness) from facial expressions. We explored the relationships between the emotion/appraisal decoding and AUs using stepwise multiple regression analyses. The results revealed that all the rated emotions and appraisals were associated with sets of AUs. The profiles of regression equations showed AUs both consistent and inconsistent with those in theoretical proposals. The results suggest that (1) the decoding of emotions and appraisals in facial expressions is implemented by the perception of set of AUs, and (2) the profiles of such AU sets could be different from previous theories.
Language
  • English
Open access status
gold
Identifiers
Persistent URL
https://sonar.ch/global/documents/46720
Statistics
Document views: 30 File downloads:
  • Full-text: 0