Evaluation and discussion of multi-modal emotion recognition

Rabie, A., Wrede, B., Vogt, T. and Hanheide, M. (2009) Evaluation and discussion of multi-modal emotion recognition. In: ICCEE '09. Second International Conference on Computer and Electrical Engineering, 28-30 Dec. 2009, Dubai.

Full content URL: http://dx.doi.org/10.1109/ICCEE.2009.192

Full text not available from this repository.

Item Type:Conference or Workshop contribution (Paper)
Item Status:Live Archive


Recognition of emotions from multimodal cues is of basic interest for the design of many adaptive interfaces in human-machine and human-robot interaction. It provides a means to incorporate non-verbal feedback in the interactional course. Humans express their emotional state rather unconsciously exploiting their different natural communication modalities. In this paper, we present a first study on multimodal recognition of emotions from auditive and visual cues for interaction interfaces. We recognize seven classes of basic emotions by means of visual analysis of talking faces. In parallel, the audio signal is analyzed on the basis of the intonation of the verbal articulation. We compare the performance of state of the art recognition systems on the DaFEx database for both complement modalities and discuss these results with regard to the theoretical background and possible fusion schemes in real-world multimodal interfaces. © 2009 IEEE.

Additional Information:Conference Code: 79725
Keywords:Adaptive interface, Audio signal, Basic emotions, Emotion recognition, Emotional state, Facial Expressions, Human robot interactions, Human-machine, Interaction interface, Multi-modal, Multi-modal interfaces, Multimodal cues, Multimodal integration, Multimodal recognition, Natural communication, Real-world, Recognition of emotion, Recognition systems, State of the art, Visual analysis, Visual cues, Electrical engineering, Human computer interaction, Human robot interaction, Machine design, Speech recognition
Subjects:G Mathematical and Computer Sciences > G400 Computer Science
Divisions:College of Science > School of Computer Science
Related URLs:
ID Code:8325
Deposited On:30 Jul 2013 09:57

Repository Staff Only: item control page