Event-Related Potentials Reveal Evidence for Late Integration of Emotional Prosody and Facial Expression in Dynamic Stimuli: An ERP Study

Foecker, Julia and Roeder, Brigitte (2019) Event-Related Potentials Reveal Evidence for Late Integration of Emotional Prosody and Facial Expression in Dynamic Stimuli: An ERP Study. Multisensory Research . ISSN 2213-4808

Full content URL: http://doi.org/10.1163/22134808-20191332

Documents
Event-Related Potentials Reveal Evidence for Late Integration of Emotional Prosody and Facial Expression in Dynamic Stimuli: An ERP Study
Publishers PDF

Request a copy
[img] PDF
MSR_advance_1332_Focker.pdf - Whole Document
Restricted to Repository staff only

1MB
Item Type:Article
Item Status:Live Archive

Abstract

The aim of the present study was to test whether multisensory interactions of emotional signals are modulated by intermodal attention and emotional valence. Faces, voices and bimodal emotionally congruent or incongruent face–voice pairs were randomly presented. The EEG was recorded while participants were instructed to detect sad emotional expressions in either faces or voices while ignoring all stimuli with another emotional expression and sad stimuli of the task irrelevant modality. Participants processed congruent sad face–voice pairs more efficiently than sad stimuli paired with an incongruent emotion and performance was higher in congruent bimodal compared to unimodal trials, irrespective of which modality was task-relevant. Event-related potentials (ERPs) to congruent emotional face–voice pairs started to differ from ERPs to incongruent emotional face–voice pairs at 180 ms after stimulus onset: Irrespectively of which modality was task-relevant, ERPs revealed a more pronounced positivity (180 ms post-stimulus) to emotionally congruent trials compared to emotionally incongruent trials if the angry emotion was presented in the attended modality. A larger negativity to incongruent compared to congruent trials was observed in the time range of 400–550 ms (N400) for all emotions (happy, neutral, angry), irrespectively of whether faces or voices were task
relevant. These results suggest an automatic interaction of emotion related information.

Keywords:event related potentials, faces, voices
Subjects:C Biological Sciences > C800 Psychology
Divisions:College of Social Science > School of Psychology
ID Code:35936
Deposited On:14 May 2019 07:49

Repository Staff Only: item control page