PSYCH OpenIR  > 中国科学院行为科学重点实验室
The integration of facial and vocal cues during emotional change perception: EEG markers
Chen, Xuhai1,2; Pan, Zhihui1; Wang, Ping1; Yang, Xiaohong3; Liu, Peng1; You, Xuqun1; Yuan, Jiajin4; Yuan, JJ
2016-07-01
Source PublicationSOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE
Correspondent Emailyuanjiajin168@126.com
ISSN1749-5016
SubtypeArticle
Volume11Issue:7Pages:1152-1161
AbstractThe ability to detect emotional changes is of primary importance for social living. Though emotional signals are often conveyed by multiple modalities, how emotional changes in vocal and facial modalities integrate into a unified percept has yet to be directly investigated. To address this issue, we asked participants to detect emotional changes delivered by facial, vocal and facial-vocal expressions while behavioral responses and electroencephalogram were recorded. Behavioral results showed that bimodal emotional changes were detected with higher accuracy and shorter response latencies compared with each unimodal condition. Moreover, the detection of emotional change, regardless of modalities, was associated with enhanced amplitudes in the N2 and P3 component, as well as greater theta synchronization. More importantly, the P3 amplitudes and theta synchronization were larger for the bimodal emotional change condition than for the sum of the two unimodal conditions. The superadditive responses in P3 amplitudes and theta synchronization were both positively correlated with the magnitude of the bimodal superadditivity in accuracy. These behavioral and electrophysiological data consistently illustrated an effect of audiovisual integration during the detection of emotional changes, which is most likely mediated by the P3 activity and theta oscillations in brain responses.
Keywordemotional change bimodal integration event related potential event related spectral perturbation
Subject Area认知神经科学
DOI10.1093/scan/nsv083
Indexed BySCI ; SSCI
Language英语
Funding OrganizationNational Natural Science Foundation of China(31300835 ; General Projects for Humanities and Social Science Research of Ministry of Education(12XJC190003) ; Fundamental Research Funds for the Central Universities(14SZYB07) ; Shaanxi Normal university ; 31371042)
WOS Research AreaNeurosciences & Neurology ; Psychology
WOS SubjectNeurosciences ; Psychology ; Psychology, Experimental
WOS IDWOS:000381229100015
WOS HeadingsScience & Technology ; Social Sciences ; Life Sciences & Biomedicine
WOS KeywordSUPERIOR TEMPORAL SULCUS ; EVENT-RELATED POTENTIALS ; MULTISENSORY INTEGRATION ; AFFECTIVE PROSODY ; HUMAN BRAIN ; FACE ; VOICE ; ERP ; EXPRESSIONS ; DYNAMICS
Citation statistics
Cited Times:8[WOS]   [WOS Record]     [Related Records in WOS]
Document Type期刊论文
Identifierhttp://ir.psych.ac.cn/handle/311026/20365
Collection中国科学院行为科学重点实验室
Corresponding AuthorYuan, JJ
Affiliation1.Shaanxi Normal Univ, Sch Psychol, Key Lab Behav & Cognit Psychol Shaanxi Prov, Xian 710062, Peoples R China
2.Shaanxi Normal Univ, Key Lab Modern Teaching Technol, Minist Educ, Xian 710062, Peoples R China
3.Chinese Acad Sci, Inst Psychol, Key Lab Behav Sci, Beijing, Peoples R China
4.Southwest Univ, Sch Psychol, Key Lab Cognit & Personal, Minist Educ, Chongqing 400715, Peoples R China
Recommended Citation
GB/T 7714
Chen, Xuhai,Pan, Zhihui,Wang, Ping,et al. The integration of facial and vocal cues during emotional change perception: EEG markers[J]. SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE,2016,11(7):1152-1161.
APA Chen, Xuhai.,Pan, Zhihui.,Wang, Ping.,Yang, Xiaohong.,Liu, Peng.,...&Yuan, JJ.(2016).The integration of facial and vocal cues during emotional change perception: EEG markers.SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE,11(7),1152-1161.
MLA Chen, Xuhai,et al."The integration of facial and vocal cues during emotional change perception: EEG markers".SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE 11.7(2016):1152-1161.
Files in This Item:
File Name/Size DocType Version Access License
The integration of f(706KB)期刊论文作者接受稿限制开放CC BY-NC-SAView Application Full Text
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Chen, Xuhai]'s Articles
[Pan, Zhihui]'s Articles
[Wang, Ping]'s Articles
Baidu academic
Similar articles in Baidu academic
[Chen, Xuhai]'s Articles
[Pan, Zhihui]'s Articles
[Wang, Ping]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Chen, Xuhai]'s Articles
[Pan, Zhihui]'s Articles
[Wang, Ping]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: The integration of facial and vocal cues during emotional change perception_ EEG markers.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.