The integration of facial and vocal cues during emotional change perception: EEG markers

doi:10.1093/scan/nsv083

	The integration of facial and vocal cues during emotional change perception: EEG markers
	Chen, Xuhai1,2 ; Pan, Zhihui 1; Wang, Ping 1; Yang, Xiaohong3 ; Liu, Peng 1; You, Xuqun 1; Yuan, Jiajin 4; Yuan, JJ
通讯作者邮箱	yuanjiajin168@126.com
摘要	The ability to detect emotional changes is of primary importance for social living. Though emotional signals are often conveyed by multiple modalities, how emotional changes in vocal and facial modalities integrate into a unified percept has yet to be directly investigated. To address this issue, we asked participants to detect emotional changes delivered by facial, vocal and facial-vocal expressions while behavioral responses and electroencephalogram were recorded. Behavioral results showed that bimodal emotional changes were detected with higher accuracy and shorter response latencies compared with each unimodal condition. Moreover, the detection of emotional change, regardless of modalities, was associated with enhanced amplitudes in the N2 and P3 component, as well as greater theta synchronization. More importantly, the P3 amplitudes and theta synchronization were larger for the bimodal emotional change condition than for the sum of the two unimodal conditions. The superadditive responses in P3 amplitudes and theta synchronization were both positively correlated with the magnitude of the bimodal superadditivity in accuracy. These behavioral and electrophysiological data consistently illustrated an effect of audiovisual integration during the detection of emotional changes, which is most likely mediated by the P3 activity and theta oscillations in brain responses.
关键词	emotional change bimodal integration event related potential event related spectral perturbation
学科领域	认知神经科学
	2016-07-01
语种	英语
DOI	10.1093/scan/nsv083
发表期刊	SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE
ISSN	1749-5016
卷号	11 期号:7 页码:1152-1161
期刊论文类型	Article
收录类别	SCI ; SSCI
WOS关键词	SUPERIOR TEMPORAL SULCUS ; EVENT-RELATED POTENTIALS ; MULTISENSORY INTEGRATION ; AFFECTIVE PROSODY ; HUMAN BRAIN ; FACE ; VOICE ; ERP ; EXPRESSIONS ; DYNAMICS
WOS标题词	Science & Technology ; Social Sciences ; Life Sciences & Biomedicine
WOS研究方向	Neurosciences & Neurology ; Psychology
WOS类目	Neurosciences ; Psychology ; Psychology, Experimental
WOS记录号	WOS:000381229100015
资助机构	National Natural Science Foundation of China(31300835 ; General Projects for Humanities and Social Science Research of Ministry of Education(12XJC190003) ; Fundamental Research Funds for the Central Universities(14SZYB07) ; Shaanxi Normal university ; 31371042)
引用统计	被引频次：23[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://ir.psych.ac.cn/handle/311026/20365
专题	中国科学院行为科学重点实验室
通讯作者	Yuan, JJ
作者单位	1.Shaanxi Normal Univ, Sch Psychol, Key Lab Behav & Cognit Psychol Shaanxi Prov, Xian 710062, Peoples R China 2.Shaanxi Normal Univ, Key Lab Modern Teaching Technol, Minist Educ, Xian 710062, Peoples R China 3.Chinese Acad Sci, Inst Psychol, Key Lab Behav Sci, Beijing, Peoples R China 4.Southwest Univ, Sch Psychol, Key Lab Cognit & Personal, Minist Educ, Chongqing 400715, Peoples R China
推荐引用方式 GB/T 7714	Chen, Xuhai,Pan, Zhihui,Wang, Ping,et al. The integration of facial and vocal cues during emotional change perception: EEG markers[J]. SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE,2016,11(7):1152-1161.
APA	Chen, Xuhai.,Pan, Zhihui.,Wang, Ping.,Yang, Xiaohong.,Liu, Peng.,...&Yuan, JJ.(2016).The integration of facial and vocal cues during emotional change perception: EEG markers.SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE,11(7),1152-1161.
MLA	Chen, Xuhai,et al."The integration of facial and vocal cues during emotional change perception: EEG markers".SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE 11.7(2016):1152-1161.

条目包含的文件
文件名称/大小	文献类型	版本类型	开放类型	使用许可
The integration of f（706KB）	期刊论文	作者接受稿	限制开放	CC BY-NC-SA	请求全文