Institutional Repository, Institute of Psychology, Chinese Academy of Sciences
Decoding the temporal representation of facial expression in face-selective regions | |
Zhang, Zhihao1,2; Chen, Tong3,4; Liu, Ye1,2![]() ![]() ![]() | |
第一作者 | Zhihao Zhang |
通讯作者邮箱 | zhaoh@psych.ac.cn (k. zhao) ; fuxl@psych.ac.cn (x. fu) |
心理所单位排序 | 1 |
摘要 | The ability of humans to discern facial expressions in a timely manner typically relies on distributed face selective regions for rapid neural computations. To study the time course in regions of interest for this process, we used magnetoencephalography (MEG) to measure neural responses participants viewed facial expressions depicting seven types of emotions (happiness, sadness, anger, disgust, fear, surprise, and neutral). Analysis of the time-resolved decoding of neural responses in face-selective sources within the inferior parietal cortex (IPfaces), lateral occipital cortex (LO-faces), fusiform gyrus (FG-faces), and posterior superior temporal sulcus (pSTS-faces) revealed that facial expressions were successfully classified starting from-100 to 150 ms after stimulus onset. Interestingly, the LO-faces and IP-faces showed greater accuracy than FG-faces and pSTS-faces. To examine the nature of the information processed in these face-selective regions, we entered with facial expression stimuli into a convolutional neural network (CNN) to perform similarity analyses against human neural responses. The results showed that neural responses in the LO-faces and IP-faces, starting-100 ms after the stimuli, were more strongly correlated with deep representations of emotional categories than with image level information from the input images. Additionally, we observed a relationship between the behavioral performance and the neural responses in the LO-faces and IP-faces, but not in the FG-faces and lpSTS-faces. Together, these results provided a comprehensive picture of the time course and nature of information involved in facial expression discrimination across multiple face-selective regions, which advances our understanding of how the human brain processes facial expressions. |
关键词 | Facial expression Magnetoencephalography (MEG) Pairwise classification Representational similarity analysis CNN |
2023-12-01 | |
语种 | 英语 |
DOI | 10.1016/j.neuroimage.2023.120442 |
发表期刊 | NEUROIMAGE (IF:5.700[JCR-2022],7.000[5-Year]) |
ISSN | 1053-8119 |
卷号 | 283页码:15 |
期刊论文类型 | 实证研究 |
收录类别 | SCI |
资助项目 | National Natural Science Foundation of China[62061136001] ; National Natural Science Foundation of China[32071055] |
出版者 | ACADEMIC PRESS INC ELSEVIER SCIENCE |
WOS关键词 | OBJECT RECOGNITION ; SPATIOTEMPORAL DYNAMICS ; NEURAL FRAMEWORK ; PATTERN-ANALYSIS ; EMOTION ; MEG ; INFORMATION ; PERCEPTION ; ABILITY ; MODELS |
WOS研究方向 | Neurosciences & Neurology ; Radiology, Nuclear Medicine & Medical Imaging |
WOS类目 | Neurosciences ; Neuroimaging ; Radiology, Nuclear Medicine & Medical Imaging |
WOS记录号 | WOS:001111569600001 |
WOS分区 | Q1 |
资助机构 | National Natural Science Foundation of China |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | https://ir.psych.ac.cn/handle/311026/46577 |
专题 | 脑与认知科学国家重点实验室 |
通讯作者 | Zhao, Ke; Fu, Xiaolan |
作者单位 | 1.Chinese Acad Sci, Inst Psychol, State Key Lab Brain & Cognit Sci, Beijing 100101, Peoples R China 2.Univ Chinese Acad Sci, Dept Psychol, Beijing 100049, Peoples R China 3.Southwest Univ, Chongqing Key Lab Nonlinear Circuit & Intelligent, Chongqing 400715, Peoples R China 4.Chongqing Key Lab Artificial Intelligence & Serv R, Chongqing 400715, Peoples R China 5.Tsinghua Univ, Dept Comp Sci & Technol, Beijing 100084, Peoples R China 6.Bournemouth Univ, Dept Psychol, Poole, Dorset, England |
第一作者单位 | 脑与认知科学国家重点实验室 |
通讯作者单位 | 脑与认知科学国家重点实验室 |
推荐引用方式 GB/T 7714 | Zhang, Zhihao,Chen, Tong,Liu, Ye,et al. Decoding the temporal representation of facial expression in face-selective regions[J]. NEUROIMAGE,2023,283:15. |
APA | Zhang, Zhihao.,Chen, Tong.,Liu, Ye.,Wang, Chongyang.,Zhao, Ke.,...&Fu, Xiaolan.(2023).Decoding the temporal representation of facial expression in face-selective regions.NEUROIMAGE,283,15. |
MLA | Zhang, Zhihao,et al."Decoding the temporal representation of facial expression in face-selective regions".NEUROIMAGE 283(2023):15. |
条目包含的文件 | ||||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Decoding the tempora(2524KB) | 期刊论文 | 出版稿 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论