Institutional Repository of Key Laboratory of Behavioral Science, CAS
MMPosE: Movie-induced Multi-label Positive Emotion Classification Through EEG Signals | |
Du, Xiaobing1,2; Deng, Xiaoming1,2; Qin, Hangyu1,2; Shu, Yezhi3; Zhao, Guozhen2,4![]() | |
第一作者 | Du, Xiaobing |
通讯作者 | Du, Xiaobing(duxiaobing16@mails.ucas.ac.cn) |
通讯作者邮箱 | zhaogz@psych.ac.cn |
心理所单位排序 | 3 |
摘要 | Emotional information plays an important role in various multimedia applications. Movies, as a widely available form of multimedia content, can induce multiple positive emotions and stimulate people's pursuit of a better life. Different from negative emotions, positive emotions are highly correlated and difficult to distinguish in the emotional space. Since different positive emotions are often induced simultaneously by movies, traditional single-target or multi-class methods are not suitable for the classification of movie-induced positive emotions. In this paper, we propose TransEEG, a model for multi-label positive emotion classification from a viewer's brain activities when watching emotional movies. The key features of TransEEG include (1) explicitly modeling the spatial correlation and temporal dependencies of multi-channel EEG signals using the Transformer structure based model, which effectively addresses long-distance dependencies, (2) exploiting the label-label correlations to guide the discriminative EEG representation learning, for that we design an Inter-Emotion Mask for guiding the Multi-Head Attention to learn the inter-emotion correlations, and (3) constructing an attention score vector from the representation-label correlation matrix to refine emotion-relevant EEG features. To evaluate the ability of our model for multi-label positive emotion classification, we demonstrate our model on a state-of-the-art positive emotion database CPED. Extensive experimental results show that our proposed method achieves superior performance over the competitive approaches. |
关键词 | Motion pictures Electroencephalography Brain modeling Emotion recognition Correlation Transformers Computational modeling Multi-channel EEG positive emotions affective computing multi-label classification transformer encoder |
2022 | |
语种 | 英语 |
DOI | 10.1109/TAFFC.2022.3221554 |
发表期刊 | IEEE Transactions on Affective Computing
![]() |
ISSN | 1949-3045 |
卷号 | 14期号:4页码:1-14 |
期刊论文类型 | 实证研究 |
收录类别 | SCI |
资助项目 | Beijing Natural Science Foundation |
出版者 | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC |
WOS关键词 | RECOGNITION |
WOS研究方向 | Computer Science |
WOS类目 | Computer Science, Artificial Intelligence ; Computer Science, Cybernetics |
WOS记录号 | WOS:001124163900036 |
WOS分区 | Q1 |
Q分类 | Q1 |
资助机构 | Beijing Natural Science Foundation |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | https://ir.psych.ac.cn/handle/311026/44384 |
专题 | 中国科学院行为科学重点实验室 |
通讯作者 | Zhao, Guozhen; Ma, Cuixia; Liu, Yong-Jin |
作者单位 | 1.Beijing Key Laboratory of Human Computer Interactions, Institute of Software, Chinese Academy of Sciences, Beijing, China 2.University of Chinese Academy of Sciences, Beijing, China 3.BNRist, MOE-Key Laboratory of Pervasive Computing, the Department of Computer Science and Technology, Tsinghua University, Beijing, China 4.CAS Key Laboratory of Behavioral Science, Institute of Psychology, Beijing, China 5.School of Computer Science and Informatics, Cardiff University, Cardiff, Wales, U.K 6.State Key Laboratory of Computer Science, Institute of Software, Chinese Academy of Sciences, Beijing, China |
通讯作者单位 | 中国科学院行为科学重点实验室 |
推荐引用方式 GB/T 7714 | Du, Xiaobing,Deng, Xiaoming,Qin, Hangyu,et al. MMPosE: Movie-induced Multi-label Positive Emotion Classification Through EEG Signals[J]. IEEE Transactions on Affective Computing,2022,14(4):1-14. |
APA | Du, Xiaobing.,Deng, Xiaoming.,Qin, Hangyu.,Shu, Yezhi.,Zhao, Guozhen.,...&Wang, Hongan.(2022).MMPosE: Movie-induced Multi-label Positive Emotion Classification Through EEG Signals.IEEE Transactions on Affective Computing,14(4),1-14. |
MLA | Du, Xiaobing,et al."MMPosE: Movie-induced Multi-label Positive Emotion Classification Through EEG Signals".IEEE Transactions on Affective Computing 14.4(2022):1-14. |
条目包含的文件 | ||||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
MMPosE__Movie_induce(33926KB) | 期刊论文 | 作者接受稿 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论