Institutional Repository, Institute of Psychology, Chinese Academy of Sciences
Micro-attention for micro-expression recognition | |
Wang, Chongyang1; Peng, Min2; Bi, Tao1; Chen, Tong3,4 | |
第一作者 | Wang, Chongyang |
通讯作者邮箱 | pengmin@cigit.ac.cn (m. peng) |
摘要 | Micro-expression, for its high objectivity in emotion detection, has emerged to be a promising modality in affective computing. Recently, deep learning methods have been successfully introduced into the micro-expression recognition area. Whilst the higher recognition accuracy achieved, substantial challenges in micro-expression recognition remain. The existence of micro expression in small-local areas on face and limited size of available databases still constrain the recognition accuracy on such emotional facial behavior. In this work, to tackle such challenges, we propose a novel attention mechanism called micro-attention cooperating with residual network. Micro-attention enables the network to learn to focus on facial areas of interest covering different action units. Moreover, coping with small datasets, the micro-attention is designed without adding noticeable parameters while a simple yet efficient transfer learning approach is together utilized to alleviate the overfitting risk. With extensive experimental evaluations on three benchmarks (CASMEII, SAMM and SMIC) and post-hoc feature visualizations, we demonstrate the effectiveness of the proposed micro-attention and push the boundary of automatic recognition of micro-expression. |
关键词 | Micro expression recognition Deep learning Attention mechanism Transfer learning |
2020 | |
DOI | 10.1016/j.neucom.2020.06.005 |
发表期刊 | Neurocomputing |
ISSN | 0925-2312 |
卷号 | 410页码:354-362 |
收录类别 | SCI ; EI |
资助项目 | UCL Overseas Research Scholarship (ORS) ; UCL Graduate Research Scholarship (GRS) |
出版者 | ELSEVIER |
WOS关键词 | CATEGORIZATION |
WOS研究方向 | Computer Science |
WOS类目 | Computer Science, Artificial Intelligence |
WOS记录号 | WOS:000579799300030 |
资助机构 | UCL Overseas Research Scholarship (ORS) ; UCL Graduate Research Scholarship (GRS) |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.psych.ac.cn/handle/311026/32218 |
专题 | 中国科学院心理研究所 |
作者单位 | 1.UCL Interaction Centre, University College London, London, United Kingdom 2.College of Electronic and Information Engineering, Southwest University, Chongqing, China 3.College of Electronic and Information Engineering, Southwest University, Chongqing, China 4.Intelligent Security Center, Chongqing Institute of Green and Intelligent Technology, CAS, Chongqing, China |
推荐引用方式 GB/T 7714 | Wang, Chongyang,Peng, Min,Bi, Tao,et al. Micro-attention for micro-expression recognition[J]. Neurocomputing,2020,410:354-362. |
APA | Wang, Chongyang,Peng, Min,Bi, Tao,&Chen, Tong.(2020).Micro-attention for micro-expression recognition.Neurocomputing,410,354-362. |
MLA | Wang, Chongyang,et al."Micro-attention for micro-expression recognition".Neurocomputing 410(2020):354-362. |
条目包含的文件 | ||||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Micro-attention for (957KB) | 期刊论文 | 出版稿 | 限制开放 | CC BY-NC-SA | 浏览 请求全文 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论