PSYCH OpenIR  > 脑与认知科学国家重点实验室
Video-based Facial Micro-Expression Analysis: A Survey of Datasets, Features and Algorithms
Ben, Xianye1; Ren, Yi2; Zhang, Junping3; Wang, Su-jing4; Kpalma, Kidiyo5; Meng, Weixiao6; Liu, Yong-jin7
First AuthorBen, Xianye
Contribution Rank4
Abstract

Different from the conventional facial expression, micro-expression is an involuntary and transient facial expression, which can reveal a genuine emotion that people attempt to hide. The detection and recognition of micro-expressions are difficult and heavily rely on expert experiences, since micro-expressions are transient and of low intensity. Due to its intrinsic particularity and complexity, micro-expression analysis is attractive but challenging, and recently becomes an active area of research. Although there are many developments in this area, a comprehensive survey that can help researchers to systematically review them is still lacking. In this survey paper, we highlight the key differences between macro- and micro-expressions, and use these differences to guide the research survey of micro-expression analysis in a cascaded structure, including neuropsychological basis, datasets, features, detection/spotting algorithms, recognition algorithms, applications and evaluation of state of the arts. In each aspect, basic techniques, advanced developments and major challenges are addressed and discussed. Furthermore, by considering the limitations in existing micro-expression datasets, we present and release a new dataset called MMEW that has more video samples and more labeled emotion types, and perform a unified comparison of representative recognition methods on MMEW. Finally, some potential research directions are explored and outlined.

2021
DOI10.1109/TPAMI.2021.3067464
Source PublicationIEEE Transactions on Pattern Analysis and Machine Intelligence
ISSN0162-8828
Subtype综述
Citation statistics
Document Type期刊论文
Identifierhttp://ir.psych.ac.cn/handle/311026/38662
Collection脑与认知科学国家重点实验室
Affiliation1.School of Information Science and Engineering, Shandong University, 12589 Qingdao, China, China
2.School of Information Science and Engineering, Shandong University, 12589 Jinan, Shandong, China
3.School of Computer Science, Fudan University, Shanghai, ShangHai, China
4.Institute of Psychology, Chinese Academy of Sciences, Beijing, Beijing, China
5.EII, IETR-INSA, RENNES, -, France
6.School of Electronics and Information Engineering, Harbin Institute of Technology, 47822 Harbin, Heilongjiang, China
7.Computer Science and Technology, Tsinghua University, Beijing, Beijing, China
Recommended Citation
GB/T 7714
Ben, Xianye,Ren, Yi,Zhang, Junping,et al. Video-based Facial Micro-Expression Analysis: A Survey of Datasets, Features and Algorithms[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2021.
APA Ben, Xianye.,Ren, Yi.,Zhang, Junping.,Wang, Su-jing.,Kpalma, Kidiyo.,...&Liu, Yong-jin.(2021).Video-based Facial Micro-Expression Analysis: A Survey of Datasets, Features and Algorithms.IEEE Transactions on Pattern Analysis and Machine Intelligence.
MLA Ben, Xianye,et al."Video-based Facial Micro-Expression Analysis: A Survey of Datasets, Features and Algorithms".IEEE Transactions on Pattern Analysis and Machine Intelligence (2021).
Files in This Item:
File Name/Size DocType Version Access License
Videobased Facial Mi(2102KB)期刊论文出版稿限制开放CC BY-NC-SAApplication Full Text
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Ben, Xianye]'s Articles
[Ren, Yi]'s Articles
[Zhang, Junping]'s Articles
Baidu academic
Similar articles in Baidu academic
[Ben, Xianye]'s Articles
[Ren, Yi]'s Articles
[Zhang, Junping]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Ben, Xianye]'s Articles
[Ren, Yi]'s Articles
[Zhang, Junping]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.