Institutional Repository, Institute of Psychology, Chinese Academy of Sciences
A Main Directional Mean Optical Flow Feature for Spontaneous Micro-Expression Recognition | |
Liu, Yong-Jin1; Zhang, Jin-Kai1; Yan, Wen-Jing3![]() ![]() ![]() | |
Abstract | Micro-expressions are brief facial movements characterized by short duration, involuntariness and low intensity. Recognition of spontaneous facial micro-expressions is a great challenge. In this paper, we propose a simple yet effective Main Directional Mean Optical-flow (MDMO) feature for micro-expression recognition. We apply a robust optical flow method on micro-expression video clips and partition the facial area into regions of interest (ROIs) based partially on action units. The MDMO is a ROI-based, normalized statistic feature that considers both local statistic motion information and its spatial location. One of the significant characteristics of MDMO is that its feature dimension is small. The length of a MDMO feature vector is 36 x 2 = 72, where 36 is the number of ROIs. Furthermore, to reduce the influence of noise due to head movements, we propose an optical-flow-driven method to align all frames of a micro-expression video clip. Finally, a SVM classifier with the proposed MDMO feature is adopted for micro-expression recognition. Experimental results on three spontaneous micro-expression databases, namely SMIC, CASME and CASME II, show that the MDMO can achieve better performance than two state-of-the-art baseline features, i.e., LBP-TOP and HOOF. |
Keyword | Micro-expression optical flow recognition feature |
2016-10-01 | |
Language | 英语 |
DOI | 10.1109/TAFFC.2015.2485205 |
Source Publication | IEEE Transactions on Affective Computing
![]() |
ISSN | 1949-3045 |
Volume | 7Issue:4Pages:299-310 |
Subtype | Article |
Indexed By | SCI |
WOS Keyword | FACIAL EXPRESSIONS ; MODELS |
WOS Headings | Science & Technology ; Technology |
WOS Research Area | Computer Science |
WOS Subject | Computer Science, Artificial Intelligence ; Computer Science, Cybernetics |
WOS ID | WOS:000389328800001 |
Citation statistics | |
Document Type | 期刊论文 |
Identifier | http://ir.psych.ac.cn/handle/311026/20934 |
Collection | 脑与认知科学国家重点实验室 |
Affiliation | 1.Tsinghua Univ, Dept Comp Sci & Technol, Tsinghua Natl Lab Informat Sci & Technol, Beijing, Peoples R China 2.Chinese Acad Sci, Inst Psychol, State Key Lab Brain & Cognit Sci, Beijing 100101, Peoples R China 3.Wenzhou Univ, Coll Teacher Educ, Wenzhou 325035, Peoples R China 4.Univ Oulu, Ctr Machine Vis Res, Infotech Oulu, POB 4500, FI-90014 Oulu, Finland 5.Univ Oulu, Dept Elect & Informat Engn, POB 4500, FI-90014 Oulu, Finland |
Recommended Citation GB/T 7714 | Liu, Yong-Jin,Zhang, Jin-Kai,Yan, Wen-Jing,et al. A Main Directional Mean Optical Flow Feature for Spontaneous Micro-Expression Recognition[J]. IEEE Transactions on Affective Computing,2016,7(4):299-310. |
APA | Liu, Yong-Jin,Zhang, Jin-Kai,Yan, Wen-Jing,Wang, Su-Jing,Zhao, Guoying,&Fu, Xiaolan.(2016).A Main Directional Mean Optical Flow Feature for Spontaneous Micro-Expression Recognition.IEEE Transactions on Affective Computing,7(4),299-310. |
MLA | Liu, Yong-Jin,et al."A Main Directional Mean Optical Flow Feature for Spontaneous Micro-Expression Recognition".IEEE Transactions on Affective Computing 7.4(2016):299-310. |
Files in This Item: | ||||||
File Name/Size | DocType | Version | Access | License | ||
A Main Directional M(762KB) | 期刊论文 | 出版稿 | 限制开放 | CC BY-NC-SA | Application Full Text |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment