PSYCH OpenIR  > 中国科学院心理健康重点实验室
Micro-expression recognition by two-stream difference network
Pan, Hang1; Xie, Lun1; Li, Juan2; Lv, Zeping3; Wang, Zhiliang1
First AuthorPan, Hang
Correspondent Emailxielun@ustb.edu.cn
Contribution Rank2
Abstract

Facial micro-expression is a superposition of micro-expression features and identity information of a subject. For the problem of identity information interference in micro-expression recognition, this study proposes a new method for facial micro-expression recognition by de-identity information, called two-stream difference network (TSDN). First, a two-stream encoder-decoder network is trained by a convolutional neural network, where the input of the micro-expression stream is a micro-expression image, and the identity stream is a facial identity image. The micro-expression image is the apex image, and the identity image is the onset image in the micro-expression sequence. The identity information and micro-expression features are recorded in the intermediate layer of the micro-expression stream, while the intermediate layer of the identity stream contains only the identity information of a subject. Then, the identity information is removed by the difference network, but micro-expression features are stored in the intermediate layer of the micro-expression stream. Given the sequence of the micro-expressions, the TSDN model of de-identity information learns the difference that stores in the expression stream. Two public spontaneous facial micro-expression data sets (SMIC and CASME II) are employed in our experiments. The experiment results show that our model can achieve a superior performance in micro-expression recognition.

2021-09-01
Language英语
DOI10.1049/cvi2.12030
Source PublicationIET COMPUTER VISION
ISSN1751-9632
Volume15Issue:6Pages:440-448
Subtype实证研究
Indexed BySCI
Funding ProjectNational Key R&D Programme of China[2018YFC 2001700] ; National Natural Science Foundation of China[61672093] ; Advanced Innovation Centre for Intelligent Robots and Systems Open Research Project[2018IRS01]
PublisherWILEY
WOS Research AreaComputer Science ; Engineering
WOS SubjectComputer Science, Artificial Intelligence ; Engineering, Electrical & Electronic
WOS IDWOS:000684219300005
WoS QuartileQ3
Funding OrganizationNational Key R&D Programme of China ; National Natural Science Foundation of China ; Advanced Innovation Centre for Intelligent Robots and Systems Open Research Project
Citation statistics
Document Type期刊论文
Identifierhttp://ir.psych.ac.cn/handle/311026/40020
Collection中国科学院心理健康重点实验室
Corresponding AuthorXie, Lun
Affiliation1.Univ Sci & Technol Beijing, Sch Comp & Commun Engn, Beijing, Peoples R China
2.Chinese Acad Sci, Ctr Aging Psychol, Inst Psychol, Key Lab Mental Hlth, Beijing, Peoples R China
3.Natl Res Ctr Rehabil Tech Aids, Affiliated Rehabil Hosp, Beijing, Peoples R China
Recommended Citation
GB/T 7714
Pan, Hang,Xie, Lun,Li, Juan,et al. Micro-expression recognition by two-stream difference network[J]. IET COMPUTER VISION,2021,15(6):440-448.
APA Pan, Hang,Xie, Lun,Li, Juan,Lv, Zeping,&Wang, Zhiliang.(2021).Micro-expression recognition by two-stream difference network.IET COMPUTER VISION,15(6),440-448.
MLA Pan, Hang,et al."Micro-expression recognition by two-stream difference network".IET COMPUTER VISION 15.6(2021):440-448.
Files in This Item:
File Name/Size DocType Version Access License
Micro-expression rec(894KB)期刊论文出版稿限制开放CC BY-NC-SAApplication Full Text
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Pan, Hang]'s Articles
[Xie, Lun]'s Articles
[Li, Juan]'s Articles
Baidu academic
Similar articles in Baidu academic
[Pan, Hang]'s Articles
[Xie, Lun]'s Articles
[Li, Juan]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Pan, Hang]'s Articles
[Xie, Lun]'s Articles
[Li, Juan]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.