Human emotion and StO2: Dataset, pattern, and recognition of basic emotions

doi:10.1016/j.patcog.2024.111249

PSYCH OpenIR

	Human emotion and StO2: Dataset, pattern, and recognition of basic emotions
	Liu, Xinyu 1,3; Chen, Tong 1,2,3; Zhou, Ju 1,3; Wang, Hanpu 1,3; Liu, Guangyuan 1,3; Fu, Xiaolan 2,4
通讯作者	Chen, Tong(c_tong@swu.edu.cn)
摘要	Emotions can be recognized through facial expressions, but this becomes challenging when facial expressions are deliberately manipulated. This study introduces tissue oxygen saturation (StO2), a non-contact measured physiological signal of hemoglobin binding to oxygen, as a novel and expression-independent indicator for emotion recognition. Herein, the first StO2-emotion dataset is developed, which encompasses six basic emotions collected from 145 participants via emotional stimulus videos. Pattern analyses indicate that StO2 exhibits distinctive patterns under various emotions, whereas facial expressions have no impact on StO2. Based on this finding, we design the intensity difference pattern-masked feature (IMF) to amplify the changes in StO2 and construct the region of interest embedded Transformer network (ROI-EmbedFormer) to capture the synergistic changes across different facial regions. Finally, an accuracy of 80.31% is achieved for StO2-based emotion recognition. This work shows that StO2 is a promising signal that can identify genuine emotions even without facial expressions.
关键词	Tissue oxygen saturation Emotion recognition Emotion pattern Emotion dataset Action unit Handcrafted features Transformer
	2025-05-01
语种	英语
DOI	10.1016/j.patcog.2024.111249
发表期刊	PATTERN RECOGNITION
ISSN	0031-3203
卷号	161 页码:14
收录类别	SCI
资助项目	Project of Chongqing Science and Technology Bureau[CSTB2023TIAD-STX0037] ; Fujian Provincial Science and Technology Plan Project[2022T3016] ; Fundamental Research Funds for the Central Universities[SWU120083]
出版者	ELSEVIER SCI LTD
WOS关键词	DATABASE
WOS研究方向	Computer Science ; Engineering
WOS类目	Computer Science, Artificial Intelligence ; Engineering, Electrical & Electronic
WOS记录号	WOS:001383376500001
资助机构	Project of Chongqing Science and Technology Bureau ; Fujian Provincial Science and Technology Plan Project ; Fundamental Research Funds for the Central Universities
引用统计
文献类型	期刊论文
条目标识符	https://ir.psych.ac.cn/handle/311026/47294
通讯作者	Chen, Tong
作者单位	1.Southwest Univ, Coll Elect & Informat Engn, Chongqing 400715, Peoples R China 2.Chinese Acad Sci, Inst Psychol, Beijing 100101, Peoples R China 3.Southwest Univ, Chongqing Key Lab Gener Technol & Syst Serv Robots, Chongqing 400715, Peoples R China 4.Chinese Acad Sci, Inst Psychol, State Key Lab Brain & Cognit Sci, Beijing 100101, Peoples R China
推荐引用方式 GB/T 7714	Liu, Xinyu,Chen, Tong,Zhou, Ju,et al. Human emotion and StO2: Dataset, pattern, and recognition of basic emotions[J]. PATTERN RECOGNITION,2025,161:14.
APA	Liu, Xinyu,Chen, Tong,Zhou, Ju,Wang, Hanpu,Liu, Guangyuan,&Fu, Xiaolan.(2025).Human emotion and StO2: Dataset, pattern, and recognition of basic emotions.PATTERN RECOGNITION,161,14.
MLA	Liu, Xinyu,et al."Human emotion and StO2: Dataset, pattern, and recognition of basic emotions".PATTERN RECOGNITION 161(2025):14.