Research on Dynamic and Static Fusion Polymorphic Gesture Recognition Algorithm for Interactive Teaching Interface | |
Feng, Zhiquan1,2; Xu, Tao1,2; Yang, Xiaohui1,2; Tian, Jinglan1,2; Yi, Jiangyan3; Zhao, Ke4 | |
2019 | |
会议名称 | 4th International Conference on Cognitive Systems and Information Processing, ICCSIP 2018 |
会议录名称 | Cognitive Systems and Signal Processing - 4th International Conference, ICCSIP 2018, Revised Selected Papers |
页码 | 104-115 |
会议日期 | November 29, 2018 - December 1, 2018 |
会议地点 | Beijing, China |
出版者 | Springer Verlag |
产权排序 | 4 |
摘要 | In order to solve the problem of teachers' excessive energy dissipation due to interaction with teaching equipment in traditional classrooms, an interactive and intelligent teaching interface is proposed to enable teachers to use the gestures to give students a geometry lesson. The traditional algorithm of gesture recognition mainly consists of feature extraction and classifier, which requires human-designed features. The recognition is mainly based on static gesture or dynamic gesture singular state recognition algorithm. The recognition accuracy is not robust enough and different people Identification results do not have the universality and ease of operation. In order to solve this problem, we propose a multi-state gesture recognition algorithm based on the deep learning network, which combines the large database of hand gestures and the deep learning algorithms. The innovation of this algorithm is as follows: Aiming at the static gesture images, a sequence reduction algorithm is proposed. According to the sequence of dynamic gestures, the first and last frame fixed and intermediate frame traversal combination algorithm are proposed to get the dynamic and static fusion gesture training datasets, and then the dynamic and static fusion datasets are input to the deep learning network GoogLeNet for training. After repeated training, we found the optimal rule of deep learning network training. According to the optimization law, we got GoogLeNet_model which can recognize 23 kinds of dynamic and static fusion gestures, the recognition rate is 97.09%. We use this model in interactive teaching interface, and achieved good application effect. 2019, Springer Nature Singapore Pte Ltd. |
关键词 | Application effect - Gesture recognition algorithm - People identification - Recognition accuracy - Reduction algorithms - Teaching equipments - Teaching interfaces - Training data sets |
学科领域 | Gesture Recognition |
DOI | 10.1007/978-981-13-7986-4_10 |
ISBN号 | 9789811379857 |
收录类别 | EI |
EI入藏号 | 20192106943762 |
EI主题词 | Classification (of information) - Cognitive systems - Deep learning - Dynamics - Educational technology - Energy dissipation - Learning algorithms - Signal processing - Students |
EI分类号 | 525.4 Energy Losses (industrial and residential) - 716.1 Information Theory and Signal Processing - 901.2 Education |
引用统计 | |
文献类型 | 会议论文 |
条目标识符 | http://ir.psych.ac.cn/handle/311026/30036 |
专题 | 健康与遗传心理学研究室 |
作者单位 | 1.School of Information Science and Engineering, University of Jinan, Jinan; 250022, China; 2.Shandong Provincial Key Laboratory of Network Based Intelligent Computing, Jinan; 250022, China; 3.Institute of Computing Technology Chinese Academy of Sciences, Beijing; 100190, China; 4.Institute of Psychology Chinese Academy of Sciences, Beijing; 100101, China |
推荐引用方式 GB/T 7714 | Feng, Zhiquan,Xu, Tao,Yang, Xiaohui,et al. Research on Dynamic and Static Fusion Polymorphic Gesture Recognition Algorithm for Interactive Teaching Interface[C]:Springer Verlag,2019:104-115. |
条目包含的文件 | 条目无相关文件。 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论