|Alternative Title||Implicit integration of audiovisual information and its influencing factors|
|Place of Conferral||中国科学院心理研究所|
|Keyword||内隐学习 异同判断任务 视听信息整合|
In daily life, things and scenes that people come into contact generally contain multiple forms of modal information (such as sounds and images). These information acts on different sensory organs, and human brain will compare, integrate, and evaluate the information from different sensory channels (such as auditory and visual modality).The integration of the multisensory information has led to a unified, coherent, and stable understanding of the external world.
Some studies have found that multisensory integration can occur when the visual information is at the unconscious status. However, previous integration studies mainly focused on the experience-based semantic association and concrete information integration of multimodal stimuli which were consistent with time and space. It remains unclear whether the abstract relation of multi-sensory information can be unconsciously integrated. Therefore, this study was aimed to combine a same-different paradigm and a backward masking paradigm to investigate whether implicit multi-sensory integration can occur at the abstract level and the factors which could influence the integration.
This study systematically investigates the implicit multi-sensory integration of abstract information and its influencing factors. The first study was aimed to explore whether people can implicitly or unconsciously integrate the abstract relation of the audio-visual information when the visual information was at the subliminal level. The results showed that the inconsistent relation between audio-visual information decreases the response accuracy of visual target stimuli compared with the consistent relation between audio-visual information, indicating that the abstract relation between the audio-visual information could be implicitly integrated. In the second study, the effect of the discrimination difficulty of the target and the task-irrelevant stimuli on implicit integration of the abstract audio-visual information was further investigated.The results showed that the discrimination difficulty of the target and task-irrelevant stimuli influenced implicit abstract integration of the audio-visual information. There was no significant consistency effect when the discrimination of the target and irrelevant stimuli were both difficult. When the target stimuli were difficult to discriminate and the irrelevant stimuli were easy to discriminate, there was multisensory facilitation effect for the visual target stimuli but multisensory inhibitory effect for the auditory target stimuli. Further, when both target and irrelevant stimuli were easy to discriminate, there was a significant consistency effect only for the target visual stimuli, suggesting there was a modality asymmetry in implicit multisensory integration.
This study explored the implicit visual auditory integration at the abstract level, which can help to understand how the human brain integrates and characterizes the multimodal information and what the relationship between consciousness, attention, and information integration is. The findings give some insights for the improvement of modern multimedia teaching methods, and some inspirations for the setting of educational application software as well as for the improvement of related algorithms in artificial intelligence.
|孙莹. 视听信息的内隐整合及其影响因素[D]. 中国科学院心理研究所. 中国科学院心理研究所,2019.|
|Files in This Item:|
|孙莹-硕士学位论文.pdf（1724KB）||学位论文||限制开放||CC BY-NC-SA||Application Full Text|
|Recommend this item|
|Export to Endnote|
|Similar articles in Google Scholar|
|Similar articles in Baidu academic|
|Similar articles in Bing Scholar|
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.