PSYCH OpenIR  > 认知与发展心理学研究室
跨通道类别学习的认知神经机制
其他题名The Neural and Cognitive Mechanisms of Cross-modal Category Learning
孙洵伟
导师付秋芳
2021-06
摘要在类别学习领域,一直以来都对是否存在内隐和外显类别学习系统的分离具有较大的争议。“双系统”理论认为,存在内隐和外显两种类别学习系统,二者有着不同的认知加工特点和的神经加工机制。而“单系统”理论则认为,仅存在一种类别学习系统,即外显的类别学习系统。但这些争议大多局限于单通道的研究。相比于单通道学习,跨通道学习更接近人类学习的真实环境。不过,由于在跨通道学习中,人脑并不是将不同通道的信息进行简单相加,而是将其整合形成统一的经验和表征,目前有关跨通道学习的认知特点和神经机制尚不清楚。因此,本研究通过采用视听跨通道刺激的特征来界定类别,探究对在离散和连续变量变化的刺激的跨通道学习中,是否存在内隐和外显类别学习的分离及其神经机制。相关研究发现不仅可以为类别学习单系统和双系统的争议提供新的研究证据,也有助于揭示跨通道类别信息在大脑中发生交互的时间进程和神经机制,从而为跨通道学习在人工智能中的应用提供启示。 研究一采用天气预测任务范式,通过操纵刺激的呈现通道,比较单通道和跨通道类别学习的特点,考察被试是否能够习得视听跨通道的类别知识,以及这些跨通道知识是否可以是内隐的。实验1a 结果发现,被试在听觉和跨通道条件下可以获得一定的无意识知识,并且在类别学习成绩上表现出了视觉通道的优势效应。实验1b 将学习阶段延长至实验1a的3 倍,结果发现,视觉优势效应依然存在,并且所有被试均获得有意识的类别知识。实验2a与2b 分别采用复杂视觉刺激、复杂视觉刺激和听觉反馈相结合的实验条件,依然发现了类别学习中的视觉优势效应。实验3 采用两维度信息来自一个客体的听觉刺激,发现听觉通道最佳反应率提高,且依然存在视觉优势效应。这些结果说明,被试可以结合两个通道的信息习得类别知识,并且这一跨通道知识可以是无意识的;但跨通道类别学习的成绩低于视觉学习,存在较为稳定的视觉优势效应。 研究二采用行为和功能磁共振成像技术,通过设置基于规则的和信息整合的类别结构,对比内隐和外显类别学习的特点以及是否存在神经机制的差异。结果发现,外显学习比内隐学习在海马、前扣带回等外显脑区激活显著更强;内隐学习则比外显学习在双侧顶下小叶、辅助运动区、左侧丘脑等相关脑区激活显著更强。此外,相较于基线任务,两种条件下的分类任务在尾状核、壳核和黑质等核团中的激活均显著更强,说明基底神经节并非特异地参与内隐类别学习,而是在内隐和外显学习中都起作用。这些结果为“双系统”提供了新的支持证据,但也说明内隐和外显类别学习系统并不是截然分离的,尾状核等脑区在内隐和外显的类别学习中都起重要作用。 研究三采用基于规则的和信息整合的类别结构,通过行为实验和事件相关电位技术,考察内隐和外显类别学习中的迁移机制和时间进程。实验6 的结果表明,在内隐和外显类别学习中,被试均能够在迁移阶段表现出迁移效应,但内隐学习组的自发迁移效应显著更大;实验7 的结果则表明,内隐学习组无法完成通道间迁移,但外显学习组则可以借助反馈更快地学习新的类别,表现出一定的迁移效应。上述结果说明,人们在内隐类别学习中可能基于相似性完成迁移,表现出通道内刺激间迁移的效应;而人们在外显类别学习中则可能基于抽象的规则和假设检验完成迁移,表现出通道间刺激内和刺激间迁移的效应。实验8 基于反应锁时的ERP 结果表明,反馈相关负波(Feedback Related Negativity, FRN)在内隐类别学习条件下波幅更大,且仅在内隐条件下存在波幅与学习成绩间的显著相关;与记忆预期相关的P3 成分在外显类别学习条件下波幅更大,且仅在外显条件下存在波幅与学习成绩间的显著相关。这些结果说明,跨通道内隐与外显类别学习在迁移机制和时间进程上均存在分离。 本研究系统地考察了跨通道类别学习的认知神经机制,不仅从跨通道学习角度提供了内隐和外显类别学习分离的行为和神经证据,还揭示了内隐和外显跨通道类别学习中的迁移机制和时间进程。研究结果发现,内隐与外显类别学习既在加工脑区如海马、左侧丘脑和顶下小叶上存在分离,也在跨通道知识的迁移机制和时间进程上存在分离。这些研究发现丰富和完善了类别学习的相关理论,有利于进一步揭示跨通道类别学习的认知特点和神经机制。
其他摘要In the field of category learning, there has been much debate about whether there is a dissociation between implicit and explicit category learning systems. The "dual system" theory suggests that there are two types of category learning systems, i.e.,implicit and explicit category learning systems, which have different cognitive processing characteristics and different neural mechanisms. The "single-system" theory, on the other hand, suggests that there is only a single system, i.e., the explicit category learning system. Most of these arguments are limited to uni-modal learning, whereas cross-modal learning is closer to the real environment of human learning than unimodal learning. Moreover, the human brain does not simply add up information from different modalities but integrates them to form a unified experience and representation.The cognitive characteristics and neural mechanisms regarding cross-modal learning remains unclear. Therefore, this study investigates whether there are two different category learning systems in cross-modal learning by using audiovisual cross-modal stimuli varied on discrete and continuous variables to define categories. The related findings may not only provide new research evidence for the controversy of category learning systems, but also help to reveal the time and neural mechanisms of cross-modal information in the brain, and thus give some inspiration to the application of crossmodal learning in artificial intelligence. Study 1 used a weather prediction task paradigm to examine whether subjects could acquire categorical knowledge across auditory and visual modalities, and whether cross-modal category knowledge could be implicit. Additionally, Study 1 manipulated the stimulus modality to investigate the characteristics of uni-modal and cross-modal category learning. The results of Experiment 1a suggested that subjects could acquire some unconscious knowledge in the auditory and cross-modal conditions and showed a dominant effect of the visual modality on category learning performance. Experiment 1b extended the training blocks to three times that of Experiment 1a and revealed that there still existed a visual dominance effect and that all subjects acquired conscious category knowledge. Experiments 2a and 2b adopted complex visual stimuli and the combination of complex visual stimuli and auditory feedback, respectively, and still observed the visual dominance effect in category learning. Experiment 3 used auditory stimuli with two dimensions from one object, and observed an increased optimal response rate in the auditory condition and a visual dominance effect. These results suggest that participants can combine information from auditory and visual modalities to acquire category knowledge and that this cross-modal knowledge can be implicit; cross-modal category learning is less well performed than visual learning and there exists a stable visual dominance effect. Study 2 used behavioral and functional magnetic resonance imaging techniques to investigate characteristics and neural mechanisms of implicit and explicit category learning by setting up rule-based and information-integrated category structures. The fMRI results revealed that the explicit learning group had significantly stronger activation in brain regions such as hippocampus and anterior cingulate gyrus; while the implicit learning group had significantly stronger activation in brain regions such as bilateral inferior parietal lobule, supplementary motor area, and left thalamus. In addition, compared to the baseline task, the categorization task elicited significantly stronger activation in the caudate nucleus and substantia nigra in both conditions. The results suggest that the basal ganglia are not specifically involved in implicit category learning, but rather play a role in both implicit and explicit learning. These results not only provide new supporting evidence for a "dual system", but also suggest that the implicit and explicit category learning systems are not totally distinct. Especially, brain regions such as the caudate nucleus play an important role in both implicit and explicit category learning. Study 3 used rule-based and information-integrated category structures to examine transfer mechanisms and time courses of implicit and explicit learning through combining behavioral and event-related potential techniques. The results of Experiment 6 showed that subjects were able to show transfer effects to new stimuli within modalities during the transfer phase in both implicit and explicit category learning groups, but the spontaneous transfer effect was significantly larger in the implicit category learning group than in the explicit category learning group. The results of Experiment 7, on the other hand, showed that the implicit category learning group could not transfer cross-modality knowledge to new stimuli across modalities, but the explicit category learning group could learn new categories faster with feedback, indicating transfer effects to new stimuli across modalities. The results suggest that implicit category learning may complete transfer based on similarity, in which the transfer effect to new stimuli within modalities can be observed, while explicit category learning may complete transfer based on abstract rules and hypothesis testing, in which the transfer effect to new stimuli both within and across modalities can be observed. The responselocked ERP results of Experiment 8 revealed a larger FRN (feedback-related negativity) in the implicit category learning group than in the explicit category learning group, and there was a significant correlation between FRN amplitudes and learning performance only in the implicit group. Moreover, the P3 component associated with memory expectancy was larger in the explicit category learning group than in the implicit category learning group and there was a significant correlation between P3 amplitudes and learning performance only in the explicit group. These results suggest that implicit and explicit cross-modal category learning have distinct transfer mechanisms and time courses. The present study systematically examined the cognitive neural mechanisms of cross-model category learning, providing not only behavioral and neural evidence for the dissociation between implicit and explicit category learning from a cross-modal processing perspective, but also revealing distinct transfer mechanisms and time courses in implicit and explicit cross-modal category learning. The results revealed that there is dissociation between implicit and explicit category learning not only in brain regions such as the hippocampus, the left thalamus, and the inferior parietal lobule, but also in transfer mechanisms and time courses of cross-modal knowledge. These findings enrich and improve the theories related to category learning and are conducive to further investigate the cognitive characteristics and neural mechanisms of crosschannel category learning.
关键词类别学习 跨通道学习 内隐学习 认知机制 神经机制
学位类型博士
语种中文
学位名称理学博士
学位专业基础心理学
学位授予单位中国科学院心理研究所
学位授予地点中国科学院心理研究所
文献类型学位论文
条目标识符https://ir.psych.ac.cn/handle/311026/39620
专题认知与发展心理学研究室
推荐引用方式
GB/T 7714
孙洵伟. 跨通道类别学习的认知神经机制[D]. 中国科学院心理研究所. 中国科学院心理研究所,2021.
条目包含的文件
条目无相关文件。
个性服务
推荐该条目
保存到收藏夹
查看访问统计
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[孙洵伟]的文章
百度学术
百度学术中相似的文章
[孙洵伟]的文章
必应学术
必应学术中相似的文章
[孙洵伟]的文章
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。