视听双通道表情加工的注意调控

PSYCH OpenIR > 认知与发展心理学研究室

	视听双通道表情加工的注意调控
其他题名	Attentional Modulation on the Processing of Visual and Auditory Expressions
	张亮
	2010-05
摘要	选择性注意研究发现，视觉和听觉注意机制是相互联系的。对某一位置视觉(听觉)刺激的注意能够促进对同一位置上听觉(视觉)刺激的加工。人类的面孔和声音分别是人类视觉与听觉环境中最重要的刺激之一。面孔表情加工的注意机制一直是认知研究的热点，但以往研究多集中于对单通道表情的单通道注意研究。现实环境中，视觉(即面孔)与听觉(即人类声音)表情常常是并存的。人脑不仅能够加工单独的面孔或声音，还能对两者进行整合。那么，视觉与听觉通道的空间注意能否同时影响视觉表情与听觉表情的加工，以及两者的整合?针对这些问题，本研究采用多通道注意研究的实验范式，以动态面孔表情及其对应的人声为材料，结合行为与脑电实验，探讨了注意对表情加工以及双通道表情整合的影响。研究结果发现：一、空间注意对面孔和声音加工的影响开始于早期阶段(视觉P1效应，听觉N1效应)，并诱发了P300与晚成分的增强。但面孔加工的早期效应不受跨通道空间注意的影响(P1效应消失)。面孔特异性成分N170不受空间注意与通道注意的影响，反应了面孔编码的自动化过程。二、面孔一声音整合开始于早期知觉阶段，整合过程同时受到空间注意与通道注意的影响，两种注意因素之间存在交互作用。视觉空间注意主要影响整合的晚成分，听觉空间注意对整合的早成分和晚成份都产生了影响。这说明，面孔-声音整合受注意调控，不是完全自动化的过程。三、表情情绪信息的加工受注意影响，空间注意与通道注意的影响主要发生在表情加工的晚期阶段。视觉与听觉情绪信息加工以及两者整合的早期过程不受注意的影响，这可能反应了情绪信息加工的自动化特点。
其他摘要	It has been found that there are crossmodal links in spatial attention between vision and audition. Directing vision spatial attention to a certain location also facilities the processing of auditory stimuli at that location, and vice versa. Human faces and voices are one of the most salient stimuli in the human visual and auditory environment. The vision spatial modulation on the facial expressions has been investigated. However, most researches focused on the unimodal attentional modulation on the unimodal expressions. In fact, faces and voices are often encountered simultaneously and integrated processed. Are the processing and integration of facial and vocal expressions modulated by both vision and audition spatial attention? To answer these questions, the present research was carried out with dynamic facial expressions and the corresponding voices. The paradigm of multimodal attention research was employed in behavioral measurements and electroencephalographic (EEG) studies. The aim of the present study was to investigate the attentional modulation on the expressions processing and the integration of bimodal expressions. The results showed that a) both early components (indexed by P1) and late components (indexed by P300 and late negative components) were modulated by spatial attention. The early effect on ERPs elicited by face stimuli were unaffected by the crossmodal spatial attention. The face-sensitive component N170 was immune from spatial and modal attention, which suggests the automatic processing of faces encoding; b) the face-voice integration started from the early perceptual stage. The integration was modulated by both spatial and modal attention. The vision spatial attention modulated the early components; the audition spatial attention modulated both early and late components. These results suggest that the face-voice integration was partially modulated by attention rather than completely automatically; c) The processing of facial and vocal emotional expressions were influenced by attention. The main effects of spatial and modal attention took place at late stages. The early components were roughly equal across different attentional conditions, which might indicate the automatic processing of the emotion information.
学科领域	应用心理学
关键词	通道注意跨通道空间注意面孔一声音按合双通道表情
学位类型	博士
语种	中文
学位专业	心理学
学位授予单位	中国科学院研究生院
学位授予地点	北京
文献类型	学位论文
条目标识符	http://ir.psych.ac.cn/handle/311026/20449
专题	认知与发展心理学研究室
作者单位	中国科学院心理研究所
推荐引用方式 GB/T 7714	张亮. 视听双通道表情加工的注意调控[D]. 北京. 中国科学院研究生院,2010.

条目包含的文件
文件名称/大小	文献类型	版本类型	开放类型	使用许可
视听双通道表情加工的注意调控.pdf（2646KB）	学位论文		限制开放	CC BY-NC-SA	请求全文