|Alternative Title||Attentional Modulation on the Processing of Visual and Auditory Expressions|
|Place of Conferral||北京|
|Keyword||通道注意 跨通道空间注意 面孔一声音按合 双通道表情|
|Other Abstract||It has been found that there are crossmodal links in spatial attention between vision and audition. Directing vision spatial attention to a certain location also facilities the processing of auditory stimuli at that location, and vice versa. Human faces and voices are one of the most salient stimuli in the human visual and auditory environment. The vision spatial modulation on the facial expressions has been investigated. However, most researches focused on the unimodal attentional modulation on the unimodal expressions. In fact, faces and voices are often encountered simultaneously and integrated processed. Are the processing and integration of facial and vocal expressions modulated by both vision and audition spatial attention? To answer these questions, the present research was carried out with dynamic facial expressions and the corresponding voices. The paradigm of multimodal attention research was employed in behavioral measurements and electroencephalographic (EEG) studies. |
The aim of the present study was to investigate the attentional modulation on the expressions processing and the integration of bimodal expressions. The results showed that a) both early components (indexed by P1) and late components (indexed by P300 and late negative components) were modulated by spatial attention. The early effect on ERPs elicited by face stimuli were unaffected by the crossmodal spatial attention. The face-sensitive component N170 was immune from spatial and modal attention, which suggests the automatic processing of faces encoding; b) the face-voice integration started from the early perceptual stage. The integration was modulated by both spatial and modal attention. The vision spatial attention modulated the early components; the audition spatial attention modulated both early and late components. These results suggest that the face-voice integration was partially modulated by attention rather than completely automatically; c) The processing of facial and vocal emotional expressions were influenced by attention. The main effects of spatial and modal attention took place at late stages. The early components were roughly equal across different attentional conditions, which might indicate the automatic processing of the emotion information.
|First Author Affilication||Institute of Psychology, Chinese Academy of Sciences|
|张亮. 视听双通道表情加工的注意调控[D]. 北京. 中国科学院研究生院,2010.|
|Files in This Item:|
|视听双通道表情加工的注意调控.pdf（2646KB）||学位论文||限制开放||CC BY-NC-SA||Application Full Text|
|Recommend this item|
|Export to Endnote|
|Similar articles in Google Scholar|
|Similar articles in Baidu academic|
|Similar articles in Bing Scholar|
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.