PSYCH OpenIR  > 中国科学院心理研究所回溯数据库(1956-2010)
IMMEDIATE INTEGRATION OF PROSODIC INFORMATION FROM SPEECH AND VISUAL INFORMATION FROM PICTURES IN THE ABSENCE OF FOCUSED ATTENTION: A MISMATCH NEGATIVITY STUDY
Li, X.; Yang, Y.; Ren, G.; Y. YANG
2009-06-16
Source PublicationNEUROSCIENCE
ISSN0306-4522
SubtypeArticle
Volume161Issue:1Pages:59-66
AbstractLanguage is often perceived together with visual information. Recent experimental evidences indicated that, during spoken language comprehension, the brain can immediately integrate visual information with semantic or syntactic information from speech. Here we used the mismatch negativity to further investigate whether prosodic information from speech could be immediately integrated into a visual scene context or not, and especially the time course and automaticity of this integration process. Sixteen Chinese native speakers participated in the study. The materials included Chinese spoken sentences and picture pairs. In the audiovisual situation, relative to the concomitant pictures, the spoken sentence was appropriately accented in the standard stimuli, but inappropriately accented in the two kinds of deviant stimuli. In the purely auditory situation, the speech sentences were presented without pictures. It was found that the deviants evoked mismatch responses in both audiovisual and purely auditory situations; the mismatch negativity in the purely auditory situation peaked at the same time as, but was weaker than that evoked by the same deviant speech sounds in the audiovisual situation. This pattern of results suggested immediate integration of prosodic information from speech and visual information from pictures in the absence of focused attention.; Language is often perceived together with visual information. Recent experimental evidences indicated that, during spoken language comprehension, the brain can immediately integrate visual information with semantic or syntactic information from speech. Here we used the mismatch negativity to further investigate whether prosodic information from speech could be immediately integrated into a visual scene context or not, and especially the time course and automaticity of this integration process. Sixteen Chinese native speakers participated in the study. The materials included Chinese spoken sentences and picture pairs. In the audiovisual situation, relative to the concomitant pictures, the spoken sentence was appropriately accented in the standard stimuli, but inappropriately accented in the two kinds of deviant stimuli. In the purely auditory situation, the speech sentences were presented without pictures. It was found that the deviants evoked mismatch responses in both audiovisual and purely auditory situations; the mismatch negativity in the purely auditory situation peaked at the same time as, but was weaker than that evoked by the same deviant speech sounds in the audiovisual situation. This pattern of results suggested immediate integration of prosodic information from speech and visual information from pictures in the absence of focused attention. (C) 2009 IBRO. Published by Elsevier Ltd. All rights reserved.
Keywordevent-related potential mismatch negativity accentuation audiovisual integration speech processing
Subject Area心理语言学
Indexed BySCI ; SSCI
Language英语
WOS IDWOS:000266225900008
Citation statistics
Cited Times:3[WOS]   [WOS Record]     [Related Records in WOS]
Document Type期刊论文
Identifierhttp://ir.psych.ac.cn/handle/311026/5467
Collection中国科学院心理研究所回溯数据库(1956-2010)
Corresponding AuthorY. YANG
AffiliationChinese Acad Sci, Inst Psychol, State Key Lab Brain & Cognit Sci, Beijing 100101, Peoples R China
Recommended Citation
GB/T 7714
Li, X.,Yang, Y.,Ren, G.,et al. IMMEDIATE INTEGRATION OF PROSODIC INFORMATION FROM SPEECH AND VISUAL INFORMATION FROM PICTURES IN THE ABSENCE OF FOCUSED ATTENTION: A MISMATCH NEGATIVITY STUDY[J]. NEUROSCIENCE,2009,161(1):59-66.
APA Li, X.,Yang, Y.,Ren, G.,&Y. YANG.(2009).IMMEDIATE INTEGRATION OF PROSODIC INFORMATION FROM SPEECH AND VISUAL INFORMATION FROM PICTURES IN THE ABSENCE OF FOCUSED ATTENTION: A MISMATCH NEGATIVITY STUDY.NEUROSCIENCE,161(1),59-66.
MLA Li, X.,et al."IMMEDIATE INTEGRATION OF PROSODIC INFORMATION FROM SPEECH AND VISUAL INFORMATION FROM PICTURES IN THE ABSENCE OF FOCUSED ATTENTION: A MISMATCH NEGATIVITY STUDY".NEUROSCIENCE 161.1(2009):59-66.
Files in This Item:
File Name/Size DocType Version Access License
Li-2009-IMMEDIATE IN(681KB) 限制开放--View Application Full Text
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Li, X.]'s Articles
[Yang, Y.]'s Articles
[Ren, G.]'s Articles
Baidu academic
Similar articles in Baidu academic
[Li, X.]'s Articles
[Yang, Y.]'s Articles
[Ren, G.]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Li, X.]'s Articles
[Yang, Y.]'s Articles
[Ren, G.]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: Li-2009-IMMEDIATE INTEGRATIO.pdf
Format: Adobe PDF
This file does not support browsing at this time
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.