Institutional Repository, Institute of Psychology, Chinese Academy of Sciences
IMMEDIATE INTEGRATION OF PROSODIC INFORMATION FROM SPEECH AND VISUAL INFORMATION FROM PICTURES IN THE ABSENCE OF FOCUSED ATTENTION: A MISMATCH NEGATIVITY STUDY | |
Li, X.; Yang, Y.; Ren, G.; Y. YANG | |
摘要 | Language is often perceived together with visual information. Recent experimental evidences indicated that, during spoken language comprehension, the brain can immediately integrate visual information with semantic or syntactic information from speech. Here we used the mismatch negativity to further investigate whether prosodic information from speech could be immediately integrated into a visual scene context or not, and especially the time course and automaticity of this integration process. Sixteen Chinese native speakers participated in the study. The materials included Chinese spoken sentences and picture pairs. In the audiovisual situation, relative to the concomitant pictures, the spoken sentence was appropriately accented in the standard stimuli, but inappropriately accented in the two kinds of deviant stimuli. In the purely auditory situation, the speech sentences were presented without pictures. It was found that the deviants evoked mismatch responses in both audiovisual and purely auditory situations; the mismatch negativity in the purely auditory situation peaked at the same time as, but was weaker than that evoked by the same deviant speech sounds in the audiovisual situation. This pattern of results suggested immediate integration of prosodic information from speech and visual information from pictures in the absence of focused attention.; Language is often perceived together with visual information. Recent experimental evidences indicated that, during spoken language comprehension, the brain can immediately integrate visual information with semantic or syntactic information from speech. Here we used the mismatch negativity to further investigate whether prosodic information from speech could be immediately integrated into a visual scene context or not, and especially the time course and automaticity of this integration process. Sixteen Chinese native speakers participated in the study. The materials included Chinese spoken sentences and picture pairs. In the audiovisual situation, relative to the concomitant pictures, the spoken sentence was appropriately accented in the standard stimuli, but inappropriately accented in the two kinds of deviant stimuli. In the purely auditory situation, the speech sentences were presented without pictures. It was found that the deviants evoked mismatch responses in both audiovisual and purely auditory situations; the mismatch negativity in the purely auditory situation peaked at the same time as, but was weaker than that evoked by the same deviant speech sounds in the audiovisual situation. This pattern of results suggested immediate integration of prosodic information from speech and visual information from pictures in the absence of focused attention. (C) 2009 IBRO. Published by Elsevier Ltd. All rights reserved. |
关键词 | event-related potential mismatch negativity accentuation audiovisual integration speech processing |
学科领域 | 心理语言学 |
2009-06-16 | |
语种 | 英语 |
发表期刊 | NEUROSCIENCE |
ISSN | 0306-4522 |
卷号 | 161期号:1页码:59-66 |
期刊论文类型 | Article |
收录类别 | SCI ; SSCI |
WOS记录号 | WOS:000266225900008 |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.psych.ac.cn/handle/311026/5467 |
专题 | 中国科学院心理研究所回溯数据库(1956-2010) |
通讯作者 | Y. YANG |
作者单位 | Chinese Acad Sci, Inst Psychol, State Key Lab Brain & Cognit Sci, Beijing 100101, Peoples R China |
第一作者单位 | 脑与认知科学国家重点实验室 |
推荐引用方式 GB/T 7714 | Li, X.,Yang, Y.,Ren, G.,et al. IMMEDIATE INTEGRATION OF PROSODIC INFORMATION FROM SPEECH AND VISUAL INFORMATION FROM PICTURES IN THE ABSENCE OF FOCUSED ATTENTION: A MISMATCH NEGATIVITY STUDY[J]. NEUROSCIENCE,2009,161(1):59-66. |
APA | Li, X.,Yang, Y.,Ren, G.,&Y. YANG.(2009).IMMEDIATE INTEGRATION OF PROSODIC INFORMATION FROM SPEECH AND VISUAL INFORMATION FROM PICTURES IN THE ABSENCE OF FOCUSED ATTENTION: A MISMATCH NEGATIVITY STUDY.NEUROSCIENCE,161(1),59-66. |
MLA | Li, X.,et al."IMMEDIATE INTEGRATION OF PROSODIC INFORMATION FROM SPEECH AND VISUAL INFORMATION FROM PICTURES IN THE ABSENCE OF FOCUSED ATTENTION: A MISMATCH NEGATIVITY STUDY".NEUROSCIENCE 161.1(2009):59-66. |
条目包含的文件 | ||||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Li-2009-IMMEDIATE IN(681KB) | 开放获取 | -- | 浏览 下载 |
个性服务 |
推荐该条目 |
保存到收藏夹 |
查看访问统计 |
导出为Endnote文件 |
谷歌学术 |
谷歌学术中相似的文章 |
[Li, X.]的文章 |
[Yang, Y.]的文章 |
[Ren, G.]的文章 |
百度学术 |
百度学术中相似的文章 |
[Li, X.]的文章 |
[Yang, Y.]的文章 |
[Ren, G.]的文章 |
必应学术 |
必应学术中相似的文章 |
[Li, X.]的文章 |
[Yang, Y.]的文章 |
[Ren, G.]的文章 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论