PSYCH OpenIR  > 认知与发展心理学研究室
Crossmodal Language Comprehension-Psycholinguistic Insights and Computational Approaches
Alacam, O (Alacam, Ozge)1; Li, XS (Li, Xingshan)2; Menzel, W (Menzel, Wolfgang)1; Staron, T (Staron, Tobias)1
First AuthorAlacam, O (Alacam, Ozge)
Correspondent Emailalacam@informatik.uni-hamburg.de ; staron@informatik.uni-hamburg.de
2020-01
Source PublicationFRONTIERS IN NEUROROBOTICS
ISSN1662-5218
SubtypeReview
Volume14Pages:不详
Contribution Rank2
Abstract

Crossmodal interaction in situated language comprehension is important for effective and efficient communication. The relationship between linguistic and visual stimuli provides mutual benefit: While vision contributes, for instance, information to improve language understanding, language in turn plays a role in driving the focus of attention in the visual environment. However, language and vision are two different representational modalities, which accommodate different aspects and granularities of conceptualizations. To integrate them into a single, coherent system solution is still a challenge, which could profit from inspiration by human crossmodal processing. Based on fundamental psycholinguistic insights into the nature of situated language comprehension, we derive a set of performance characteristics facilitating the robustness of language understanding, such as crossmodal reference resolution, attention guidance, or predictive processing. Artificial systems for language comprehension should meet these characteristics in order to be able to perform in a natural and smooth manner. We discuss how empirical findings on the crossmodal support of language comprehension in humans can be applied in computational solutions for situated language comprehension and how they can help to mitigate the shortcomings of current approaches.

Keywordlanguage comprehension crossmodality psycholinguistics incrementality prediction speaker intention
DOI10.3389/fnbot.2020.00002
Indexed BySCIE
Language英语
Citation statistics
Document Type期刊论文
Identifierhttp://ir.psych.ac.cn/handle/311026/31317
Collection认知与发展心理学研究室
Affiliation1.Univ Hamburg, Dept Informat, Nat Language Syst Grp, Hamburg, Germany
2.Chinese Acad Sci, Inst Psychol, Reading & Visual Cognit Lab, Beijing, Peoples R China
Recommended Citation
GB/T 7714
Alacam, O ,Li, XS ,Menzel, W ,et al. Crossmodal Language Comprehension-Psycholinguistic Insights and Computational Approaches[J]. FRONTIERS IN NEUROROBOTICS,2020,14:不详.
APA Alacam, O ,Li, XS ,Menzel, W ,&Staron, T .(2020).Crossmodal Language Comprehension-Psycholinguistic Insights and Computational Approaches.FRONTIERS IN NEUROROBOTICS,14,不详.
MLA Alacam, O ,et al."Crossmodal Language Comprehension-Psycholinguistic Insights and Computational Approaches".FRONTIERS IN NEUROROBOTICS 14(2020):不详.
Files in This Item:
File Name/Size DocType Version Access License
Crossmodal Language (800KB)期刊论文出版稿限制开放CC BY-NC-SAApplication Full Text
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Alacam, O (Alacam, Ozge)]'s Articles
[Li, XS (Li, Xingshan)]'s Articles
[Menzel, W (Menzel, Wolfgang)]'s Articles
Baidu academic
Similar articles in Baidu academic
[Alacam, O (Alacam, Ozge)]'s Articles
[Li, XS (Li, Xingshan)]'s Articles
[Menzel, W (Menzel, Wolfgang)]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Alacam, O (Alacam, Ozge)]'s Articles
[Li, XS (Li, Xingshan)]'s Articles
[Menzel, W (Menzel, Wolfgang)]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.