PSYCH OpenIR  > 认知与发展心理学研究室
词汇知识的视听跨通道迁移
其他题名Cross-Modal Transfer of Word Knowledge From Auditory Modality to Visual Modality
刘佳钰
导师李兴珊
2022-06
摘要日常生活中,我们通过听、说、读、写等多个通道使用语言。在每个通道中,词汇知识,也就是词汇所具有的各种属性均会影响词汇加工。例如,相对于不常使用的词,读者对常使用的词识别速度会更快。而词汇知识是如何表征的,以及不同加工通道的词汇知识是否共享均为心理语言学的重要理论问题。值得注意的是,成年人在使用语言的同时仍会不断进行词汇学习。此过程中,新习得的词汇知识能否跨通道迁移,仍是亟待解决的问题。为理解这些问题,本文通过考察词汇知识中词频能否从听觉通道迁移至视觉通道及其具体表现,探讨不同通道词汇知识的共享情况。 研究一中,我们在两个实验中设计训练和测试阶段。训练阶段中通过训练提升关键词的词频,而后在一段时间后进行重叠歧义字符串切分测试,观测训练后词汇的词频变化在视觉通道中的体现。重叠歧义字符串是一种三字组合(如,旁白板),左(旁白)右(白板)两个字均可与中间的字组成双字词,因此它有两种切分形式(旁白-板;旁-白板)。已有研究表明,重叠歧义字符串的切分对词频非常敏感,高频词更容易被切分成词。我们在实验 1 的训练阶段通过听觉呈现关键词,实验 2 的训练阶段通过视觉呈现关键词。在两个实验的测试阶段,实验材料则均通过视觉呈现。我们通过实验 1 考察词频知识是否可以跨通道迁移,通过对比两个实验,比较跨通道迁移的词频效应和通道内训练的词频效应。两个实验结果均显示,在 5 分钟与 7 天后的测试中,经训练的词汇被切分成词的概率显著高于未训练的词。实验结果表明词频知识可以产生视听跨通道迁移,并在一段时间内持续稳定。两个实验的结果对比发现,跨通道迁移的词频效应大小和通道内训练词频效应大小相似。 在研究二中,我们采用眼动跟踪技术,考察词频的跨通道迁移效应在中文阅读过程中的具体表现。在实验 3 的训练阶段中同时设计了听觉训练、视觉训练与无训练三种条件。在测试阶段,被试先后进行两项测试任务:重叠歧义字符串切分与句子阅读。结果显示,切分测试中的训练效应与研究一一致,听觉或视觉训练后的词汇在测试中被切分成词的概率均显著高于未训练的词汇。眼动指标也显示出显著的跨通道和通道内训练效应,即经过视觉或听觉训练后的关键词,在句子阅读中首次注视时间和第一遍阅读时间更短,总阅读时间也更短。这些结果表明,通过听觉通道训练的词频知识能够跨通道迁移,并在阅读任务中表现出词频效应。 综上所述,两个研究发现,通过听觉通道训练获取的词频知识可以跨通道迁移到视觉通道,而且其效应的大小与在视觉通道内训练得到的词频知识相似,这些研究结果表明词频知识在视听不同通道之间存在一定程度上的共享。研究结果支持词频等词汇知识更有可能存储在语言认知模型中的语义层面。本研究对更全面地理解词汇加工的认知机理具有重要的理论意义,能够为词汇识别模型的开发提供重要数据支持。此外,研究还具有重要的实践价值。以后在统计词汇词频时,不仅要考虑书面语言的词频,还要考虑口头语言的词频。
其他摘要In daily life, we use language through multiple modalities, including listening, speaking, reading, and writing. In each modality, lexical knowledge, which means the various words properties can affect lexical processing. For example, frequently used words are processed more quickly than infrequently used words in all modalities. How lexical knowledge is represented and whether lexical knowledge is shared across different modalities are important theoretical questions in psycholinguistics. It is important to note that adults continue to learn lexical knowledge while using language. Whether newly acquired lexical knowledge can be transferred across modalities is still an open question. To explore these issues, we identified the degree of sharing of lexical knowledge across modalities by examining whether word frequency knowledge can be transferred from the auditory modality to the visual modality. In Study 1, we designed training and test sessions within two experiments. In the training session, the word frequency of target words was improved by training, while the overlapping ambiguous string segmentation test was conducted after a period of time to observe the word frequency effects of the trained words in the visual modality. The overlapping ambiguous string is a three-character combination, where both two characters on the left and two characters on the right can form a two-character word (e.g., “旁白板”, in which the left-side word “旁白” means narrator, and the right-side word “白板” means white board), so it has two forms of segmentation. It has been shown that the segmentation of overlapping ambiguous strings is sensitive to word frequency, and high-frequency words are more likely to be segmented. We presented target words in auditory modality in the training session of Experiment 1, and in visual modality in the training session of Experiment 2. Target wrods were presented in visual modality in the test session of both experiments. We examined whether word frequency knowledge could be transferred from auditory modality to visual modality in Experiment 1, and compared the word frequency effect of cross-moal transfer with the word frequency effect of within-modality training by comparing the two experiments. The results of both experiments showed that trained words were more likely to be segmented into words than untrained words both in the 5-minute interval test and 7-day interval test. The results suggested that word frequency knowledge can be cross-modal transferred, and the newly acquired word frequency effect is stable over time. Comparing the results of the two experiments showed that the magnitude of word frequency effect for cross-modal transfer were similar to that of within-modality training. In Study 2, we used the eye-tracking technique to examine the specific performance of cross-modal transfer effects of word frequency during Chinese reading. Three conditions, auditory training, visual training and no training, were designed in the training session of Experiment 3. In the test session, participants performed two test tasks successively: overlapping ambiguous string segmentation and sentence reading. The results showed that the training effect in the segmentation test was consistent with Study 1, and the probability of words being segmented into words in the test session was significantly higher for either auditory or visual trained words than for untrained words. Eye-movement results also showed significant cross-modal and within-modality training effects. Target words that were trained in visual or auditory modality had shorter first fixation duration and gaze duration in sentence reading, and shorter total reading time. These results suggested that word frequency knowledge trained through the auditory modality can be transferred into visual modality and exhibit word frequency effects in reading tasks. In summary, two studies showed that word frequency knowledge acquired through training in the auditory modality can be transferred to the visual modality, and the magnitude of the effect is similar to that of word frequency knowledge obtained through training within the visual modality. These results suggested that word frequency knowledge is shared to some extent between visual modality and auditory modality, and supported that lexical knowledge such as word frequency is more likely to be stored at the semantic level in the cognitive models of language. This study has important theoretical implications for a more comprehensive understanding of the cognitive mechanisms of lexical processing, and can provide important support for the development of lexical recognition models. In addition, the study has important practical value, revealing that studies related to statistical lexical word frequency consider word frequencies of written language along with those of spoken language.
关键词中文阅读 词频 词汇学习 跨通道迁移 眼动
学位类型硕士
语种中文
学位名称理学博士
学位专业基础心理学
学位授予单位中国科学院大学
学位授予地点中国科学院心理研究所
文献类型学位论文
条目标识符https://ir.psych.ac.cn/handle/311026/43126
专题认知与发展心理学研究室
推荐引用方式
GB/T 7714
刘佳钰. 词汇知识的视听跨通道迁移[D]. 中国科学院心理研究所. 中国科学院大学,2022.
条目包含的文件
文件名称/大小 文献类型 版本类型 开放类型 使用许可
刘佳钰-硕士论文.pdf(1693KB)学位论文 开放获取CC BY-NC-SA请求全文
个性服务
推荐该条目
保存到收藏夹
查看访问统计
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[刘佳钰]的文章
百度学术
百度学术中相似的文章
[刘佳钰]的文章
必应学术
必应学术中相似的文章
[刘佳钰]的文章
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。