Abstract: The feasibility and practical application of fulltextualizing towards Multimodal corpus of emotion in speech is explored from the perspective of linguistic semiotics. It is actually an initial methodological application and discussion on both the discipline of linguistic semiotics and further explorations and researchers of the established corpus. With the implication of the interface of semiotics and linguistics, the fulltextualizing perspectives and methods can not only restore the given information, but also dig out new information carried by the transcribed corpus.

Key words: linguistic semiotics, multimodality, corpus of emotion in speech, fulltext

摘要： 在符号学与语言学的交叉学科语言符号学视角下，探讨语言符号学对语料库全文本解读的可行性和实际应用价值，是语言符号学应用广度上一个新尝试，也是对语料库后续价值的进一步挖掘。本文主要从已经建立的语力和韵律关联性多模态语音情感语料库的语言符号学全文本解读分析入手，论证语言符号学视角下多模态语音情感语料库的全文本解读不仅可以还原语料库的原有信息，而且生成新的可用信息，更好地解释语力、韵律和情感的互动关联，同时为语料库的后续研发提供资源基础，从而说明语言符号学这个新兴交叉学科的实际应用价值和对研究空间的拓展功能。

关键词: 语言符号学, 多模态, 语音情感语料库, 全文本