Social Semiotic Multimodal Research: A Meaning-based Approach
Yu Liu
Abstract: Multimodal research has attracted increasing interest and set up dialogues with many different disciplines. Based on social semiotic theories of communication, this research examines multimodal representations in scientific discourse with a meaning-based approach to explore the functional specialization of non-verbal modes such as scientific diagrams, the relationships between different semiotic resources in the same text, and the transformation from one mode to another. The present study also responds to several theoretical and methodological issues made of social semiotic multimodal research and discusses the implications of multimodal studies for teaching and learning science.
Key words: multimodality, social semiotics, meaning, science education
社会符号学视角下的多模态研究：一项基于意义的研究方法
刘宇
摘要：多模态研究已经成为当今人文及社会科学领域中的热点问题，并且同多个学科建立起对话关系。本文从社会符号学的视角出发，采用基于意义的研究方法，对科学语篇中的多模态表征进行系统分析。分析范围包括诸如科学图像等非语言表征的功能特性，同一语篇中不同符号系统之间的关系，以及不同模态之间的转化过程。针对外界对多模态分析的理论和研究方法提出的问题和质疑，本文也将作出回应，并讨论多模态研究给科学教育带来的启示。
关键词：多模态，社会符号学，意义，科学教育
