Image-text interaction: an analysis on multimodal instructional compositions

Abstract:

This study analyzes multimodal instructional compositions from the specific context of distance learning in an attempt to shed light on how the processes of interaction between modes of visual expression and writing are outlined in this context. We applied the perspective of the relations of status and logical semantics developed by Martinec and Salway, as well as the semiotic interactions developed by Roland Barthes. A class of a Language and Literature teaching degree course, distance mode, was chosen as subject of analysis. This class mainly aims to develop oral skills (listening and speaking) and writing aspects related to the studied content. Preliminary results showed that the theory of analysis of these interactions proposed by those authors has much to offer to us, teachers, in the task of helping students to understand how the interactions between semiotic modes are shaped. We also see that the potential of contribution to learning that may be offered by each mode needs to be better understood, so that we can facilitate the process of literacy through the use of multimodal compositions.

Keywords:
Image-text interaction; Logical semantics relations