Abstract
The article analyzes relations between the text and the image as two different semiotic modes in the framework of multimodal studies. Key theoretical approaches to this issue are outlined. Visual and verbal narratives are examined at three levels: ideational, interpersonal and textual. The ideational meaning system comprises actions, characters and circumstances. The interpersonal system covers a wide range of issues connected with interaction between the reader and the characters. The textual meaning is realized by giving prominence to certain objects in the image or the text. Logico-semantic relations of elaboration, enhancement and extension are revealed. Elaboration is characterized by clarification and exemplification, the image may be more general than the text, and vice versa. Enhancement relations include various circumstances (temporal, spatial, causal), besides, both the text and the image may enhance each other. Extension adds new, semantically unrelated information and offers alternative ways of story unfolding. The research is based on contemporary picture books (J. Scieszka, L. Anholt, F. French, R. Munsch) and illustrated fairy tales (E. Delessert, B. Ensor) and directed at revealing various types of text-image relations.
Highlights
One of the recent tendencies in linguistics is the development of multimodal research, aimed at the analysis of various semiotic systems that create meaning
Texts and images were analyzed by separate branches of science with their own approaches and methods of research
Within multimodal studies the text and the image are considered as a combination of interrelated modes
Summary
One of the recent tendencies in linguistics is the development of multimodal research, aimed at the analysis of various semiotic systems that create meaning. Such mediated visual focalization has no verbal correspondence Talking about another component of an interpersonal meaning system – pathos, it has to be mentioned that contemporary fairy tales with illustrations depicted in the minimalist style The story extends and the reader finds out about the stepmother’s arrest, though this information is missing in the text fragment In both of the above-mentioned examples visual fragments extend verbal ones, but in the example the opposite process takes place: But Old Granny Wolf was out chopping wood in the forest The interpersonal meaning system covers a wide range of issues connected with the interaction between the reader and the characters It is visually realized by means of unmediated and mediated focalization, various depiction styles, ambiance and verbally – by verbs of perception, characterization, emotion and evaluative language. Further research of text-image relations may include the comparative analysis of correlations between the text and the image in comics, as well as the multimodal analysis of such transmedial phenomena as digital narratives, computer games, films, cartoons
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Free) 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a call
