Teaching Literacy Skills through Multimodal Texts

Document Type: Original Article


1 Department of Translation Studies, Jahrom University, Jahrom, Fars, Iran

2 Department of Teaching English as a Foreign Language (TEFL), University of Hormozgan, Bandar Abbas, Iran



Multimodal Discourse is a theory of communication in multimedia. The notion of modes refers to semiotic resources which allow the simultaneous realization of discourses and types of (inter)action. Media are the material resources being used for the production such as music, language, and images. This study examined Iranian EFL learners’ perception of multimodal texts. The objective of the study was to examine how Iranian EFL learners utilized their general literacy practices and multimodal repertoires to develop their meaning-making process. The participants were 18 intermediate EFL learners attending Iran Language Institute (ILI), and were exposed to advertisement materials. They were asked to reconstruct their perceptions both visually and verbally. The participants’ responses were analyzed according to the social semiotics model suggested by Kress and van Leeuwen (2001). Results revealed that the participants made contextualized perceptions of the advertisement materials indicating their sociocultural framework. Moreover, applying multimodal knowledge, the students promoted their learning status via transformative self-affected strategies. Multimodal/multiliteracies pedagogy could promote EFL students' critical literacy practices to develop new worldviews and question the imposing discursive moments.


Ajayi, L. (2008). Meaning-making, multimodal representa­tion, and transformative pedagogy: An exploration of meaning construction instructional practices in an ESL high school classroom. Journal of Language, Identity, and Education, 7(3&4), 206-229.
Ajayi, L. (2011). A multiliteracies pedagogy: Exploring semiotic possibilities of a Disney video in a third grade diverse classroom. Issues and Ideas in Public Education, 43(3), 396-413.
Ary, D., Jacobs, L. C., & Razavieh, A. (2002). Introduction to research in Education (6th ed.). Belmont: Wadsworth Group.
Bezemer, J., & Kress, G. (2008). Writing in multimodal texts: A social semiotic account of designs for learning. Written Communication, 25, 166-195.
Bezemer, J., & Kress, G. (2015). Multimodality, learning and communication: A social semiotic frame. Routledge.
Christelle, K. (2012). The translation of advertisements: issues of semiotics, symbolism and persuasion. Retrievedfrom: www.wiredspace.wits.ac.za/handle/10539/12095
Davies, J. (2006). Affinities and beyond! Developing ways of seeing in online spaces. E-Learning, 3(2), 217-234.
Dyson, A.H. (2003). Welcome to the jam: Popular culture, school literacy, and the making of childhoods. Harvard Educational Review, 73(3), 328-361.
Echevarria, J., Vogt, M., & Short, D. (2008). Making content comprehensible for English learners: The SIOPmodel (3rd ed.). Boston: Pearson Education.
Gee, J. P. (2003). What video games have to teach us about learning and literacy. New York: Palgrave Macmillan.
Gorard, S., & Taylor, C. (2004). Combining methods in educational and social research. McGraw-Hill International
Gowda, S. (2011). Advertising and culture. London: Penguin.
Halliday, M.A.K. (1976). Halliday: System and function in language: Selected papers (G.Kress, Ed.). London: Oxford University Press.
Halliday, M.A.K. (1978). Language as social semiotic: The social interpretation of language and meaning. London: University Park Press.
Hammersley, M. (1990). Reading ethnographic research: A critical guide. London: Longman.
Jewitt, C. (2005). Multimodality, reading, and "writing" for the 21st century. Discourse: Studies in the Cultural Politics of Education, 26(3),315-331.
Kao, C. L., Liao, C. Y., & Lan, Y. J. (2017). Listening strategy applications by learners under the context of multimodality. In Advanced Learning Technologies (ICALT), 2017 IEEE 17th International Conference on (pp. 354-356). IEEE.
Kress, G. (2001). You’ve just got to learn how to see: Curriculum subjects, young people and schooled engagement with the world. Linguistics and Education, 11(4),401-415.
Kress, G., & van Leeuwen, T. (1996). Reading images: The grammar of visual design. London: Routledge.
Kress, G., & van Leeuwen, T. (2001). Multimodal discourse: The modes and media of contemporary communication. New York: Oxford University Press.
Kress, G., & van Leeuwen, T. (2006). Reading images: The grammar of visual design. London: Routledge.
Lodico, M. G., Spaulding, D. T., & Voegtle, K. H. (2010). Methods in Educational Research: From Theory to Practice. John Wiley and Sons
Marchetti, E., & Valente, A. (2018). Interactivity and multimodality in language learning: the untapped potential of audiobooks. Universal Access in the Information Society, 17 (2), 257-274.
New London Group. (1996). A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review, 66 (1), 60-92.
O'Halloran, K. (ed.). (2004). Multimodal discourse analysis: Systemic functional perspectives. London and New York: Continuum.
Stein, P. (2004). Representation, rights, and resources: Multimodal pedagogies in the language and literacy classroom. In B. Norton and K. Toohey (Eds.), Critical pedagogies and language learning (pp. 95-115). Cambridge, UK: Cambridge University Press.
van Leeuwen, T. (1999). Speech, music, sound. London: Macmillan.
Van Lier, L. (2004). The ecology and semiotics of language learning: A sociocultural perspective. Norwell, MA: Kluwer Academic.
Willis, A.I., & Harris, V.J. (2000). Political acts: literacy learning and teaching. Reading Research Quarterly, 35(1), 72-89.
Yates, L. (2004). What does good education research look like? Situating a field and its practices. In Lyn Yates (Ed.). Conducting educational research. Maidenhead, Berks, Open University Press
Zander, R. S., & Zander, B. (2000). The art of possibility: Transforming professional and personal life. NY, Penguin.