Multimodal meanings

the typography in picturebooks published on the website Vooks

Authors

DOI:

https://doi.org/10.18309/ranpoll.v55.1826

Keywords:

Multimodality, Typography, Picturebooks

Abstract

Visual compositions have been present in Western society since the beginning of civilization. They evolved due to technological advances and are nowadays more visual than ever with the use of images, colors, layout, and typography. The latter has gained the attention of theorists such as van Leeuwen (2006), Serafini and Clausen (2012) and Silva and Barbosa (2020). Its potential may be seen in picturebooks – a literary and multimodal material widely used in educational contexts (Serafini, 2014). Therefore, this research investigated the semiotic potential of typography in contemporary picturebooks in order to understand the possible meanings of its organization. Five picturebooks from the website Vooks were selected and three parts – the cover, pages of narration, and pages of mental and verbal processes – were analyzed. Then, their typography was described based on the categories proposed by van Leeuwen (2006) and Serafini and Clausen (2012). The results showed that typography has the potential of visually defining which participant is speaking as well as establishing relations with the meaning of the word. For example, the typography of “jumped” was organized as if the letters were jumping themselves. Thus, the emphasis on aspects such as weight, size, and framing may make readers aware that typography can express meanings that go beyond the verbal text.

Downloads

Download data is not yet available.

Author Biographies

Maria Eduarda Sousa Santos, Universidade Federal do Piauí

Maria Eduarda Sousa Santos has a degree in English from the Federal University of Piauí. During her studies, she was part of undergraduate research projects such as ICV (Iniciação Científica Voluntária) and PIBIC (Programa Institucional de Bolsas de Iniciação Científica. She was also a fellow teacher from the Language Without Borders (IsF) program. Currently, she is interested in studies related to Social Semiotics, Multimodality, Multiliteracy, Visual Literacy, Language Acquisition, and Teaching/Learning of Foreign Languages. She is a member of GEMTE, a study group focused on Multimodality, Technologies and Education. 

Vânia Soares Barbosa, Universidade Federal do Piauí

Vânia Soares Barbosa é doutora em Linguística Aplicada pela Universidade Estadual do Ceará (UECE) e realizou estágio de pós-doutorado na Universidade de Birmigham, Inglaterra. Atua como professora Adjunta na Coordenação de Letras Estrangeiras, na Universidade Federal do Piauí. Tem experiência na área de Linguística Aplicada, com ênfase no ensino de língua inglesa e formação de professores, leitura, história da língua inglesa, multimodalidade e multiletramentos. Coordena o Grupo de Estudos em Multimodalidade, Tecnologia e Ensino – GEMTE UFPI. Seus interesses de pesquisa são principalmente: ensino de línguas estrangeiras, análise e produção de materiais didáticos, semiótica social /multimodalidade e tradução intersemiótica. ORCID: https://orcid.org/0000-0002-5816-1064.

References

ADAMI, Elisabetta. Multimodality. In: GARCIA, Ofelia; FLORES, Nelson; SPOTTI, Massimiliano. Oxford handbook of language and society. Oxford: Oxford University Press, 2016. p. 451-472.

ARRUDA, Mariana Oliveira Martins de; SANTOS, Maria Eduarda Sousa; BARBOSA, Vânia Soares. Multimodalidade em livros acadêmico-científicos: o uso de características tipográficas em capas e sumários. Kiri-Kerê - Pesquisa em Ensino, v. 1, n. 8, p. 65-83, aug. 2022. Available from: https://periodicos.ufes.br/kirikere/article/view/37956. Accessed in: 10 sep. 2022.

BARBOSA, Vânia Soares. Multimodalidade e letramento visual: Uma proposta de intervenção pedagógica para integrar as habilidades de ler e ver no processo de ensino e aprendizagem de Inglês como língua estrangeira. 2017. 416 f. Tese (Doutorado em Linguística Aplicada) – Centro de Humanidades, Programa de Pós-Graduação em Linguística Aplicada, Universidade Estadual do Ceará, Fortaleza, 2017.

BRENNAN-NELSON, Denise; WEISER, Florence. Mae the Mayfly. Ann Arbor: Sleeping Bear Press, 2020. Available from: https://watch.vooks.com/videos/mae-the-mayfly. Accessed in: 12 feb. 2022.

BURNETT, Frances Hodgson. The secret garden. New York; Oxford: Oxford University Press, 1993.

CALLOW, Jon; ZAMMIT, Katina. Visual literacy: From picture books to electronic texts. In: MONTEITH, Moira. Teaching primary literacy with ICT. Buckingham; Philadelphia: Open University Press, 2002. p. 188-201.

HALLIDAY, Michael Alexander Kirkwood. An introduction to functional grammar. London: Edward Arnold, 1985.

JEFFERS, Olivers. A child of books. Massachusetts: Candlewick Press, 2016.

KANG; Anna; WEYANT, Christopher. I am (not) scared. San Francisco: Two Lion, 2017. Available from: https://watch.vooks.com/videos/i-am-not-scared. Accessed in: 12 feb. 2022.

KIZER, Katie. Be big: Beatrice’s first day at school. Washington: Storybook Genius, 2018. Available from: https://watch.vooks.com/videos/be-big-beatrices-first-day-of-first-grade. Accessed in: 12 feb. 2022.

KRESS, Gunther. Multimodality: A social semiotic approach to contemporary communication. New York: Routledge, 2010.

KRESS, Gunther; VAN LEEUWEN, Theo. Reading images: The grammar of visual design. 1st ed. London: Routledge, 1996.

KRESS, Gunther; VAN LEEUWEN, Theo. Reading images: The grammar of visual design. London: Routledge, 2006.

KRESS, Gunther; VAN LEEUWEN, Theo. Reading images: The grammar of visual design. 3rd ed. London: Routledge, 2021.

MACHIN, David. Introduction to multimodal analysis. London: Hodder Arnold, 2007.

MACLEAR, Kyo; ARSENAULT, Isabelle. Spork. Toronto: Kids Can Press, 2011. Available from: https://watch.vooks.com/videos/spork. Accessed in: 12 feb. 2022.

SCHWEBS, Ture. Affordances of an App: a reading of The Fantastic Flying Books of Mr. Morris Lessmore. Barnelitterært Forskningstidsskrift, v. 5, n. 1, p. 1-11, mar. 2014. Available from: https://www.idunn.no/doi/10.3402/blft.v5.24169. Accessed in: 29 apr. 2022.

SERAFINI, Frank. Reading the visual: An introduction to teaching multimodal literacy. New York; London: Teachers College Columbia University, 2014.

SERAFINI, Frank; CLAUSEN, Jennifer. Typography as a Semiotic Resource. Journal of Visual Literacy, v. 31, n. 2, p. 1-16, jan. 2012. Available from: https://asu.elsevierpure.com/en/publications/typography-as-semiotic-resource. Accessed in: 02 feb. 2022.

SERAFINI, Frank; KACHORSKY, Dani; AGUILERA, Earl. Picture books in the digital age. The Reading Teacher, v. 69, n. 5, p. 509-512, mar./apr. 2016. Available from: https://ila.onlinelibrary.wiley.com/doi/10.1002/trtr.1452. Accessed in: 19 apr. 2022.

SILVA, Cristiana Barbosa Nunes da; BARBOSA, Vânia Soares. O uso da tipografia nas interfaces de jogos: uma leitura multimodal. Texto Digital, Florianópolis, v. 16, n. 1, p. 266-280, jan./jul. 2020. Available from: https://doi.org/10.5007/1807-9288.2020v16n1p266. Accessed in: 28 apr. 2022.

SIPE, Lawrence. Picturebooks as aesthetic objects. Literacy Teaching and Learning: An International Journal of Early Reading and Writing, v. 6, n. 1, p. 23-42, 2001. Available from: https://www.semanticscholar.org/paper/Picturebooks-as-Aesthetic-Objects-Sipe/18b63cb93fdcba215c5fd6a8474d5a15d7a87faa. Accessed in: 21 apr. 2022.

STAFFORD, Tim. Teaching visual literacy in the primary classroom: Comic books, film, television and picture narratives. London; New York: Routledge, 2011.

SUNDY, Jonathan. Earth Yay. Portland: Vooks Inc, 2021. Available from: https://watch.vooks.com/videos/earth-yay. Accessed in: 12 feb. 2022.

VAN LEEUWEN, Theo. Multimodality. In: SIMPSON, James (ed.). The routledge handbook of applied linguistics. London: Routledge, 2011. p. 668-682.

VAN LEEUWEN, Theo. Towards a semiotic of typography. Information Design Journal, v. 14, n. 2, p. 139-55, jan. 2006. Available from: https://www.jbe-platform.com/content/journals/10.1075/idj.14.2.06lee. Accessed in: 02 feb. 2022.

Published

2024-04-30

How to Cite

Santos, M. E. S., & Soares Barbosa, V. (2024). Multimodal meanings: the typography in picturebooks published on the website Vooks. Revista Da Anpoll, 55, e1826. https://doi.org/10.18309/ranpoll.v55.1826

Issue

Section

Estudos Linguísticos