Comparing the Effectiveness of Multimodal vs Monomodal Digital Flashcards for L2 Vocabulary Learning

Joshua Hicks, Rina Marnita, Oktavianus Oktavianus

Abstract


This applied psycholinguistics study explores whether multimodal flashcards (containing text, audio, and a picture) are more effective than monomodal flashcards (containing text only) as a tool for learning the meanings of novel second-language (L2) concrete nouns. A flashcard application that utilizes active recall testing and spaced repetition – Anki – was used as a research instrument. A within-subject design was used: Each participant (n = 25) studied a total of 30 L2-L1 (Esperanto–Indonesian) word pairs over the course of 7 study sessions using an assortment of 15 multimodal and 15 monomodal flashcards, with each word pair being presented multimodally to approximately half of participants and monomodally to the other half. When (re)viewing the answer side of a card, participants were instructed to tap ‘Good’ if they recalled the answer correctly or ‘Again’ if not. Recall accuracy data for the two card types was collected and then analysed using a paired t-test, the results of which indicated that the number of user-initiated reviews (‘Again’ count, which is indicative of the number of memory lapses) was significantly higher for monomodal flashcards (M = 83.2 ,SD = 61.3) than for multimodal flashcards (M = 58.8 ,SD = 32.1), t(24) = 3.4, p = .001. These results support the hypothesis that multimodal flashcards are more effective than monomodal flashcards as a tool for learning the meanings of L2 concrete nouns. By implication, language learners can enhance their recall accuracy of L2 concrete nouns by creating and using flashcards that include multiple semantically congruent modes.

Keywords


multimodal; multisensory; dual-encoding; recall; vocabulary

Full Text:

PDF

References


Bakla, A., & Çekiç, A. (2017). Using an Online Vocabulary Memorization Tool versus Traditional Vocabulary Exercises. Ana Dili Eğitimi Dergisi [Journal of Mother Tongue Education], 5(4), 948–966.

Carpenter, S. K., & Olson, K. M. (2012). Are pictures good for learning new vocabulary in a foreign language? Only if you think they are not. Journal of Experimental Psychology: Learning, Memory, and Cognition, 38(1), 92–101. https://doi.org/10.1037/a0024828

Carreker, S., & Birsh, J. R. (2018). Multisensory teaching of basic language skills activity book (Fourth edition). Paul H. Brookes Publishing Co. https://eric.ed.gov/?id=ED529098

Clark, J. M., & Paivio, A. (1987). A Dual Coding Perspective on Encoding Processes. In M. A. McDaniel & M. Pressley (Eds.), Imagery and Related Mnemonic Processes (pp. 5–33). Springer New York. https://doi.org/10.1007/978-1-4612-4676-3_1

Clark, J. M., & Paivio, A. (1991). Dual coding theory and education. Educational Psychology Review, 3(3), 149–210. https://doi.org/10.1007/BF01320076

Jaya, E. (2016). Using Anki (A computer-based flashcard program) in improving vocabulary in the second grade students of SMP Negeri 6 Makassar. https://doi.org/10.13140/RG.2.2.10837.47844

Karpicke, J. D., & Bauernschmidt, A. (2011). Spaced retrieval: Absolute spacing enhances learning regardless of relative spacing. Journal of Experimental Psychology: Learning, Memory, and Cognition, 37(5), 1250–1257. https://doi.org/10.1037/a0023436

Li, W., Yu, J., Zhang, Z., & Liu, X. (2022). Dual Coding or Cognitive Load? Exploring the Effect of Multimodal Input on English as a Foreign Language Learners’ Vocabulary Learning. Frontiers in Psychology, 13, 834706. https://doi.org/10.3389/fpsyg.2022.834706

Lin, C.-C., & Yu, Y.-C. (2017). Effects of presentation modes on mobile-assisted vocabulary learning and cognitive load. Interactive Learning Environments, 25(4), 528–542. https://doi.org/10.1080/10494820.2016.1155160

Magrassi, L., Aromataris, G., Cabrini, A., Annovazzi-Lodi, V., & Moro, A. (2015). Sound representation in higher language areas during language generation. Proceedings of the National Academy of Sciences of the United States of America, 112(6), 1868–1873. https://doi.org/10.1073/pnas.1418162112

Mayer, R. E. (2002). Cognitive Theory and the Design of Multimedia Instruction: An Example of the Two-Way Street Between Cognition and Instruction. New Directions for Teaching and Learning, 2002(89), 55–71. https://doi.org/10.1002/tl.47

Moran, Z. D., Bachman, P., Pham, P., Hah Cho, S., Cannon, T. D., & Shams, L. (2013). Multisensory Encoding Improves Auditory Recognition. Multisensory Research, 26(6), 581–592. https://doi.org/10.1163/22134808-00002436

Mujahidah, Hasanah, N., Yusuf, M., Zulfah, & Fatmasyamsinar, A. A. (2024). The Implementation of Ankiapp to Improve Students’ Vocabulary Mastery. SALTeL Journal (Southeast Asia Language Teaching and Learning), 7(1), Article 1. https://doi.org/10.35307/saltel.v7i1.115

Nakata, T. (2020). Learning Words With Flash Cards and Word Cards. In S. Webb (Ed.), The Routledge handbook of vocabulary studies (pp. 304–319). Routledge.

Nation, I. S. P. (2013). Learning Vocabulary in Another Language (2nd ed.). Cambridge University Press. https://doi.org/10.1017/CBO9781139858656

Nguyen, B.-P. T. (2021). Mobile-Assisted Vocabulary Learning: A Review of Anki. I-Manager’s Journal of Educational Technology, 18(3), 16–21. https://doi.org/10.26634/jet.18.3.17917

Okray, Z., Jacob, P. F., Stern, C., Desmond, K., Otto, N., Talbot, C. B., Vargas-Gutierrez, P., & Waddell, S. (2023). Multisensory learning binds neurons into a cross-modal memory engram. Nature, 617(7962), Article 7962. https://doi.org/10.1038/s41586-023-06013-8

Paivio, A. (1986). Mental representations: A dual coding approach. Oxford University Press ; Clarendon Press.

Paivio, A., & Csapo, K. (1973). Picture superiority in free recall: Imagery or dual coding? Cognitive Psychology, 5(2), 176–206. https://doi.org/10.1016/0010-0285(73)90032-7

Paivio, A., & Desrochers, A. (1980). A dual-coding approach to bilingual memory. Canadian Journal of Psychology / Revue Canadienne de Psychologie, 34(4), 388–399. https://doi.org/10.1037/h0081101

Paivio, A., & Lambert, W. (1981). Dual coding and bilingual memory. Journal of Verbal Learning and Verbal Behavior, 20(5), 532–539. https://doi.org/10.1016/S0022-5371(81)90156-0

Refold. (n.d.). Basic Anki Setup. Retrieved 22 April 2023, from https://refold.la/roadmap/stage-1/a/anki-setup

Shams, L., & Seitz, A. R. (2008). Benefits of multisensory learning. Trends in Cognitive Sciences, 12(11), 411–417. https://doi.org/10.1016/j.tics.2008.07.006




DOI: https://doi.org/https://doi.org/10.24815/siele.v12i3.39630

Article Metrics

Abstract view : 0 times
PDF - 0 times

Refbacks

  • There are currently no refbacks.


Print ISSN: 2355-2794, Online ISSN: 2461-0275

This work is licensed under a Creative Commons Attribution 4.0 International License.


View Journal Stats