Utilizing Augmented Reality (AR) Technology to Enhance Medical English Multimodal Literacy

Erikson Saragih, Mahriyuni Mahriyuni

Abstract


Previous studies have proved that augmented reality (AR) technology can effectively improve conventional literacy in general language learning since the paradigm for teaching reading has changed from the use of one mode of literacy to multimodal literacy. Although some research on literacy has been carried out before, specific research exploring the application of AR to enhance multimodal literacy in ESP learning, especially in English for Nurse courses has never been conducted. This study investigated how nursing students interact with others utilizing AR technology using several multimodal modes to increase their medical English multimodal literacy and the effect of AR on their multimodal literacy in ESP learning. With this multimodal ESP learning survey, fifty nursing students taking English for nursing courses participated in the study to reveal their experiences to enhance their medical English literacy through AR Technology. The findings showed that nursing students used 3 modes in AR (visual, imaging, and animations. The three modes were used to help viewers comprehend complex material, give them specific ideas, and encourage participation. Moreover, nursing students also utilized musical backgrounds and sound effects to elicit strong emotions and improve immersive experiences. The outcomes also showed a significant improvement in nursing students' multimodal English literacy skills when the material was created for a location-based AR application using a variety of multimodal media.

Keywords


Augmented reality; medical English; multimodal literacy; nursing students

Full Text:

PDF

References


Akçayır, M., & Akçayır, G. (2017). Advantages and challenges associated with augmented reality for education: A systematic review of the literature. Educational Research Review, 20(1), 1–11. https://doi.org/10.1016/j.edurev.2016.11.002

Alalwan, N., Cheng, L., Al-Samarraie, H., Yousef, R., Ibrahim Alzahrani, A., & Sarsam, S. M. (2020). Challenges and prospects of virtual reality and augmented reality utilization among primary school teachers: A developing country perspective. Studies in Educational Evaluation, 66(March), 100876. https://doi.org/10.1016/j.stueduc.2020.100876

Ariano, R., Manca, M., Paternò, F., & Santoro, C. (2023). Smartphone-based augmented reality for end-user creation of home automation. Behavior and Information Technology, 42(1), 124–140. https://doi.org/10.1080/0144929X.2021.2017482

Billinghurst, M., & Dunser, A. (2012). Augmented reality in the classroom. Computer, 45(7), 56–63. https://doi.org/10.1109/MC.2012.111

Challenor, J., & Ma, M. (2019). A review of augmented reality applications for history education and heritage visualization. Multimodal Technologies and Interaction, 3(2), 39. https://doi.org/10.3390/mti3020039

Che-Dalim, C. S., Sunar, M. S., Dey, A., & Billinghurst, M. (2020). Using augmented reality with speech input for non-native children’s language learning. International Journal of Human-Computer Studies, 134, 44–64. https://doi.org/10.1016/j.ijhcs.2019.10.002

Chen, M. P., Wang, L. C., Zou, D., Lin, S. Y., Xie, H., & Tsai, C. C. (2022). Effects of captions and English proficiency on learning effectiveness, motivation and attitude in augmented-reality-enhanced theme-based contextualized EFL learning. Computer Assisted Language Learning, 35(3), 381–411. https://doi.org/10.1080/09588221.2019.1704787

Chen, X., Zou, D., Cheng, G., & Xie, H. (2020). Detecting latent topics and trends in educational technologies over four decades using structural topic modeling: A retrospective of all volumes of Computers & Education. Computers and Education, 151(February), 103855. https://doi.org/10.1016/j.compedu.2020.103855

Cheng, Y. W., Wang, Y., Cheng, I. L., & Chen, N. S. (2019). An in-depth analysis of the interaction transitions in a collaborative Augmented Reality-based mathematic game. Interactive Learning Environments, 27(5–6), 782–796. https://doi.org/10.1080/10494820.2019.1610448

Crompton, H., Bernacki, M., & Greene, J. A. (2020). Psychological foundations of emerging technologies for teaching and learning in higher education. Current Opinion in Psychology, 36, 101–105. https://doi.org/10.1016/j.copsyc.2020.04.011

Davis, N. L., Gough, M., & Taylor, L. L. (2019). Online teaching: Advantages, obstacles, and tools for getting it right. Journal of Teaching in Travel and Tourism, 19(3), 256–263. https://doi.org/10.1080/15313220.2019.1612313

Elmqaddem, N. (2019). Augmented reality and virtual reality in education: Myth or reality? International Journal of Emerging Technologies in Learning, 14(3), 234–242. https://doi.org/10.3991/ijet.v14i03.9289

Finch, K., Theakston, A., & Serratrice, L. (2020). Teaching modern foreign languages in multilingual classrooms: An examination of Key Stage 2 teachers’ experiences. Language Learning Journal, 48(5), 628–642. https://doi.org/10.1080/09571736.2018.1448432

Garzón, J. (2021). An overview of twenty-five years of augmented reality in education. Multimodal Technologies and Interaction, 5(7), 37. https://doi.org/10.3390/mti5070037

Garzón, J., Kinshuk, Baldiris, S., Gutiérrez, J., & Pavón, J. (2020). How do pedagogical approaches affect the impact of augmented reality on education? A meta-analysis and research synthesis. Educational Research Review, 31(2), 100334. https://doi.org/10.1016/j.edurev.2020.100334

Larchen-Costuchen, A., Darling, S., & Uytman, C. (2021). Augmented reality and visuospatial bootstrapping for second-language vocabulary recall. Innovation in Language Learning and Teaching, 15(4), 352–363. https://doi.org/10.1080/17501229.2020.1806848

Lin, V., Liu, G. Z., & Chen, N. S. (2022). The effects of an augmented-reality ubiquitous writing application: A comparative pilot project for enhancing EFL writing instruction. Computer Assisted Language Learning, 35(5–6), 989–1030. https://doi.org/10.1080/09588221.2020.1770291

López-Belmonte, J., Moreno-Guerrero, A. J., López-Núñez, J. A., & Hinojo-Lucena, F. J. (2020). Augmented reality in education. A scientific mapping in Web of Science. Interactive Learning Environments, 31(4), 1860-1874. https://doi.org/10.1080/10494820.2020.1859546

Parmaxi, A., & Demetriou, A. A. (2020). Augmented reality in language learning: A state-of-the-art review of 2014–2019. Journal of Computer Assisted Learning, 36(6), 861–875. https://doi.org/10.1111/jcal.12486

Wedyan, M., Falah, J., Elshaweesh, O., Alfalah, S. F. M., & Alazab, M. (2022). Augmented reality-based English language learning: Importance and state of the art. Electronics (Switzerland), 11(17), 2692. https://doi.org/10.3390/electronics11172692

Wu, H. K., Lee, S. W. Y., Chang, H. Y., & Liang, J. C. (2013). Current status, opportunities, and challenges of augmented reality in education. Computers and Education, 62, 41–49. https://doi.org/10.1016/j.compedu.2012.10.024

Yang, S., & Mei, B. (2018). Understanding learners’ use of augmented reality in language learning: insights from a case study. Journal of Education for Teaching, 44(4), 511–513. https://doi.org/10.1080/02607476.2018.1450937


Article Metrics

Abstract view : 0 times
PDF - 0 times

Refbacks

  • There are currently no refbacks.