Experiences of ESL students and instructors using Grammarly in academic writing

Yueh Yea Lo

Abstract


Incorporating artificial intelligence writing assistants (AIWAs) into academic writing provides opportunities to improve higher educational formative assessment. The current study seeks to examine the effectiveness of Grammarly, an AI writing assistant (AIWA), in providing instantaneous and personalised feedback to English as a second language (ESL) graduate students. The data were collected through semi-structured interviews and focus group discussions with 30 graduate students and five writing instructors with more than three years of teaching experience in graduate writing at a Malaysian public university. The results demonstrated that Grammarly enhanced student motivation, engagement, and writing proficiency through constant and detailed feedback compared to conventional approaches with time constraints and high subjectivity. However, the findings also highlighted limitations in the variety of feedback provided by Grammarly particularly in addressing nuanced academic writing needs and tailoring suggestions for complex content. Furthermore, Grammarly can support self-regulated learning while decreasing writing anxiety. This finding contributes to the ongoing discourse on AI incorporation in education and employing a balanced method in incorporating AI feedback with human oversights. This limitation underscores the importance of using Grammarly as a complementary tool rather than a standalone solution. Summarily, incorporating AIWAs responsibly can assist in providing a more conducive learning context for students future academic and professional endeavours.

Keywords


Academic writing; artificial intelligence writing assistants (AIWAs); ESL learners; formative assessment; higher education

Full Text:

PDF

References


Adhami, N., & Taghizadeh, M. (2024). Integrating inquiry-based learning and computer supported collaborative learning into flipped classroom: Effects on academic writing performance and perceptions of students of railway engineering. Computer Assisted Language Learning, 37(3), 521-557. https://doi.org/10.1080/09588221.2022.2046107

Akgun, S., & Greenhow, C. (2022). Artificial intelligence in education: Addressing ethical challenges in K-12 settings. AI and Ethics, 2(3), 431-440. https://doi.org/10.1007/s43681-021-00096-7

Alharbi, W. (2023). AI in the foreign language classroom: A pedagogical overview of automated writing assistance tools. Education Research International, 1-15. https://doi.org/10.1155/2023/4253331

Almulla, M. A. (2024). Investigating Influencing Factors of Learning Satisfaction in AI ChatGPT for Research: University Students Perspective. Heliyon, 1-18. https://doi.org/10.1016/j.heliyon.2024.e32220

Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77-101. https://doi.org/10.1191/1478088706qp063oa

Calma, A., Cotronei-Baird, V., & Chia, A. (2022). Grammarly: An instructional intervention for writing enhancement in management education. The International Journal of Management Education, 20(3), 1-13. https://doi.org/10.1016/j.ijme.2022.100704

Chang, D. H., Lin, M. P. C., Hajian, S., & Wang, Q. Q. (2023). Educational design principles of using AI chatbot that supports self-regulated learning in education: Goal setting, feedback, and personalization. Sustainability, 15(17), 1-15. https://doi.org/10.3390/su151712921

Chaudhry, M. A., & Kazim, E. (2022). Artificial Intelligence in Education (AIEd): A high-level academic and industry note 2021. AI and Ethics, 2(1), 157-165. https://doi.org/10.1007/s43681-021-00074-z

Darvishi, A., Khosravi, H., Sadiq, S., Gašević, D., & Siemens, G. (2024). Impact of AI assistance on student agency. Computers & Education, 210, 1-18. https://doi.org/10.1016/j.compedu.2023.104967

Fathi, J., & Rahimi, M. (2024). Utilising artificial intelligence-enhanced writing mediation to develop academic writing skills in EFL learners: a qualitative study. Computer Assisted Language Learning, 1-40. https://doi.org/10.1080/09588221.2024.2374772

Gebremariam, H. T., & Asgede, D. M. (2023). Effects of students’ self-reflection on improving essay writing achievement among Ethiopian undergraduate students: A counterbalanced design. Asian-Pacific Journal of Second and Foreign Language Education, 8(1), 1-21. https://doi.org/10.1186/s40862-023-00203-7

González-Calatayud, V., Prendes-Espinosa, P., & Roig-Vila, R. (2021). Artificial intelligence for student assessment: A systematic review. Applied sciences, 11(12), 1-15. https://doi.org/10.3390/app11125467

Graham, S. (2018). A revised writer (s)-within-community model of writing. Educational Psychologist, 53(4), 258-279. https://doi.org/10.1080/00461520.2018.1481406

Graham, S., Collins, A. A., & Ciullo, S. (2024). Evidence-based recommendations for teaching writing. Education 3-13, 1-14. https://doi.org/10.1080/03004279.2024.2357893

Gui, M., Gerosa, T., Argentin, G., & Losi, L. (2023). Mobile media education as a tool to reduce problematic smartphone use: Results of a randomised impact evaluation. Computers & Education, 194, 1-14. https://doi.org/10.1016/j.compedu.2022.104705

Guo, K., Pan, M., Li, Y., & Lai, C. (2024). Effects of an AI-supported approach to peer feedback on university EFL students' feedback quality and writing ability. The Internet and Higher Education, 63, 1-15. https://doi.org/10.1016/j.iheduc.2024.100962

Imran, M., & Almusharraf, N. (2023). Analyzing the role of ChatGPT as a writing assistant at higher education level: A systematic review of the literature. Contemporary Educational Technology, 15(4), 1-14. https://doi.org/10.30935/cedtech/13605

Jónsdóttir, A. A., Kang, Z., Sun, T., Mandal, S., & Kim, J. E. (2023). The effects of language barriers and time constraints on online learning performance: An eye-tracking study. Human Factors, 65(5), 779-791. https://doi.org/10.1177/00187208211010949

Kamalov, F., Santandreu Calonge, D., & Gurrib, I. (2023). New era of artificial intelligence in education: Towards a sustainable multifaceted revolution. Sustainability, 15(16), 1-27. https://doi.org/10.3390/su151612451

Law, L. (2024). Application of generative artificial intelligence (GenAI) in language teaching and learning: A scoping literature review. Computers and Education Open, 6, 1-13. https://doi.org/10.1016/j.caeo.2024.100174

Lee, I., & Yuan, R. E. (2021). Understanding L2 writing teacher expertise. Journal of Second Language Writing, 52, 1-12. https://doi.org/10.1016/j.jslw.2020.100755

Leenknecht, M., Wijnia, L., Köhlen, M., Fryer, L., Rikers, R., & Loyens, S. (2021). Formative assessment as practice: The role of students’ motivation. Assessment & Evaluation in Higher Education, 46(2), 236-255. https://doi.org/10.1080/02602938.2020.1765228

Lo, Y. Y. (2023). Academic writing for non-native speakers. Malaysia: Universiti Malaya Press

Lu, Q., Yao, Y., & Zhu, X. (2024). The Effects of Writing Revisions on Writing Improvement Among Undergraduate Students: The Moderating Role of Self-rating Accuracy. The Asia-Pacific Education Researcher, 33(3), 535-544. https://doi.org/10.1007/s40299-023-00749-7

Maphoto, K. B., Sevnarayan, K., Mohale, N. E., Suliman, Z., Ntsopi, T. J., & Mokoena, D. (2024). Advancing students' academic excellence in distance education: Exploring the potential of generative AI integration to improve academic writing skills. Open Praxis, 16(2), 142-159. https://doi.org/10.55982/openpraxis.16.2.649

Morris, R., Perry, T., & Wardle, L. (2021). Formative assessment and feedback for learning in higher education: A systematic review. Review of Education, 9(3), 1-26. https://doi.org/10.1002/rev3.3292

Myers, M. C., & Wilson, J. (2023). Evaluating the construct validity of an automated writing evaluation system with a randomization algorithm. International Journal of Artificial Intelligence in Education, 33(3), 609-634. https://doi.org/10.1007/s40593-022-00301-6

Nazari, N., Shabbir, M. S., & Setiawan, R. (2021). Application of Artificial

Intelligence powered digital writing assistant in higher education: randomized controlled trial. Heliyon, 7(5), 1-9. https://doi.org/10.1016/j.heliyon.2021.e07014

Nguyen, A., Hong, Y., Dang, B., & Huang, X. (2024). Human-AI collaboration patterns in AI-assisted academic writing. Studies in Higher Education, 1-18. https://doi.org/10.1080/03075079.2024.2323593

Okai-Ugbaje, S. (2021). Towards a pedagogical and sociotechnical framework for the strategic integration of mobile learning in higher education in low- and middle-income countries. Higher Education Research & Development, 40(3), 581-598.

https://doi.org/10.1080/07294360.2020.1773768

Ou, A. W., Stöhr, C., & Malmström, H. (2024). Academic communication with AI-powered language tools in higher education: From a post-humanist perspective. System, 121, 1-14. https://doi.org/10.1016/j.system.2024.103225

Özer, Ö., & Yükselir, C. (2023). Digital Writing Practices in the Information Age: Possibilities and Implications for English Language Teachers and Learners. In Yangin-Eksi, G., Akayoglu, S., & Anyango, L. (Eds.), New Directions in Technology for Writing Instruction (pp. 211-232). Cham: Springer International Publishing.

Panadero, E., & Lipnevich, A. A. (2022). A review of feedback models and

typologies: Towards an integrative model of feedback elements. Educational Research Review, 35, 1-22. https://doi.org/10.1016/j.edurev.2021.100416

Phyo, W. M., Nikolov, M., & Hódi, Á. (2023). How international doctoral students’ fields of study, proficiency in English and gender interact with their sense of making progress in English academic writing abilities. Plos one, 18(12), 1-20. https://doi.org/10.1371/journal.pone.0296186

Punar Özçelik, N., & Yangın Ekşi, G. (2024). Cultivating writing skills: the role of ChatGPT as a learning assistant—a case study. Smart Learning Environments, 11(10), 1-18. https://doi.org/10.1186/s40561-024-00296-8

Qashou, A. (2021). Influencing factors in M-learning adoption in higher education. Education and information technologies, 26(2), 1755-1785. https://doi.org/10.1007/s10639-020-10323-z

Rad, H. S., Alipour, R., & Jafarpour, A. (2023). Using artificial intelligence to foster students’ writing feedback literacy, engagement, and outcome: A case of Wordtune application. Interactive Learning Environments, 1-21. https://doi.org/10.1080/10494820.2023.2208170

Rahmi, R., Amalina, Z., Andriansyah, A., & Rodgers, A. (2024). Does it really help? Exploring the impact of Al-Generated writing assistant on the students’ English writing. Studies in English Language and Education, 11(2), 998-1012. https://doi.org/10.24815/siele.v11i2.35875

Runge, I., Lazarides, R., Rubach, C., Richter, D., & Scheiter, K. (2023). Teacher-reported instructional quality in the context of technology-enhanced teaching: The role of teachers’ digital competence-related beliefs in empowering learners. Computers & Education, 198, 1-13. https://doi.org/10.1016/j.compedu.2023.104761

Şahan, Ö., & Sahan, K. (2023). A narrative inquiry into the emotional effects of English medium instruction, language learning, and career opportunities. Linguistics and Education, 75, 1-10. https://doi.org/10.1016/j.linged.2023.101149

Shen, C., Shi, P., Guo, J., Xu, S., & Tian, J. (2023). From process to product: writing engagement and performance of EFL learners under computer-generated feedback instruction. Frontiers in Psychology, 14, 1-13. https://doi.org/10.3389/fpsyg.2023.1258286

Sherafati, N., & Mahmoudi Largani, F. (2023). The potentiality of computer-based feedback in fostering EFL learners’ writing performance, self-regulation ability, and self-efficacy beliefs. Journal of Computers in Education, 10(1), 27-55. https://doi.org/10.1007/s40692-022-00221-3

Tang, L., Shen, K., Le, H., Shen, Y., Tan, S., Zhao, Y., Juelich, T., Li, X., Gasevic, D., & Fan, Y. (2024). Facilitating learners' self‐assessment during formative writing tasks using writing analytics toolkit. Journal of Computer Assisted Learning, 1-18. https://doi.org/10.1111/jcal.13036

Wei, P., Wang, X., & Dong, H. (2023). The impact of automated writing evaluation on second language writing skills of Chinese EFL learners: A randomized controlled trial. Frontiers in Psychology, 14, 1-11. https://doi.org/10.3389/fpsyg.2023.1249991

Wei, X., Chu, X., Geng, J., Wang, Y., Wang, P., Wang, H., Wang, C., & Lei, L. (2024). Societal impacts of chatbot and mitigation strategies for negative impacts: A large-scale qualitative survey of ChatGPT users. Technology in Society, 77, 1-16. https://doi.org/10.1016/j.techsoc.2024.102566

Yang, L. F., & Zhang, L. J. (2023). Self-regulation and student engagement with feedback: The case of Chinese EFL student writers. Journal of English for Academic Purposes, 63, 1-14. https://doi.org/10.1016/j.jeap.2023.101226

Yu, S., & Lu, Y. (2021). An introduction to artificial intelligence in education. Singapore: Springer.

Zhai, X., Chu, X., Chai, C. S., Jong, M. S. Y., Istenic, A., Spector, M., Liu, B. J., & Li, Y. (2021). A Review of Artificial Intelligence (AI) in Education from 2010 to 2020. Complexity, 1-18. https://doi.org/10.1155/2021/8812542

Zou, D., Xie, H., & Wang, F. L. (2023). Effects of technology enhanced peer, teacher and self-feedback on students’ collaborative writing, critical thinking tendency and engagement in learning. Journal of Computing in Higher Education, 35(1), 166-185. https://doi.org/10.1007/s12528-022-09337-y




DOI: https://doi.org/10.24815/siele.v12i3.40518

Article Metrics

Abstract view : 0 times
PDF - 0 times

Refbacks

  • There are currently no refbacks.


Print ISSN: 2355-2794, Online ISSN: 2461-0275

This work is licensed under a Creative Commons Attribution 4.0 International License.


View Journal Stats