An online communicative translation assessment model in an Indonesian EFL translation class: Students’ perceptions

Soni Tantan Tandiana, Fuad Abdullah, Dede Anwar, Emmas Maspupah

Abstract


Translation studies have grown enormously in recent decades and have expanded to include the pedagogical lens as a breakthrough. However, little is known about how the students perceive the online communicative translation assessment model (OCTAM). The present study explores how the students perceive the implementation of the online communicative translation assessment model in classrooms. The investigative locus of this study was a class on Translating and Interpreting (TI) at a state university in Tasikmalaya, West Java, Indonesia. Thirteen students from a TI class participated in this study. The data were obtained from semi-structured interviews and analysed using a thematic analysis. The findings revealed that OCTAM provided students with an effective translation assessment model, coped with their limited English vocabulary, guided them to focus on knowledge of form, function, and meaning of both source and target texts, offered them a more contextual translation test, raised their awareness of translating as a meaning-making practice, facilitated them to correct grammatical errors, created a less anxious test atmosphere, and generated their multimodal communicative competence. Pedagogically, this study bridges translation and foreign language education, mainly by examining how an online communicative translation assessment model functions as a cutting-edge translation model to assess students’ translation competence.

Keywords


multimodal communicative competence; online communicative translation assessment model (OCTAM); pedagogical translation studies; thematic analysis; translation competence

Full Text:

PDF

References


Abduh, M. Y. M. (2021). Full-time online assessment during COVID-19 lockdown: EFL teachers’ perceptions. Asian EFL Journal, 28(1), 26-46.

Abdullah, F., Hidayati, A. N., Andriani, A., Silvani, D., Ruslan, R., Tandiana, S. T., & Lisnawati, N. (2022). Fostering students’ multimodal communicative competence through genre-based multimodal text analysis. Studies in English Language and Education Journal, 9(2), 632-650. https://doi.org/10.24815/siele.v9i2.23440

Adami, E., & Pinto, S. R. (2020). Meaning-(re)making in a world of untranslated signs: Towards a research agenda on multimodality, culture, and translation. In M. Boria, Á. Carreres, M. Noriega-Sánchez, & M. Tomalin (Eds.), Translation and multimodality: Beyond words (pp. 71-93). Routledge. https://doi.org/10.4324/9780429341557-4

Al-Hattami, A. A. (2020). E-assessment of students’ performance during the e-teaching and learning. International Journal of Advanced Science and Technology, 29(8), 1537-1547.

Babitha, M., Sushama, C., Gudivada, V. K., Kazi, K. S., & Bandaru, S. R. (2022). Trends of artificial intelligence for online exams in education. International Journal of Early Childhood Special Education, 14(1), 2457-2463.

Bailey, D., & Lee, A. R. (2020). An exploratory study of Grammarly in the language learning context: An analysis of test-based, textbook-based and facebook corpora. TESOL International Journal, 15(2), 4-27.

Baxter, P., & Jack, S. (2008). Qualitative case study methodology: Study design and implementation for novice researchers. The Qualitative Report, 13, 544-559. https://doi.org/10.46743/2160-3715/2008.1573

Beeby, A., Fernández, M., Fox, O., Kozlova, I., Neunzig, W., Presas, M., Rodríguez-Inés, P., Romero, L., & Hurtado Albir, A. (2005). Investigating translation competence: Conceptual and methodological issues. Meta, 50(2), 609-619. https://doi.org/10.7202/011004ar

Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77-101. https://doi.org/10.1191/1478088706qp063oa

Castilho, S., Doherty, S., Gaspari, F., & Moorkens, J. (2018). Approaches to human and machine translation quality assessment. In J. Moorkens, S. Castilho, F. Gaspari, & S. Doherty (Eds.), Translation quality assessment (pp. 9-38). Springer. https://doi.org/10.1007/978-3-319-91241-7_2

Chesnokova, A., Zyngier, S., Viana, V., Jandre, J., Rumbesht, A., & Ribeiro, F. (2017). Cross-cultural reader response to original and translated poetry: An empirical study in four languages. Comparative Literature Studies, 54(4), 824-849. https://doi.org/10.5325/complitstudies.54.4.0824

Chochiang, K., Thongkhamdee, T., & Sathansat, L. (2020). Translation quality assessment of online translation systems in translating English to Thai on Phuket tourism. Journal of Computer Science, 16(11), 1535-1545. https://doi.org/10.3844/jcssp.2020.1535.1545

Dale, R. (2020). Natural language generation: The commercial state of the art in 2020. Natural Language Engineering, 26(4), 481-487. https://doi.org/10.1017/S135132492000025X

Dashtestani, R. (2013). EFL teachers’ and students’ perspectives on the use of electronic dictionaries for learning English. CALL-EJ, 14(2), 51-65.

Dewaele, J. M., Witney, J., Saito, K., & Dewaele, L. (2018). Foreign language enjoyment and anxiety: The effect of teacher and learner variables. Language Teaching Research, 22(6) 676-697. https://doi.org/10.1177/1362168817692161

Doherty, S., Moorkens, J., Gaspari, F., & Castilho, S. (2018). On education and training in translation quality assessment. In J. Moorkens, S. Castilho, F. Gaspari, & S. Doherty (Eds.), Translation quality assessment: From principles to practice (pp. 95-106). Springer. https://doi.org/10.1007/978-3-319-91241-7_5

Ellis, R. (2016). Focus on form: A critical review. Language Teaching Research, 20(3), 405-428. https://doi.org/10.1177/1362168816628627

Ellis, R. (2024). Rod Ellis’s essential bookshelf: Focus on form. Language Teaching, 57(2), 246-261. https://doi.org/10.1017/S026144482200012X

Fitria, T. N. (2021). QuillBot as an online tool: Students’ alternative in paraphrasing and rewriting of English writing. Englisia: Journal of Language, Education, and Humanities, 9(1), 183-196. http://dx.doi.org/10.22373/ej.v9i1.10233

Halliday, M. A. K., & Hasan, R. (1989). Language, context, and text: Aspects of language in a social-semiotic perspective. Oxford University Press.

Halliday, M. A. K., & Martin, J. R. (1993). Writing science: Literacy and discursive power. Routledge.

Halliday, M. A. K., & Matthiessen, C. M. I. M. (2014). Halliday’s introduction to functional grammar (4th ed.). Routledge.

Han, L., Jones, G. J., & Smeaton, A. F. (2021). Translation quality assessment: A brief survey on manual and automatic methods. In Y. Bizzoni, E. Teich, C. España-Bonet, & J. van Genabith (Eds.), Proceedings for the First Workshop on Modelling Translation: Translatology in the Digital Age (pp. 15-33). Association for Computational Linguistics. https://aclanthology.org/2021.motra-1.3/

Hatim, B., & Mason, I. (1993). Discourse and the translator (4th ed.). Longman.

Hatim, B., & Mason, I. (1997). The translator as communicator. Routledge.

Hendy, A., Abdelrehim, M., Sharaf, A., Raunak, V., Gabr, M., Matsushita, H., Kim, J. Y., Afify, M., & Awadalla, H. H. (2023). How good are GPT models at machine translation? A comprehensive evaluation. arXiv. http://dx.doi.org/10.48550/arXiv.2302.09210

Hidayat, A., & Helmanto, F. (2023). Translation teaching model in offline, online, and hybrid mode. Journal of English Teaching, 9(1), 44-56. https://doi.org/10.33541/jet.v9i1.4448

Hidayati, A. N., Abdullah, F., Andriani, A., Rosmala, D., & Nurvianti, N. (2022). English speaking anxiety among Indonesian junior high school learners: In search of causes and solutions. Getsempena English Education Journal, 9(1), 53-63. https://doi.org/10.46244/geej.v9i1.1746

Holliday, A. (1999). Small cultures. Applied linguistics, 20(2), 237-264. https://doi.org/10.1093/applin/20.2.237

Horwitz, E. K. (1986). Preliminary evidence for the reliability and validity of a foreign language anxiety scale. TESOL Quarterly, 20(3), 559-564. https://doi.org/10.2307/3586302

Hoshi, M. (2002). Practices, beliefs and perceptions of Japanese EFL self-access learners toward Internet-based language learning. CALL-EJ Online, 4(1), 1-13.

House, J. (1997). Translation quality assessment: A model revisited. Gunter Narr Verlag Publisher.

House, J. (2001). Translation quality assessment: Linguistic description versus social evaluation. Meta, 46(2), 243-257. https://doi.org/10.7202/003141ar

House, J. (2006). Text and context in translation. Journal of Pragmatics, 38(3), 338-358. https://doi.org/10.1016/j.pragma.2005.06.021

House, J. (2015). Translation quality assessment: past and present. In J. House (Ed.), Translation: A multidisciplinary approach (pp. 241-276). Palgrave Macmillan. https://doi.org/10.1057/9781137025487_13

Hurtado Albir, A., & Taylor, P. (2015). The acquisition of translation competence: Competences, tasks, and assessment in translator training. Meta, 60(2), 256-280. https://doi.org/10.7202/1032857ar

Javier, D. R. (2022). App review using tech tools for academic writing: “Grammarly” as a Pedagogical Tool. MEXTESOL Journal, 46(2), 1-3.

Jewitt, C., & Kress, G. (2003). Multimodal literacy. Peter Lang.

Joshi, A., Virk, A., Saiyad, S., Mahajan, R., & Singh, T. (2020). Online assessment: Concept and applications. Journal of Research in Medical Education & Ethics, 10(2), 79-89. http://dx.doi.org/10.5958/2231-6728.2020.00015.3

Kastberg, P., & Anderson, T. B. (2012). Machine translation tools - Tools of the translator’s trade. Communication & Language at Work, 1(1), 34-45. http://dx.doi.org/10.7146/claw.v1i1.7238

Kelly, D. (2014). A handbook for translator trainers. Routlegde.

Kress, G., & van Leeuwen, T. (2006). Reading images: The grammar of visual design (2nd ed.). Routledge.

Krüger, R. (2022). Using Jupyter notebooks as didactic instruments in translation technology teaching. The Interpreter and Translator Trainer, 16(4), 503-523. https://doi.org/10.1080/1750399X.2021.2004009

Lagarda, A. L., Ortiz-Martínez, D., Alabau, V., & Casacuberta, F. (2015). Translating without in-domain corpus: Machine translation post-editing with online learning techniques. Computer Speech & Language, 32(1), 109-134. https://doi.org/10.1016/j.csl.2014.10.004

Lee, S. M. (2020). The impact of using machine translation on EFL students’ writing. Computer Assisted Language Learning, 33(3), 157-175. https://doi.org/10.1080/09588221.2018.1553186

Liu, K., & Cheung, A. K. (2023). Translation and interpreting in the age of COVID-19: Challenges and opportunities. In K. Liu & A. K. F. Cheung (Eds.), Translation and interpreting in the age of COVID-19 (pp. 1-10). Springer. https://doi.org/10.1007/978-981-19-6680-4_1

Long, M. (1997). Focus on form in task-based teaching. McGraw Hill.

Mannahali, M., Rijal, S., & Yusri. (2020). Communicative translation method in increasing students’ performance in translation class. The Asian ESP Journal, 16(4), 259-270.

Mauser, A., Hasan, S., & Ney, H. (2008). Automatic evaluation measures for statistical machine translation system optimization. In N. Calzolari, K. Choukri, B. Maegaard, J. Mariani, J. Odijk, S. Piperidis, & D. Tapias (Eds.). Proceedings of The Sixth International Language Resources and Evaluation (LREC’08) (pp. 3089-3092). European Language Resources Association (ELRA). https://aclanthology.org/L08-1403/

Miles, M. B., Huberman, A. M., & Saldaña, J. (2014). Qualitative data analysis: A methods sourcebook (3rd ed.). SAGE Publications, Inc.

Mohamed, E. J. (2022). Translation methods: A comparison study between semantic and communicative translation. International Journal of Linguistics, Literature and Translation, 5(4), 86-94. https://doi.org/10.32996/ijllt.2022.5.4.11

Moorkens, J., Castilho, S., Gaspari, F., & Doherty, S. (2018). Translation quality assessment: From principles to practice. Springer.

Newmark, P. (1981). Approaches to translation. Pergamon Press.

Nida, E. A., & Taber, C. (1969). The theory and practice of translation. Brill.

Nourinezhad, S., & Kashefian-Naeeini, S. (2020). Iranian EFL university learners and lecturers’ attitude towards translation as a tool in reading comprehension considering background variables of age, major and years of experience. Cogent Education, 7(1), 1746104. https://doi.org/10.1080/2331186X.2020.1746104

O’Neill, R., & Russell, A. M. T. (2019). Stop! Grammar time: University students’ perceptions of the automated feedback program Grammarly. Australasian Journal of Educational Technology, 35(1), 42-56. https://doi.org/10.14742/ajet.3795

Pichette, F. (2009). Second language anxiety and distance language learning. Foreign Language Annals, 42(1), 77-93. https://doi.org/10.1111/j.1944-9720.2009.01009.x

Pintado Gutiérrez, L. (2021). Translation in language teaching, pedagogical translation, and code-switching: Restructuring the boundaries. The Language Learning Journal, 49(2), 219-239. https://doi.org/10.1080/09571736.2018.1534260

Pym, A. (2004). E-learning in translator training. In L. Rega & M. Magris (Eds.), Übersetzen in der Fachkommunikation [Translation in specialist communication]: Comunicazione specialistica e traduzione [Specialist communication and translation] (pp. 161-173). Gunter Narr Verlag Publisher.

Rakhimova, D., Karibayeva, A., & Turarbek, A. (2024). The task of post-editing machine translation for the low-resource language. Applied Sciences, 14(2), 486. https://doi.org/10.3390/app14020486

Rambe, S. L. (2021). Creative techniques for online learning assessment. Englisia: Journal of Language, Education, and Humanities, 8(2), 138-147. https://doi.org/10.22373/ej.v8i2.8111

Rashidovna, K. S. (2022). The relationship between translation and culture. International Journal of Literature and Languages, 2(11), 35-42.

Reiß, K. (1971). Möglichkeiten und grenzen der übersetzungskritik [Possibilities and limits of translation criticism]. Hueber.

Reiss, K., & Vermeer, H. J. (1984). Groundwork for a general theory of translation. Max Niemeyer Verlag.

Rico, C. (2017). The e-Portfolio: Constructing learning in translation technology. Interpreter and Translator Trainer, 11(1), 79-95. https://doi.org/10.1080/1750399X.2017.1306995

Rico, C., & Pastor, D. G. (2022). The role of machine translation in translation education: A thematic analysis of translator educators’ beliefs. Translation and Interpreting, 14(1), 177-197.

Rivera-Trigueros, I. (2022). Machine translation systems and quality assessment: A systematic review. Language Resources and Evaluation, 56(2), 593-619. https://doi.org/10.1007/s10579-021-09537-5

Robert, I. S., Schrijver, I., & Ureel, J. J. (2024). Measuring translation revision competence and post-editing competence in translation trainees: Methodological issues. Perspectives, 32(2), 177-191. https://doi.org/10.1080/0907676X.2022.2030377

Royce, T. (2002). Multimodality in the TESOL classroom: Exploring visual-verbal synergy. TESOL Quarterly, 36(2), 191-205. https://doi.org/10.2307/3588330

Russell, V. (2020). Language anxiety and the online learner. Foreign Language Annals, 53(2), 338-352. https://doi.org/10.1111/flan.12461

Russell, V., & Murphy‐Judy, K. (2020). Teaching language online: A guide to designing, developing, and delivering online, blended, and flipped language courses. Routledge.

Salamah, D. (2021). Translation competence and translator training: A review. International Journal of Linguistics, Literature and Translation, 4(3), 276-291. http://dx.doi.org/10.32996/ijllt.2021.4.3.29

Sánchez, C. D. (2007). Proficiency guidelines to determine levels of communicative translation competence in translation training [Unpublished master’s thesis]. Universidad Nacional.

Sarason, I. G. (1984). Stress, anxiety, and cognitive interference: Reactions to tests. Journal of Personality and Social Psychology, 46(4), 929-938. https://doi.org/10.1037/0022-3514.46.4.929

Schaffner, C. (1998). The concept of norms in translation studies. Current Issues in Language & Society, 5(1-2), 1-9. http://dx.doi.org/10.1080/13520529809615500

Seifert, T., & Feliks, O. (2019). Online self-assessment and peer-assessment as a tool to enhance student-teachers’ assessment skills. Assessment and Evaluation in Higher Education, 44(2), 169-185. https://doi.org/10.1080/02602938.2018.1487023

Stolze, R. (2003). Hermeneutisches übersetzen [Hermeneutic translation]. Gunter Narr Verlag Publisher.

Toury, G. (1995). Descriptive translation studies and beyond. John Benjamins.

Tymoczko, M. (2000). Translation and political engagement. The Translator, 6(1). 23-47. https://doi.org/10.1080/13556509.2000.10799054

Vallès, D. (2014). Applying Juliane House’s translation quality assessment model (1997) on a humorous text: A case study of ‘The Simpsons’. New Readings, 14, 42-63. http://dx.doi.org/10.18573/newreadings.98

Venuti, L. (2004). The translator’s invisibility: A history of translation. Routledge.

Wang, A. (2021). Semantic and communicative translation in Chronicle of Blood Merchant. Jurnal Bahasa Lingua Scientia, 11(2), 317-340. https://doi.org/10.21274/ls.2019.11.2.327-342

Way, A. (2018). Quality expectations of machine translation. In J. Moorkens, S. Castilho, F. Gaspari, & S. Doherty (Eds.), Translation quality assessment: From principles to practice (pp. 159-178). Springer. https://doi.org/10.1007/978-3-319-91241-7_8

Widdowson, H. (2004). Text, context, pretext: Critical issues in discourse analysis. Blackwell.

Williams, K., & Davis, M. (2017). Referencing and understanding plagiarism. Macmillan International Higher Education.

Xiao, Y., Wu, L., Guo, J., Li, J., Zhang, M., Qin, T., & Liu, T. Y. (2023). A survey on non-autoregressive generation for neural machine translation and beyond. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(10), 11407-11427. https://doi.org/10.1109/TPAMI.2023.3277122

Xiong, Y., & Suen, H. K. (2018). Assessment approaches in massive open online courses: Possibilities, challenges and future directions. International Review of Education, 64(2), 241-263. https://doi.org/10.1007/s11159-018-9710-5

Yundayani, A., Abdullah, F., Tandiana, S. T., & Sutrisno, B. (2021). Students’ cognitive engagement during emergency remote teaching: Evidence from the Indonesian EFL milieu. Journal of Language and Linguistic Studies, 17(1), 17-33. http://dx.doi.org/10.52462/jlls.2

Zu, M., & Dong, Y. (2015, December). A brief analysis of communicative translation and semantic translation. In L. Zhao (Ed.), Proceedings of the 2015 Joint International Social Science, Education, Language, Management and Business Conference (pp. 269-272). Atlantis Press.




DOI: https://doi.org/10.24815/siele.v12i1.35265

Article Metrics

Abstract view : 58 times
PDF - 29 times

Refbacks

  • There are currently no refbacks.


Print ISSN: 2355-2794, Online ISSN: 2461-0275

This work is licensed under a Creative Commons Attribution 4.0 International License.


View Journal Stats