Assessment design, learning strategies and obstacles in facing Computer-Based Madrasah Exam on the English subject

Bahrun Bahrun, Rizki Maulana, Asnawi Muslem, Yulianti Yulianti

Abstract


The objectives of this study were to describe how teachers design the Computer-Based Madrasah Exam (CBME) questions for English subjects, to investigate learning strategies students use, and to explore the obstacles the students face in this exam. Questionnaires and interviews were used as the instruments to collect data for this study. A number of 95 ninth-grade students and two English teachers of Madrasah Tsanawiyah Negeri No. 1 (MTsN 1; this school level is equivalent to junior high schools) in South Aceh, Indonesia, participated in this study. The data were analyzed quantitatively and qualitatively using thematic analysis. The results revealed that in designing the assessment of CBME, the teachers used four strategies which were preparing for the change in the final exam model, selecting sources in designing the exam questions, preparing students to face the exam in the new model, and resolving obstacles in developing the exam questions. Meanwhile, the students used five strategies in facing the exam, they are managing time, motivating themselves, creating study groups, practicing, and strengthening basic abilities. Furthermore, the obstacles that the students faced in the exam are a lack of skill in using a computer for the exam, slow internet access, limited computer availability, limitation of vocabulary mastery, taking time to understand questions, and peers’ interventions. Thus, this study suggests that more training is still needed for teachers in designing the assessment model of CMBE and the school also need sufficient facilities before they enforce CMBE to their students.

Keywords


Computer-Based Madrasah Examination (CBME); EFL students; English subject; strategies; assessment design

Full Text:

PDF

References


Achmad, D., Komariah, E., Jannah, W. M., & Silviyanti, T. M. (2023). Probing into the obstacles faced by internship student-teachers in designing lesson plans. Studies in English Language and Education, 10(1), 303-321. https://doi.org/10.24815/siele.v10i1.26647

Aji, A. A., & Basthomi, Y. (2022). Assessing students during online learning: A case study on a Linguistic subject teacher’s experience. Language Circle: Journal of Language and Literature, 16(2), 264–273.

Appelbaum, S. H., & Honeggar, K. (1998). Empowerment: A contrasting overview of organizations in general and nursing in particular‐an examination of organizational factors, managerial behaviors, job design, and structural power. Empowerment in Organizations, 6(2), 29-50. https://doi.org/10.1108/14634449810210715

Arnista, J. (2015, June 18). Sebab pendidikanikan di daerah terpencil menjadi tertinggal [The cause for education in remote areas to be lagging behind]. Kompasiana. https://www.kompasiana.com/jiilaanarnista/54f67336a33311b07d8b4c18/sebab-pendidikan-di-daerah-terpencil-menjadi-tertinggal

Arikunto, S. (2013). Dasar-dasar evaluasi pendidikan [Principles of educational evaluation]. PT Bumi Aksara.

Ashman, A., & Gillies, R. (Eds.). (2003). Cooperative learning: The social and intellectual outcomes of learning in groups. Routledge.

Baryla, W., Bialobrzeska, O., Bocian, K., Parzuchowski, M., Szymkow, A., & Wojciszke, B. (2019). Perspectives questionnaire: Measuring propensities to take the viewpoints of the agent or recipient. Personality and Individual Differences, 144, 1-10. https://doi.org/10.1016/j.paid.2019.02.025

Bassett, K., Olbricht, G. R., & Shannon, K. B. (2020). Student pre-class preparation by both reading the textbook and watching videos online improves exam performance in a partially flipped course. CBE—Life Sciences Education, 19(3), Article 32. https://doi.org/10.1187/cbe.19-05-0094

Beatty, K. (2013). Teaching & Researching: Computer-assisted language learning. Routledge.

Beleulmi, S. (2022). Challenges of online assessment during Covid-19 pandemic: An experience of Study Skills teachers. Afak for Sciences Journal, 7(2), 49–62.

Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa

Brown, H. D. (2003). Language assessment: Principles and classroom practice. Blackwell Publisher.

Brown, H. D. (2004). Language assessment principles and classroom practices. Longman.

Burns, P. K., & Bozeman, W. C. (1981). Computer-assisted instruction and mathematics achievement: Is there a relationship? Educational Technology, 21(10), 32-39.

Castleberry, A., & Nolen, A. (2018). Thematic analysis of qualitative research data: Is it as easy as it sounds? Currents in pharmacy teaching and learning, 10(6), 807-815. https://doi.org/10.1016/j.cptl.2018.03.019

Chappuis, S., & Stiggins, R. J. (2002). Classroom assessment for learning. Educational Leadership, 60, 40-43. https://doi.org/10.4236/ce.2019.1012218

Chow, H. K., Goh, C., & Tan, Y. K. (2008). Examinations in Singapore: Change and continuity (1891-2007). World Scientific.

Claessens, B. J., van Eerde, W., Rutte, C. G., & Roe, R. A. (2007). A review of the time management literature. Personnel Review, 36(2), 255-276. https://doi.org/10.1108/00483480710726136

Cooperstein, S. E., & Kocevar‐Weidinger, E. (2004). Beyond active learning: A constructivist approach to learning. Reference Services Review, 32(2), 144-148. https://doi.org/10.1108/00907320410537658

Dandekar, P. D. (2020). Effect of formative assessment of students on their academic performance in Department of Kriya Sharir. Journal of Education Technology in Health Sciences, 7(1), 33-38. http://doi.org/10.18231/j.jeths.2020.008

Darmawan, D., & Harahap, E. (2016). Communication strategy for enhancing quality of graduates nonformal education through Computer Based Test (CBT) in West Java Indonesia. International Journal of Applied Engineering Research, 11(15), 8641-8645.

Debreli, E., & Demirkan, S. (2016). Sources and levels of foreign language speaking anxiety of English as a foreign language university student with regard to language proficiency and gender. International Journal of English Language Education, 4(1), 49-62.

Drach-Zahavy, A., Goldblatt, H., Admi, H., Blau, A., Ohana, I., & Itzhaki, M. (2022). A multi-level examination of nursing students’ resilience in the face of the COVID-19 outbreak: A cross-sectional design. Journal of advanced nursing, 78(1), 109–120. https://doi.org/10.1111/jan.14951

Erdiana, N., Daud, B., Sari, D. F., & Dwitami, S. K. (2020). A study of anxiety experienced by EFL students in speaking performance. Studies in English Language and Education, 7(2), 334-346. https://doi.org/10.24815/siele.v7i2.16768

Erdiana, N., & Panjaitan, S. (2023). How is HOTS integrated into the Indonesian high school English textbook? Studies in English Language and Education, 10(1), 60-77. https://doi.org/10.24815/siele.v10i1.26052

Fletcher-Wood, H. (2021). Habits of success: Getting every student learning. Routledge.

Fox, G. K., Bowden, S. C., & Smith, D. S. (1998). On-road assessment of driving competence after brain impairment: Review of current practice and recommendations for a standardized examination. Archives of Physical Medicine and Rehabilitation, 79(10), 1288-1296. https://doi.org/10.1016/S0003-9993(98)90277-5

George Lucas Educational Foundation. (2008, July 15). Why is assessment important? George Lucas Educational Foundation. https://www.edutopia.org/assessment-guide-importance

Gibbons, M. (2003). The self-directed learning handbook: Challenging adolescent students to excel. John Wiley & Sons.

Gibbs, G. (2006). Why assessment is changing. In C. Bryan & K. Clegg (Eds.), Innovative assessment in higher education (pp. 31-42). Routledge.

Golshan-Shirazi, S., & Guiochon, G. (1989). Theoretical study of system peaks and elution profiles for large concentration bands in the case of a binary eluent containing a strongly sorbed additive. Journal of Chromatography A, 461, 1-18. https://doi.org/10.1016/S0021-9673(00)94271-7

Hanifa, R. (2018). Factors generating anxiety when learning EFL speaking skills. Studies in English Language and Education, 5(2), 230-239. https://doi.org/10.24815/siele.v5i2.10932

Hall, K., & Sheehy, K. (2010). Assessment and learning: Summative approaches. In J. Arthur (Ed.), Learning to teach in the primary school (pp. 245–256). Routledge.

Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81-112. https://doi.org/10.3102/0034654302984

Heleem, A., Javaid, M., Qadri, M. A., & Suman, R. (2022). Understanding the role of digital technologies in education: A review. Sustainable Operations and Computers, 3, 275-285. https://doi.org/10.1016/j.susoc.2022.05.004

Hvalshagen, M., Lukyanenko, R., & Samuel, B. M. (2022). Empowering users with narratives: Examining the efficacy of narratives for understanding data-oriented conceptual models. Information Systems Research, 0(0), Article 1141. https://doi.org/10.1287/isre.2022.1141

Ioannou-Georgiou, S. (2003). Assessing young learners. Oxford University Press.

Jaques, D. (2000). Learning in groups: A handbook for improving group work. Psychology Press.

Jaques, D., & Salmon, G. (2006). Learning in groups: A handbook for face-to-face and online environments (4th ed.). Routledge.

Kaye, T., & Ehren, M. (2021). Computer-assisted instruction tools: A model to guide use in low-and middle-income countries. The International Journal of Education and Development using Information and Communication Technology, 17(1), 82-99.

Knight, L., & Pye, A. (2005). Network learning: An empirically derived model of learning by groups of organizations. Human Relations, 58(3), 369-392. https://doi.org/10.1177/0018726705053427

Konrad, M., Keesey, S., Ressa, V. A., Alexeeff, M., Chan, P. E., & Peters, M. T. (2014). Setting clear learning targets to guide instruction for all students. Intervention in School and Clinic, 50(2), 76-85. https://doi.org/10.1177/1053451214536042

Kurniati, D., Riyono, A., & Utomo, B. (2023). Challenges in online assessment: The case of Indonesian teachers. International Journal of Social Science, 2(5), 2063-2068. https://doi.org/10.53625/ijss.v2i5.4811

Kusuma, I. P. I. (2022). EFL teachers’ online teaching in rural schools during the COVID-19 pandemic: Stories from Indonesia. Studies in English Language and Education, 9(1), 203-221. https://doi.org/10.24815/siele.v9i1.21239

Limeranto, J. T., & Subekti, A. S. (2021). Indonesian Theology students’ foreign language reading anxiety and reading performance: A correlational study. Studies in English Language and Education, 8(1), 131-142. https://doi.org/10.24815/siele.v8i1.17398

Lu, Y., & Ramamurthy, K. (2011). Understanding the link between information technology capability and organizational agility: An empirical examination. MIS Quarterly, 365(4), 931-954. https://doi.org/10.2307/41409967

Luthfiyyah, R., Cahyono, B. Y., Ivone, F. M., & Suryati, N. (2022). EFL secondary school teachers’ conceptions of online assessment in emergency remote teaching: A phenomenographic study. Studies in English Language and Education, 9(2), 1041-1058. https://doi.org/10.24815/siele.v9i3.23459

MacCann, C., Fogarty, G. J., & Roberts, R. D. (2012). Strategies for success in education: Time management is more important for part-time than full-time community college students. Learning and Individual Differences, 22(5), 618-623. https://doi.org/10.1016/j.lindif.2011.09.015

McNamara, C. (1999). General guidelines for conducting interviews. Sage.

Misra, R., & McKean, M. (2000). College students’ academic stress and its relation to their anxiety, time management, and leisure satisfaction. American Journal of Health Studies, 16(1), 41-51.

Mohmmed, A. O., Khidhir, B. A., Nazeer, A., & Vijayan, V. J. (2020). Emergency remote teaching during Coronavirus pandemic: The current trend and future directive at Middle East College Oman. Innovative Infrastructure Solutions, 5(3). https://doi.org/10.1007/s41062-020-00326-7

Muslem, A., Sahardin, R., Heriansyah, H., Fata, I. A., Djalaluddin, Y., & Hankinson, E. (2022). YouTube teaching materials with peer support to improve students’ mastery of subject content learning. Studies in English Language and Education, 9(2), 651-666. https://doi.org/10.24815/siele.v9i2.25236

Muslem, A., Yusuf, Y. Q., & Juliana, R. (2018). Perceptions and barriers to ICT use among English teachers in Indonesia. Teaching English with Technology, 18(1), 3-23.

Natarajarathinam, M., Capar, I., & Narayanan, A. (2009). Managing supply chains in times of crisis: A review of literature and insights. International Journal of Physical Distribution & Logistics Management, 39(7), 535-573. https://doi.org/10.1108/09600030910996251

Nisbet, J., & Shucksmith, J. (2017). Learning strategies. Routledge.

Odanga, S. J. (2018). Strategies for increasing students’ self-motivation. Asian Research Journal of Arts & Social Sciences, 6(4), 1-6. https://doi.org/10.9734/ARJASS/2018/41354

O’Malley, K. (2015, October 27). 4 common types of tests teachers give (and why). General Education. https://resources.noodle.com/articles/4-types-of-tests-teachers-give-and-why/

O’Neil, H. F. (Ed.). (2014). Learning strategies. Academic Press.

Perry, K., Meissel, K., & Hill, M. F. (2022). Rebooting assessment. Exploring the challenges and benefits of shifting from pen-and-paper to computer in summative assessment. Educational Research Review, 26, Article 100451. https://doi.org/10.1016/j.edurev.2022.100451

Pressley, M., Yokoi, L., van Meter, P., Van Etten, S., & Freebern, G. (1997). Some of the reasons why preparing for exams is so hard: What can be done to make it easier? Educational Psychology Review, 9, 1-38. https://doi.org/10.1023/A:1024796622045

Retnawati, H., Hadi, S., Nugraha, A. C., Arlinwibowo, J., Sulistyaningsih, E., Djidu, H., Apino, E, & Iryanti, H. D. (2017). Implementing the computer-based national examination in Indonesian schools: The challenges and strategies. Problems of Education in the 21st Century, 75(6), 612-633. https://doi.org/10.33225/pec/17.75.612

Rosidin, U., Herpratiwi, Suana, W., & Firdaos, R. (2019). Evaluation of national examination (UN) and national-based school examination (USBN) in Indonesia. European Journal of Educational Research, 8(3), 827-937. https://doi.org/10.12973/eu-jer.8.3.827

Saukah, A., & Cahyono, A. E. (2015). National exam in Indonesia and its implications to the teaching and learning of English. Jurnal Penelitian dan Evaluasi Pendidikan, 19(2), 243-255. https://doi.org/10.21831/pep.v19i2.5583

Sherratt, P. (2014). Passing exams for dummies (2nd ed.). Wiley Publishing.

Shoyzokovich, S. S., & Dilnur, R. (2023). Types of tests used in teaching English language and their role in assessment. Educational Research in Universal Sciences, 2(Special Issue), 427-430.

Silverman, R. (2021, April 19). Exam preparation: Five key strategies. Simon Fraser University Library. https://www.lib.sfu.ca/about/branches-depts/slc/learning/exam-prep/exam-prep-5-strategies

Silviyanti, T. M., & Yusuf, Y. Q. (2015). EFL teachers’ perceptions on using ICT in their teaching: To use or to reject? Teaching English with Technology, 15(4), 29-43.

Soe, K., Koki, S., & Chang, J. M. (2000). Effect of Computer-Assisted Instruction (CAI) on reading achievement: A meta-analysis [Reports]. Pacific Recourse for Education and Learning, Honolulu.

Stanley, J. C. (2000). Helping students learn only what they don’t already know. Psychology, Public Policy, and Law, 6(1), 216-222. https://doi.org/10.1037/1076-8971.6.1.216

Sugianto, A. (2016). An analysis of English National Final Examination for junior high school in terms of validity and reliability. Journal on English as a Foreign Language, 6(1), 31-42. https://doi.org/10.23971/jefl.v6i1.427

Susanti, A. (2015, May 13). Lima alasan kamu harus bentuk kelompok belajar [Five reasons you should form a study group]. OkeNews. https://edukasi.okezone.com/read/2015/05/12/65/1148671/lima-alasan-kamu-harus-bentuk-kelompok-belajar

Swaray, R. (2012). An evaluation of a group project designed to reduce free-riding and promote active learning. Assessment & Evaluation in Higher Education, 37(3), 285-292. https://doi.org/10.1080/02602938.2010.531246

Tanner, K. D. (2012). Promoting student metacognition. CBE Life Sciences Education, 11(2), 113-120. https://doi.org/10.1187/cbe.12-03-0033

Taylor-Powell, E. (2003). Analyzing quantitative data. University of Wisconsin. http://learningstore.uwex.edu/assets/pdfs/g3658-12.pdf

Thoonen, E. E. J., Sleegers, P. J. C., Peetsma, T. T. D., & Oort, F. J. (2011). Can teachers motivate students to learn? Educational Studies, 37(3), 345-360. https://doi.org/10.1080/03055698.2010.507008

Tilaar, H. A. R. (2006). Problematika dalam mewujudkan cita-cita NKRI: Permasalahan dan alternatif penyelesaian reformasi pendidikan nasional [Problems in actualizing the ideals of the Republic of Indonesia: Problems and alternative solutions to national education reform]. Perspektif Ilmu Pendidikan, 13(VII), 43-47. https://doi.org/10.21009/PIP.131.6

Vaismoradi, M., Turunen, H., & Bondas, T. (2013). Content analysis and thematic analysis: Implications for conducting a qualitative descriptive study. Nursing & Health Sciences, 15(3), 398-405. https://doi.org/10.1111/nhs.12048

Yin, S., Chen, F., & Chang, H. (2022). Assessment as learning: How does peer assessment function in students’ learning? Frontier in Psychology, 13, Article 912568. https://doi.org/10.3389/fpsyg.2022.912568

Yusuf, Y. Q., Mustafa, F., & Iqbal, R. M. (2021). An inquiry into grammatical errors in writing committed by high achieving EFL students. International Journal of Language Studies, 15(2), 1-22.

Zulfikar, F. (2022, February 16). UN SD Tahun 2022 dihapus, bagaimana ketentuan lulusnya? [The 2022 SD National Examination is eliminated, what are the conditions for graduation?] Detikcom. https://www.detik.com/edu/sekolah/d-5944053/un-sd-tahun-2022-dihapus-bagaimana-ketentuan-lulusnya




DOI: https://doi.org/10.24815/siele.v10i2.31954

Article Metrics

Abstract view : 0 times
PDF - 0 times

Refbacks

  • There are currently no refbacks.


Print ISSN: 2355-2794, Online ISSN: 2461-0275

This work is licensed under a Creative Commons Attribution 4.0 International License.


View Journal Stats