Assessment design, learning strategies and obstacles in facing Computer-Based Madrasah Exam on the English subject

Bahrun Bahrun, Rizki Maulana, Asnawi Muslem, Yulianti Yulianti


The objectives of this study were to describe how teachers design the Computer-Based Madrasah Exam (CBME) questions for English subjects, to investigate learning strategies students use, and to explore the obstacles the students face in this exam. Questionnaires and interviews were used as the instruments to collect data for this study. A number of 95 ninth-grade students and two English teachers of Madrasah Tsanawiyah Negeri No. 1 (MTsN 1; this school level is equivalent to junior high schools) in South Aceh, Indonesia, participated in this study. The data were analyzed quantitatively and qualitatively using thematic analysis. The results revealed that in designing the assessment of CBME, the teachers used four strategies which were preparing for the change in the final exam model, selecting sources in designing the exam questions, preparing students to face the exam in the new model, and resolving obstacles in developing the exam questions. Meanwhile, the students used five strategies in facing the exam, they are managing time, motivating themselves, creating study groups, practicing, and strengthening basic abilities. Furthermore, the obstacles that the students faced in the exam are a lack of skill in using a computer for the exam, slow internet access, limited computer availability, limitation of vocabulary mastery, taking time to understand questions, and peers’ interventions. Thus, this study suggests that more training is still needed for teachers in designing the assessment model of CMBE and the school also need sufficient facilities before they enforce CMBE to their students.


Computer-Based Madrasah Examination (CBME); EFL students; English subject; strategies; assessment design

Full Text:



Achmad, D., Komariah, E., Jannah, W. M., & Silviyanti, T. M. (2023). Probing into the obstacles faced by internship student-teachers in designing lesson plans. Studies in English Language and Education, 10(1), 303-321.

Aji, A. A., & Basthomi, Y. (2022). Assessing students during online learning: A case study on a Linguistic subject teacher’s experience. Language Circle: Journal of Language and Literature, 16(2), 264–273.

Appelbaum, S. H., & Honeggar, K. (1998). Empowerment: A contrasting overview of organizations in general and nursing in particular‐an examination of organizational factors, managerial behaviors, job design, and structural power. Empowerment in Organizations, 6(2), 29-50.

Arnista, J. (2015, June 18). Sebab pendidikanikan di daerah terpencil menjadi tertinggal [The cause for education in remote areas to be lagging behind]. Kompasiana.

Arikunto, S. (2013). Dasar-dasar evaluasi pendidikan [Principles of educational evaluation]. PT Bumi Aksara.

Ashman, A., & Gillies, R. (Eds.). (2003). Cooperative learning: The social and intellectual outcomes of learning in groups. Routledge.

Baryla, W., Bialobrzeska, O., Bocian, K., Parzuchowski, M., Szymkow, A., & Wojciszke, B. (2019). Perspectives questionnaire: Measuring propensities to take the viewpoints of the agent or recipient. Personality and Individual Differences, 144, 1-10.

Bassett, K., Olbricht, G. R., & Shannon, K. B. (2020). Student pre-class preparation by both reading the textbook and watching videos online improves exam performance in a partially flipped course. CBE—Life Sciences Education, 19(3), Article 32.

Beatty, K. (2013). Teaching & Researching: Computer-assisted language learning. Routledge.

Beleulmi, S. (2022). Challenges of online assessment during Covid-19 pandemic: An experience of Study Skills teachers. Afak for Sciences Journal, 7(2), 49–62.

Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101.

Brown, H. D. (2003). Language assessment: Principles and classroom practice. Blackwell Publisher.

Brown, H. D. (2004). Language assessment principles and classroom practices. Longman.

Burns, P. K., & Bozeman, W. C. (1981). Computer-assisted instruction and mathematics achievement: Is there a relationship? Educational Technology, 21(10), 32-39.

Castleberry, A., & Nolen, A. (2018). Thematic analysis of qualitative research data: Is it as easy as it sounds? Currents in pharmacy teaching and learning, 10(6), 807-815.

Chappuis, S., & Stiggins, R. J. (2002). Classroom assessment for learning. Educational Leadership, 60, 40-43.

Chow, H. K., Goh, C., & Tan, Y. K. (2008). Examinations in Singapore: Change and continuity (1891-2007). World Scientific.

Claessens, B. J., van Eerde, W., Rutte, C. G., & Roe, R. A. (2007). A review of the time management literature. Personnel Review, 36(2), 255-276.

Cooperstein, S. E., & Kocevar‐Weidinger, E. (2004). Beyond active learning: A constructivist approach to learning. Reference Services Review, 32(2), 144-148.

Dandekar, P. D. (2020). Effect of formative assessment of students on their academic performance in Department of Kriya Sharir. Journal of Education Technology in Health Sciences, 7(1), 33-38.

Darmawan, D., & Harahap, E. (2016). Communication strategy for enhancing quality of graduates nonformal education through Computer Based Test (CBT) in West Java Indonesia. International Journal of Applied Engineering Research, 11(15), 8641-8645.

Debreli, E., & Demirkan, S. (2016). Sources and levels of foreign language speaking anxiety of English as a foreign language university student with regard to language proficiency and gender. International Journal of English Language Education, 4(1), 49-62.

Drach-Zahavy, A., Goldblatt, H., Admi, H., Blau, A., Ohana, I., & Itzhaki, M. (2022). A multi-level examination of nursing students’ resilience in the face of the COVID-19 outbreak: A cross-sectional design. Journal of advanced nursing, 78(1), 109–120.

Erdiana, N., Daud, B., Sari, D. F., & Dwitami, S. K. (2020). A study of anxiety experienced by EFL students in speaking performance. Studies in English Language and Education, 7(2), 334-346.

Erdiana, N., & Panjaitan, S. (2023). How is HOTS integrated into the Indonesian high school English textbook? Studies in English Language and Education, 10(1), 60-77.

Fletcher-Wood, H. (2021). Habits of success: Getting every student learning. Routledge.

Fox, G. K., Bowden, S. C., & Smith, D. S. (1998). On-road assessment of driving competence after brain impairment: Review of current practice and recommendations for a standardized examination. Archives of Physical Medicine and Rehabilitation, 79(10), 1288-1296.

George Lucas Educational Foundation. (2008, July 15). Why is assessment important? George Lucas Educational Foundation.

Gibbons, M. (2003). The self-directed learning handbook: Challenging adolescent students to excel. John Wiley & Sons.

Gibbs, G. (2006). Why assessment is changing. In C. Bryan & K. Clegg (Eds.), Innovative assessment in higher education (pp. 31-42). Routledge.

Golshan-Shirazi, S., & Guiochon, G. (1989). Theoretical study of system peaks and elution profiles for large concentration bands in the case of a binary eluent containing a strongly sorbed additive. Journal of Chromatography A, 461, 1-18.

Hanifa, R. (2018). Factors generating anxiety when learning EFL speaking skills. Studies in English Language and Education, 5(2), 230-239.

Hall, K., & Sheehy, K. (2010). Assessment and learning: Summative approaches. In J. Arthur (Ed.), Learning to teach in the primary school (pp. 245–256). Routledge.

Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81-112.

Heleem, A., Javaid, M., Qadri, M. A., & Suman, R. (2022). Understanding the role of digital technologies in education: A review. Sustainable Operations and Computers, 3, 275-285.

Hvalshagen, M., Lukyanenko, R., & Samuel, B. M. (2022). Empowering users with narratives: Examining the efficacy of narratives for understanding data-oriented conceptual models. Information Systems Research, 0(0), Article 1141.

Ioannou-Georgiou, S. (2003). Assessing young learners. Oxford University Press.

Jaques, D. (2000). Learning in groups: A handbook for improving group work. Psychology Press.

Jaques, D., & Salmon, G. (2006). Learning in groups: A handbook for face-to-face and online environments (4th ed.). Routledge.

Kaye, T., & Ehren, M. (2021). Computer-assisted instruction tools: A model to guide use in low-and middle-income countries. The International Journal of Education and Development using Information and Communication Technology, 17(1), 82-99.

Knight, L., & Pye, A. (2005). Network learning: An empirically derived model of learning by groups of organizations. Human Relations, 58(3), 369-392.

Konrad, M., Keesey, S., Ressa, V. A., Alexeeff, M., Chan, P. E., & Peters, M. T. (2014). Setting clear learning targets to guide instruction for all students. Intervention in School and Clinic, 50(2), 76-85.

Kurniati, D., Riyono, A., & Utomo, B. (2023). Challenges in online assessment: The case of Indonesian teachers. International Journal of Social Science, 2(5), 2063-2068.

Kusuma, I. P. I. (2022). EFL teachers’ online teaching in rural schools during the COVID-19 pandemic: Stories from Indonesia. Studies in English Language and Education, 9(1), 203-221.

Limeranto, J. T., & Subekti, A. S. (2021). Indonesian Theology students’ foreign language reading anxiety and reading performance: A correlational study. Studies in English Language and Education, 8(1), 131-142.

Lu, Y., & Ramamurthy, K. (2011). Understanding the link between information technology capability and organizational agility: An empirical examination. MIS Quarterly, 365(4), 931-954.

Luthfiyyah, R., Cahyono, B. Y., Ivone, F. M., & Suryati, N. (2022). EFL secondary school teachers’ conceptions of online assessment in emergency remote teaching: A phenomenographic study. Studies in English Language and Education, 9(2), 1041-1058.

MacCann, C., Fogarty, G. J., & Roberts, R. D. (2012). Strategies for success in education: Time management is more important for part-time than full-time community college students. Learning and Individual Differences, 22(5), 618-623.

McNamara, C. (1999). General guidelines for conducting interviews. Sage.

Misra, R., & McKean, M. (2000). College students’ academic stress and its relation to their anxiety, time management, and leisure satisfaction. American Journal of Health Studies, 16(1), 41-51.

Mohmmed, A. O., Khidhir, B. A., Nazeer, A., & Vijayan, V. J. (2020). Emergency remote teaching during Coronavirus pandemic: The current trend and future directive at Middle East College Oman. Innovative Infrastructure Solutions, 5(3).

Muslem, A., Sahardin, R., Heriansyah, H., Fata, I. A., Djalaluddin, Y., & Hankinson, E. (2022). YouTube teaching materials with peer support to improve students’ mastery of subject content learning. Studies in English Language and Education, 9(2), 651-666.

Muslem, A., Yusuf, Y. Q., & Juliana, R. (2018). Perceptions and barriers to ICT use among English teachers in Indonesia. Teaching English with Technology, 18(1), 3-23.

Natarajarathinam, M., Capar, I., & Narayanan, A. (2009). Managing supply chains in times of crisis: A review of literature and insights. International Journal of Physical Distribution & Logistics Management, 39(7), 535-573.

Nisbet, J., & Shucksmith, J. (2017). Learning strategies. Routledge.

Odanga, S. J. (2018). Strategies for increasing students’ self-motivation. Asian Research Journal of Arts & Social Sciences, 6(4), 1-6.

O’Malley, K. (2015, October 27). 4 common types of tests teachers give (and why). General Education.

O’Neil, H. F. (Ed.). (2014). Learning strategies. Academic Press.

Perry, K., Meissel, K., & Hill, M. F. (2022). Rebooting assessment. Exploring the challenges and benefits of shifting from pen-and-paper to computer in summative assessment. Educational Research Review, 26, Article 100451.

Pressley, M., Yokoi, L., van Meter, P., Van Etten, S., & Freebern, G. (1997). Some of the reasons why preparing for exams is so hard: What can be done to make it easier? Educational Psychology Review, 9, 1-38.

Retnawati, H., Hadi, S., Nugraha, A. C., Arlinwibowo, J., Sulistyaningsih, E., Djidu, H., Apino, E, & Iryanti, H. D. (2017). Implementing the computer-based national examination in Indonesian schools: The challenges and strategies. Problems of Education in the 21st Century, 75(6), 612-633.

Rosidin, U., Herpratiwi, Suana, W., & Firdaos, R. (2019). Evaluation of national examination (UN) and national-based school examination (USBN) in Indonesia. European Journal of Educational Research, 8(3), 827-937.

Saukah, A., & Cahyono, A. E. (2015). National exam in Indonesia and its implications to the teaching and learning of English. Jurnal Penelitian dan Evaluasi Pendidikan, 19(2), 243-255.

Sherratt, P. (2014). Passing exams for dummies (2nd ed.). Wiley Publishing.

Shoyzokovich, S. S., & Dilnur, R. (2023). Types of tests used in teaching English language and their role in assessment. Educational Research in Universal Sciences, 2(Special Issue), 427-430.

Silverman, R. (2021, April 19). Exam preparation: Five key strategies. Simon Fraser University Library.

Silviyanti, T. M., & Yusuf, Y. Q. (2015). EFL teachers’ perceptions on using ICT in their teaching: To use or to reject? Teaching English with Technology, 15(4), 29-43.

Soe, K., Koki, S., & Chang, J. M. (2000). Effect of Computer-Assisted Instruction (CAI) on reading achievement: A meta-analysis [Reports]. Pacific Recourse for Education and Learning, Honolulu.

Stanley, J. C. (2000). Helping students learn only what they don’t already know. Psychology, Public Policy, and Law, 6(1), 216-222.

Sugianto, A. (2016). An analysis of English National Final Examination for junior high school in terms of validity and reliability. Journal on English as a Foreign Language, 6(1), 31-42.

Susanti, A. (2015, May 13). Lima alasan kamu harus bentuk kelompok belajar [Five reasons you should form a study group]. OkeNews.

Swaray, R. (2012). An evaluation of a group project designed to reduce free-riding and promote active learning. Assessment & Evaluation in Higher Education, 37(3), 285-292.

Tanner, K. D. (2012). Promoting student metacognition. CBE Life Sciences Education, 11(2), 113-120.

Taylor-Powell, E. (2003). Analyzing quantitative data. University of Wisconsin.

Thoonen, E. E. J., Sleegers, P. J. C., Peetsma, T. T. D., & Oort, F. J. (2011). Can teachers motivate students to learn? Educational Studies, 37(3), 345-360.

Tilaar, H. A. R. (2006). Problematika dalam mewujudkan cita-cita NKRI: Permasalahan dan alternatif penyelesaian reformasi pendidikan nasional [Problems in actualizing the ideals of the Republic of Indonesia: Problems and alternative solutions to national education reform]. Perspektif Ilmu Pendidikan, 13(VII), 43-47.

Vaismoradi, M., Turunen, H., & Bondas, T. (2013). Content analysis and thematic analysis: Implications for conducting a qualitative descriptive study. Nursing & Health Sciences, 15(3), 398-405.

Yin, S., Chen, F., & Chang, H. (2022). Assessment as learning: How does peer assessment function in students’ learning? Frontier in Psychology, 13, Article 912568.

Yusuf, Y. Q., Mustafa, F., & Iqbal, R. M. (2021). An inquiry into grammatical errors in writing committed by high achieving EFL students. International Journal of Language Studies, 15(2), 1-22.

Zulfikar, F. (2022, February 16). UN SD Tahun 2022 dihapus, bagaimana ketentuan lulusnya? [The 2022 SD National Examination is eliminated, what are the conditions for graduation?] Detikcom.


Article Metrics

Abstract view : 0 times
PDF - 0 times


  • There are currently no refbacks.

Print ISSN: 2355-2794, Online ISSN: 2461-0275

This work is licensed under a Creative Commons Attribution 4.0 International License.

View Journal Stats