Evaluating EFL textbooks for vocational high schools in Indonesia: A corpus-informed and lexile-based model

Diana Omega Santi, Ignatius Tri Endarto

Abstract


Even though textbooks play an integral role in EFL teaching and learning processes, evaluation of English textbooks for vocational high schools in the Indonesian context and their relevancy to the targeted proficiency was still rare. This study identified text difficulty levels and English vocabulary profiles of a set of digital English coursebooks for vocational high schools in Indonesia. It also analyzed how text difficulty levels and vocabulary profiles correspond with the targeted proficiency level of vocational high school graduates. A corpus-informed and Lexile-based model was employed as the design of this research. Lexile framework was employed to measure text difficulty, while corpus information was utilized to determine the vocabulary profiles of the selected textbooks. Three tools were used to analyze the data quantitatively, namely Lexile Text Analyzer® Professional, LancsBox, and English Vocabulary Profile in Text Inspector. This study found that the approximate text difficulty of reading passages in the coursebooks for grades 10 and 12 is slightly higher than the expected language proficiency level for vocational high school graduates. On the other hand, the approximate text difficulty of reading passages in the coursebook for grade 11 is slightly lower. However, in terms of vocabulary profiles, the three books emphasize the target vocabulary at the expected level (B1), as suggested by the Directorate of Vocational High School Development. In addition to those findings, it is important that teachers consider other factors outside the scope of this research, such as learners’ proficiency levels and interests or other qualitative data about the books, to determine whether the coursebooks are appropriate for their classes.

Keywords


English for vocational high school; English vocabulary profile; Lexile framework for reading; text difficulty; text complexity

Full Text:

PDF

References


Ahmed, W. M. A. (2021). Exploring EFL university learners’ acquisition of advanced reading skills in the Yemeni context. Indonesian Journal of Applied Linguistics, 10(3), 771-781.

Alfter, D., & Volodina, E. (2018). Towards single word lexical complexity prediction. In J. Tetreault, J. Burstein, E. Kochmar, C. Leacock, & H. Yannakoudakis (Eds.), The thirteenth workshop on innovative use of NLP for building educational applications (pp. 79–88). Association for Computational Linguistics. https://doi.org/10.18653/v1/W18-05

Alsaif, A., & Masrai, A. (2019). Extensive reading and incidental vocabulary acquisition: The case of a predominant language classroom input. International Journal of Education and Literacy Studies, 7(2), 39-45.

Alsulami, Y. A. K. (2021). An evaluation of a fourth level English textbook used in secondary schools in Riyadh city. English Language Teaching, 14(2), 68-83.

Anshar, M. R., Emilia, E., & Damayanti, I. L. (2014). The evaluation of English electronic books for junior high school in Indonesia. Jurnal Ilmu Pendidikan dan Pengajaran, 1(3), 289–298.

Arias, I. J. (2007). Selecting reading materials wisely. LETRAS, 41, 131–151.

Brezina, V., Weill-Tessier, P., & McEnery, A. (2021). #LancsBox 6.0 manual.

Cambridge Dictionary. (2023). Awakened. https://dictionary.cambridge.org/dictionary/english/awakened

Cambridge University Press. (2013). Introductory guide to the Common European Framework of Reference (CEFR) for English language teachers. http://www.englishprofile.org/images/pdf/GuideToCEFR.pdf

Capel, A. (2010). A1–B2 vocabulary: Insights and issues arising from the English Profile Wordlists project. English Profile Journal, 1(1), 1–11. https://doi.org/10.1017/s2041536210000048

Capel, A. (2012). Completing the English Vocabulary Profile: C1 and C2 vocabulary. English Profile Journal, 3(1), 1–14. https://doi.org/10.1017/s2041536212000013

Creswell, J. W. (2014). Research design: Qualitative, quantitative, and mixed methods approaches, 4th ed. SAGE Publications, Inc.

Davidson, M. (2013). Books that children CAN read: Decodable books and book leveling. Aguirre Division of JBS International.

Dinata, R. P. (2022). An analysis of English textbook for tenth graders of vocational high school in Indonesia. Jurnal Ilmiah Universitas Batanghari Jambi, 22(3), 2085-2092.

Direktorat Pembinaan Sekolah Menengah Kejuruan. (2017). Strategi implementasi revitalisasi SMK melalui bilingual learning ecosystem [Strategies on the implementation of vocational high school revitalization through bilingual learning ecosystem] (C. Widjajanti, Ed.). Direktorat Pembinaan Sekolah Menengah Kejuruan.

Educational Testing Service. (2019). Mapping the TOEIC® tests on the Common European Framework of Reference for languages. www.ets.org/toeic.

English Profile. (2015a). English vocabulary profile FAQs. English Profile.

English Profile. (2015b). Text Inspector. Cambridge University Press. https://languageresearch.cambridge.org/wordlists/text-inspector

Gebhard, J. G. (1989). Relevancy, authenticity, comprehensibility and selection of EFL materials. PASAA, 19(1), 32–34.

Gholami, R., Noordin, N., & Rafik-Galea, S. (2017). A thorough scrutiny of ELT textbook evaluations: A review inquiry. International Journal of Education and Literacy Studies, 5(3), 82–91. https://doi.org/10.7575/aiac.ijels.v.5n.3p.82

Hasnita, S. S., Sundarso, & Santosa, R. S. (2014). Evaluasi program Buku Sekolah Elektronik (BSE) Kementerian Pendididkan Nasional tingkat SMA di Kota Semarang: Studi pada SMA Negeri 9 Semarang [Evaluating the Electronic Coursebook program proposed by Ministry of National Education at senior high school level: A study of SMA Negeri 9 Semarang]. Journal of Public Policy and Management Review, 3(1), 1–10.

Johansson, S. (2011). A multilingual outlook of corpora studies. In V. Viana, S. Zyngier, & G. Barnbrook (Eds.), Perspectives on corpus linguistics (Vol. 48, pp. 115–129). John Benjamins Publishing Company. http://benjamins.com/catalog/scl

Kementerian Pendidikan dan Kebudayaan. (2017). Surat edaran no 10/D/KR/2017 [Official circular letter no. 10/D/KR/2017].

Khurniawan, A. W., & Wahidiat, S. (2019). Strategi peningkatan daya saing lulusan SMK melalui penguatan kompetensi bahasa Inggris [Strategies for enhancing the competitiveness of vocational high school graduates: Strengthening English competence]. Kementerian Pendidikan dan Kebudayaan

Knight, B. (2015). Applications of English profile. In J. Harrison & F. Barker (Eds.), English profile in practice (1st ed., pp. 93–105). Cambridge University Press.

Kouvela, E., Hernandez-Martinez, P., & Croft, T. (2017). “This is what you need to be learning”: An analysis of messages received by first-year mathematics students during their transition to university. Mathematics Education Research Journal. https://doi.org/10.1007/s13394-017-0226-2

Krashen, S. (2001). The Lexile framework: Unnecessary and potentially harmful. California School Library Association Journal, 24(2), 25–26.

Lennon, C., & Burdick, H. (2014). The Lexile framework as an approach for reading measurement and success. http://cdn.lexile.com/cms_page_media/135/The Lexile Framework for Reading.pdf

Longman Dictionary of Contemporary English Online. (2018). Awaken. https://www.ldoceonline.com/dictionary/awaken

Lupo, S. M., Tortorelli, L., Invernizzi, M., Ryoo, J. H., & Strong, J. Z. (2019). An exploration of text difficulty and knowledge support on adolescents’ comprehension. Reading Research Quarterly, 54(4), 457-479.

Mamac, M. H., & Bangga, L. A. (2022). Using linguistic-informed analysis to assess model texts for EFL reading and writing. Indonesian Journal of Applied Linguistics, 12(2), 421-433. https://doi.org/10.17509/ijal.v12i2.45868

Menteri Pendidikan dan Kebudayaan Republik Indonesia. (2016). Peraturan Menteri Pendidikan dan Kebudayaan Republik Indonesia [Ministerial Decree of the Minister of Education and Culture of the Republic of Indonesia].

Menteri Pendidikan Nasional Republik Indonesia. (2008). Peraturan Menteri Pendidikan Nasional Republik Indonesia [Ministerial Decree of the Minister of Education and Culture of the Republic of Indonesia].

MetaMetrics. (2018). Educator guide: Lexile framework for reading. https://lexile.com/wp-content/uploads/2018/09/Lexile-Educator-Guide-MM0066W.pdf

MetaMetrics. (2019a). Lexile Analyzer® user guide. https://la-tools.lexile.com/help/

MetaMetrics. (2019b). Lexile Text Analyzer: Text preparation guide. https://hubsupport.lexile.com/Images/Lexile%20Analyzer%20Text%20Preparation%20Guide.pdf

MetaMetrics. (2020). Lexile measures overview. https://metametricsinc.com/wp-content/uploads/2020/08/Lexile-Measures-Overview.pdf

MetaMetrics Inc. (2022). About the Lexile Text Analyzer. MetaMetrics Inc. https://partnerhelp.metametricsinc.com/concept/c_laea_about.html

Mertler, C. A. (2016). Introduction to educational research, 1st ed. SAGE Publications, Inc.

Mitchell, K. (2018). Reading metrics explanations and justifications. University of Colorado Boulder.

Omer, I. E. A. M., & Al-Khaza’leh, B. A. (2021). Readability and readability formulas: English as a foreign language tertiary education teachers’ awareness in Shaqra University, Saudi Arabia. Journal of Education in Black Sea Region, 7(1), 166-180.

Ramadhana, M. A., Indah, O. D., & Suhardi. (2019). An evaluation of English language textbook: Interlanguage English for senior high school students. Jurnal Studi Guru dan Pembelajaran, 2(1), 1–7. https://doi.org/10.30605/jsgp.2.1.2019.1262

Rokhimah, D. R. (2016). Content evaluation of electronic English textbook for vocational school based on basic competences of curriculum 2013 [Doctoral dissertation, Universitas Pendidikan Indonesia]. Bandung.

Senninger, T. (2000). Abenteuer leiten-in Abenteuern lernen: Methodenset zur Planung und Leitung kooperativer Lerngemeinschaften für Training und Teamentwicklung in Schule, Jugendarbeit und Betrieb. Ökotopia Verlag.

Setiawan, D. A., Wahyuna, Y. T., & Mobit, M. (2024). An evaluation of reading materials in Indonesia vocational English textbook. Jurnal Ilmiah Wahana Pendidikan, 10(2), 277-284.

Sholihah, U. (2016). An analysis of English textbook for eleventh year students of senior high school on the basis of the 2013 Curriculum. Magistra, 28(95), 56–73.

Smith, M., & Turner, J. (2016). The Common European Framework of Reference for languages (CEFR) and the Lexile® framework for reading: Bringing more precision to language learning. In MetaMetrics. https://metametrics.s3.amazonaws.com/public/dynamic/international/pdfs/CEFR_1.pdf

Syairofi, A., Mujahid, Z., Mustofa, M., Ubaidillah, M. F., & Namaziandost, E. (2022). Emancipating SLA findings to inform EFL textbooks: A look at Indonesian school English textbooks. The Asia-Pacific Education Researcher, 32(2), 1-12.

Tannenbaum, R. J., & Wylie, E. C. (2013). Mapping TOEIC® and TOEIC Bridge™ test scores to the Common European Framework of Reference. The research foundation for the TOEIC tests: A compendium of studies, 2, 6-1. https://www.ets.org/Media/Research/pdf/TC2-06.pdf

Text Inspector. (2022a). Analyzing the CEFR level of vocabulary using the English Vocabulary Profile (EVP). Weblingua Ltd.

Text Inspector. (2022b). About us. Weblingua Ltd.

Ulla, M. B., & Perales, W. F. (2021). Developing an English language teaching textbook in a Thai university: Classroom language teachers as writers. English Teaching & Learning 45, 461–476. https://doi.org/10.1007/s42321-021-00078-2

Widiati, U., Rohmah, Z., & Furaidah. (2016). Bahasa Inggris: Untuk SMA/MA/SMK/MAK kelas X, edisi kedua [English: For first-year upper secondary school students, 2nd ed.]. Kementerian Pendidikan dan Kebudayaan.

Winimurti, Y. A., & Nur, D. R. (2019). Evaluation on senior high school English textbooks. Journal of English Language and Pedagogy, 2(2), 143–152.

Yetti, D. (2019). An analysis of readability level of reading material in English textbook for first grade of senior high school [Doctoral dissertation, Universitas Islam Negeri Sultan Syarif Kasim Riau]. Pekanbaru.

Zahruni, N. A., Fahmi, F., & Pratolo, B. W. (2020). Challenges of taking TOEIC test and how to overcome: Perception of Indonesian vocational students. Ethical Lingua: Journal of Language Teaching and Literature, 7(1), 82–91. https://doi.org/10.30605/25409190.167




DOI: https://doi.org/10.24815/siele.v11i3.34976

Article Metrics

Abstract view : 0 times
PDF - 0 times

Refbacks

  • There are currently no refbacks.


Print ISSN: 2355-2794, Online ISSN: 2461-0275

This work is licensed under a Creative Commons Attribution 4.0 International License.


View Journal Stats