Key Predictors of Proficiency in L2 Writing: Syntactic, Lexical Complexity, and Accuracy

Shinjae Park

Abstract


While many studies have examined individual aspects of complexity, accuracy, and fluency (CAF) as indicators of language performance, few have explored how syntactic complexity, lexical complexity, and accuracy function together to measure writing proficiency. This study aims to fill that gap by identifying reliable methods to measure 14 indices of syntactic complexity, 5 of lexical complexity, and 9 of accuracy. It additionally investigates how these indices contribute to holistic writing assessments. It further examines which specific indices best predict writing proficiency and determine writing quality. A total of 138 essays by Korean learners of English were analyzed using the L2 Syntactic Complexity Analyzer and Text Inspector. Multiple regression analyses were conducted to interpret the data. The results show that proficiency is best predicted by the number of coordinate phrases per clause and dependent clauses per T-unit (syntactic complexity), sophistication (lexical complexity), and article usage (accuracy). Lexical sophistication emerged as the strongest predictor of proficiency. The paper also discusses the Common European Framework of Reference for Languages (CEFR) rubrics and offers insights into selecting and categorizing writing proficiency measures. Implications for L2 writing assessment, pedagogy, and the use of automated text analysis tools are discussed, along with suggestions for future research.


Keywords


syntactic complexity; lexical complexity; accuracy; sophistication; assessment

Full Text:

PDF

References


Chen, Y., & Baker, P. (2016). Investigating critical discourse features across second language development: Lexical bundles in rated learner essays, CEFR B1, B2 and C1. Applied Linguistics, 37(6), 849–880.

Barrot, J. S., & Agdeppa, J. Y. (2021). Complexity, accuracy, and fluency as indices of college-level L2 writers’ proficiency. Assessing Writing, 47, 100510. https://doi.org/10.1016/j.asw.2020.100510

Brumfit, C. (1984). Communicative methodology in language teaching: The roles of fluency and accuracy (vol. 129). Cambridge University Press.

Bui, G. (2021). Influence of learners’ prior knowledge, L2 proficiency and pre-task planning on L2 lexical complexity. International Review of Applied Linguistics in Language Teaching, 59(4), 543-567. https://doi.org/10.1515/iral-2018-0244

Casal, J. E., & Lee, J. J. (2019). Syntactic complexity and writing quality in assessed first-year L2 writing. Journal of Second Language Writing, 44, 51-62. https://doi.org/10.1016/j.jslw.2019.03.005

Crossley, S. A., & McNamara, D. S. (2012). Predicting second language writing proficiency: The roles of cohesion and linguistic sophistication. Journal of Research in Reading, 35(2), 115-135. http://www.ebsco.co.kr/linksource/kookmin_ls.bmp

Council of Europe. Council for Cultural Co-operation. Education Committee. Modern Languages Division. (2001). Common European Framework of Reference for Languages: Learning, teaching, assessment. Cambridge University Press.

Dagneaux, E., Denness, S., Granger, S., Meunier, F., Neff, J., & Thewissen, J. (1996). Error tagging manual.

Ellis, R. (2003). Task-based language learning and teaching. Oxford University Press.

Glover, P. (2011). Using CEFR level descriptors to raise university students’ awareness of their speaking skills. Language Awareness, 20(2), 121-133. https://doi.org/10.1080/09658416.2011.555556

Granger, S., Swallow, H., & Thewissen, J. (2022). The Louvain error tagging manual. Version 2.0. https://repository.uantwerpen.be/docman/irua/102b7d/granger_et_al__error_tagging_manual_v2_0_2022.pdf

Halliday, M. A. K. (1994). Spoken and written modes of meaning. Media texts: Authors and readers, 7, 51-73.

Halliday, M. A. K., & Martin, J. R. (1993). Writing science: Literacy and discursive power. Pittsburgh University Press.

Housen, A., & Kuiken, F. (2009). Complexity, accuracy, and fluency in second language acquisition. Applied Linguistics, 30(4), 461-473. https://doi.org/10.1093/applin/amp048

Johansson, V. (2008). Lexical diversity and lexical density in speech and writing: A developmental perspective. Working papers/Lund University, Department of Linguistics and Phonetics, 53, 61-79.

Johnson, M. D. (2017). Cognitive task complexity and L2 written syntactic complexity, accuracy, lexical complexity, and fluency: A research synthesis and meta-analysis. Journal of Second Language Writing, 37, 13-38. https://doi.org/10.1016/j.jslw.2017.06.001

Kuiken, F., Vedder, I., & Gilabert, R. (2010). Communicative adequacy and linguistic complexity in L2 writing. Communicative Proficiency and Linguistic Development: Intersections between SLA and Language Testing Research, 1, 81-100.

Khushik, G. A., & Huhta, A. (2020). Investigating syntactic complexity in EFL learners’ writing across common European framework of reference levels A1, A2, and B1. Applied Linguistics, 41(4), 506-532. https://doi.org/10.1093/applin/amy064

Laufer, B., & Nation, P. (1999). A vocabulary-size test of controlled productive ability. Language Testing, 16(1), 33-51. https://doi.org/10.1177/026553229901600103

Lu, X. (2010). Automatic analysis of syntactic complexity in second language writing. International Journal of Corpus Linguistics, 15(4), 474-496. https://doi.org/10.1075/ijcl.15.4.02lu

Lu, X. (2012). The relationship of lexical richness to the quality of ESL learners’ oral narratives. The Modern Language Journal, 96(2), 190-208. http://www.ebsco.co.kr/linksource/kookmin_ls.bmp

Malvern, D., & Richards, B. (2002). Investigating accommodation in language proficiency interviews using a new measure of lexical diversity. Language Testing, 19(1), 85-104. https://doi.org/10.1191/0265532202lt221oa

Martínez, A. C. L. (2018). Analysis of syntactic complexity in secondary education EFL writers at different proficiency levels. Assessing Writing, 35, 1-11. https://doi.org/10.1016/j.asw.2017.11.002

McCarthy, P. M., & Jarvis, S. (2007). Vocd: A theoretical and empirical evaluation. Language Testing, 24(4), 459-488. https://doi.org/10.1177/0265532207080767

Michel, M. (2017). Complexity, accuracy, and fluency in L2 production. Routledge handbook of instructed second language acquisition (pp. 50-68).

Owen, N., Shrestha, P., & Bax, S. (2021). Researching lexical thresholds and lexical profiles across the Common European Framework of Reference for Languages (CEFR) levels assessed in the APTIS test. ARAGs Research Reports Online, (1). https://www.britishcouncil.org/sites/default/files/owen_shrestha_and_bax_layout.pdf

Park, S. (2022a). Syntactic complexity in a learner written corpus and L2 speaking quality: Suggestions for distinguishing L2 speaking proficiency. Journal of Language and Linguistic Studies, 18(1), 361-371. https://doi.org/10.52462/jlls.187

Park, S. (2022b). A corpus-based comparison of syntactic complexity in spoken and written learner language. Canadian Journal of Applied Linguistics, 25(2), 47-70. https://doi.org/10.37213/cjal.2022.32477

Park, S. (2023a). Grammatical accuracy among Korean EFL learners by proficiency level. English Language and Literature, 28(4), 139-160. https://doi.org/10.46449/MJELL.2023.11.28.4.139

Park, S. (2023b). Comparison of lexical complexity in L2 speaking and writing and factors predicting English speaking proficiency. 3L: Southeast Asian Journal of English Language Studies, 29(1). http://doi.org/10.17576/3L-2023-2901-09

Read, J. (2007). Second language vocabulary assessment: Current practices and new directions. International Journal of English Studies, 7(2), 105-126. https://revistas.um.es/ijes/article/view/49021

Skehan, P. (1998). A cognitive approach to language learning. Oxford University Press.

Skehan, P. (2009). Modelling second language performance: Integrating complexity, accuracy, fluency, and lexis. Applied Linguistics, 30(4), 510-532. https://doi.org/10.1093/applin/amp047

Tabari, M. A., Lu, X., & Wang, Y. (2023). The effects of task complexity on lexical complexity in L2 writing: An exploratory study. System, 114, 103021.

Tavakoli, P., & Skehan, P. (2005). Strategic planning, task structure and performance testing. In R. Ellis (Ed.), Planning and task performance in a second language (pp. 239-277). John Benjamins.

Ure, J. (1971). Lexical density and register differentiation. In G. E. Perrem & J. L. M. Trim (Eds.), Applications of linguistics: Selected papers of the Second International Congress of Applied Linguistics (pp. 443-452). Cambridge University Press.

Wang, L., & Yu, D. (2022). UAM Corpus Tool: A convenient and comprehensive software. Sch Int J Linguist Lit, 5(10), 352-356. https://doi.org/10.36348/sijll.2022.v05i10.006

Yoon, H. J., & Polio, C. (2017). The linguistic development of students of English as a second language in two written genres. Tesol Quarterly, 51(2), 275-301. https://doi.org/10.1002/tesq.296

Yoon, S., Park, S., & Yoo, H. (2022). Learner corpus: Collection and application of the English part of Incheon National University Multi-Language Learner Corpus (INU-MULC). Applied Linguistics, 38(4), 33-58. http://dx.doi.org/10.17154/kjal.2022.12.38.4.33




DOI: https://doi.org/https://doi.org/10.24815/siele.v12i3.42039

Article Metrics

Abstract view : 0 times
PDF - 0 times

Refbacks

  • There are currently no refbacks.


Print ISSN: 2355-2794, Online ISSN: 2461-0275

This work is licensed under a Creative Commons Attribution 4.0 International License.


View Journal Stats