Comparing Two Measures of L2 Depth of Vocabulary Knowledge Using their Relationship with Vocabulary Size
Abstract
Background. This study compared two tests of second language (L2) depth of vocabulary knowledge, namely the word association test (WAT) and vocabulary knowledge scale (VKS), with respect to their associations with vocabulary size. The same relationships were further examined separately for the five word-frequency bands of the vocabulary size test.
Method. 115 Iranian English as a Foreign Language (EFL) learners who were native speakers of Persian took the WAT, VKS, and Vocabulary Levels Test (VLT). The selected participants were undergraduates who ranged from freshmen to junior and were both male (n=47) and female (n=68) students.
Results. The outcomes of multiple linear regression analyses indicated that: (a) while both measures of vocabulary depth were predictive of the VLT, the WAT had a higher association with the dependent variable; (b) both the WAT and VKS were predictive of the high-frequency vocabulary, with the relationships being more significant for the WAT; (c) the WAT could significantly predict the mid-frequency vocabulary, whereas the VKS had no significant contribution; and (d) while the VKS was significantly associated with the low-frequency vocabulary, the WAT had no significant contribution to the prediction of this level.
Implications. The implications of the findings are interpreted with reference to the suitability of both the WAT and VKS depending on the type of input, expected response, and desired frequency of the target words.
Downloads
References
Abdullah, K. I., Puteh, F., Azizan, A. R., Hamdan, N. N., & Saude, S. (2013). Validation of a controlled productive Vocabulary Levels Test below the 2000-word level. System, 41(2), 352-364. DOI: https://doi.org/10.1016/j.system.2013.03.005
Akbarian, I. (2008). The role of vocabulary knowledge in predicting performance on reading comprehension item types [Unpublished doctoral dissertation]. University of Tehran, Iran.
Akbarian, I. (2010). The relationship between vocabulary size and depth for ESP/EAP learners. System, 38(3), 391-401. DOI: https://doi.org/10.1016/j.system.2010.06.013
Alavi, S. M., & Akbarian. I. (2012). The role of vocabulary size in predicting performance on TOEFL reading item types. System, 40(3), 376-385. DOI: https://doi.org/10.1016/j.system.2012.07.002
Alharthi, T. (2020). Investigating the relationship between vocabulary knowledge and FL speaking performance.International Journal of English Linguistics, 10(1), 37-46. DOI: https://doi.org/10.5539/ijel.v10n1p37
Atai, M. R. & Dabbagh, A. (2010). Investigating vocabulary depth and semantic set in EFL learners' vocabulary use in writing. TELL Journal, 4(2), 27-49.
Baba, K. (2009). Aspects of lexical proficiency in writing summaries in a foreign language. Journal of Second Language Writing, 18(3), 191-208. DOI: https://doi.org/10.1016/j.jslw.2009.05.003
Beglar, D. (2010). A Rasch-based validation of the Vocabulary Size Test. Language Testing, 27(1), 101-118. https://doi.org/10.1177%2F0265532209340194.
Cameron, L. (2002). Measuring vocabulary size in English as an additional language. Language Teaching Research, 6(2), 145-173. https://doi.org/10.1191%2F1362168802lr103oa.
Dabbagh, A. (2016). The predictive role of vocabulary knowledge in listening comprehension: depth or breadth? International Journal of English Language and Translation Studies, 4(3), 1-13.
Dabbagh, A., & Janebi Enayat, M. (2019). The role of vocabulary breadth and depth in predicting second language descriptive writing performance. Language Learning Journal, 47(5), 575-590. DOI: https://doi.org/10.1080/09571736.2017.1335765
David, A. (2008). Vocabulary breadth in French L2 learners. The Language Learning Journal, 36(2), 167-180. DOI: https://doi.org/10.1080/09571730802389991
Derakhshan, A., & Janebi Enayat, M. (2020). High- and mid-frequency vocabulary size as predictors of Iranian university EFL students' speaking performance. Iranian Journal of English for Academic Purposes, 9(3), 1-13.
Duong, T. M. (2022). Insights into ESP Vocabulary Learning Strategies Used by Vietnamese Tertiary Students. Journal of Language and Education, 8(1), 38-49. DOI: https://doi.org/10.17323/jle.2022.10924
Elgort, I. (2013). Effects of L1 definitions and cognate status of test items on the Vocabulary Size Test. Language Testing, 30(2), 253-272. https://doi.org/10.1177%2F0265532212459028.
Field, A. (2009). Discovering statistics using SPSS (3rd ed.). Sage Publications.
Geranpayeh, A. (2003). A quick review of the English Quick Placement Test. UCLES Research Notes, 12, 8-10.
Greidanus, T., & Nienhuis, L. (2001). Testing the quality of word knowledge in a second language by means of word associations: Types of distracters and types of associations. Modern Language Journal, 85(4), 567-577. DOI: https://doi.org/10.1111/0026-7902.00126
Greidanus, T., Beck, B., & Wakely, R. (2005). Testing the development of French word knowledge by advanced Dutch and English-speaking learners and native speakers. Modern Language Journal, 89(2), 221-233. DOI: https://doi.org/10.1111/j.1540-4781.2005.00276.x
Gyllstad, H. (2007). Testing English collocations. Media-Tryck, Lund University.
Gyllstad, H., Vilkaite, L., & Schmitt, N. (2015). Assessing vocabulary size through multiple choice formats: Issues with guessing and sampling rates. ITL International Journal for Applied Linguistics, 166(2), 278-306. DOI: https://doi.org/10.1075/itl.166.2.04gy1
Haastrup, K., & Henriksen. B. (2000). Vocabulary acquisition: acquiring depth of knowledge through network building.International Journal of Applied Linguistics, 10(2), 221-240. DOI: https://doi.org/10.1111/j.1473-4192.2000.tb00149.x
Henriksen, B. (1999). Three dimensions of vocabulary development. Studies in Second Language Acquisition, 21(2), 303-317. DOI: https://doi.org/10.1017/S0272263199002089
Henriksen, B. (2008). Declarative lexical knowledge. In D. Albrechtsen, K. Haastrup, & B. Henriksen (Eds.), Vocabulary and writing in a first and second language (pp. 22-66). Palgrave Macmillan.
Huang, H.-F. (2006). Breadth and depth of English vocabulary knowledge: Which really matters in the academic reading performance of Chinese university students? [Unpublished master's thesis]. McGill University.
Ishii, T. (2005). Diagnostic tests of vocabulary knowledge for Japanese learners of English [Unpublished doctoral dissertation]. University of Nottingham.
Ishii, T., & N. Schmitt. (2009). Developing an integrated diagnostic test of vocabulary size and depth. RELC Journal, 40(5), 5-22. https://doi.org/10.1177%2F0033688208101452.
Janebi Enayat, M., & Amirian, S. M. R. (2020). The relationship between vocabulary size and depth for Iranian EFL learners at different language proficiency levels. Iranian Journal of Language Teaching Research, 8(2), 97-114. DOI: https://doi.org/10.30466/ijltr.2020.120891
Janebi Enayat, M., & Babaii, E. (2018). Reliable predictors of reduced redundancy test performance: The interaction between lexical bonds and test takers' depth and breadth of vocabulary knowledge. Language Testing, 35(1), 121-144. DOI: https://doi.org/10.1177/0265532216683223
Janebi Enayat, M., & Derakhshan, A. (2021). Vocabulary size and depth as predictors of second language speaking ability. System, 99, 1-15. DOI: https://doi.org/10.1016/j.system.2021.102521
Janebi Enayat, M., Amirian, S. M. R., Zareian, G., & Ghaniabadi, S. (2018). Reliable measure of written receptive vocabulary size: Using the L2 depth of vocabulary knowledge as a yardstick. Sage Open, 8(1), 1-15. DOI: https://doi.org/10.1177/2158244017752221
Laufer, B., Elder, C., Hill, K., & Congdon, P. (2004). Size and strength: Do we need both to measure vocabulary knowledge? Language Testing, 21(2), 202-226. https://doi.org/10.1191%2F0265532204lt277oa.
Mathews, J. (2018). Vocabulary for listening: Emerging evidence for high and mid-frequency vocabulary knowledge. System, 72, 23-36. DOI: https://doi.org/10.1016/j.system.2017.10.005
Meara, P., & Wolter, B. (2004). V-Links: beyond vocabulary depth. In D. Albrechtsen, K. Haastrup, & B. Henriksen (Eds.), Writing and vocabulary in foreign language acquisition (pp. 85-96). Museum Tusculanum Press.
Milton, J. (2009). Measuring second language vocabulary acquisition. Multilingual Matters.
Nassaji, H. (2006). The relationship between depth of vocabulary knowledge and L2 learners' lexical inferencing strategy use and success. The Modern Language Journal, 90(3), 387-40. DOI: https://doi.org/10.1111/j.1540-4781.2006.00431.x
Nation, I.S.P. (1983). Testing and teaching vocabulary. Guidelines, 5, 12-25.
Nation, I.S.P. (1990). Teaching and learning vocabulary. Newbury House.
Nation, I.S.P. (2001). Learning vocabulary in another language. Cambridge University Press.
Nation, P., & Beglar, D. (2007). A vocabulary size test. The Japan Association for Language Teaching, 31(7), 9-12.
Nguyen, L.T.C., & Nation, I.S.P. (2011). A bilingual vocabulary size test of English for Vietnamese learners. RELC Journal, 42(1), 86-99. https://doi.org/10.1177%2F0033688210390264.
Noro, T. (2002). The roles of depth and breadth of vocabulary knowledge in reading comprehension in EFL. ARELE: Annual Review of English Language Education in Japan, 13, 71-80. DOI: https://doi.org/10.20581/arele.16.0_141
Nurweni, A. & Read, J. (1999). The English vocabulary knowledge of Indonesian university students. English for Specific Purposes, 18(2), 161-175. DOI: https://doi.org/10.1016/S0889-4906(98)00005-2
Paribakht, T. S., & Wesche, M. (1993). Reading comprehension and second language development in a comprehension-based ESL program. TESL Canada Journal, 11(1), 9-29. DOI: https://doi.org/10.18806/tesl.v11i1.623
Paribakht, T.S., & Wesche, M. (1997). Vocabulary enhancement activities and reading for meaning in second language vocabulary acquisition. In J. Coady & T. Huckin (Eds.), Second language vocabulary acquisition: A rationale for pedagogy (pp.174-200). Cambridge University Press.
Qian, D. (1998). Depth of vocabulary knowledge: assessing its role in adults' reading comprehension in English as a second language. [Unpublished doctoral dissertation]. University of Toronto, Canada.
Qian, D. (1999). Assessing the roles of depth and breadth of vocabulary knowledge in reading comprehension. The Canadian Modern Language Review, 56(2), 283-307. DOI: https://doi.org/10.3138/cmlr.56.2.282
Qian, D. (2002). Investigating the relationship between vocabulary knowledge and academic reading performance: an assessment perspective. Language Learning, 52(3), 513-536. DOI: https://doi.org/10.1111/1467-9922.00193
Read, J. (1993). The development of a new measure of L2 vocabulary knowledge. Language Testing, 10(3), 355-371. https://doi.org/10.1177%2F026553229301000308.
Read, J. (1995). Validating the word association format as a measure of depth of vocabulary knowledge. Paper presented at the 17th Language Testing Colloquium, Long Beach, CA.
Read, J. (1998). Validating a test to measure depth of vocabulary knowledge. In A.J. Kunnan (Ed.), Validation in language assessment (pp. 41-60). Lawrence Erlbaum.
Read, J. (2000). Assessing vocabulary. Cambridge University Press.
Read, J. (2004). Plumbing the depth: how should the construct of vocabulary knowledge be defined? In P. Bogaards & B. Laufer (Eds.), Vocabulary in a second language, (pp. 209-227). Benjamins.
Read, J. (2007). Second language vocabulary assessment: Current practices and new directions.International Journal of English Studies, 7(2), 105-125. DOI: https://doi.org/10.6018/ijes.7.2.49021
Roche, T., & Harrington, M. (2013). Recognition vocabulary knowledge as a predictor of academic performance in an English as a foreign language setting. Language Testing in Asia, 3(12), 1-13. DOI: https://doi.org/10.1186/2229-0443-3-12
Schmitt, N. (1999). The relationship between TOEFL vocabulary items and meaning, association, collocation and word-class knowledge. Language Testing, 16(2), 189-216. https://doi.org/10.1177%2F026553229901600204.
Schmitt, N. (2010). Researching vocabulary: A vocabulary research manual. Palgrave Macmillan.
Schmitt, N. (2014). Size and depth of vocabulary knowledge: what the research shows. Language Learning, 64(4), 913-951. DOI: https://doi.org/10.1111/lang.12077
Schmitt, N., & Schmitt, D. (2014). A reassessment of frequency and vocabulary size in L2 vocabulary teaching. Language Teaching, 47(4), 484-503. DOI: https://doi.org/10.1017/S0261444812000018
Schmitt, N., Ching Ng, J. W., & Garras, J. (2011). The word associates format: Validation evidence. Language Testing, 28(1), 105-126. https://doi.org/10.1177%2F0265532210373605.
Schmitt, N., Schmitt, D., & Clapham, C. (2001). Developing and exploring the behavior of two new versions of the vocabulary levels test. Language Testing, 18(1), 55-88. https://doi.org/10.1177%2F026553220101800103.
Schoonen, R., & Verhallen, M. (2008). The assessment of deep word knowledge in young first and second language learners. Language Testing, 25(2), 211-236. https://doi.org/10.1177%2F0265532207086782.
Shimamoto, T. (2000). An analysis of receptive vocabulary knowledge: Depth versus breadth. The Japan-British Association for English Teaching, 4, 69-80.
Stewart, J. (2014). Do multiple-choice options inflate estimates of vocabulary size on the VST? Language Assessment Quarterly, 11(3), 271-282. DOI: https://doi.org/10.1080/15434303.2014.922977
Stewart, J., & White, D. A. (2011). Estimating guessing effects on the Vocabulary Levels Test for differing degrees of word knowledge. TESOL Quarterly, 45(2), 370-380. DOI: https://doi.org/10.5054/tq.2011.254523
Uchihara, T., & Clenton, J. (2020). Investigating the role of vocabulary size in second language speaking ability. Language Teaching Research, 24(4), 540-556. DOI: https://doi.org/10.1177/1362168818799371
Uchihara, T., & Clenton, J. (2022). The role of spoken vocabulary knowledge in second language speaking proficiency. The Language Learning Journal. Advance online publication. DOI: https://doi.org/10.1080/09571736.2022.2080856
Vermeer, A. (2001). Breadth and depth of vocabulary in relation to L1/L2 acquisition and frequency of input. Applied Psycholinguistics, 22(2), 217-234. DOI: https://doi.org/10.1017/S0142716401002041
Webb, S. (2013). Depth of vocabulary knowledge. In C.A. Chapelle (Ed.), The encyclopedia of applied linguistics (pp. 1-8). Blackwell Publishing Ltd.
Webb, S. A., & Sasao, Y. (2013). New directions in vocabulary testing. Language Testing, 44(3), 263-277. https://doi.org/10.1177%2F0033688213500582.
Webb, S., Sasao, Y., & Ballance, O. (2017). The updated Vocabulary Levels Test: Developing and validating two new forms of the VLT. ILT International Journal of Applied Linguistics, 168(1), 33-69. DOI: https://doi.org/10.1075/itl.168.1.02web
Wesche, M., & Paribakht, T. S. (1996). Assessing second language vocabulary knowledge: Depth versus breadth. The Canadian Modern Language Review, 53(1), 13-40. DOI: https://doi.org/10.3138/cmlr.53.1.13
Xing, P., & Fulcher, G. (2007). Reliability assessment for two versions of Vocabulary Levels Tests. System, 35(2), 182-191. DOI: https://doi.org/10.1016/j.system.2006.12.009
Zareva, A. (2005). Models of lexical knowledge assessment of second language learners of English at higher levels of language proficiency. System, 33(4), 547-562. DOI: https://doi.org/10.1016/j.system.2005.03.005
Zhang, B., & Annual, S. B. (2008). The role of vocabulary in reading comprehension: the case of secondary school students learning English in Singapore. RELC Journal, 39(1), 51-76. https://doi.org/10.1177%2F0033688208091140.
Zhang, D. (2012). Vocabulary and grammatical knowledge in L2 reading comprehension: A structural equation modeling study. Modern Language Journal, 96, 554-571. DOI: https://doi.org/10.1111/j.1540-4781.2012.01398.x
Zhang, D., & Koda, K. (2017). Assessing L2 vocabulary depth with word associates format tests: Issues, findings, and suggestions. Asian-Pacific Journal of Second and Foreign Language Education, 2(1), 1-30. DOI: https://doi.org/10.1186/s40862-017-0024-0
Zhong, H. F. (2016). The relationship between receptive and productive vocabulary knowledge: a perspective from vocabulary use in sentence writing. The Language Learning Journal, 46(4), 1-17. DOI: https://doi.org/10.1080/09571736.2015.1127403
Copyright (c) 2022 National Research University Higher School of Economics
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the Copyright Notice.
