Assessment of Intercultural Communicative Competence in High-Stakes Speaking Tests: The case of the Czech Republic
Abstract
Background: For a long time, concepts such as the intercultural communicative competence have challenged the view of culture as purely fact-based, objective content to be transmitted to students, from whom only retention is expected. Today, cultural knowledge plays virtually no role in international standardised English exams such as TOEFL or the Cambridge English Qualifications. It is unknown to which extent this is true for examinations at the national level, and the materials used to prepare students for these examinations.
Methods: The study provides a quantitative account of exam topics in the speaking part of the final exam in Czech grammar schools. The sample consists of 206 grammar schools in the Czech Republic (58% of all such schools). The percentage of knowledge-oriented, culture-specific topics was calculated for each school. The study further analyses the content of four books used to prepare students for the exam. The sample comprises four frequently used preparatory books. The text in the chapters that deal with cultural topics is classified using Larzén’s (2005) typology of culture.
Results: The study has demonstrated that approximately 50% of the final exam topics are focused on specific English-speaking countries, their geography, history and literature. A similar tendency, but significantly more pronounced, has been found in the preparatory materials. More than 95% of their content was heavily knowledge-oriented with no discernible difference between older and recently published materials. Virtually no evidence of a skill-based or intercultural approach to culture was found.
Conclusions: The study has confirmed what is often only an unfounded assumption by researchers and it has shown that the traditional factual view of culture is still immensely popular with no change in sight. Recommendations for material writers, teachers, and teacher educators are provided at the end of the study.
Downloads
References
Baker, W. (2009). The cultures of English as a lingua franca. TESOL Quarterly, 43(4), 567-592. http://dx.doi.org/10.1002/j.1545-7249.2009.tb00187.x
Baker, W. (2022). From intercultural to transcultural communication. Language and Intercultural Communication, 22(3), 280-293. http://dx.doi.org/10.1080/14708477.2021.2001477
Bayyurt, Y. (2006). Non-native English language teachers’ perspective on culture in English as a Foreign Language classrooms. Teacher Development, 10(2), 233-247. http://dx.doi.org/10.1080/13664530600773366
Borghetti, C. (2017). Is there really a need for assessing intercultural competence? Some ethical issues. Journal of Intercultural Communication, 17(2), 1-15. http://dx.doi.org/10.36923/jicc.v17i2.736
Byram, M. (1997). Teaching and assessing intercultural communicative competence. Multilingual matters.
Byram, M. (2014). Twenty-five years on – from cultural studies to intercultural citizenship. Language, Culture and Curriculum, 27(3), 209-225. http://dx.doi.org/10.1080/07908318.2014.974329
Byrd, D., Cummings, A. H., Watzke, J., & Montes, M. F. (2011). An examination of culture knowledge: A study of L2 teachers’ and teacher educators’ beliefs and practices. Foreign Language Annals, 44(1), 4-39.
Canale, G. (2016). (Re)Searching culture in foreign language textbooks, or the politics of hide and seek. Culture and Curriculum, 29(2), 225-243. http://dx.doi.org/10.1080/07908318.2016.1144764
Deardorff, D. K. (2009). Implementing intercultural competence assessment. In D. K. Deardorff (Ed.), The SAGE handbook of intercultural competence (pp. 477-491). SAGE. http://dx.doi.org/10.4135/9781071872987
Decke-Cornill, H. (2003). ‘We would have to invent the language we are supposed to teach’: The issue of English as lingua franca in language education in Germany. In M. Byram & P. Grundy (Eds.), Context and culture in language teaching and learning (pp. 59-71). Multilingual matters.
Driscoll, P., Earl, J., & Cable, C. (2013). The role and nature of the cultural dimension in primary modern languages. Language Culture and Curriculum, 26(2), 146-160. https://doi.org/10.1080/07908318.2013.799675
Fantini, A. E. (2009). Assessing intercultural competence: Issues and tools. In D. K. Deardorff, The SAGE Handbook of Intercultural Competence (pp. 456-476). SAGE.
Forman, R. (2014). How local teachers respond to the culture and language of a global English as a Foreign Language textbook. Language, Culture and Curriculum, 27(1), 72-88. http://dx.doi.org/10.1080/07908318.2013.868473
Gu, X., & Zhao, Y. (2021). Integration of Teaching and Assessing Intercultural Communicative Competence. Chinese Journal of Applied Linguistics, 44(2), 241–258. https://doi.org/10.1515/CJAL-2021-0014
Jenkins, J., & Leung, C. (2017). Assessing English as a lingua franca. In E. Shohamy, I. G. Or & S. May (Eds.), Language testing and assessment (pp. 103-117). Springer.
Johnson, G., & Rinvolucri, M. (2010). Culture in our classrooms: Teaching language through cultural content. Delta publishing.
Ke, I.-C. (2018). Has English been increasingly tested as an international language? Evidence from 1956–2016. Language, Culture and Curriculum, 32(2), 191-206. http://dx.doi.org/10.1080/07908318.2018.1512609
Kramsch, C. (1995). The cultural component of language teaching. Language, Culture and Curriculum, 8(2), 83-92. http://dx.doi.org/10.1080/07908319509525192
Larzén, E. (2005). In pursuit of an intercultural dimension in EFL-teaching: Exploring cognitions among Finland-Swedish comprehensive school teachers. Åbo akademi university press.
Lee, K.-Y. (2009). Treating culture: What 11 high school EFL conversation textbooks in South Korea do. English Teaching: Practice and Critique, 8(1), 76-96.
Liddicoat, A., & Scarino, A. (2010). Eliciting the intercultural in foreign language education at school. In A. Paran & L. Sercu (Eds.), Testing the untestable in language education (pp. 52-73). Multilingual matters.
Liddicoat, A., & Scarino, A. (2012). Assessing intercultural language learning. In J. Jackson (Ed.), The Routledge handbook of language and intercultural communication (pp. 123-142). Routledge.
Liu, K.-L. (2021). Teaching and Assessing Intercultural Communicative Competence (ICC): Experience with Student-Authored Critical Incidents. Taiwan Journal of TESOL, 18(1), 1–27. https://doi.org/10.30397/TJTESOL.202104_18(1).0001
Llosa, L. (2017). Assessing students’ content knowledge and language proficiency. In E. Shohamy, I. G. Or & S. May, Language testing and assessment (pp. 3-14). Springer.
Llurda, E., & Calvet-Terré, J. (2022). Native-speakerism and non-native second language teachers: A research agenda. Language Teaching, 57(2), 229-245. https://doi.org/10.1017/S0261444822000271
McIntyre, D. (2005). Bridging the gap between research and practice. Cambridge Journal of Education, 35(3), 357-382. http://dx.doi.org/10.1080/03057640500319065
McNamara, T. (2000). Language testing. Oxford University Press.
Murphy, E. (1988). The cultural dimension in foreign language teaching: Four models. Language, Culture and Curriculum, 1(2), 147-163. http://dx.doi.org/10.1080/07908318809525033
Paige, M. R., Jorstad, H., Siaya, L., Klein, F., & Colby, J. (1999). Culture learning in language education: A review of the literature. In R. M. Paige, D. L. Lange & Y. A. Yeshova, Culture as the Core: Integrating Culture into the Language Curriculum (pp. 47-113). University of Minnesota.
Rodríguez, A. R., & Espinar, Á. M. (2015). General and specific culture learning in EFL textbooks aimed at adult learners in Spain. Studia Anglica Posnaniensia, 50(1), 5-25.
Safa, M. A., & Tofighi, S. (2021). Intercultural communicative competence beliefs and practices of Iranian pre-service and in-service EFL teachers. Innovation in Language Learning and Teaching, 16(2), 164–175. https://doi.org/10.1080/17501229.2021.1889562
Scarino, A. (2010). THE ISSUE: Assessing intercultural capability in learning languages: A renewed understanding of language, culture, learning, and the nature of assessment. The Modern Language Journal, 94(1), 324-329. http://dx.doi.org/10.1111/j.1540-4781.2010.01023.x
Scarino, A. (2017). Culture and language assessment. In E. Shohamy, I. G. Or & S. May (Eds.), Language testing and assessment (pp. 15-32). Springer.
Seidlhofer, B. (2005). English as a lingua franca. ELT Journal, 59(4), 339-341. https://doi.org/110.1093/elt/cci064
Sercu, L. (2002). Autonomous learning and the acquisition of intercultural communicative competence: Some implications for course development. Language, Culture and Curriculum, 15(1), 61-74. http://dx.doi.org/10.1080/07908310208666633
Sercu, L. (2004). Assessing intercultural competence: A framework for systematic test development in foreign language education and beyond. Intercultural Education, 15(1), 73-89. http://dx.doi.org/10.1080/1467598042000190004
Sercu, L. (2010). Assessing intercultural competence: More questions than answers. In A. Paran & L. Sercu (Eds.), Testing the untestable in language education (pp. 17-34). Multilingual Matters.
Shin, J., Eslami, Z. R., & Chen, W.-C. (2011). Presentation of local and international culture in current international English- language teaching textbooks. Language, Culture and Curriculum, 24(3), 253-268. http://dx.doi.org/10.1080/07908318.2011.614694
Schauer, G. A. (2020). Measuring intercultural competence. In P. Winke & T. Brunfaut (Eds.), The Routledge handbook of second language acquisition and language testing (pp. 359-370). Routledge.
Vanderlinde, R., & van Braak, J. (2010). The gap between educational research and practice: Views of teachers, school leaders, intermediaries and researchers. British Education Research Journal, 36(2), 299-316. http://dx.doi.org/10.1080/01411920902919257
Weir, C. J. (2005). Testing as validity. In C. J. Weir, Language testing and validation: An evidence-based approach (pp. 1-40). Palgrave Macmillan.
Zerzová, J. (2012). Interkulturní komunikativní kompetence a její rozvíjení v hodinách anglického jazyka na 2. stupni ZŠ [Intercultural communicative competence and its development in Czech lower-secondary English classes]. Munipress.
Zotzmann, K. (2015). The impossibility of defining and measuring intercultural competencies. In D. J. Rivers (Ed.), Resistance to the known: Counter-conduct in language education (pp. 168-191). Palgrave Macmillan. http://dx.doi.org/10.1057/9781137345196_8
Copyright (c) 2025 National Research University Higher School of Economics
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the Copyright Notice.
