The Language of Praise in Russian Students’ Evaluation of Teaching
Abstract
Recent decades have seen a dramatic rise in student evaluation of teaching (SET). However, they have overwhelmingly focused on quantitative ratings, neglecting students’ written feedback. This study addresses the lack of qualitative research on SET by applying a semantic theory and computational methods for analysing the language of positive feedback comments provided by students of the Higher School of Economics (HSE) in Russia. Analysing a corpus of student commentary about teaching also contributes to the theory of pragmatics as the approach to analysing qualitative evaluations of teaching is based on the premise that students’ positive feedback can be treated as a sort of the compliment/praise speech act reflecting cultural specificity. Our findings showed that quantitatively the most common semantic pattern used by HSE students is ACTOR + (AUGMENTOR) EVALUATOR + PHYSICAL/MENTAL ACTION PERFORMED BY THE ACTOR + (AUGMENTOR) EVALUATOR. Thus, HSE students tend to praise the teacher more often than the other components of the teaching process and the teacher’s behaviour, thoughts, and feelings are viewed as more important than skills and speech.
Downloads
References
Ahmad, S. Z. (2015). Evaluating student satisfaction of quality at international branch campuses. Assessment & Evaluation in Higher Education, 40(4), 488-507. DOI: https://doi.org/10.1080/02602938.2014.925082
Alhija, F. N. A., & Fresko, B. (2009). Student evaluation of instruction: What can be learned from students' written comments? Studies in Educational Evaluation, 35(1), 37-44. DOI: https://doi.org/10.1016/j.stueduc.2009.01.002
Allami, H., & Montazeri, M. (2012). Iranian EFL learners' compliment responses. System, 40(4), 466-482. DOI: https://doi.org/10.1016/j.system.2012.10.010
Amin, M. (1994). Gender as a discriminating factor in the evaluation of teaching. Assessment & Evaluation in Higher Education, 19(2), 135-143. DOI: https://doi.org/10.1080/0260293940190206
Austin, J. L. (1962). How to do things with words. Harvard University Press.
Bai, G. (2015). On the pragmatic patterns of Chinese college English learners' compliment responses. International journal of English linguistics, 5(4), 106-119. DOI: https://doi.org/10.5539/ijel.v5n4p106
Blair, E., & Noel, K. V. (2014). Improving higher education practice through student evaluation systems: Is the student voice being heard? Assessment & Evaluation in Higher Education, 39(7), 879-894. DOI: https://doi.org/10.1080/02602938.2013.875984
Brophy, J. (1981). Teacher praise: A functional analysis. Review of Educational Research, 51(1), 5-32. http://dx.doi/. DOI: https://doi.org/10.3102/00346543051001005
Brown, P., & Levinson, S. C. (1987). Politeness: Some universals in language usage (Studies in Interactional Sociolinguistics). Cambridge University Press.
Burnett, P. C. (2002). Teacher praise and feedback and students' perceptions of the classroom environment. Educational Psychology, 22(1), 51-6. DOI: https://doi.org/10.1080/01443410120101215
Busygina, A. L., & Busygina, T. A. (2013). Influence of the teacher's emotionality on the students' assessment of their pedagogical image. Samara Journal of Science, 4(5), 44-45.
Centra, J., & Gaubatz, N. (2000). Is there gender bias in student evaluations of teaching? Journal of Higher Education, 71(1), 17-33. DOI: https://doi.org/10.2307/2649280
Chen, Ch. Y., Wang, Sh. Y., & Yang, Y. F. (2017). A study of the correlation of the improvement of teaching evaluation scores based on student performance grades. International Journal of Higher Education, 6(2), 162-168. DOI: https://doi.org/10.5430/ijhe.v6n2p162
Cheng, J., & Marsh, H. W. (2010). National student survey: Are differences between universities and courses reliable and meaningful? Oxford Review of Education, 36(6), 693-712. DOI: https://doi.org/10.1080/03054985.2010.491179
Davison, E., & Price, J. (2009). How do we rate? An evaluation of online student evaluations. Assessment & Evaluation in Higher Education, 34(1), 51-65. DOI: https://doi.org/10.1080/02602930801895695
Dziedziul, P. (2017). The universal categories of praxeology in light of natural semantic metalanguage theory. Libertarian Papers, 9(2), 249-276. DOI: https://doi.org/10.2307/409588
Goddard, C. (2008). Natural semantic metalanguage: The state of the art. In Goddard, C. (Ed.), Cross-Linguistic semantics. Studies in language companion series (vol. 102, pp.1-34). John Benjamins Publishing Company. DOI: https://doi.org/10.1075/slcs.102
Grainger, K. (2018). We're not in a club now: A neo-Brown and Levinson approach to analyzing courtroom data. Journal of Politeness Research, 14(1), 19-38. DOI: https://doi.org/10.1515/pr-2017-0039
Grice, H. P. (1975). Logic and conversation. In Cole, P. & Morgan, J. L. (Eds.), Studies in syntax and semantics: Speech acts (vol. 3, pp. 41-58). Academic Press.
Herbert, R. K. (1986). Say thank you - or something. American Speech, 61(1), 76-88. DOI: https://doi.org/10.2307/454710
Herbert, R. K. (1989). The ethnography of English compliments and compliment responses. In Oleksy, W. (Ed.), Contrastive Pragmatics (pp.3-37). John Benjamins Publishing Company. DOI: https://doi.org/10.1075/pbns.3.05her
Holmes, J. (1988). Compliments and compliment responses in New Zealand. Anthropological Linguistics, 28(4), 485-508.
Holmes, J., & Brown, D.F. (1987). Teachers and students learning about compliments. TESOL Quarterly, 21(3), 523-546. DOI: https://doi.org/10.2307/3586501
Humboldt, W. (1999). On language: On the diversity of human language construction and its influence on the mental development of the human species. Cambridge University Press.
Huth, Th. (2006). Negotiating structure and culture: L2 learners' realization of L2 compliment-response sequences in talk-in-interaction. Journal of Pragmatics, 38(12), 2025-2050. DOI: https://doi.org/10.1016/j.pragma.2006.04.010
Huxham, M., Laybourn, Ph., Cairncross, S., Gray, M., Brown, N., Goldfinch, J., & Earl, Sh. (2008). Collecting student feedback: A comparison of questionnaire and other methods. Assessment & Evaluation in Higher Education, 33(6), 675-686. DOI: https://doi.org/10.1080/02602930701773000
Hyland, F., & Hyland, K. (2001). Sugaring the pill: Praise and criticism in written feedback. Journal of Second Language Writing, 10(3), 185-212. DOI: https://doi.org/10.1016/S1060-3743(01)00038-8
Issers, O. S. (2006). Kommunikativnye strategii i taktiki russkoi rechi [Communicative strategies and tactics of Russian speech]. URSS.
Kachevskaia, A. A. (2007). Kompliment kak verbal'noie sredstvo obshchenia [Compliment as a verbal means of communication]. MSLU.
Leech, G. N. (1983). Principles of pragmatics. Longman.
Light, G., & Cox, R. (2001). Learning and teaching in higher education: The reflective professional. Paul Chapman.
Lin, Ch. Y., Woodfield, H., & Ren, W. (2012). Compliments in Taiwan and Mainland Chinese: The influence of region and compliment topic. Journal of Pragmatics, 44(11), 1486-1502. DOI: https://doi.org/10.1016/j.pragma.2012.06.012
Maíz-Arévalo, C. (2012). ‘‘Was that a compliment?'' Implicit compliments in English and Spanish. Journal of Pragmatics, 44(8), 980-996. DOI: https://doi.org/10.1016/j.pragma.2012.04.004
Manes, J. (1983). Compliments: A mirror of cultural values. In N. Wolfson & E. Judd (Eds.), Sociolinguistics and language acquisition (pp. 96-102). Newbury House.
Manes, J., & Wolfson, N. (1981). The compliment formula. In F. Coulmas (Ed.), Conversational routine (pp.115-132). Mouton.
Nguyen Thu Huong. (2013). K voprosu o leksicheskih sredstvah vyrazheniia komplimenta v sovremennoi russkoi i vietnamskoi kul'ture [Lexical means of the compliment in Russian and Vietnamese cultures]. Global Scientific Potential. Philology, 12(33), 74-78.
Otto, J., Sanford, D. A., & Ross, D. N. (2008). Does ratemyprofessor.com really rate my professor? Assessment & Evaluation in Higher Education, 33(4), 354-368. DOI: https://doi.org/10.1080/02602930701293405
Rajput, Q., Haider, S., & Ghani, S. (2016). Lexicon-based sentiment analysis of teachers' evaluation. Applied Computational Intelligence and Soft Computing, 2016, Article ID 2385429. DOI: https://doi.org/10.1155/2016/2385429
Richardson, J. T. E., Slater, J. B., & Wilson, J. (2007). The national student survey: Development, findings and implications. Studies in Higher Education, 32(24), 557-580. DOI: https://doi.org/10.1080/03075070701573757
Saif, H., He, Y., Fernandez, M., & Alani, H. (2014). Semantic patterns for sentiment analysis of Twitter. In Mika, P., Tudorache, T., Bernstein, A., Welty, Ch. et al. (Eds.), Lecture notes in computer science (vol. 8797, pp. 324-340). Springer. DOI: https://doi.org/10.1007/978-3-319-11915-1_21
Sapir, E. (1929). The status of Linguistics as a science. Language, 5(4), 207-214. DOI: https://doi.org/10.2307/409588
Sarwar, M., Dildar, M., Shah, A. A., & Hussain, S. (2017). Relationship among students' academic achievement, students' evaluation of teacher and students' evaluation of course. The Dialogue, 12(1), 50-58.
Searle, J. R. (1969). Speech acts: An essay in the philosophy of language. Cambridge University Press.
Searle, J. R. (1975). A taxonomy of illocutionary acts. University of Minnesota Press.
Seifoori, Z., & Emadi, S. E. (2015). A Contrastive study of American and Persian compliment speech act. Modern Journal of Language Teaching Methods, 5(3), 543-549.
Shcheboleva, I. B., & Sun', M. (2016). Lingvokul'turologicheskie osobennosti komplimenta v russkom i kitaiskom jazykah [Linguocultural features of compliment in Russian and Chinese]. Problemy prepodavania philologicheskih distsyplin inostrannym uchashchimsya, 4, 449-455.
Solodka, A., Sukhomlynsky, V. O., & Perea, L. (2018). The speech act of complimenting as part of the Ukrainian, Russian and English-Speaking Communities: Ukraine and the USA. Arab World English Journal, 9(4), 39 -55. DOI: https://doi.org/10.24093/awej/vol9no4.3
Spencer, K. J., & Schmelkin, L. P. (2002). Student perspectives on teaching and its evaluation. Assessment & Evaluation in Higher Education, 27(5), 397-409. DOI: https://doi.org/10.1080/0260293022000009285
Spooren, P., Brockx, B., & Mortelmans, D. (2013). On the validity of student evaluation of teaching: The state of the art. Review of Educational Research, 83(4), 598-642. DOI: https://doi.org/10.3102/0034654313496870
Stewart, M. (2015). The language of praise and criticism in a student evaluation survey. Studies in Educational Evaluation, 45, 1-9. DOI: https://doi.org/10.1016/j.stueduc.2015.01.004
Steyn, C., Davies, C., & Sambo, A. (2018). Eliciting student feedback for course development: The application of a qualitative course evaluation tool among business research students. Assessment and Evaluation in Higher Education, 44(1), 11-24. DOI: https://doi.org/10.1080/02602938.2018.1466266
Suketi, T. M. (2014). Analysis of compliment response strategies in consultation between students and teacher [Undergraduate thesis]. Universitas Kristen Satya Wacana.
Tabakowska, E. (2001). Kognitywne podstawy języka i językoznawstwa. Towarzystwo Autorów i Wydawców Prac Naukowych University.
Tang, Ch. H., & Zhang, G. Q., (2009). A contrastive study of compliment responses among Australian English and Mandrian Chinese speakers. Journal of Pragmatics, 41(2), 325-345. DOI: https://doi.org/10.1016/j.pragma.2008.05.019
Thawabieh, A. M. (2017). A comparison between students' self-assessment and teachers' assessment. Journal of Curriculum and Teaching, 6(1), 14-20. DOI: https://doi.org/10.5430/jct.v6n1p14
Wierzbicka, A. (1980). Lingua mentalis: The semantics of natural language. Academic Press Australia.
Wierzbicka, A. (1991). Cross-cultural pragmatics: The semantics of human interaction. Mouton de Gruyter.
Wierzbicka, A. (1996). Semantics: Primes and universals. Oxford University Press.
Whorf, B. L. (1982). Language, thought and reality: Selected writings of Benjamin Lee Whorf. MIT Press.
Wolfson, N. (1981). Invitations, compliments and the competence of the native speaker. International Journal of Psycholinguistics, 8(4), 7-22.
Wolfson, N. (1983). An empirically based analysis of complimenting in American English. In N. Wolfson & E. Judd (Eds.), Sociolinguistics and Language Acquisition (pp. 82-95). Newbury House.
Wolfson, N., & Manes, J. (1980). The compliment as a social strategy. Papers in Linguistics: International Journal of Human Communication, 13(3), 410-451. DOI: https://doi.org/10.1080/08351818009370503
Wongsurawat, W. (2011). What's a comment worth? How to better understand student evaluations of teaching. Quality Assurance in Education, 19(1), 67-83. DOI: https://doi.org/10.1108/09684881111107762
Zaitseva, E., Milsom, C., & Stewart, M. (2013). Connecting the dots: Using concept maps for interpreting student satisfaction. Quality in Higher Education, 19(2), 225-247. DOI: https://doi.org/10.1080/13538322.2013.802576
Alangari, M., Jaworska, S., & Laws, J. (2020). Who's afraid of phrasal verbs? The use of phrasal verbs in expert academic writing in the discipline of linguistics. Journal of English for Academic Purposes, 43, 100814. DOI: https://doi.org/10.1016/j.jeap.2019.100814
Arakin, V. (1989). Comparative typology of the English and Russian languages. Prosveshhenie.
Ariel, M. (1990). Accessing Noun-Phrase Antecedents. Routledge.
Bickerton, D. (1981). Roots of language. Karoma Press. http://langsci-press.org/catalog/book/91.
Chernyakhovskaya, L. (1976). Translation and the structure of meaning. Mezhdunarodnye otnoshenija.
Chesterman, A. (2005). On definiteness: A study with special reference to English and Finnish (Digitally printed 1st pbk. version). Cambridge University Press.
Chrabaszcz, A., & Jiang, N. (2014). The role of the native language in the use of the English nongeneric definite article by L2 learners: A cross-linguistic comparison. Second Language Research, 30(3), 351-379. DOI: https://doi.org/10.1177/0267658313493432
Christophersen, P. (1939). The Articles: A study of Their Theory and Use in English. Einar Munksgaard.
Dolgina, E. (2008). The study of the articles in modern English: A cognitive approach. Issues of Cognitive Linguistics, 4, 25-32.
Epstein, R. (2002). The definite article, accessibility, and the construction of discourse referents. Cognitive Linguistics, 12(4), 333-378. DOI: https://doi.org/10.1515/cogl.2002.007
Grannis, O. C. (1972). The definite article conspiracy in English. Language Learning, 22(2), 275-289. DOI: https://doi.org/10.1111/j.1467-1770.1972.tb00088.x
Hawkins, J. (1978). Definiteness and indefiniteness: A study in reference and grammaticality prediction. Routledge.
Hawkins, J. (1980). On surface definite articles in English ‘Proving underlying indefiniteness and explaining the conversion to definiteness'. In The Semantics of Determiners (RLE Linguistics B: Grammar) (vol. 24, pp. 41-66). Routledge.
Hawkins, J. (1991). On (In)definite Articles: Implicatures and (un)grammaticality Prediction. Journal of Linguistics, 27(2), 405-442.
Hinkel, E. (2004). Tense, aspect and the passive voice in L1 and L2 academic texts. Language Teaching Research, 8(1), 5-29. DOI: https://doi.org/10.1191/1362168804lr132oa
Ilyish, B. (1948). Modern English language (2nd ed.). Izdatelstvo literatury na angliiskom yazyke.
Jiang, F. (Kevin), & Hyland, K. (2020). There are significant differences…: The secret life of existential there in academic writing. Lingua, 233, 102758. DOI: https://doi.org/10.1016/j.lingua.2019.102758
Khlabutina, L. (2011). Indefinite article as rheme actualization means in scientific discourse. Philological Sciences. Issues of Theory and Practice, 2, 182-186.
Kirchik, O., Gingras, Y., & Larivière, V. (2012). Changes in publication languages and citation practices and their effect on the scientific impact of Russian science (1993-2010). Journal of the American Society for Information Science and Technology, 63(7), 1411-1419. DOI: https://doi.org/10.1002/asi.22642
Kubryakova, E., & Iriskhanova, O. (2007). Linguistic abstraction in the names of categories. Izvestiya RAN. Ser. Literatury i yazyka, 66(2), 3-12.
Liu, D. (2012). The most frequently-used multi-word constructions in academic written English: A multi-corpus study. English for Specific Purposes, 31(1), 25-35. DOI: https://doi.org/10.1016/j.esp.2011.07.002
Liu, D., & Gleason, J. L. (2002). Acquisition of the article ‘the' by non-native speakers of English: An analysis of four nongeneric uses. Studies in Second Language Acquisition, 24(1), 1-26.
Master, P. (1995). Consciousness raising and article pedagogy. In In D. Belcher & G. Braine (Eds.), Academic writing in second language: Essays on research and pedagogy (pp. 183-204). Ablex.
Nikitin, M. (1997). Course on linguistic semantics. Nauchnyj centr problem dialoga.
Oakey, D. (2020). Phrases in EAP academic writing pedagogy: Illuminating Halliday's influence on research and practice. Journal of English for Academic Purposes, 44, 100829. DOI: https://doi.org/10.1016/j.jeap.2019.100829
Popova, N. G., & Beavitt, T. A. (2017). English as a means of scientific communication: Linguistic imperialism or interlingua? Integration of Education, 21(1), 54-70. DOI: https://doi.org/10.15507/1991-9468.086.021.201701.054-070
Popova, N. G., Biricheva, E. V., & Beavitt, T. A. (2018). Three aspects of the phenomenon of science: In search for unity among sociologists. The Education and Science Journal, 20(9), 35-55. DOI: https://doi.org/10.17853/1994-5639-2018-9-35-55
Postal, P. (1969). On so-called ‘pronouns' in English. In D. Reibel & S. Schane (Eds.), Modern studies in English (pp. 201-223). Prentice-Hall.
Rasskazova, T., Guzikova, M., & Green, A. (2017). English language teacher development in a Russian university: Context, problems and implications. Ampersand, 4, 1-9. DOI: https://doi.org/10.1016/j.amper.2017.01.001
Shevyakova, V. (1976). Actual division of the sentence. Nauka.
Smirnitsky, A. (1959). Morfologija anglijskogo jazyka [Morphology of the English Language]. Izdatel'stvo literatury na inostrannyh jazykah.
Sommerstein, A. H. (1972). On the so-called definite article in English. Linguistic Inquiry, 3(2), 197-209.
Swales, J. (1990). Genre analysis: English in academic and research settings. Cambridge University Press.
Taylor, H., & Goodall, J. (2019). A preliminary investigation into the rhetorical function of ‘I' in different genres of successful business student academic writing. Journal of English for Academic Purposes, 38, 135-145. DOI: https://doi.org/10.1016/j.jeap.2019.01.009
Whitman, R. L. (1974). Teaching the article in English. TESOL Quarterly, 8(3), 253-262. DOI: https://doi.org/10.2307/3586169
WonHo Yoo, I. (2008). A corpus analysis of (the) last/next + temporal nouns. Journal of English Linguistics, 36(1), 39-61. DOI: https://doi.org/10.1177/0075424207306710
WonHo Yoo, I. (2009). The English definite article: What ESL/EFL grammars say and what corpus findings show. Journal of English for Academic Purposes, 8(4), 267-278. DOI: https://doi.org/10.1016/j.jeap.2009.07.004
Yang, A., Zheng, S., & Ge, G. (2015). Epistemic modality in English-medium medical research articles: A systemic functional perspective. English for Specific Purposes, 38, 1-10. DOI: https://doi.org/10.1016/j.esp.2014.10.005
Zanina, E. (2016). Strategic hedging: A comparative study of methods, results and discussion (and conclusion) sections of research articles in English and Russian. Journal of Language and Education, 2(2), 52-60. DOI: https://doi.org/10.17323/2411-7390-2016-2-2-52-60
Copyright (c) 2020 National Research University Higher School of Economics
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the Copyright Notice.
