Journal of new advances in English Language Teaching and Applied Linguistics

Journal of new advances in English Language Teaching and Applied Linguistics

The Utility of Coh-Metrix Application for the Selection of Core Texts: Trialling of Texts for Students of Computer Sciences

Document Type : review paper

Authors
Mahmoud Jafarie 1
Hossein Heidari Tabrizi 2
1 Department of English, Isfahan (Khorasgan) Branch, Islamic Azad University, Isfahan, Iran
2 Department of English, Isfahan (Khorasgan) Branch, Islamic Azad University, Iran
10.22034/jeltal.2022.4.2.11
Abstract
Measurement assuredly lends more objectivity and reliability to textbook evaluation and selection and enables it to provide a lens into the actual effect of how teachers use an ELT textbook on the academic literacy of learners. This paper reports a trial project for computation of cohesion metrics of ESP texts for Iranian students of computer sciences. The project first shedded light on some inadequacy of the text selection rubrics within the paradigm of text-driven materials development problematizing the subjective, intuitive, impressionistic criteria for the selection of the core text. Then it raised two questions. They asked what enables achievement of the multi-dimensional mental representation of texts on the part of the target learners and how it is accomplished. Third, it introduced a utility application called Coh-Metrix that was developed to compute instantly and automatically cohesion ad readability indices. Forth, it put to test some existing ESP text for students of computer sciences for cohesion indices in order to make a tentative comparison with some grade level 6 science text against cohesion metrics. Lastly and never to be least, it concluded that explicit cohesive characteristics of texts enable the achievement of multidimensional mental representation of the text by selection and assignment of a core text cohesive enough using some objective metrics. Iranian EFL teachers and materials developers can, by implication, employ objective measures as they are evaluating and selecting core texts.
Keywords
Cohesion Metrics
Textbook Evaluation and Selection
Multidimensional Mental Representation of Text
Text-Driven Material Development
Utility Application
Anderson, J. (2017a). Context, analysis and practice. IATEFL Voices, 256, 4–5.
Anderson, J. (2020).The TATE model: A curriculum design framework for language teaching. ELT Journal; doi:10.1093/elt/ccaa005.
Breen, M. &Candlin, C. (1987). What materials? A consumer’s and designer’s guide. In L. E. Shelden (ed.). ELT textbook and materials: Problems in evaluation and development. ELT Documents 126. (pp. 13-28) Oxford: Modern English Publications in association with The British Council.
Cain, K. & Nash, H. M. (2011). The influence of connectives on young readers’ processing and comprehension of text. Journal of Educational Psychology, 103(2), 429–441.
Coh-Metrix URL: http://141.225.61.35/cohmetrix2017
Connor, C. M., Morrison, F. J., Fishman, B. J., Schatschneider, C., & Underwood, P. (2007). The early year: Algorithm-guided individualized reading instruction. Science, 315(5811), 464–465.
Crossley, S. A., Allen, D., & McNamara, D. S. (2011). Text readability and intuitive simplification: A comparison of readability formulas. Reading in a Foreign Language, 23, 84–102.
Crossley, S. A., Salsbury, T., McCarthy, P.M.,& McNamara,D. S. (2008). LSA as a measure of coherence in second language natural discourse. In V. Sloutsky, B. Love, & K. McRae (Eds.), Proceedings of the 30th annual conference of the Cognitive Science Society (pp. 1906–1911). Washington, DC: Cognitive Science Society.
Cunningsworth, A. (1995). Choosing your coursebook. Oxford: Heinemann.
Dufty, D. F., Graesser, A. C., Louwerse, M., & McNamara, D. S. (2006). Assigning grade level to textbooks: Is it just readability? In R. Sun & N. Miyake (Eds.), Proceedings of the 28th Annual Conference of the Cognitive Science Society (pp. 1251–1256). Austin, TX: Cognitive Science Society.
Duran, N. D., McCarthy, P. M., Graesser, A. C., & McNamara, D. S. (2007). Using temporal cohesion to predict temporal coherence in narrative and expository texts. Behavior Research Methods, 39, 212–223.
Ellis, R. (1997). SLA research and language teaching. Oxford: Oxford University Press.
Graesser, A. C., & McNamara, D. S. (2011). Computational analyses of multilevel discourse comprehension. Topics in Cognitive Science, 3, 371–398.
Graesser, A. C., Gernsbacher, M. A., & Goldman, S. R. (Eds.). (2003). Handbook of discourse processes. Mahwah, NJ: Lawrence Erlbaum.
Graesser, A. C., Mcnamara, D. S., &Kulikowich J. M. (2011). Coh-Metrix: Providing multilevel analyses of text characteristics. Educational Researcher, 40(5), 223–234.
Guilloteaux, M. J. (2013). Language textbook selection: Using materials analysis from the perspective of SLA principles. The Asia-Pacific Education Researcher, 22(3), 231-239.
Hutchinson, T. & Waters, A. (1987). English for specific purposes. Cambridge: Cambridge University Press.
McDonough, J. & Shaw, C. (2003). Materials and methods in ELT: A teacher’s guide. (2nd Ed.). Malden, MA: Blackwell Publishing Ltd.
McNamara, D. S., Graesser, A. C., &Louwerse, M. M. (2012). Sources of text difficulty: Across genres and grades. In J. P. Sabatini, E. Albro, & T. O’Reilly (Eds.), Measuring up: Advances in how we assess reading ability (pp. 89–116). Plymouth, UK: Rowman& Littlefield Education.
McNamara, D. S., Graesser, A. C., McCarthy, P. M., &Cai, Z. (2014). Automated evaluation of text and discourse with Coh-Metrix. Cambridge University Press.
McNamara, D. S., Louwerse, M. M., McCarthy, P. M., &Graesser, A. C. (2010). Coh-Metrix: Capturing linguistic features of cohesion. Discourse Processes, 47(4), 292–330.
Mukundan, J. &Ahour, T. (2010). A review of textbook evaluation checklists across four decades (1970-2008). In Tomlinson, B., Masuhara, H. (Eds.). Research for materials development in language learning: Evidence for best practice (pp. 336-352). London: Continuum.
Swales, J. (1980). ESP: the textbook problem. ESP Journal, 1(1), 11-23.
Sheldon, L. E. (1988). Evaluating ELT textbooks and materials. ELT Journal, 42(4), 237–46.
Tomlinson, B. (Ed.). (2003). Developing materials for language teaching. London: Continuum Press.
Tomlinson, B. (2013b). Developing principled frameworks for materials development. In B. Tomlinson (Ed.), Developing materials for language teaching (2nd ed., pp. 95-118). London: Bloomsbury.
Tomlinson, B. &Masuhara, H. (2013). Adult coursebooks. ELT Journal,67(2), 233–49.
Tomlinson, B. &Masuhara, H. (2018). The complete guide to the theory and practice of materials development for language learning. Hoboken: Wiley Blackwell.
Yang, Y., Wang, X., & Wen, X. (2008). Evaluation of English textbook using fuzzy analytic hierarchy process. International Workshop on Education Technology and Training.
Yousefkhani, M., Ayat, N., &Farrahi, A. (1385). English for computer engineering. Tehran: Payam Noor Universirty Press.
Zhao, Y. &Zheng, S. (2006). A theoretical analysis of several western textbook evaluation systems and their implications for the college English textbook evaluation in china. Foreign Language Education, 03, 39-45. https://doi.org/ 10.16362/j.cnki.cn61-1023/h.2006.03.013
Zwaan, R. A. &Radvansky, G. A. (1998). Situation models in language comprehension and memory. Psychological Bulletin, 123, 162–185.
 
Journal of new advances in English Language Teaching and Applied Linguistics
Volume 4, Issue 2
September 2022
Pages 1029-1050

  • Receive Date 23 July 2022
  • Revise Date 05 October 2022
  • Accept Date 15 October 2022