Developing a Critical Checklist for Textbook Evaluation

Document Type : Research Paper


1 Department of English Language and Literature, Qaemshahr Branch, Islamic Azad University, Mazandaran, Iran

2 Department of English , Qaemshahr Branch, Islamic Azad University, Mazandaran, Iran


This study has been carried out to develop a critical checklist for global/commercial textbooks which play a crucial role in language teaching/learning. For this aim, a number of items have been developed based on a comprehensive review of the related literature and experts’ opinions. The tentative checklist was administered to the targeted population, yet 326 checklists were deemed appropriate for the analysis. The statistical analyses utilized in this study were exploratory factor analysis and partial confirmatory factor analysis. Prior to the exploratory factor analysis, a correlation analysis reduced the items into 44. Next, the exploratory factor analysis identified ten components. Additionally, six items were excluded from the checklist due to simultaneous factor loading and the finalized checklist was truncated into 38 items.  To investigate the possibility for further validation studies, the result of partial confirmatory factor analysis was not statistically significant.  Results of this study have the potentials to shed some lights on the ideological aspects of textbook evaluation.


Alimorad, Z. (2016). Cultural values represented in first certificate masterclass taught in Iran: Uncovering the hidden curriculum. Sage, 6(1), 1-8.
Allwright, R. (1981). What do we want teaching materials for? ELT Journal, 36, 5-18.
Anjaneyulu, T. (2014). A critical analysis of the English language textbooks in Andhra Pradesh, India. ELT Research Journal, 3(4), 181-200.
Barker, C., Pistrang, N., & Elliot, R. . (1994). Research methods in clinical and counselling psychology. Oxford: John Wiley & Sons.
Benesch, S. (1993). ESL, ideology, and politics of pragmatism . TESOL Quarterly , 705-716.
Clark, R. (1992). Principles and practice of CLA in the classroom. In N. Fairclough (Ed.), Critical language awareness (pp. 117-140). London: Pearson Education.
Cunningsworth, A. (1995). Choosing your coursebook. Oxford: Heinemann.
Daoud, A., & Clce-Murcia, M. (1979). Selecting and evaluating a textbook. In M. &. Clce-Murcia (Ed.), Teaching English as a second or foreign language (pp. 302-207). Cambridge : MA: New bury House Publishers.
Davies, A. (2006). What do learners really want from their EFL courses? ELT Journal, 60(1), 1-12.
Dewey, J. (1916). Democracy and education: An introduction to the philosophy of education. New York: Macmillan.
Dornyei, Z. (2007). Research methods in applied linguistics: Quantitative, qualitative and mixed methodologies. Oxford : Oxford University Press.
Edge, J. & Wharton, S. (1998). Autonomy and development: Living in the material world. In B. Tomlinson (Ed.), Materials development for language teaching (pp. 295-310). Cambridge: Cambridge University Press.
Fairclough, N. (1989). Language and power. New York: Longman.
Fairclough, N. (1995). Critical discourse analysis: The critical study of language (2nd  ed.). 
           London: Longman.
Field, A. (2009). Discovering statistics using SPSS. London : Sage.
Freire, P. (1970). Pedagogy of the oppressed. New York: The Continuum International Publishing.
Garinger, D. (2002). textbook selection for the ESL classroom. Eric Digest. Retrieved November   24, 2016 from
Giesen, D., Vis-Visschers, R., & Beukenhorst, D.  (2012). Questionnaire development. Hague: Statistics Netherlands.
Gignac, G. E. (2009). Partial confirmatory factor analysis: Describe and illustrated on the NEO-PI-R. Journal of Personality Assessment, 91(1), 40-47.
Hadley, G. (2014). Global textbooks in local context: An empirical investigation of effectiveness. In N. Harwood (Ed.), English language teaching textbooks: Content, consumption, production (pp. 205-238). London: Routledge.
Hill, D. A. (2013). The visual elements in EFL coursebooks. In B. Tomlinson (Ed.), Developing materials for language teaching (pp. 157-166). London: Bloomsbury.
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexesin covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1-55.
Hutchinson, T. & Torres, E. (1994). The textbook as agent of change. ELT Journal , 48 (4), 315-328.
Koupaee Dar, Z., Rahimi, A., & Shams, M. R. (2010). (2010). Teaching reading with a critical attitude:Using critical discourse analysis (CDA) to raise EFL university students' critical language awareness (CLA). International Journal of Criminology and Sociological Theory, 3(2), 457-467.Kincheloe, L. J. (2008). Critical pedagogy and the knowledge wars of the twenty- first century. International Journal of Critical Pedagogy, 1(1), 1-22.
Kincheloe, L. J. (2008). Critical pedagogy and the knowledge wars of the twenty- first century. International Journal of Critical Pedagogy, 1(1), 1-22.
Kumaravadivelu, B. (2006). Understanding language teaching:From method to postmethod. New Jersey: Lawrence Erlbaum Associates. MacCallum, R. C., Widaman, K. F., Zhang, S., & Hong, S. (1999). Sample size in factor analysis. Psychological Methods, 4(1), 84-99.
MacCallum, R. C., Widaman, K. F., Zhang, S., & Hong, S. (1999). Sample size in factor analysis. Psychological Methods, 4(1), 84-99.
McDonough, J., Shaw, C., & Masuhara,. (2013). Materials and Methods in ELT: A teacher's guide. Oxford: Wiley-Blackwell.
McGrath, I. (2002). Materials evaluation and design for language teaching. Edinburgh:  Edinburgh University Press.
Nation, I. S. P., & Macalister, J. (2010). Language curriculum design . New York : Routledge.
O'Neil, R. (1982). Why use textbooks? ELT Journal , 36 (2), 104-111.
Pennycook, A. (1990). Towards a critical applied linguistics for the 1990s. Issues in Applied Linguistics, 1(1), 8-28.
Pennycook, A. (2010). Critical and alternative directions in applied linguistics . Australian Review of Applied Linguitsics, 1-16.
Phillipson, R. (1992). Linguistic imperialism. Oxford: Oxford University Press.
Prettyman, K. (2006). Rethinking power: Learners as teachers and teachers as learners. In C. Dozier, P. Johnston, & R. Rogers, Critical literacy/critical teaching: Tools for preparing responsive teachers (pp. 46-53). New York: Teachers College Press.
Roberts, J. T. (1996). Demystifying materials evaluation. Pergamon , 24 (3), 375-389.
Roohani, A., & Heidari, N. (2012). Evaluating an instructional textbook: A critical discourse perspective. Issues in Langauge Teaching, 1(1), 123-158.
Taylor, S. K., Despagne, C., & Faez, F. (2018). Critical language awarness. In J. I. Liontas (Ed.), The TESOL encyclopedia of English language teaching (pp. 1-16). Hoboken: NJ: Wiley.
Tomlinson, B. (2012). Materials development for language learning and teaching. Language Teaching, 45(2), 143-179.
Tomlinson, B. (2013). Materials evaluation. In B. Tomlinson (Ed.), Developing materials for language teaching (pp. 21-43). London: Bloomsbury.
Ur, P. (1996). Acourse in language teaching: Practice and theory . UK: Cambridge University Press.
van Dijk, T. A. (2001). Critical discourse analysis. In D. Tannen, D. Schiffrin, & H. & Hamilton (Eds.), The handbook of discourse analysis (pp. 352-371). Oxford: Blackwell.
Widdowson, H. G. (2004). Text, Context, Pretext: Critical issues in discourse analysis. Oxford: Blackwell Publishing.
Williams, M. & Burden, R. (1997). Psychology for Language Teachers: A Social Constructivist   Approach. Cambridge: Cambridge University Press.
Siavash Zokaeieh is a Ph.D. candidate at Islamic Azad University, Qaemshahr Branch, Iran. His main reseach area  is critical language studies.
Shaban Najafi Karimi is an assistant professor at Islamic Azad University, Qaemshahr Branch.His main research interests include teaching langauge skills and materials development.
Farzaneh Nouri is currently a Ph.D. candidate  in TEFL at Islamic Azad University, Qaemshahr Branch, Iran. Her research interest is critical language testing.
Afsaneh Hakimzadeh is a Ph.D. candidate in TEFL at Islamic  Azad University of Qaemshahr, Iran. Her research interests is checklist development in postmethod pedagogy.