Abstract

Curriculum guides education and ensures unity and integrity in educational and training activities. Furthermore, it plays a crucial role in providing quality education to students. Education quality is therefore influenced by the quality of the curriculum. In addition to the quality of the curriculum design, its applicability in the classroom is equally important. Since teachers implement the curriculum in class, they are one of the best judges of the curriculum's quality, its applicability, its design, and the benefits derived from implementing it. It is important to assess the quality of a curriculum based on teachers' evaluations. There are numerous studies on teacher program evaluation in the literature, but it is also clear that a comprehensive curriculum evaluation scale is needed. To meet this need, a scale was developed based on teachers’ evaluations. Taking into account the quality and elements of the curriculum, a two-dimensional structure was developed. An independent sample of 279 teachers for exploratory factor analysis (EFA) and 220 teachers for confirmatory factor analysis (CFA) participated in the study. Based on the EFA, 31 items and 8 factor structures were identified. CFA results showed adequate fit indices for the 8-factor structure. As evidence of construct validity, the scale demonstrated convergent and discriminant validity. The Cronbach's alpha and omega reliability coefficients were sufficient for reliability, and the items were discriminatory. The scale was found to be valid and reliable enough to assess the quality of the curriculum based on teachers' views. The scale will contribute in one aspect to assessing the curriculum, and in another aspect to evaluating the outcomes of teacher preparation and in-service training.  

Keywords

References

• Adams, J. E. (2000). Taking charge of curriculum: Teacher networks and curriculum implementation. Teachers College Press.
• Akıncı, M., & Köse, E. (2021). Research trends of program evaluation studies conducted between 2010-2019 in Turkey. Cukurova University Faculty of Education Journal, 50(1), 77-120.
• Apsari, Y. (2018). Teachers' problems and solutions in implementing curriculum 2013. Acuity: Journal of English Language Pedagogy, Literature and Culture, 3(1), 11-23. https://doi.org/10.35974/acuity.v3i1.620
• Bartlett, M. S. (1951). The effect of standardization on a Chi-square approximation in factor analysis. Biometrika, 38(3/4), 337-344. https://doi.org/10.1093/biomet/38.3-4.337
• Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. Spine, 25(24), 3186-3191. https://doi.org/10.1097/00007632-200012150-00014
• Ben‐Chaim, D., Joffe, N., & Zoller, U. (1994). Empowerment of elementary school teachers to implement science curriculum reforms. School Science and Mathematics, 94(7), 356-366. https://doi.org/10.1111/j.1949-8594.1994.tb15694.x
• Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88, 588-606. https://doi.org/10.1037/0033-2909.88.3.588
• Bledsoe, K. L., & Graham, J. A. (2005). The use of multiple evaluation approaches in program evaluation. American Journal of Evaluation, 26(3), 302-319. https://doi.org/10.1177/1098214005278749
• Briggs, N.E., & MacCallum. R.C. (2003). Recovery of weak common factors by maximum likelihood and ordinary least squares estimation. Multivariate Behavioral Research, 38(1). 25-56. https://doi.org/10.1207/S15327906MBR3801_2
• Brown, J. D. (1995). The elements of language curriculum - A systematic approach to program development. Heinle & Heinle Publishers.
• Browne, M. W. (2001). An overview of analytic rotation in exploratory factor analysis. Multivariate Behavioral Research, 36(1), 111-150. https://doi.org/10.1207/S15327906MBR3601_05
• Burul, C., & Tezci, E. (2022). A scale development study to determine teachers’ curriculum fidelity. Journal of National Education, 51(235), 2417-2446. https://doi.org/10.37669/milliegitim.896628
• Button, L. J. (2021). Curriculum essentials: A journey. Pressbooks.
• Byrne, B. M. (2001). Structural equation modeling with AMOS. Lawrence Erlbaum Associates.
• Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81-105. https://doi.org/10.1037/h0046016
• Carless, D. R. (1998). A case study of curriculum implementation in Hong Kong. System, 26(3), 353-368. https://doi.org/10.1016/S0346-251X(98)00023-2
• Cattell, R. B. (1978). The scientific use of factor analysis in behavioral and life sciences. Plenum. https://doi.org/10.1007/978-1-4684-2262-7
• Clark, C., &. Yinger, R. J. (1987). Teacher planning. In D. Berliner, & B. Rosenshine (Eds.), Talks to teachers (pp. 342-365). Random House.
• Colton, D., & Covert, R. (2007). Designing and constructing ınstruments for social research and evaluation. Jossey-Bass.
• Comrey, A.L. & Lee, H. B. (1992). A first course in factor analysis. Erlbaum.
• Connelly, F. M. (1980). Teachers’ roles in the using and doing of research and curriculum development. Journal of Curriculum Studies, 12(2), 95-107. https://doi.org/10.1080/0022027800120202
• Dagenais, M. E., Hawley, D., & Lund, J. P. (2003). Assessing the effectiveness of a new curriculum: Part I. Journal of dental education, 67(1), 47-54. https://doi.org/10.1002/j.0022-0337.2003.67.1.tb03618.x
• DASH. (2001). Korniza e kurrikulit të ri të kosovës [The framework of the new curriculum of Kosovo]. Author.
• Demes, K. A., & Geeraert, N. (2014). Measures matter: Scales for adaptation, cultural distance, and acculturation orientation revisited. Journal of Cross-Cultural Psychology, 45(1), 91-109. https://doi.org/10.1177/0022022113487590
• Dindar, H., & Yaygın, S. (2007). Teachers’ perceptions about the transition process to elementary school science and technology teaching curriculum. Kastamonu Education Journal, 15(1), 185-198.
• Ding, L., Velicer, W. F. & Harlow, L. L. (1995). Effects of estimation methods, number indicators per factor, and improper solutions on structural equation modeling fit indices. Structural Equation Modeling, 2, 119-144. https://doi.org/10.1080/10705519509540000
• Dunn, T. J., Baguley, T., & Brunsden, V. (2014). From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology, 105(3), 399-412. https://doi.org/10.1111/bjop.12046
• Ediger, M. (2003). Philosophy and curriculum. Discovery Publishing House.
• Elliott, J. (1994). The teacher's role in curriculum development: An unresolved issue in English attempts at curriculum reform. Curriculum Studies, 2(1), 43-69. https://doi.org/10.1080/0965975940020103
• Erdoğan, M., Kayır, Ç. G., Kaplan, H., Ünal, Ü. Ö. A., & Akbunar, Ş. (2005). Teachers views on curriculum developed since 2005: A content analysis of the researches between 2005 and 2011. Kastamonu Education Journal, 23(1), 171-196.
• Erss, M. (2018). ‘Complete freedom to choose within limits’–teachers’ views of curricular autonomy, agency and control in Estonia, Finland and Germany. The Curriculum Journal, 29(2), 238-256. https://doi.org/10.1080/09585176.2018.1445514
• Evans, B. (2003). The William and Mary curriculum user survey results. Center for Gifted Education.
• Evans, W. (1986). An investigation of curriculum implementation factors. Education, 106(4), 447-453.
• Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272–299. https://doi.org/10.1037/1082-989X.4.3.272
• Ford, J. K., McCallum, R. S. & Tait, M. (1986). The application of exploratory factor analysis in applied psychology: A critical review and analysis. Personnel Psychology, 39, 291314. https://doi.org/10.1111/j.1744-6570.1986.tb00583.x
• Fornell, C. & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39-50. https://doi.org/10.1177/002224378101800104
• Fu, Y., & Sibert, S. (2017). Teachers' perspectives: Factors that impact implementation of integrated curriculum in K-3 classrooms. International Journal of Instruction, 10(1), 169-186. https://doi.org/10.12973/iji.2017.10111a
• Gomez, R., & Fisher, J. W. (2003). Domains of spiritual well-being and development and validation of the Spiritual Well-Being Questionnaire. Personality and Individual Differences, 35(8), 1975–1991. https://doi.org/10.1016/S0191-8869(03)00045-X.
• Goodlad, J. I. (1964). School curriculum reform in the United States. In D. Flinders & S. Thornton (Eds.), The Curriculum studies reader (pp.45-54). Routledge Falmer.
• Gouveia, V. V. & Soares, A. K. S. (2015). Calculadoras de validade de construto [Construct validity calculators]. Universidade Federal da Paraíba.
• Gredler, M. E. (1996). Program evaluation. Prentice Hall.
• Gutek, G. L. (1988). Philosophical and ideological voices on education. Prentice-Hall.
• Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2019). Multivariate data analysis. Cengage Learning.
• Harrison, D.A. & McLaughlin, M.E. (1993). Cognitive processes in self-report responses: Tests of item context effects in work attitude measures. Journal of Applied Psychology, 78,129-140. https://doi.org/10.1037/0021-9010.78.1.129
• Heling, Z., & Bangxiu, X. (2009). The philosophical foundation and practice of the reform in the contemporary curriculum and instruction. Tattva Journal of Philosophy, 1(2), 57-71. https://doi.org/10.12726/tjp.2.5
• Heyman, R. D. (1981). Analyzing the curriculum. International Review of Education, 27, 449-470. https://doi.org/10.1007/BF00598141
• Ho, R. (2006). Handbook of univariate and multivariate data analysis and interpretation with SPSS. Chapman & Hall. https://doi.org/10.1201/9781420011111
• Horn, J. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30(2), 179-185. https://doi.org/10.1007/BF02289447
• Hu, L. T., & Bentler, P. M. (1999). Cut-off criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55. https://doi.org/10.1080/10705519909540118
• Kaiser, H. F. (1974). An index of factorial simplicity. Psychometrika, 39(1), 31-36. https://doi.org/10.1007/BF02291575
• Kandemir, M. A., Tezci, E., Shelley, M., & Demirli, C. (2019). Measurement of creative teaching in mathematics class. Creativity Research Journal, 31(3), 1-12. https://doi.org/10.1080/10400419.2019.1641677
• Karakus, G. (2021). A literary review on curriculum implementation problems. Shanlax International Journal of Education, 9(3), 201-220. https://doi.org/10.34293/education.v9i3.3983
• Kelly, A. L. (2004). The curriculum- theory and practice. Sage.
• Kern, D. E., Thomas, P. A., & Hughes, M. T. (2007). Curriculum development for medical education: a six-step approach. The John's Hopkins University Press.
• Kline, P. (1994). An easy guide to factor analysis. Routledge.
• Ladesma, R.D. & Valero- Mora, P. (2007). Determining the number of factors to retain in EFA: An easy-to-use computer program for carrying out parallel analysis. Practical Assessment, Research and Evaluation, 12(2), 1-11.
• Lewthwaite, B. (2001). The development, validation and application of a primary school science curriculum implementation questionnaire [Unpublished Doctoral dissertation]. Curtin University, Perth.
• MacCallum, R. C., Browne, M. W., & Cai, L. (2007). Factor analysis models as approximations. In R. Cudeck & R. C. MacCallum (Eds.). Factor analysis at 100: Historical developments and future directions (pp.153-175). Lawrence Erlbaum.
• MacCallum, R. C., Widaman, K. F., Zhang, S., & Hong, S. (1999). Sample size in factor analysis. Psychological Methods, 4(1), 84–99. https://doi.org/10.1037/1082-989x.4.1.84
• Macdonald, D. (2003). Curriculum change and the post-modern world: Is the school curriculum reform movement an anachronism? Journal of Curriculum Studies, 35(2), 139-149. https://doi.org/10.1080/00220270210157605
• Male, B. (2012). The primary curriculum design handbook: preparing our children for the 21st century. Continuum International Publishing.
• Malhotra, N. K. (2011). Pesquisa de marketing: Uma orientação aplicada [Marketing research: An applied orientation]. Bookman.
• Maren, M. S., Salleh, U. K. M., & Zulnaidi, H. (2021). Assessing prospective teachers’ soft skills curriculum implementation: Effects on teaching practicum success. South African Journal of Education, 41(3), Article 1915. https://doi.org/10.15700/saje.v41n3a1915
• Marsh, C. J. & Willis, G. (2007). Curriculum: Alternative approaches, ongoing issues. Merrill Prentice Hall.
• MAShT. (2016a). Korniza e kurrikules e arsimit parauniversitar të Republikës së Kosovës [Pre-university education curriculum framework of the Republic of Kosovo]. Blendi.
• MAShT. (2016b). Kurrikula bërthamë për arsimin e mesëm të ulët-Klasa VI,VII,VIII,IX [Core curriculum for lower secondary education-Grades VI, VII, VIII, IX]. Blendi.
• McCormick, R., & James, M. (2018). Curriculum evaluation in schools. Routledge. https://doi.org/10.4324/9780429454233
• Mehmeti, F., & Tezci, E. (2018). Evaluation of the sixth grade technology
• teaching curriculum in Kosovo. Turkish Studies, 13(11), 933-960.
• Nevenglosky, E. A. (2018). Barriers to effective curriculum implementation [Unpublished Doctoral dissertation]. Walden University, Minneapolis.
• Nouraey, P., Al-Badi, A., Riasati, M. J., & Maata, R. L. (2020). Educational program and curriculum evaluation models: A mini systematic review of the recent trends. Universal Journal of Educational Research, 8(9), 4048-4055. https://doi.org/10.13189/ujer.2020.080930
• Nunnally, J.C. & Bernstein, I. H. (1994). Psychometric theory. McGraw-Hill.
• O'Connor, B. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer's MAP test. Behavior Research Methods, Instrumentation, and Computers, 32, 396-402.
• Ornstein, A. C. (1990). Philosophy as a basis for curriculum decisions. The High School Journal, 74(2), 102-109.
• Ornstein, A. C., & Hunkins, F. P. (2003). Kurrikula - baza, parime dhe probleme [Curriculum, foundations, principles and issues]. Institute of Pedagogical Studies.
• Patton, M. Q. (2002). Qualitative research and evaluation methods. Sage.
• Posner, G. J., & Strike, K. A. (1974). An analysis of curriculum structure (ED089432). ERIC.
• Pratt, D. (1994). Curriculum planning. Hardcourt Brace College.
• Raykov, T. (1997). Estimation of composite reliability for congeneric measures. Applied Psychological Measurement, 21(2), 173-184. https://doi.org/10.1177/01466216970212006
• Şahan, H. H. (2007). Evaluation of third year mathematics program in elementary school (Publication no. 229042) [Doctoral dissertation, Hacettepe University]. Council of Higher Education Thesis Center.
• Saylor, J. & M. Alexander, W. (1973). Planning curriculum for schools. Holt, Rinehert and Winston.
• Schellhase, K. C. (2009). Are approaches to teaching and/or student evaluation of instruction scores related to the amount of faculty formal educational course work [Unpublished doctoral dissertation]. University of Central Florida Orlando, Florida.
• Scott, D. (2001). Curriculum and assessment. Greenwood Publishing.
• Sjögrén, A., Poskiparta, M., Liimatainen, L., & Kettunen, T. (2003). Teachers’ views on curriculum development in health promotion in two Finnish polytechnics. Nurse Education Today, 23(2), 112-122. https://doi.org/10.1016/S0260-6917(02)00165-X
• Stes, A., De Maeyer, S., & Van Petegem, P. (2010). Approaches to teaching in higher education: Validation of a Dutch version of the Approaches to Teaching Inventory. Learning Environments Research, 13(1), 59-73. http://dx.doi.org/10.1007/s10984-009-9066-7
• Stufflebeam, D. (2001). Evaluation models. New Directions for Evaluation, 89, 7-98. https://doi.org/10.1002/ev.3
• Taba, H. (1962). Curriculum development: Theory and practice. Harcourt, Brace and World.
• Tabachnick, B. G., & Fidel, L. S. (2001). Using multivariate statistics. Allyn and Bacon.
• Tanner, D., &. Tanner, L. N. (1970). Curriculum development. Macmillan.
• Tezci, E. (2017). Adaptation of ATI-R Scale to Turkish samples: Validity and reliability analyses. International Education Studies, 10(1), 67-81. https://doi.org/10.5539/ies.v10n1p67
• Thompson, B. (2004). Exploratory and confirmatory factor analysis: Understanding concepts and applications. American Psychological Association. https://doi.org/10.1037/10694-000
• Thompson, D., Bell, T., Andreae, P., & Robins, A. (2013). The role of teachers in implementing curriculum changes. In T. Camp & P. Tymann (Eds.), Proceeding of the 44th ACM Technical Symposium on Computer Science education (pp. 245-250). SIGCSE. https://doi.org/10.1145/2445196.2445272
• Van den Akker J. (2003). Curriulum perspetives: An introdution. In J. van den Akker, W. Kuiper & U. Hameyer (Eds.), Curriculum landscapes and trends (pp. 1-10). Kluwer. https://doi.org/10.1007/978-94-017-1205-7_1
• Van den Akker, J., Gravemeijer, K., McKenney, S., & Nieveen, N. (2006). Educational design research. Routledge. https://doi.org/10.4324/9780203088364
• VanTassel-Baska, J., & Brown, E. F. (2007). Toward best practice: An analysis of the efficacy of curriculum models in gifted education. Gifted Child Quarterly, 51(4), 342-358. https://doi.org/10.1177/0016986207306323
• Velicer, W. F. (1976). Determining the number of components from the matrix of partial correlations. Psychometrika, 41, 321-327. https://doi.org/10.1007/BF02293557
• Velicer, W. F., Eaton, C. A., & Fava, J. L. (2000). Construct explication through factor or component analysis: A review and evaluation of alternative procedures for determining the number of factors or components. In R. D. Goffin & E. Helmes (Eds.), Problems and solutions in human assessment: Honoring Douglas N. Jackson at seventy (pp. 41–71). Kluwer Academic/Plenum Publishers. https://doi.org/10.1007/978-1-4615-4397-8_3
• Walker, F. D. (2003). Fundamentals of curriculum passion and professionalism. Lawrence Erlbaum Associates. https://doi.org/10.4324/9781410606259
• Wang, H., & Cheng, L. (2009). Factors affecting teachers' curriculum implementation. Linguistics Journal, 4(2), 135-166.
• Williams, B., Onsman, A., & Brown, T. (2020). Exploratory factor analysis: A five-step guide for novices. Journal of Emergency Primary Health Care, 8(3), 1-13. https://doi.org/10.33151/ajp.8.3.93
• Yavuz, G., & Doğan, N. (2015). Using Velicer's Map Test and Horn's Parallel Analysis for determining component number. Hacettepe University Journal of Education, 30(3), 176-188.
• Zhang, L. F. (2001). Approaches and thinking styles in teaching. The Journal of Psychology, 135(5), 547-561. http://dx.doi.org/10.1080/00223980109603718.
• Zwick, W. R., & Velicer, W. F. (1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin, 99(3), 432–442. https://doi.org/10.1037/0033-2909.99.3.432

License

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.