Abstract

In the K-12 settings, teachers are encouraged to teach STEM subjects using a more integrated approach, and not be treated as stand-alone disciplines. STEM integration represents a way to think about curriculum change. It is a concept of how to restructure what is taught and what students learn. The nature of STEM disciplines no doubt creates certain challenges for STEM teachers. Despite researchers having made extensive progress in understanding of STEM integrative approaches, there are considerable barriers that relate to revolution of curriculum, assessment, and teaching practices in the K-12 STEM education system. For example, tools for assessing integrated STEM instruction have been developed, yet there has been limited implementation or adoption of teacher assessment for integrated STEM instruction. The purpose of this action research study was to understand how the preservice educators interpreted the language in the integrated STEM through AFNR rubric that was developed in 2018 (Wang & Knobloch, 2018). Four themes emerged when examining how preservice educators interpreted and applied the rubric for integrated STEM education: (1) Prejudgments based on prior knowledge and experiences, or course expectations informed interpretation of levels of STEM integration; (2) limited to no teaching experience resulted in novice interpretation of the integrated STEM lessons; (3) level one (Exploring) was a clean cut, but gray areas existed in interpreting levels two (Developing) and three (Advancing); and, (4) the rubric was a tool that helped preservice educators reflect on the purpose of teaching certain content/concepts. Preservice educators also gave recommendations to improve the rubric. Additionally, they recommended more scaffolding, examples, expert modeling, group discussion, and experiences when learning to use the rubric.

Keywords

References

• Alvesson, M., & Sköldberg, K. (2017). Reflexive methodology: New vistas for qualitative research. Sage.
• Andrade, H. G. (2001). The effects of instructional rubrics on learning to write. Educational Theory and Practice Faculty Scholarship, 6. https://scholarsarchive.library.albany.edu/etap_fac_scholar/6
• Andrade, H., & Du, Y. (2005). Student perspectives on rubric-referenced assessment. Practical Assessment, Research, and Evaluation, 10(1), 3. https://doi.org/10.7275/g367-ye94
• Asunda, P. A., & Walker, C. (2018). Integrated STEM: Views and challenges of engineering and technology education K-12 teachers. Career and Technical Education Research, 43(2), 179-194. https://doi.org/10.5328/cter43.2.179
• Bartles, S. L., Rupe, K. M., & Lederman, J. S. (2019). Shaping preservice teachers’ understanding of STEM: A collaborative math and science methods approach. Journal of Science Teacher Education, 30(6), 666-680. https://doi.org/10.1080/1046560X.2019.1602803
• Bassey, M. (1998). Action research for improving educational practice. In Halsall, R. (Ed.) Teacher research and school improvement: Opening doors from the inside (pp. 93-108). Open University Press.
• Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3, 77-101. https://doi.org/10.1191/1478088706QP063OA
• Brookhart, S. M. (2018, April). Appropriate criteria: key to effective rubrics. In Frontiers in Education (Vol. 3, p. 22). https://doi.org/10.3389/feduc.2018.00022
• Bryan, L.A., Moore, T.J., Johnson, C.C., & Roehrig, G.H. (2016). Integrated STEM education. In C.C. Johnson, E.E. Peters-Burton, & T.J. Moore (Ed.) STEM road map: A framework for integrated STEM education (pp. 23-37). Routledge.
• Bybee, R. W. (2010). Advancing STEM education: A 2020 vision. Technology and Engineering Teacher, 70(1), 30-36.
• Cheng, Y. C., & So, W. W. M. (2020). Managing STEM learning: A typology and four models of integration. International Journal of Educational Management, 34(6), 1063-1078. https://doi.org/10.1108/IJEM-01-2020-0035
• Corp A., Fields, M., & Naizer G. (2020). Elementary STEM teacher education (pp. 337-348). In C. Johnson, M. Mohr-Schroeder, T. Moore, & L. English (Eds.) Handbook of Research on STEM Education. Purdue University Press.
• Douglas, K. A., Gane, B. D., Neumann, K., & Pellegrino, J. W. (2020). Contemporary Methods of Assessing Integrated STEM Competencies. In Handbook of Research on STEM Education (pp. 234-254). Routledge.
• Du, W., Liu, D., Johnson, C. C., Sondergeld, T. A., Bolshakova, V. L., & Moore, T. J. (2019). The impact of integrated STEM professional development on teacher quality. School Science and Mathematics, 119(2), 105-114. https://doi.org/10.1111/ssm.12318
• Eck, C. J., Whisenhunt, J., Robinson, J. S., Neumann, K. L., Utley, J., & Gossen, D. (2021). How pre-service agricultural education teachers plan to integrate STEM competencies in their lessons. NACTA Journal, 65, 242-253.
• Frost, P. (2002). Principles of the action research cycle (pp. 24-32). In Ritchie, R., Pollard, A., Frost, P., & Eaude, T. (Eds.) Action research: A guide for teachers. Burning issues in primary education (Issue No. 3). National Primary Trust.
• Gardner, M. (2017). Beyond the acronym: Preparing preservice teachers for integrated STEM education. AILACTE Journal, 14(1), 37-53.
• Gul, R., Kanwal, S., & Khan, S. S. (2020). Preferences of the Teachers in Employing Revised Blooms Taxonomy in their Instructions. Sir Syed Journal of Education & Social Research, 3(2), 258-266. https://doi.org/10.36902/sjesr-vol3-iss2-2020(258-266)
• Guzey, S. S., Caskurlu, S., & Kozan, K. (2020). Integrated STEM pedagogies and student learning. In Handbook of research on STEM education (pp. 65-75). Routledge.
• Herschbach, D. R. (2011). The STEM initiative: Constraints and challenges. Journal of STEM teacher Education, 48(1), 96-122. https://doi.org/10.30707/JSTE48.1Herschbach
• Ivanitskaya, L., Clark, D., Montgomery, G., & Primeau, R. (2002). Interdisciplinary learning: Process and outcomes. Innovative Higher Education, 27(2), 95-111. https://doi.org/10.1023/A:1021105309984
• Johnson, R. B., & Onwuegbuzie, A. J. (2004). Mixed methods research: A research paradigm whose time has come. Educational Researcher, 33(7), 14-26. https://doi.org/10.3102%2F0013189X033007014
• Kalyuga, S. (2009). Knowledge elaboration: A cognitive load perspective. Learning and Instruction, 19(5), 402-410. https://doi.org/10.1016/j.learninstruc.2009.02.003
• Kraft, N. P. (2002). Teacher research as a way to engage in critical reflection: A case study. Reflective practice, 3(2), 175-189. https://doi.org/10.1080/14623940220142325
• Krathwohl, D. R. (2002). A revision of Bloom's taxonomy: An overview. Theory into practice, 41(4), 212-218.
• Kuhl, J. (2000). A functional-design approach to motivation and self-regulation: The dynamics of personality systems interactions. In Handbook of Self-regulation (pp. 111-169). Academic Press.
• Lodge, J. M., Kennedy, G., Lockyer, L., Arguel, A., & Pachman, M. (2018). Understanding difficulties and resulting confusion in learning: an integrative review. Frontiers in Education, 3, 49. https://doi.org/10.3389/feduc.2018.00049
• Moore, T. J., Stohlmann, M. S., Wang, H. H., Tank, K. M., Glancy, A. W., & Roehrig, G. H. (2014). Implementation and integration of engineering in K-12 STEM education. In S. Purzer, J. Strobel, & M.E. Cardella (Eds.) Engineering in pre-college settings: Synthesizing research, policy, and practices. Purdue University Press.
• Moore, T. J., Johnson, C. C., & Peters-Burton, E. E. (2015). The need for a STEM road map. In C. C. Johnson, E. E. Peters-Burton, and T. J. Moore (Eds.), STEM road map: A framework for integrated STEM education (pp. 3–12). Routledge.
• Moore, T. J., Johnston, A. C., & Glancy, A. W. (2020). A synthesis of conceptual framework and definition. In C. Johnson, M. Mohr-Schroeder, T. Moore, & L. English (Eds.) Handbook of Research on STEM Education (pp. 3-16). Purdue University Press.
• Mustafa, N., Ismail, Z., Tasir, Z., & Mohamad Said, M. N. H. (2016). A meta-analysis on effective strategies for integrated STEM education. Advanced Science Letters, 22(12), 4225-4228.
• National Academy of Engineering and National Research Council. (2009). Engineering in K-12 education: Understanding the status and improving the prospects. The National Academies Press. https://doi.org/10.17226/12635
• National Academy of Engineering and National Research Council. (2014). STEM integration in K-12 education: Status, prospects, and an agenda for research. National Academies Press.
• National Research Council. (2012). A framework for K-12 science education: Practices, crosscutting concepts, and core ideas. The National Academies Press.
• National Science & Technology Council (NSTC). (2018). Charting a course for success: America’s strategy for STEM education. A report by the committee on STEM education of the National Science & Technology Council. Retrieved from https://www.hsdl.org/?view&did=826425
• O’Brien, S., Karsnitz, J., Sandt, S., Bottomley, L., & Parry, E. (2014). Engineering in preservice teacher education. In S. Purzer, J. Strobel, & M. Cardella (Eds.), Engineering in Pre-college Settings: Synthesizing Research, Policy, and Practices (pp. 277–300). Purdue University Press.
• Panadero, E. (2011). Instructional help for self-assessment and self-regulation: Evaluation of the efficacy of self-assessment scripts vs. rubrics [Unpublished doctoral dissertation]. Universidad Autónoma de Madrid, Madrid, España.
• Panadero, E., & Jonsson, A. (2013). The use of scoring rubrics for formative assessment purposes revisited: A review. Educational Research Review, 9, 129-144. https://doi.org/10.1016/j.edurev.2013.01.002
• Panadero, E., Tapia, J. A., & Huertas, J. A. (2012). Rubrics and self-assessment scripts effects on self-regulation, learning and self-efficacy in secondary education. Learning and individual differences, 22(6), 806-813. https://doi.org/10.1016/j.lindif.2012.04.007
• Radloff J., & Guzey, S. (2017). Investigating changes in preservice teachers’ conceptions of STEM education following video analysis and reflection. School Science and Mathematics, 117(3-4), 158-167. https://doi.org/10.1111/ssm.12218
• Reynolds-Keefer, L. (2010). Rubric-referenced assessment in teacher preparation: An opportunity to learn by using. Practical Assessment, Research, and Evaluation, 15(1), 8. https://doi.org/10.7275/psk5-mf68
• Rice, A. H., & Kitchel, T. (2018). Agriculture teachers’ integrated belief systems and its influence on their pedagogical content knowledge. Journal of Agricultural Education, 59(1), 51-69. https://doi.org/10.5032/jae.2018.01059
• Ryu, M., Mentzer, N., & Knobloch, N. (2018). An examination of preservice teachers' learning of STEM integration: Implications for integrated STEM teacher preparation. International Journal of Technology and Design Education, 29(3), 493-512. https://doi.org/10.1007/s10798-018-9440-9
• Saldaña, J. (2016). The coding manual for qualitative researchers (3rd ed.). Sage.
• Schamber, J. F., & Mahoney, S. L. (2006). Assessing and improving the quality of group critical thinking exhibited in the final projects of collaborative learning groups. The Journal of General Education, 55(2), 103-137. https://doi.org/10.2307/jgeneeduc.55.2.0103
• Scherer, H. H., McKim, A. J., Wang, H. H., DiBenedetto, C. A., & Robinson, K. (2019). Making sense of the buzz: Providing a taxonomy of “STEM” in agriculture, food, and natural resources education. Journal of Agricultural Education, 60(2), 28-53. https://doi.org/10.5032/jae.2019.02028
• Schwartz, R. S., & Gess-Newsome, J. (2008). Elementary science specialists: A pilot study of current models and a call for participation in the research. Science Educator, 17(2), 19– 30.
• Shernoff, D. J., Sinha, S., Bressler, D. M. & Ginsburg, L. (2017). Assessing teacher education and professional development needs for the implementation of integrated approaches to STEM education. International Journal of STEM Education, 4(1), 1-16. https://doi.org/10.1186/s40594-017-0068-1
• Sias, C. M., Nadelson, L. S., Juth, S. M., & Seifert, A. L. (2017). The best laid plans: Educational innovation in elementary teacher generated integrated STEM lesson plans. The Journal of Educational Research, 110(3), 227-238. https://doi.org/10.1080/00220671.2016.1253539
• Somekh, B. (1995). The contribution of action research to development in social endeavours: A position paper on action research methodology. British Educational Research Journal, 21(3), 339-55. https://doi.org/10.1080/0141192950210307
• Stubbs, E.A., & Myers, B.E. (2015). Multiple case study of STEM in school-based agricultural education. Journal of Agricultural Education, 56(2), 188-203. https://doi.org/10.5032/jae.2015.02188
• Stubbs, E. A., & Myers, B. E. (2016). Part of what we do: Teacher perceptions of STEM integration. Journal of Agricultural Education, 57(3), 87-100. https://doi.org/10.5032/jae.2016.0308
• Thibaut, L., Knipprath, H., Dehaene, W., & Depaepe, F. (2018). The influence of teachers’ attitudes and school context on instructional practices in integrated STEM education. Teaching and Teacher Education, 71, 190-205. https://doi.org/10.1016/j.tate.2017.12.014
• Uzuntiryaki-Kondakci, E., Demirdöğen, B., Akın, F. N., Tarkin, A., & Aydın-Günbatar, S. (2017). Exploring the complexity of teaching: the interaction between teacher self-regulation and pedagogical content knowledge. Chemistry Education Research and Practice, 18(1), 250-270. https://doi.org/10.1039/C6RP00223D
• Van Merriënboer, J., & Sweller, J. (2005). Cognitive load theory and complex learning: recent developments and future directions. Educational Psychology Review, 17, 147-177. https://doi.orgg/10.1007/s10648-005-3951-0
• Vasquez, J.A., Sneider, C., & Comer, M. (2013). STEM lesson essentials: Integrating science, technology, engineering, and mathematics. Heinemann.
• Walker, W., Moore, T., Guzey, S., & Sorge, B. (2018). Frameworks to develop integrated STEM curricula. K-12 STEM Education, 4(2), 331-339.
• Wang, H. H., & Knobloch, N. A. (2018). Levels of STEM integration through Agriculture, Food, and Natural Resources, Journal of Agricultural Education, 59(3), 258-277. https://doi.org/10.5032/jae.2018.03258
• Wang, H. H., & Knobloch, N. A. (2020). Preservice informal educators’ beliefs and practices of teaching STEM through AFNR. Journal of Agricultural Education, 61(2), 57-76. https://doi.org/10.5032/jae.2020.02057
• Wang, H. H., & Knobloch, N. A. (in press). Teacher beliefs and practices in STEM integration. In X. F. Liu & L. Wang (Eds.). International Encyclopedia of Education (4th Edition). Elsevier.
• Wang, H. H., Charoenmuang, M., Knobloch, N. A., & Tormoehlen, R. L. (2020). Defining interdisciplinary collaboration at high school settings through teachers’ beliefs and practices of STEM integration by using a complex designed system. International Journal of STEM Education, 7, 3. https://doi.org/10.1186/s40594-019-0201-4
• Wolters, C. A. (2003). Regulation of motivation: Evaluating an underemphasized aspect of self-regulated learning. Educational psychologist, 38(4), 189-205. https://doi.org/10.1207/S15326985EP3804_1

License

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.