MEASURING HIGHER-ORDER THINKING SKILLS IN SCIENCE AMONG PRIMARY SCHOOL STUDENTS USING ITEM RESPONSE THEORY

Sandag Gendenjamts

Abstract


Higher-order thinking skills (HOTS) are crucial competence in education. Higher-order thinking skills can help learners solve problems and decision making efficiently by anticipating connections between divergent ideas. The present study aims to develop reliable and valid instruments to assess higher-order thinking skills in science among primary school students. The study followed eight stages of developing a model adapted from a previous study. The total sample of this research comprised 428 fifth-grade students from six primary schools located in urban and rural areas in Mongolia. The gathered data were analyzed using SPSS 22.0 and STATA 16.0 to examine the item characteristics curve, test reliability, and item correlation. The study recommends developing creativity skills through exercise-based activities, so those item developers could produce reliable and valid instruments to assess HOTS.

 

Article visualizations:

Hit counter


Keywords


higher-order thinking skills, assessment, test instrument, measurement, reliability, validity

Full Text:

PDF

References


Anderson, L. W. (2001). A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom’s Taxonomy of Educational Objectives. London: Longman.

Borg, W. R., & Gall, M. D. (1983). Educational Research: An Introduction. New York: Longman.

Güler, N. (2014). Analysis of open-ended statistics questions with Many Facet Rasch Model. Eurasian Journal of Educational Research, 55, 73-90. https://doi.org/10.14689/ejer.2014.55.5.

Haladyna, T. M. (1997). Writing Test Items to Evaluate Higher Order Thinking. Oakland, CA: Pearson.

Lawson, A. E. (1993). At what levels of education is the teaching of thinking effective? Theory Into Practice, 32(3), 170-178, DOI: 10.1080/00405849309543593

MECSS & MIER. (2019). Education in Mongolia, A Country Report (pp. 7-8).

Nitko, A. J., & Brookhart, S. M. 2007. How to Assess Higher-Order Thinking Skills in Your Classroom http://mpi.uinsgd.ac.id/wp-content/uploads/2018/07/

Nunnally, J. C. (1967). Psychometric Theory. New York: McGraw-Hill (pp. 172-235).

Paul, R., & Nosich, R. (1992). A model for the national assessment of higher-order thinking. (ERIC Document Reproduction Service No. ED 353 296).

OECD, (2015), Skills for Social Progress: The Power of Social and Emotional Skills, OECD Skills Studies, OECD Publishing, Paris, https://doi.org/10.1787/9789264226159-en.

Ontario. (2016). 21st-Century Competencies. Retrieved 17 April 2021, from http://www.edugains.ca/resources21CL/21stCenturyLearning/21CL_21stCentuyCompetencies.pdf

Otgonbaatar, K. (2020). Examining Mathematical Creativity Among Mongolian Ninth-Grade Students Using Problem-Posing Approach. Journal of Education and Practice, 11(27), 69-75. https://doi.org/10.7176/jep/11-27-08

Otgonbaatar, K. (2021a). Effectiveness of anchoring vignettes in re-evaluating self-rated social and emotional skills in mathematics. International Journal of Evaluation and Research in Education (IJERE), 10(1), 237. https://doi.org/10.11591/ijere.v10i1.20716

Otgonbaatar, K. (2021b). The development of a theoretical framework and tools to measure social and emotional skills in mathematics in the Mongolian lower secondary education (Doctoral dissertation, 広島大学).

Partnership for 21st Century Skills. (2009). “P21 framework definitions”, Retrieved 17 April 2020, from https://eric.ed.gov/?id=ED519462

Scully, Darina. (2017). Constructing multiple-choice items to measure higher-order thinking. Practical Assessment, Research, and Evaluation, 22, 4.

Shellens, T., & Valcke, M. (2005). Collaborative learning in asynchronous discussion groups: What about the impact on the cognitive process? Computers in Human Behavior, 21(6), 957-975.

Tanujaya, B., Mumu, J., & Margono, G. (2017). The relationship between higher order thinking skills and academic performance of students in mathematics instruction.

TIMSS & PIRLS. (2011). Study report.

UNESCO. (2015). Transversal competencies in education Policy and Practice. (S. Strandberg, Ed.). Paris: UNESCO. Retrieved from http://unesdoc.unesco.org/images/0023/002319/231907E.pdf.

Отгонбаатар, Х. (2016). Даалгаврын хариултын онол (Item response theory)-ын 3 параметртэй загварыг ашиглаж тестийн даалгавруудад шинжилгээ хийх нь. Proceedings of the Mongolian Academy of Sciences, 56(2), 24–30. https://doi.org/10.5564/pmas.v56i2.707.




DOI: http://dx.doi.org/10.46827/ejes.v10i12.5089

Refbacks

  • There are currently no refbacks.


Copyright (c) 2023 Sandag Gendenjamts

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

Copyright © 2015-2023. European Journal of Education Studies (ISSN 2501 - 1111) is a registered trademark of Open Access Publishing Group. All rights reserved.

This journal is a serial publication uniquely identified by an International Standard Serial Number (ISSN) serial number certificate issued by Romanian National Library (Biblioteca Nationala a Romaniei). All the research works are uniquely identified by a CrossRef DOI digital object identifier supplied by indexing and repository platforms. All authors who send their manuscripts to this journal and whose articles are published on this journal retain full copyright of their articles. All the research works published on this journal are meeting the Open Access Publishing requirements and can be freely accessed, shared, modified, distributed and used in educational, commercial and non-commercial purposes under a Creative Commons Attribution 4.0 International License (CC BY 4.0).