AN INVESTIGATION INTO THE MEASUREMENT INVARIANCE OF PISA 2012 MATHEMATICAL LITERACY TEST

Merve Ayvalli, Bayram Biçak

Abstract


The aim of this study is to investigate the measurement invariance of PISA 2012 mathematical literacy among the OECD member countries, and gender and region groups in Turkey. Among cognitive test booklets implemented in PISA 2012, booklet 8 which was used commonly by all countries was selected for this correlational survey study. The study was conducted using the dataset belonging to 23.311 students that took booklet 8 in the OECD member countries and 377 students that took this booklet in Turkey. Initially, measurement models were verified for all groups by performing a confirmatory factor analysis separately for OECD member countries, gender and region groups. The research then proceeded with the phase of testing the measurement invariance by testing the equivalence of covariance matrices for all groups. The measurement invariance was tested by means of a multi-group confirmatory factor analysis. The results revealed that the measurement invariance held true for the gender and region groups in Turkey, but not for the OECD member countries, and that the strong factorial invariance model was the one that worked most successfully among the models of measurement invariance.

 

Article visualizations:

Hit counter

DOI

Keywords


PISA 2012, mathematical literacy, measurement invariance, multi-group confirmatory factor analysis

Full Text:

PDF

References


Akyıldız, M. (2009). PIRLS 2001 Testinin Yapı Geçerliğinin Ülkelerarası Karşılaştırılması Yüzüncü Yıl Üniversitesi Eğitim Fakültesi Dergisi, 6(1), 18-47.

Bahadır, E. (2012). Uluslararası öğrenci değerlendirme programına (PISA 2009) göre Türkiye’deki öğrencilerin okuma becerilerini etkileyen değişkenlerin bölgelere göre incelenmesi (Yayımlanmamış Yüksek Lisans Tezi). Hacettepe Üniversitesi, Ankara.

Başusta, N. B. U. (2010). Ölçme Eşdeğerliği. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi, 1(2).

Brown, T. A. (2006). Confirmatory factor analysis for applied research. New York: Guilford Publications.

Byrne, B. M. and Watkins, D. (2003). The issue of measurement invariance revisited. Journal of Cross-Cultural Psychology, 34(2), 155-175.

Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural equation modeling, 14(3), 464-504.

Cheung, G. W. and Rensvold, R. B. (2000). Assessing extreme and acquiescence response sets in cross-cultural research using structural equations modeling. Journal of Cross-Cultural Psychology, 31(2) 187-212.

Ercikan, K. and Koh, K. (2005). Examining the construct comparability of the English and French version of TIMSS. International Journal of Testing, 5, 23-35.

Herdman, M., Fox-Rushby, J., & Badia, X. (1998). A model of equivalence in the cultural adaptation of HRQoL instruments: the universalist approach. Quality of life Research, 7(4), 323-335.

Karakoç Alatlı, B. (2016). Uluslararası Öğrenci Değerlendirme Programı (PISA - 2012) okuryazarlık testlerinin ölçme değişmezliğinin incelenmes. (Yayımlanmamış Yüksek Lisans Tezi). Ankara Üniversitesi, Ankara.

Kıbrıslıoğlu, N. (2015). PISA 2012 Matematik Öğrenme Modelinin Kültürlere ve Cinsiyete Göre Ölçme Değişmezliğinin İncelenmesi: Türkiye-Çin (Şangay)-Endonezya Örneği (Yayımlanmamış Yüksek Lisans Tezi). Hacettepe Üniversitesi, Ankara.

Kline, R. B. (2005). Principles and practice of structural equation modeling (Second Edition) New York: Guilford Press.

Marsh, H. W., Hau, K. T., Artelt, C., Baumert, J., & Peschar, J. L. (2006). OECD's brief self-report measure of educational psychology's most useful affective constructs: Cross-cultural, psychometric comparisons across 25 countries. International Journal of Testing, 6(4), 311-360.

Marsh, H. W., Abduljabbar, A. S., Abu-Hilal, M. M., Morin, A. J., Abdelfattah, F., Leung, K. C., ... & Parker, P. (2013). Factorial, convergent, and discriminant validity of timss math and science motivation measures: A comparison of Arab and Anglo-Saxon countries. Journal of Educational Psychology, 105(1), 108.

MEB. (2015). PISA 2012 araştırması ulusal nihai raporu. Ölçme, Değerlendirme ve Sınav Hizmetleri Genel Müdürlüğü.

Mushquash, C. J. and Bova, D. L. (2007). Cross-cultural assessment and measurement issues. Journal on Developmental Disabilities, 13(1), 53-65.

OECD (2013). PISA 2012 Assessment and Analytical Framework: Mathematics, Reading, Science, Problem Solving and Financial Literacy, PISA, OECD Publishing. http://dx.doi.org/10.1787/9789264190511-en

OECD. (2014). PISA 2012 Results in Focus: What 15-year-old Students Know and What They can Do with What They Know.

Öğretmen, T. (2006). Uluslararası Okuma Becerilerinde Gelişim Projesi (PIRLS) 2001 Testinin psikometrik özelliklerinin incelenmesi: Türkiye-Amerika Birleşik Devletleri örneği. (Yayımlanmamış Doktora Tezi). Hacettepe Üniversitesi, Ankara.

Raykov, T. and Marcoulides, G. A. (2008). An Introduction to Applied Multivariate Analysis (First Edition). NY: Taylor & Francis Group.

Tabachnick, B.G. and Fidell, L.S. (2013). Using multivariate statistics (6th ed.). New Jersey: Pearson.

Tyson, H.E. (2004). Ethnic differences using behavior rating scales to assess the mental health of children: A conceptual and psychometric critique. Child Psychiatry and Human Development, 34 (3), 167-201. 11.

Uyar. Ş. ve Doğan, N. (2014). PISA 2009 Türkiye örnekleminde öğrenme stratejileri modelinin farklı gruplarda ölçme değişmezliğinin incelenmesi. Uluslararası Türk Eğitim Bilimleri Dergisi, 2, 30-43.

Van de Vijver, F. J. R., and Leung, K. (1997). Methods and data analysis for cross-cultural research. Newbury Park, CA: Sage

Weston, R. and Gore, P. A. (2006). A brief guide to structural equation modeling. The Counseling Psychologist, 34(5), 719-751.

Wu, D. A., Li, Z., & Zumbo, B. D. (2007). Decoding the meaning of factorial invariance and updating the practice of multi-group confirmatory factor analysis: A demonstration with TIMSS data. Practical Assessment, Research & Evaluation, 12(3), 1-26.




DOI: http://dx.doi.org/10.46827/ejes.v0i0.1816

Refbacks

  • There are currently no refbacks.


Copyright (c) 2018 Merve Ayvalli, Bayram Biçak

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

Copyright © 2015-2023. European Journal of Education Studies (ISSN 2501 - 1111) is a registered trademark of Open Access Publishing Group. All rights reserved.

This journal is a serial publication uniquely identified by an International Standard Serial Number (ISSN) serial number certificate issued by Romanian National Library (Biblioteca Nationala a Romaniei). All the research works are uniquely identified by a CrossRef DOI digital object identifier supplied by indexing and repository platforms. All authors who send their manuscripts to this journal and whose articles are published on this journal retain full copyright of their articles. All the research works published on this journal are meeting the Open Access Publishing requirements and can be freely accessed, shared, modified, distributed and used in educational, commercial and non-commercial purposes under a Creative Commons Attribution 4.0 International License (CC BY 4.0).