ASSESSMENT FAIRNESS AT THE UNIVERSITY OF CAPE COAST: EVALUATING THE FACTOR STRUCTURE AND MEASUREMENT INVARIANCE ACROSS GENDER

Samuel Oppong, Nathaniel Quansah, Regina Mawusi Nugba, Vera Rosemary Ankoma-Sey, Samuel Yaw Ampofo, Gabriel Essilfie

Abstract


The specific purpose of the study was to evaluate the factor structure of statistics assessment fairness inventory (SAFI) which was adapted for the Ghanaian context and further examine measurement invariance across gender. SAFI factor structure and construct validity were assessed with a sample of 735 Ghanaian university students through exploratory and confirmatory factor analysis. Through an exploratory factor analysis, five dimensions were obtained which include: learning materials and practices, test design, opportunity to demonstrate learning test administration and grading, and offering feedback. A confirmatory factor analysis was then conducted to examine the factor loadings of the items. Further analysis revealed a partial measurement invariance of the fairness construct with equal means and equal variances in relation to gender. This suggested that the SAFI is valid, reliable, and can equally work across gender. It is recommended that SAFI has important implications for decisions regarding the conduct of especially, high-stakes examinations.

 

Article visualizations:

Hit counter


Keywords


educational assessment, assessment fairness, measurement invariance, statistics assessment fairness

Full Text:

PDF

References


Bazvand, A. D., & Rasooli, A. “Students’ experiences of fairness in summative assessment: A study in a higher education context”. Studies in Educational Evaluation, 2022, (72), 101118.

Berti, C., Molinari, L., & Speltini, G. “Classroom justice and psychological engagement: Students’ and teachers’ representations”. Social Psychology of Education, 2010, (13), 541-556. doi:10.1007/s11218-010-9128-9

Chory-Assad, R. “Classroom justice: Perceptions of fairness as a predictor of student motivation, learning, and aggression”. Communication Quarterly, 2002 (50), 58-77. doi:10.1080/01463370209385646

Chory-Assad, R., & Paulsel, M. “Antisocial classroom communication: Instructor influence and interactional justice as predictors of student aggression”. Communication Quarterly, 2004b, (52), 98-114. doi:10.1080/01463370409370184

Civelek ME, İnce H, Karabulut AT. “The mediator roles of attitude toward the web site and user satisfaction on the effect of system quality on net benefit: A structural equation model on web site success”. European Scientific Journal, 2016.

Cizek, G. J. “Defining and distinguishing validity: interpretations of score meaning and justifications of test use”. Psychological methods, 2012 17(1), 31.

Donahue, B. H. “The effect of partial measurement invariance on prediction”. University of Georgia, 2006 (Doctoral dissertation).

Green, S., Johnson, R., Kim, D., & Pope, N. “Ethics in classroom assessment practices: Issues and attitudes”. Teaching and teacher education, 2007, (23), 999-1011. doi:10.1016/j.tate.2006.04.042

Hau K, T, Marsh H, W. “The use of item parcels in structural equation modelling: Non‐normal data and small sample sizes”. British Journal of Mathematical and Statistical Psychology. 2004, 57(2):327-51.

Holmgren, J., & Bolkan, S. “Instructor responses to rhetorical dissent: Student perceptions of justice and classroom outcomes”. Communication Education, 2014, (63), 17-40. doi:10.1080/03634523.2013.833644

Ishak, Z., & Fin, L. “Truants' and teachers' behaviors in the classroom”. Procedia-Social and Behavioral Sciences, 2013, (103), 1228-1237. doi:10.1016/j.sbspro.2013.10.451

Laing, K., Mazzoli Smith, L., & Todd, L. “The impact agenda and critical social research in education: Hitting the target but missing the spot”? Policy Futures in Education, 2018, 16(2), 169-184.

Lei PW, Wu Q. “Introduction to structural equation modeling: Issues and practical considerations”. Educational Measurement: issues and practice, 2007, 26(3):33-43.

Lunenburg, F. “Self-efficacy in the workplace: implications for motivation and performance”. International Journal of Management, Business, and Administration, 2011, 14, 1–7.

McNamara T, Ryan K. “Fairness versus justice in language testing: The place of English literacy in the Australian citizenship test”. Language Assessment Quarterly, 2011 Apr 1;8(2):161-78.

Murdock, T., Miller, A., & Goetzinger, A. “Effects of classroom context on university students' judgments about cheating: Mediating and moderating processes”. Social Psychology of Education, 2007, 10, 141-169. doi:10.1007/s11218-007-9015-1

Murillo, F. J., & Hidalgo, N. “Students’ conceptions about a fair assessment of their learning”. Studies in Educational Evaluation, 2017, (53), 10-16.

Nisbet I, Shaw SD. Fair assessment viewed through the lenses of measurement theory. Assessment in Education: Principles, policy & practice, 2019, 26(5):612-29.

Nitko A, J. “Conceptual frameworks to accommodate the validation of rapidly changing requirements for assessments”. Curriculum and assessment. 2001, (1):143-63.

Oppong, S., Nugba, R. M., Asamoah, E., Quansah, N., & Ankoma-Sey, V. R. Teachers Confidence of Classroom Assessment Practices: A Case of Basic Schools in Upper Denkyira West District, Ghana. European Journal of Education Studies, 10(11). October 2023.

Owolabi HO, Ayandele J K, Olaoye D D. “A Systematic Review of Structural Equation Model (SEM)”. Open Journal of Educational Development (ISSN: 2734-2050), 2020, 1(2):27-39.

Pallant, J. “SPSS survival manual—A step-by-step guide to data analysis using SPSS for windows”. 2007, Maidenhead: Open University Press.

Pepper MB, Pathak S. “Classroom contribution: What do students perceive as fair assessment”? Journal of Education for Business, 2008, 83(6):360-8.

Quansah, F. “The use of Cronbach alpha reliability estimates in research among students in public universities in Ghana”. Africa Journal of Teacher Education, 2017 (1);7822.

Rezai, A. “Fairness in classroom assessment: development and validation of a questionnaire”. Language Testing in Asia, 2022, 12(1), 17.

Steinmetz H, Schmidt P, Tina-Booh A, Wieczorek S, Schwartz S, H. “Testing measurement invariance using multigroup CFA: Differences between educational groups in human values measurement”. Quality & Quantity, 2009, (43), 599-616.

Tabachnick, B. G., Fidell, L. S., & Ullman, J. B. “Using multivariate statistics” Boston, MA: Pearson, 2013, Vol. 6, pp. 497-516.

Tierney, R. “Fairness in classroom assessment”. In J. H. McMillan (Ed.), SAGE handbook of research on classroom assessment, 2013, (pp. 125–144). Thousand Oaks, CA: SAGE Publications

Tierney, R. D. “Fairness in educational assessment. In M. A. Peters (Ed.), Encyclopedia of Educational Philosophy and Theory. 2016, DOI: 10.1007/978-981-287-532-7_400-1

Wallace, M. P. “Fairness and justice in L2 classroom assessment: Perceptions from test takers”. Journal of Asia TEFL, 2018, 15(4), 1051.

Yu S, Hudders L. “Measurement invariance of the modified brand luxury index scale across gender, age and countries”. Journal of Fashion Marketing and Management: An International Journal. 2022, 26(5):870-89.




DOI: http://dx.doi.org/10.46827/ejes.v11i3.5233

Refbacks

  • There are currently no refbacks.


Copyright (c) 2024 Samuel Oppong, Nathaniel Quansah, Regina Mawusi Nugba, Vera Rosemary Ankoma-Sey, Samuel Yaw Ampofo, Gabriel Essilfie

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

Copyright © 2015-2023. European Journal of Education Studies (ISSN 2501 - 1111) is a registered trademark of Open Access Publishing Group. All rights reserved.

This journal is a serial publication uniquely identified by an International Standard Serial Number (ISSN) serial number certificate issued by Romanian National Library (Biblioteca Nationala a Romaniei). All the research works are uniquely identified by a CrossRef DOI digital object identifier supplied by indexing and repository platforms. All authors who send their manuscripts to this journal and whose articles are published on this journal retain full copyright of their articles. All the research works published on this journal are meeting the Open Access Publishing requirements and can be freely accessed, shared, modified, distributed and used in educational, commercial and non-commercial purposes under a Creative Commons Attribution 4.0 International License (CC BY 4.0).