A STRUCTURAL EQUATION MODELING OF THE ASSESSMENT PRACTICES INVENTORY MODIFIED (APIM) SCALE: AN ASSESSMENT MODEL FOR HIGHER EDUCATION INSTITUTIONS
Abstract
This research analysed the psychometric properties of the Assessment Practices Inventory Modified (APIM) using structural equation modelling. The APIM scale was distributed to a sample of 350 academic staff selected from both private and public universities in Uganda. A purely quantitative approach with a stratified random sampling technique to select the participants was adopted for this study. The objective of this study was to; test the psychometric properties of the APIM scale. The results of the psychometric properties revealed that the APIM scale is an adequate instrument in measuring assessment practices among university academic staff. The hypothesised model was found to be adequate in explaining assessment practices among academic staff in universities; χ² = 902.619, χ²/df = 1.842, df = 490, p = .000, CFI = .906, RMSEA = .052, and SRMR = .050. The findings revealed that the APIM hypothesised model was fit and adequate to explain the factors assessment practices of staff in higher education institutions. This has led to a recommendation that formal assessment training programmes should be made mandatory to all academic staff in universities in Uganda to understand assessment design, administration, interpretation and application.
Article visualizations:
Keywords
Full Text:
PDFReferences
Ainsworth, L., & Viegut, D. (2006). Common formative assessments: How to connect standards-based instruction and assessment. California: Corwin.
Alexander, W. A., Trudy, W. B., Patricia, K, C., El-Khawas, E., Ewell, P. T., Hutchings, P., Theodore, J. M., Kay, M. M., Mentkowski, M., Miller, M. A., Thomas, M. E., & Wright, B. D. (2003). Best Practices in Academic Assessment. AAHE Assessment Forum, Exxon Education Foundation.
Alkharusi, H. (2011). Teachers’ classroom assessment skills: Influence of gender, subject area, grade level, teaching experience and in-service assessment training. Turkish Science Education, 8(2), 39-47.
Alkharusi, H. (2012). Educational assessment attitudes, competences, knowledge, and practices: An exploratory study of Muscat teachers in the Sultanate of Oman. Journal of Education and Learning, 1(2), 217-232.
Arter, J. A. (2003). Assessment for learning: Classroom assessment to improve student achievement and well-being. RIEPR2004, 24.
Astin, A. W., Banta, T. W., Cross, K. P., El-Khawas, E., Ewell, P. T., Hutchings, P., Marchese, T. J., McClenney, K. M., Mentkowski, M., Miller, M. A., Moran, E. T., & Wright, B. D. (1993). Principles of good practice for assessing student learning. Leadership Abstracts, 6(4), 1-2.
Banta, T. W. & Associates. (1993). Making a difference: Outcomes of a decade of assessment in higher education. San Francisco: Jossey-Bass.
Banta, T. W., Lund, J. P., & Oblander, F. W. (1996). Assessment in practice: Putting principles to work on college campuses. San Francisco: Jossey-Bass.
Benson, A. D. (2003). Assessing participant learning in online environments. New Directions for Adult and Continuing Education, 100, 69-78.
Bentler, P. M. (1992). On the fit of models to covariance and methodology. Psychology Bulletin, 112, 400-404.
Biggs, J. (2003). Aligning teaching and assessment to course objectives. Paper presented at ICHEd Conference: Teaching and Learning in Higher Education: New Trends and Innovations, April 13-17, in University of Aveiro, Portugal. Retrieved January 10, 2012. http://www.event.ua.pt/iched/main/ invcom/p182.pdf
Black, P., & Wiliam, D. (1998a). Assessment and classroom learning. Assessment in Education, 5 (1), 7-74.
Black, P., & Wiliam, D. (1998b). Inside the black box: Raising standards through classroom assessment. Phi Delta Kappan, 80(2), 139-148.
Black, P., & Wiliam, D. (2003). In praise of educational research: Formative assessment. British Educational Research Journal, 29(5), 623-637.
Bloom, B. S., Madaus, G. F., & Hastings, J. T. (1981). Evaluation to improve learning. New York: McGraw-Hill.
Boud, D., & Associates. (2010). Assessment 2020: Seven propositions for assessment reform in higher education. Sydney: Australian Learning and Teaching Council. Retrieved February 13, 2012. http://www.iml.uts.edu.au/assessment-futures/Assessment-2020_propositions_final.pdf
Boud, D., Cohen, R., & Sampson, J. (1999). Peer learning and assessment. Assessment and Evaluation in Higher Education, 24(4), 413-426.
Braskamp, L. A. (1991). Purposes, issues and principles of assessment. NCA Quarterly, 66(2), 417-429.
Brown, G. T. L. (2003). Teachers’ instructional conceptions: Assessments relationship to learning, teaching, curriculum, and teacher efficacy. Paper presented at the Joint Conference of the Australian and New Zealand Associations for Research in Education (AARE/NZARE). Auckland: University of Auckland. Retrieved March 18, 2012. http://www.aare.edu.au/ 03pap/bro03022.pdf
Brown, G. T. L. (2011). Intermediate topics in confirmatory factor analysis and structural equation modelling. Presentation to Research Development Office, Continuing Professional Development Programme. The Hong Kong Institute of Education. Retrieved February 15, 2012. http://www.academia.edu/ 1684096/Intermediate_Topics_in_Confirmatory_Factor_Analysis_CFA_and_Structural_Equation_Modeling_SEM_
Brown, T. A. (2007). Confirmatory factor analysis for applied research. New York: Guild Ford Press.
Burry-Stock, J. A., & Frazier, C. H. (2008). Revision of the Assessment Practice Inventory Revised (APIR): A combined exploratory factor analysis and polytomous IRT approach. Paper Presented at the American Educational Research Association. New York: NY.
Byrne, B. M. (2006). Structural equation modelling with EQS: Basic concepts, applications, and programming (2nd edn.). New Jersey: Lawrence Erlbaum.
Byrne, B. M. (2010). Structural equation modelling with AMOS. Basic concepts, applications, and programming (2nd edn.). New York: Routledge.
Connoley, R. (2004). Criterion-referenced assessment. Faculty of Business & Law, Deakin University. Retrieved August 21, 2011. http://deakin.edu.au/itl/assets/resources/pd/tl-modules/scholarly/studyguides/ criterion-ref-assessment.pdf
Crook, C., Gross, H., & Dymott, R. (2006). Assessment relationships in higher education: The tension of process and practice. British Educational Research Journal, 32(1), 95-114.
Dixon, T. P. (1994). A discussion of non-traditional outcomes assessment models. Stillwater, OK: National Conference of Academic Deans. (ERIC Document Reproduction Service No. ED 372 698).
Dunca, C. R., & Noonan, B. (2007). Factors affecting teachers’ grading and assessment practices. The Alberta Journal of Educational Research, 53(1), 1-21.
Duvall, B. (1994). Obtaining student cooperation for assessment. In T. H. Bers, & M. L. Mittler (Eds.), Assessment and testing: Myths and realities (New Directions for Community Colleges (pp. 47-52). San Francisco: Jossey-Bass.
Earl, L. M. (2003). Assessment as learning: Using classroom assessment to maximize student learning. Thousand Oaks, CA: Corwin Press.
Ebersole, T. E. (2009). Postsecondary assessment: Faculty attitudes and levels of engagement. Assessment Update, 1(2), 13-14.
Eisenman, C. D. (1991). Faculty participation in assessment programs. NCA Quarterly, 66(2), 458- 464.
Elwood, J., & Klenowski, V. (2002). Creating communities of shared practice: The challenges of assessment use in learning and teaching. Assessment & Evaluation in Higher Education, 27(3), 243-256.
Ewell, P. T. (1987a). Assessment, accountability and improvement: Managing the contradiction. Boulder, CO: National Centre for Higher Education Management Systems.
Ewell, P. T. (1987b). Strengthening assessment for academic quality improvement. In M. W. Peterson, D. D. Dills, & L. A. Mets (Eds.), Planning and management for a changing environment: A handbook on redesigning postsecondary institutions (pp. 360-381). San Francisco: Jossey-Bass.
Ewell, P. T. (1988). Implementing assessment: Some organizational issues. In T. W. Banta (Eds.), Implementing outcomes assessment: Promise and perils (pp. 15-28). San Francisco: Jossey-Bass.
Ewell, P. T. (1991). Assessment and public accountability: Back to the future. Change, 23(6), 12-17.
Ewell, P. T. (1994). Developing state-wide performance indicators for higher education: Policy themes and variations. In S. S. Ruppert (Eds.), Charting higher education accountability: A sourcebook on state-level performance indicators (pp. 147-166). Denver, CO: Education Commission of the States.
Ewell, P. T., & Boyer, C. M. (1988). Acting out state-mandated assessment: Evidence from five states. Change, 20(4), 40-47.
Fatmawati, A. (2011). Using portfolio to assess student learning of problem solving. Geelong-Victoria: Deakin University.
Frazier, C. H. (2007). Investigating teachers’ self-perceptions applications of classroom assessment practices using Assessment Practice Inventory Revised (APIR). Doctoral Dissertation, University of Alabama.
Gardner, H. (1999). Assessment in context. In P. Murphy (Edn.), Learners, Learning and Assessment. London: Paul Chapman.
Gibbs, G. (2006). Why assessment is changing. In C. Bryan & K. Clegg, (Eds.), Innovative Assessment in Higher Education (pp. 11-22). London: Routledge.
Gipps, C. (1998). Socio-cultural aspects of assessment. Review of Research in Education, 24, 355-392.
Gore, J., Ladwig, J., Elsworth, W., & Ellis, H. (2009). Quality assessment framework: A guide for assessment practice in higher education. The Australian Learning and Teaching Council Ltd. Retrieved December 10, 2012. http://www.academia.edu/655848/QUALITY_ASSESSMENT_FRAMEWORK_A_Guide_for_Assessment_Practice_in_Higher_Education
Gronlund, N. E. (2006). Assessment of student achievement (8th edn.). Boston: Pearson.
Guskey, T. R., & Bailey, J. M. (2001). Developing grading and reporting systems for student learning. California: Corwin Press.
Harlen, W., & James, M. (1997). Assessment and learning: Differences and relationships between formative and summative assessment. Assessment in Education, 4(3), 365-379.
Higher Education Academy (HEA). (2007). Good practices in assessment of NQF BTEC higher national in further education colleges. Higher education academy. United Kingdom. Retrieved December 12, 2011. http://www.heacademy.ac.uk/resources/detail/subjects/engineering/good-practice-in-assessment-of-nqf-btec-higher-nationals
Hindi, N., & Miller, D. (2000). A survey of assessment practices in accounting departments of colleges and universities. Journal of Education for Business, 75(5), 286.
Hutchings, P., & Marchese, T. (1990). Watching assessment: Questions, stories, prospects. Change, 22(5), 12-38.
James, R., McInnis, C., & Devlin, M. (2002). Assessing learning in Australian universities: Ideas, strategies and resources for quality in student assessment. Centre for the Study of Higher Education. www.cshe.unimelb.edu.au/assessinglearning
Kells, H. R. (1992). An analysis of the nature and recent development of performance indicators in higher education. Higher Education Management, 4(2), 131-138.
Kirkwood, A., & Price, L. (2008). Assessment and student learning: A fundamental relationship and the role of information and communication technologies. Open Learning: The Journal of Open and Distance Learning, 23(1), 5-16.
Knight P., & Yorke, M. (2003). Employability and good learning in higher education. Teaching in Higher Education, 8(1), 3-16.
Lei, P. W., & Wu, Q. (2007). An NCME Instructional Module on Introduction to structural equation modelling: Issues and practical considerations. Pennsylvania: The Pennsylvania State University.
Luth, R. W. (2010). Assessment and grading at the University of Alberta: Policies, practices, and possibilities. A report to the Provost and the University. Alberta: University of Alberta.
Madaus, G., Raczek, A., & Clark, M. (1997). The historical and policy foundations of the assessment movement. In A. Goodwin (Edn.), Assessment for equity and inclusion: Embracing all our children, (pp. 1-34). New York: Routledge.
Martell, K., & Calderon, T. (2005). Assessment of student learning in business schools: What it is, where we are, and where we need to go next. In K. Martell & T. Calderon (Eds.), Assessment of student learning in business schools: Best practices each step of the way (pp. 1-22). Tallahassee, Florida: Association for Institutional Research.
McKeachie, W. J., & Svinicki, M. (2006). McKeachie's teaching tips: Strategies, research, and theory for college and university teachers. Boston: Houghton Mifflin.
McMillan, J. H. (2003). Understanding and improving teachers’ classroom assessment decision making: Implications for theory and practice. Educational Measurement: Issues and Practice, 22(4), 34-43.
Mentkowski, M. (1991). Creating a context where institutional assessment yields educational improvement. Journal of General Education, 40, 255-283.
Ministry of Education [MOE], (2010). Assessment and evaluation in Saskatchewan: Assessment and evaluation. Unpublished. Retrieved January 13, 2012. http://www.prairiesouth.ca/staff/curriculum-a-learning/assessment.html
National Council for Curriculum and Assessment [NCCA]. (2005). Supporting assessment in schools - 1: Assessment in primary schools. USA: National Council for Curriculum and Assessment.
Netherlands Inspectorate of Education (NIE). (2008). Assessment matters: The quality assurance of student assessment in higher education. Report of an international working group. Retrieved November 12, 2011. www.enqa.eu/.../QA% 20of%20Student%20Assessment%20Report.pdf
O’Connor, K. (2009). Reforming grading practices in secondary schools. Principal's Research Review, 4(1), 1-7.
O’Donovan, B., Price, M., & Rust, C. (2001). The student experience of criterion referenced assessment through the use of a common criteria assessment grid. Innovations in Learning and Teaching International, 38(1), 74-85.
O'Grady, G. (2006). Guide for good practice in assessment. Ngee Ann Polytechnic, Singapore. Retrieved February 12, 2012. http://www.learnerstogether. net/PDF/Guide-for-Good-Practice-in-Assessment.pdf
Ong, S. L. (2010). Profiling classroom teacher’s assessment practice. The 36th International Association of Education Assessment Conference. Assessment for the Future Generation, Bangkok, Thailand. Retrieved December 16, 2011. www.iaea.info/documents/paper_4d32f2cd.pdf
Orlich, R. J., Harder, R. C., Callahan, R. C., & Gibson, H. W. (2001). Teaching strategies: A guide to better instruction (6th edn.). New York: Houghton Mifflin.
Orzolek, D. C. (2006). The paradox of assessment: Assessment as paradox. Research and Issues in Music Education, 4(1), 1-5. Retrieved September 12, 2011. http://www.stthomas.edu/rimeonline/vol4/orzolek.htm
Paris, S., & Hoffman, J. (2004). Reading assessments in kindergarten through third grade: Findings from the centre for the improvement of early reading achievement. The Elementary School Journal, 105(2), 199-217.
Peterson, M. W. (1988). The organizational environment for student learning. In J. S. Stark & L. A. Mets (Eds.), Improving teaching and learning through research. San Francisco: Jossey-Bass.
Peterson, M. W. (1997). Inventory of institutional support for student assessment. National Centre for Research to Improve Postsecondary Teaching and Learning. Michigan, Ann Arbor: University of Michigan, NCPI.
Peterson, M. W., & Spencer, M. G. (1990). Understanding academic culture and climate. In W. G. Tierney (Eds.), Assessing academic climates and culture. San Francisco: Jossey-Bass.
Peterson, M. W., Cameron, K. S., Knapp, A., Spencer, M. G., & White, T. H. (1991). Assessing the organizational and administrative context for teaching and learning: An institutional self-study manual. Michigan, Ann Arbor: University of Michigan, NCPI.
Peterson, M. W., Cameron, K. S., Mets, L. A., Jones, P., & Ettington, D. (1986). The organizational context for teaching and learning: A review of the research literature. Michigan, Ann Arbor: University of Michigan, NCPI.
Peterson, M. W., Einarson, M. K., Augustine, C. H., & Vaughan, D. S. (1999a). Institutional support for student assessment: Methodology and results of a national survey. National Centre for Postsecondary Improvement. Stanford, CA: Stanford University, NCPI.
Peterson, M. W., Einarson, M. K., Augustine, C. H., & Vaughan, D. S. (1999b). Designing student assessment to strengthen institutional performance in comprehensive institutions. National Canter for Postsecondary Improvement. Stanford, CA: Stanford University, NCPI.
Peterson, M. W., Einarson, M. K., Trice, A. G., & Nichols, A. R. (1997). Improving organizational and administrative support for student assessment: A review of the research literature. National Centre for Postsecondary Improvement. Stanford, CA: Stanford University, NCPI.
Popper, E. (2005). Learning goals: The foundation of curriculum development and assessment. In K. Martell & T. Calderon (Eds.), Assessment of student learning in business schools: Best practices each step of the way, 1(2), 1-23. Tallahassee, Florida: Association for Institutional Research.
Quality Assurance Agency for Higher Education [QAAHE] (2007). Integrative assessment: Managing assessment practices and procedures, guide 4. Adams way, Mansfield, NG18 4FN Science and Business Media B.V.
Quality Matters (2006). Quality matters rubric standards, quality matters, inter-institutional quality assurance in online learning. Retrieved November 8, 2011. http://www.qmprogram.org/Rubric.htm
Roeber, E. D. (2002). How we will gather the data we need to inform policy makers? In R. W. Lissitz & W. D. Schafer (Eds.), Assessment in educational reform. Both means and ends. Boston, MA: Allyn and Bacon.
Ryan, G. J. (1993). After accreditation: How to institutionalize outcomes-based assessment. In C. Praeger (Eds.), Accreditation of the two-year college. San Francisco: Jossey-Bass.
Sadler, D. R. (2009). Fidelity as a precondition for integrity in grading academic achievement. Assessment & Evaluation in Higher Education, 34(1), 1-17.
Satterly, D. (1989). Assessment in schools (2nd Edn.). Oxford: Blackwell.
Schreiber, J. B., Stage, F. K., King, J., Nora, A., & Barlow, E. A. (2006). Reporting Structural Equation Modelling and Confirmatory Factor Analysis: A review. Journal of Educational Research, 99(6), 323-337.
Shohamy, E. (2004). Assessment in multicultural societies: Applying democratic principles and practices to language testing. In B. Norton & K. Toohey (Eds.), Critical pedagogies and language learning (pp. 72-93). Cambridge: Cambridge University Press.
The Quality Assurance Agency for Higher Education [QAHE] (2006). Code of practice of academic quality and standards in higher education. Section 6: Assessment of students. Retrieved January 23, 2012. http://www.qaa.ac.uk/ assuringstandardsandquality/code-of-practice/Pages/default.aspx
Toohey, S. (1999). Designing courses for higher education. Buckingham: Open University Press.
Warren-Piper, D., Nulty, D. D., & O'Grady, G. (1996). Examination practices and procedures in Australian universities. Higher Education Division, Department of Employment Education and Training. Evaluations and Investigations Program. AGPS, Canberra.
Weddel, K. S., & Van Duzer, C. (1997). Needs assessment for adult ESL learners. ERIC Digest. Washington, DC: National Clearinghouse for ESL Literacy Education.
Young, C. C., & Knight, M. E. (1993). Providing leadership for organizational change. In T. W. Banta, J. P. Lund, K. E. Black, & F. W. Oblander (Eds.), Making a difference: Outcomes of a decade of assessment in higher education. San Francisco, CA: Jossey-Bass.
Zhang, Z. (1995). Investigating teachers’ perceived assessment practices and assessment competencies on the API. Tuscaloosa, AL: The University of Alabama.
Zhang, Z. (1996). Teacher assessment competency: A Rasch model analysis. A paper presented at the annual meeting of American Educational Association. USA, New York.
Zhang, Z., & Burry-Stock, J. A. (1994). Assessment practices inventory. Tuscaloosa, AL: The University of Alabama.
Zhang, Z., & Burry-Stock, J. A. (2003). Classroom assessment practices and teachers’ self-perceived assessment skills. Applied Measurement in Education, 16(4), 323-342.
DOI: http://dx.doi.org/10.46827/ejes.v0i0.2955
Refbacks
- There are currently no refbacks.
Copyright (c) 2020 Musa Matovu
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright © 2015-2023. European Journal of Education Studies (ISSN 2501 - 1111) is a registered trademark of Open Access Publishing Group. All rights reserved.
This journal is a serial publication uniquely identified by an International Standard Serial Number (ISSN) serial number certificate issued by Romanian National Library (Biblioteca Nationala a Romaniei). All the research works are uniquely identified by a CrossRef DOI digital object identifier supplied by indexing and repository platforms. All authors who send their manuscripts to this journal and whose articles are published on this journal retain full copyright of their articles. All the research works published on this journal are meeting the Open Access Publishing requirements and can be freely accessed, shared, modified, distributed and used in educational, commercial and non-commercial purposes under a Creative Commons Attribution 4.0 International License (CC BY 4.0).
