PROPOSING A METHOD TO CREATE METACOGNITIVE SCHOOL EXAMS
Abstract
Metacognition is defined as the capacity of the persons to monitor, to regulate and to construct knowledge about their inner processes. Theoretically, this construct is relevant to Education and correlated areas, since the process of learning and knowledge construction involves metacognition. Besides, there are evidences that certain metacognitive components are predictors of academic achievement of the students. Regarding these aspects, this paper proposes a methodology that permits educators to elaborate metacognitive school exams, which are capable of measuring both the students' knowledge of an educational domain (i.e., concepts pertaining to biology, chemistry, history, mathematics, physics, and so on), and the following metacognitive abilities: feeling-of-knowing, monitoring (detection of errors), self-management, and judgment. In this paper, we present the methodology stressing on the steps that enable the teacher to elaborate a school exam capable of measuring a target educational domain, as well as the stated metacognitive abilities. Concomitantly, we apply this methodology, showing the construction of the Metacognitive School Exam in Electrostatics.
Article visualizations:
Keywords
Full Text:
PDFReferences
Andretta, I.; Silva, J. G.; Susin, N.; & Freire, S. D. (2010). Metacognição e aprendizagem: como se relacionam? Psico, Porto Alegre, PUCRS, 41(1), pp. 7-13.
Beaujean, A. A. (2013) Factor Analysis Using R. Practical Assessment, Research & Evaluation, Vol 18, No 4 Page 2. https://pareonline.net/pdf/v18n4.pdf
Busnello, F. B., Jou, G. I. & Sperb, T. M. (2012). Desenvolvimento de habilidades metacognitivas: capacitação de professores de ensino fundamental. Psicologia: Reflexão e Crítica,.25(2), 311-319. http://www.scielo.br/pdf/prc/v25n2/a13v25n2.pdf
Byrne, B. M. (1998). Multivariate applications book series. Structural equation modeling with LISREL, PRELIS, and SIMPLIS: Basic concepts, applications, and programming. Mahwah, NJ, US: Lawrence Erlbaum Associates Publishers.
Costa, C. J. B. (2013). Sucesso escolar no ensino secundário-Autorregulação e performances de aprendizagem em busca do sucesso (Tese de doutoramento em Ciências da Educação). Universidade de Coimbra, Portugal. https://estudogeral.sib.uc.pt/bitstream/10316/24218/3/Sucesso%20escolar%20no% 20ensino%20secundario.pdf
Dunning, D., Johnson, K., Ehrlinger, J., & Kruger, J. (2003). Why people fail to recognize their own incompetence. Current Directions in Psychological Science, 12(3), 83-87 https://doi.org/10.1111/1467-8721.01235
Efklides, A. (2006). Metacognition and affect: What can metacognitive experiences tell us about the learning process? Educational Research Review, 1 (1), 3-14. doi:10.1016/j.edurev.2005.11.001
Flavell, J. H. (1976). Metacognitive aspects of problem solving. In L. B. Resnick (Ed.), The nature of intelligence (pp.231-236). Hillsdale, NJ: Erlbaum
Flavell, J. H. (1979). Metacognition and cognitive monitoring: A new area of cognitive– developmental inquiry. American Psychologist, 34(10), 906-911. http://dx.doi.org/10.1037/0003-066X.34.10.906
Fleming, S. M., Massoni, S., Gajdos, T. & Vergnaud, J. C. (2016). Metacognition about the past and future: quantifying common and distinct influences on prospective and retrospective judgments of self-performance. Neuroscience of Consciousness, 2016(1) 1–12 doi: 10.1093/nc/niw018
Fox, J. P., Maarten, M., Mulder, J. & Verhagen, J. (2016). Complex Latent Variable Modeling in Educational Assessment. Communications in Statistic - Simulation and Computation, 45(5): 1499–1510, DOI: 10.1080/03610918.2014.939518
Frey, A., Seitz, N. N., & Brandt, S. (2016). Testlet-Based Multidimensional Adaptive Testing. Frontiers in Psychology, 7, 1758. http://doi.org/10.3389/fpsyg.2016.01758
Garret, J., Alman, M., Gardner, S., & Born, C. (2007). Assessing students' metacognitive skills. American Journal of Pharmaceutical Education, 71(1), 1-7. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1847545/pdf/ajpe14.pdf
Gomes, C. M. A., & Golino, H. F. (2014). Self-reports on students' learning processes are academic metacognitive knowledge. Psicologia Reflexão e Crítica, 27 (3), 433-441. DOI: 10.1590/1678-7153.201427307
Gomes, C. M. A., Hudson F. Golino, H. F., & Menezes, I. G. (2014). Predicting School Achievement Rather than Intelligence: Does Metacognition Matter? Psychology, 5, 1095-1110. DOI: 10.4236/psych.2014.59122
Gomes, C. M. A., Almeida, L. S. & Núñez, J. C. (2017). Rationale and Applicability of Exploratory Structural Equation Modeling (ESEM) in Psychoeducational Contexts. Psicothema, 29(3), 396-401. doi: 10.7334/psicothema2016.369
Gonçalves, J. & Martins, M. A. (2013) Avaliação Da Metacognição, Autorregulação Eutilização De Estratégias Cognitivas Em Atividades De Investigação. Atas do XII Congresso Internacional Galego-Português de Psicopedagogia. Braga: Universidade do Minho, pp 4153-4165
Hart, J. T. (1965). Memory and the feeling-of-knowing experience. Journal of Educational Psychology, 56(4), 208-216. http://dx.doi.org/10.1037/h0022263
Hart, J. T. (1967). Memory and the memory-monitoring process. Journal of Verbal Learning & Verbal Behavior, 6(5), 685-691. http://dx.doi.org/10.1016/S0022- 5371(67)80072-0
Heale, R. & Twycross, A. (2015). Validity and reliability in quantitative studies. Evidence-Based Nursing 18(3):66-67 http://dx.doi.org/10.1136/eb-2015-102129
Hertzog, C., Dunlosky, J. & Sinclair, S. M. (2010). Memory & Cognition, 38(6): 771-784. https://doi.org/10.3758/MC.38.6.771
Hirschfeld, G. & von Brachel, R. (2014) Multiple-group confirmatory factor analysis. Practical Assessment, Research & Evaluation, Vol 19, No 7 Page 2 https://pareonline.net/getvn.asp?v=19&n=7
Hood, S. B. (2009). Validity and reliability in quantitative studies. Evidence-Based Nursing 18(3), 66-67 doi: 10.1136/eb-2015-102129
Lai, E. R. (2011). Metacognition: A literature review. Pearson research reports. New York, NY. http://www.pearsonassessments.com/hai/images/tmrs/metacognition_Literature _Review_Final.pdf
LaMarca, A. (2014). The development of a questionnaire on metacognition for students in secondary school. In Proceedings of EDULEARN14 Conference 7th-9th July 2014 (pp. 676-691). Barcelona: IATED.
Lawanto, O. (2010). Students' metacognition during an engineering design project. Performance Improvement Quarterly, 23(2), 117-136. https://doi.org/10.1002/piq.20084
Lee, G., Brennan, R. L., & Frisbie, D. A. (2001). Incorporating the testlet concept in test score analyses. Educational Measurement: Issues and Practice, 19(4), 5-9.
Loehlin, J. C. (2004). Latent variable models: An introduction to factor, path, and structural equation analysis. 4. Ed. Mahwah, NJ: Lawrence Erlbaum.
Luz, A. M. R., Alvares, B. A. (2011a). Física − Contexto e Aplicações Volume - 3. (1ª ed). São Paulo: Scipione.
Metcalfe, J., Schwartz, B. L., & Joaquim, S. G. (1993). The cue-familiarity heuristic in metacognition. Journal of Experimental Psychology: Learning, Memory, and Cognition, 19(4), 851-861. http://dx.doi.org/10.1037/0278-7393.19.4.851
Metcalfe, J., Dunlosky, J., (2008). Metamemory. In Learning and Memory: A Comprehensive Reference -Vol 2- Elsevier. Pages 349-362 http://www.columbia.edu/cu/psychology/metcalfe/PDFs/Metcalfe%202008.pdf
Metcalfe, J. (1986). Feeling-of-knowing in memory and problem solving. Journal of Experimental Psychology: Learning, Memory, and Cognition, 12(2), 288-294. http://dx.doi.org/10.1037/0278-7393.12.2.288
Nelson, T. O., & Narens, L. (1996). Why investigate Metacognition? In J. Metcalfe & A. P. Shimamura (Ed.), Metacognition. Knowing about knowing (pp. 1-27). Cambridge, MA: MIT Press.
http://www.imbs.uci.edu/~lnarens/1994/Nelson&Narens_Book%20Chapter_1994.p
Nelson, T. O., & Narens, L. (1980). Norms of 300 general-information questions: Accuracy of recall, latency of recall, and felling-of-knowing ratings. Journal of Verbal Learning and Verbal Behavior, 19, 338–368. doi: 10.1016/S0022-5371(80)90266- 2
Nelson, T. O., & Narens, L. (1994). Why investigate metacognition. In J. Metcalfe, & A. P. Shimamura (Eds.), Metacognition: Knowing about knowing (pp. 1-25). Cambridge, MA: MIT Press.
Paris, S. G., & Winograd, P. (1990). Metacognition in academic learning and instruction. In B. F. Jones (Ed.), Dimension of thinking and Cognitive Instruction. Hillsdale, NJ: Erlbaum.
Pires, A. A. M., & Gomes, C. M. A. (2017). Três procedimentos equivocados na elaboração de provas escolares: Explicitação e discussão. Ponte International Scientific Journal, 73(3), 2-14. doi: http://dx.doi.org/10.21506/j.ponte.2017.3.1,
Roebers, C. M., Krebs, S. S., & Roderer, T. (2014). Metacognitive monitoring and control in elementary school children: Their interrelations and their role for test performance. Learning and Individual Differences, 29, 141–149. https://doi.org/10.1016/j.lindif.2012.12.003
Schneider, W. (2010). The Development of Metacognitive Competences. In: H. Salatas Waters and W. Schneider (Eds.) (2010), Metacognition, Strategy Use, and Instruction. New York: Guilford Press.203-214. DOI: 10.1007/978-3-642-03129- 8_14
Schraw, G. (1997). The Effect of Generalized Metacognitive Knowledge on Test Performance and Confidence Judgments. The Journal of Experimental Education, 65(2), 135-146. DOI: 10.1080/00220973.1997.9943788
Schraw, G (1998). Promoting general metacognitive awareness. Instructional Science, 26(1-2), 113–125. https://doi.org/10.1023/A:1003044231033
Schraw, G. (2008). A conceptual analysis of five measures of metacognitive monitoring. Metacognition and Learning, 4(1), 33-45. doi:10.1007/s11409-008-9031-3.
Schraw, G., Crippen., K. J., & Hartley, K. (2006). Promoting Self-Regulation in Science Education: Meatacognition as Part of a Broader Perspective on Learning. Research in Science Education, 36(1-2), 111-139. DOI: 10.1007/s11165-005-3917-8
Sternberg, R. (2000). Psicologia cognitiva. Porto Alegre, RS: Artes Médicas.
Stewart, P. W., Cooper, S. S., & Moulding, L. R. (2007). Metacognitive development in professional educators. The Researcher, 21(1), 32−40.
Tanikawa, H. A.M. & Boruchovitch, E. (2016). Monitoramento Metacognitivo de alunos do ensino fundamental Psicologia Escolar e Educacional, SP. Volume 20, Número 3, pp 457-464.
http://dx.doi.org/10.1590/2175-3539/2015/02031012
Thiede, K. W., & Anderson, M. C. M. (2003). Summarizing can improve metacomprehension accuracy. Contemporary Educational Psychology, 28(xxx), 129- 160.
Thomas, A. K., Bulevich, J. B., Dubois, S. J. (2012). An analysis of the determinants of the feeling-of-knowing. Consciousness and Cognition 21(4), 1681–1694. https://doi.org/10.1016/j.concog.2012.09.005
Urbina, S. (2014). Essentials of psychological testing (2nd ed.). Hoboken: Wiley.
Veenman, M. V. J. (2011). Alternative assessment of strategy use with self-report instruments: a discussion. Metacognition and Learning, 6(2), pp 205–211. https://doi.org/10.1007/s11409-011-9080-x
Veenman, M. V. J. & Verheij, J. (2003). Technical students’ metacognitive skills: Relating general vs. specific metacognitive skills to study success. Learning and Individual Differences, 13, pp. 259-272.
Veenman, M. V. J.; Wilhelm, P., & Beishuizen, J. J. (2004). The relation between intellectual and metacognitive skills from a developmental perspective. Learning and Instruction, 14, pp. 89-109.
Wainer, H., & Kiely, G. L. (1987). Item clusters and computerized adaptive testing: A case for testlets. Journal of Educational Measurement, 24(3), 185-201. http://dx.doi.org/10.1111/j.1745-3984.1987.tb00274.x
Wirth, R. J., Edwards M. C. (2007). Psychol Methods. 12(1): 58–79. doi:10.1037/1082- 989X.12.1.58.
Wixson, K. K. (1983). Postreading question–answer interactions and children's learning from text. Journal of Educational Psychology, 75(3), 413-423. http://dx.doi.org/10.1037/0022-0663.75.3.413
Yeung, N. & Summerfield, C. (2012). Metacognition in human decision-making: confidence and error monitoring. Philosophical Transactions Royal Society, 367(1594), 1310–1321 doi:10.1098/rstb.2011.0416
Yong, A. G., & Pearce, S. (2013). A beginner’s guide to factor analysis: Focusing on exploratory factor analysis. Tutorials in Quantitative Methods for Psychology, 9(2), 79-94. doi: 10.20982/tqmp.09.2.p079
DOI: http://dx.doi.org/10.46827/ejes.v0i0.2153
Refbacks
- There are currently no refbacks.
Copyright (c) 2018 Aquiles Augusto Maciel Pires, Cristiano Mauro Assis Gomes
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright © 2015-2023. European Journal of Education Studies (ISSN 2501 - 1111) is a registered trademark of Open Access Publishing Group. All rights reserved.
This journal is a serial publication uniquely identified by an International Standard Serial Number (ISSN) serial number certificate issued by Romanian National Library (Biblioteca Nationala a Romaniei). All the research works are uniquely identified by a CrossRef DOI digital object identifier supplied by indexing and repository platforms. All authors who send their manuscripts to this journal and whose articles are published on this journal retain full copyright of their articles. All the research works published on this journal are meeting the Open Access Publishing requirements and can be freely accessed, shared, modified, distributed and used in educational, commercial and non-commercial purposes under a Creative Commons Attribution 4.0 International License (CC BY 4.0).
