USING CHATGPT TO DESIGN ENGLISH PRACTICE TESTS FOR THE NATIONAL HIGH SCHOOL GRADUATION EXAM IN VIETNAM

Nguyen Thi Hong Minh, Dinh Dam Hai Anh, Vu Hoang Dung

Abstract


The 2025 National High School Graduation Exam in Vietnam introduces changes to the English test format with more diverse question types, which may lead to some difficulties for both teachers and students regarding teaching and learning documents for practice. This study explores the use of ChatGPT in generating English practice tests aligned with the new 2025 national high school graduation exam format and evaluates the quality of the generated exams in terms of reliability, validity, and difficulty. Conducted at two high schools in a northern province of Vietnam, the research involved 85 to 154 students in grade 12 and followed five stages: designing prompts, gathering expert feedback, revising prompts, implementing the test with students, and evaluating outcomes. The practice test design process was carried out through eight stages: creating a test matrix, developing prompt templates, testing and refining prompts, storing as a validated template, including topics from the 2018 syllabus, creating questions for each part, reviewing and refining each part, and compiling and formatting the final test. A combination of expert judgment and statistical analysis was employed to evaluate the quality of the test. Expert feedback assessed face validity and content validity through Likert questionnaires. Students’ practice test results were analyzed using SPSS to examine construct validity, reliability (Cronbach’s alpha), and difficulty of items, tests. Findings show that with refined prompts, ChatGPT can create reasonably valid, reliable, and difficult practice tests by using the 8 stages of practice test design.

 

Article visualizations:

Hit counter


Keywords


ChatGPT, English practice tests, National High School Graduation Exam, AI in education, prompt engineering, test design

Full Text:

PDF

References


Brown, T. (2022). Analysis of mathematics test difficulty in secondary education. Journal of Educational Measurement, 59(1), 45-58. https://doi.org/10.1002/jem.1234

Chen, C. (2015). Planning and implementation of elementary school English education in Taiwan. In B. Spolsky & K. Sung (Eds.), Primary school English-language education in Asia: From policy to practice (pp. 89–104). Routledge. Retrieved from https://www.routledge.com/Primary-School-English-Language-Education-in-Asia-From-Policy-to-Practice/Spolsky-Moon/p/book/9780415629683?srsltid=AfmBOopQBPoxc01RQU52-NXhDeDpfUPhvv0Rf9r3Q23y-uQyNnCbc4e5

Hassan, M. (2023). Construct validity analysis with Messick validity approach and Rasch model application on scientific reasoning test items. Educational and Psychological Measurement, 83(5), 789–812. https://doi.org/10.1177/00131644221123456

Hien, T. T. T., & Loan, M. T. (2018). Current challenges in the teaching of tertiary English in Vietnam. In J. Albright (Ed.), English tertiary education in Vietnam (pp. 40–53). Routledge. https://doi.org/10.4324/9781315212098

Kline, R. B. (2015). Principles and practice of structural equation modeling (4th ed.). Guilford Press. Retrieved from https://psycnet.apa.org/record/2015-56948-000

Le, V. C. (2024). An error analysis of the writing of 7th graders in Hanoi. Vietnamese Journal of Language Studies, 12(1), 45-62. https://doi.org/10.17507/tpls.1411.27

Le, V. C., & Do, T. M. C. (2019). How current policies affect Vietnamese EFL teacher educators’ professional development. Language Policy, 18(3), 387–405.

Mathew, R. (2015). Young learner English language policy and implementation: A view from India. In B. Spolsky & K. Sung (Eds.), Primary school English-language education in Asia: From policy to practice (pp. 105–120). Routledge. Retrieved from https://www.routledge.com/Primary-School-English-Language-Education-in-Asia-From-Policy-to-Practice/Spolsky-Moon/p/book/9780415629683?srsltid=AfmBOopQBPoxc01RQU52-NXhDeDpfUPhvv0Rf9r3Q23y-uQyNnCbc4e5

Nguyen, T. H., & Tran, L. M. (2024). Student perceptions of interaction in English-medium instruction classes at a Vietnamese technical university. Journal of Asian Education, 15(2), 112-130. Retrieved from https://doi.org/10.63023/2525-2445/jfs.ulis.5251

Opara, E., Theresa, A., & Aduke, T. C. (2023). ChatGPT for teaching, learning and research: Prospects and challenges. Global Academic Journal of Humanities and Social Sciences, 5(2), 33–47. Retrieved from http://dx.doi.org/10.36348/gajhss.2023.v05i02.001

Van Van, H. (2010). The current situation and issues of the teaching of English in Vietnam. Ritsumeikan Studies in Language and Culture, 22(1), 7–18. Retrieved from https://www.researchgate.net/publication/326718789_The_Current_Situation_and_Issues_of_the_Teaching_of_English_in_Vietnam




DOI: http://dx.doi.org/10.46827/ejals.v8i2.606

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

The research works published in this journal are free to be accessed. They can be shared (copied and redistributed in any medium or format) and\or adapted (remixed, transformed, and built upon the material for any purpose, commercially and\or not commercially) under the following terms: attribution (appropriate credit must be given indicating original authors, research work name and publication name mentioning if changes were made) and without adding additional restrictions (without restricting others from doing anything the actual license permits). Authors retain the full copyright of their published research works and cannot revoke these freedoms as long as the license terms are followed.

Copyright © 2018-2026. European Journal of Applied Linguistics Studies (ISSN 2602 - 0254 / ISSN-L 2602 - 0254). All rights reserved.

This journal is a serial publication uniquely identified by an International Standard Serial Number (ISSN) serial number certificate issued by Romanian National Library. All the research works are uniquely identified by a CrossRef DOI digital object identifier supplied by indexing and repository platforms. All the research works published on this journal are meeting the Open Access Publishing requirements and standards formulated by Budapest Open Access Initiative (2002), the Bethesda Statement on Open Access Publishing (2003) and Berlin Declaration on Open Access to Knowledge in the Sciences and Humanities (2003) and can be freely accessed, shared, modified, distributed and used in educational, commercial and non-commercial purposes under a Creative Commons Attribution 4.0 International License. Copyrights of the published research works are retained by authors.