Ảnh bìa

Evaluation of Automated Vocabulary Quiz Generation with VocQGen

Đã lưu trong:
Xuất bản năm:Vocabulary Learning and Instruction vol. 14, no. 1 (2025)
Tác giả chính: Wang, Qiao
Tác giả khác: Rose, Ralph L, Sugawara, Ayaka, Orita, Naho
Được phát hành:
Castledown Publishers
Những chủ đề:
Japan
Vocabulary Skills
Artificial Intelligence
Computer Software
Multiple Choice Tests
Technology Uses in Education
Word Lists
Academic Language
Computer Assisted Testing
Language Tests
Natural Language Processing
Grammar
Accuracy
Cloze Procedure
Test Items
Comparative Analysis
Computational Linguistics
English (Second Language)
Second Language Learning
Second Language Instruction
Teaching Methods
College Students
Foreign Countries
Truy cập trực tuyến:Citation/Abstract
Full text outside of ProQuest
Các nhãn: Thêm thẻ
Không có thẻ, Là người đầu tiên thẻ bản ghi này!
Bài tóm tắt:VocQGen is an automated tool designed to generate multiple-choice cloze (MCC) questions for vocabulary assessment in second language learning contexts. It leverages several natural language processing (NLP) tools and OpenAI's GPT-4 model to produce MCC items quickly from user-specified word lists. To evaluate its effectiveness, we used the first sublist in the Academic Word List (AWL) to generate 60 questions with VocQGen. Then we compared the quality of 60 autogenerated questions with 40 manually created ones through expert reviews and through pilot testing with 68 students. Expert review results indicate that automatically generated questions exhibit higher grammatical accuracy and clearer contexts in question stems. However, the tool occasionally produces distractors that are acceptable as correct responses. Pilot testing results show that in general the number of correct responses is higher in autogenerated questions, indicating the less challenging nature of these questions. The study concludes that manual check is still required for questions generated by VocQGen and future work should focus on improving distractor effectiveness.
Nguồn:ERIC