Testing the viability of ChatGPT as a companion in L2 writing accuracy assessment

Atsushi Mizumoto, Natsuko Shintani, Miyuki Sasaki, Mark Feng Teng

研究成果: Article同行評審

12 引文 斯高帕斯(Scopus)

摘要

This study explores the effectiveness of ChatGPT as a tool for evaluating linguistic accuracy in second language (L2) writing, situated within the complexity, accuracy, and fluency (CAF) framework. By using the Cambridge Learner Corpus First Certificate in English (CLC FCE) dataset, an error-tagged learner corpus, it compares ChatGPT's performance to human evaluators and Grammarly in assessing errors or accuracy rates across 232 writing samples. The findings indicate a strong correlation between ChatGPT's assessments and human accuracy ratings, demonstrating its precision in automated assessments. In comparison to Grammarly, ChatGPT shows a closer alignment with human judgments and students’ writing scores. Thus, ChatGPT can be a potential tool for enhancing efficiency in L2 research and L2 writing pedagogy.

原文English
文章編號100116
期刊Research Methods in Applied Linguistics
3
發行號2
DOIs
出版狀態Published - 8月 2024

指紋

深入研究「Testing the viability of ChatGPT as a companion in L2 writing accuracy assessment」主題。共同形成了獨特的指紋。

引用此