Grammatical Error Correction: Are We There Yet?

Muhammad Reza Qorib, Hwee Tou Ng


Abstract
There has been much recent progress in natural language processing, and grammatical error correction (GEC) is no exception. We found that state-of-the-art GEC systems (T5 and GECToR) outperform humans by a wide margin on the CoNLL-2014 test set, a benchmark GEC test corpus, as measured by the standard F0.5 evaluation metric. However, a careful examination of their outputs reveals that there are still classes of errors that they fail to correct. This suggests that creating new test data that more accurately measure the true performance of GEC systems constitutes important future work.
Anthology ID:
2022.coling-1.246
Volume:
Proceedings of the 29th International Conference on Computational Linguistics
Month:
October
Year:
2022
Address:
Gyeongju, Republic of Korea
Venue:
COLING
SIG:
Publisher:
International Committee on Computational Linguistics
Note:
Pages:
2794–2800
Language:
URL:
https://aclanthology.org/2022.coling-1.246
DOI:
Bibkey:
Cite (ACL):
Muhammad Reza Qorib and Hwee Tou Ng. 2022. Grammatical Error Correction: Are We There Yet?. In Proceedings of the 29th International Conference on Computational Linguistics, pages 2794–2800, Gyeongju, Republic of Korea. International Committee on Computational Linguistics.
Cite (Informal):
Grammatical Error Correction: Are We There Yet? (Qorib & Ng, COLING 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.coling-1.246.pdf
Data
JFLEG