Adapting to Learner Errors with Minimal Supervision

Alla Rozovskaya, Dan Roth, Mark Sammons


Abstract
This article considers the problem of correcting errors made by English as a Second Language writers from a machine learning perspective, and addresses an important issue of developing an appropriate training paradigm for the task, one that accounts for error patterns of non-native writers using minimal supervision. Existing training approaches present a trade-off between large amounts of cheap data offered by the native-trained models and additional knowledge of learner error patterns provided by the more expensive method of training on annotated learner data. We propose a novel training approach that draws on the strengths offered by the two standard training paradigms—of training either on native or on annotated learner data—and that outperforms both of these standard methods. Using the key observation that parameters relating to error regularities exhibited by non-native writers are relatively simple, we develop models that can incorporate knowledge about error regularities based on a small annotated sample but that are otherwise trained on native English data. The key contribution of this article is the introduction and analysis of two methods for adapting the learned models to error patterns of non-native writers; one method that applies to generative classifiers and a second that applies to discriminative classifiers. Both methods demonstrated state-of-the-art performance in several text correction competitions. In particular, the Illinois system that implements these methods ranked at the top in two recent CoNLL shared tasks on error correction.1 We conduct further evaluation of the proposed approaches studying the effect of using error data from speakers of the same native language, languages that are closely related linguistically, and unrelated languages.
Anthology ID:
J17-4002
Volume:
Computational Linguistics, Volume 43, Issue 4 - December 2017
Month:
December
Year:
2017
Address:
Cambridge, MA
Venue:
CL
SIG:
Publisher:
MIT Press
Note:
Pages:
723–760
Language:
URL:
https://aclanthology.org/J17-4002
DOI:
10.1162/COLI_a_00299
Bibkey:
Cite (ACL):
Alla Rozovskaya, Dan Roth, and Mark Sammons. 2017. Adapting to Learner Errors with Minimal Supervision. Computational Linguistics, 43(4):723–760.
Cite (Informal):
Adapting to Learner Errors with Minimal Supervision (Rozovskaya et al., CL 2017)
Copy Citation:
PDF:
https://aclanthology.org/J17-4002.pdf
Data
FCE