Improving Low-resource Grammatical Error Correction Via Automatic Linguistic Neurons Probing and Optimizing

Zihao Yu, Ying Li, Zhengtao Yu, Shengxiang Gao, Cunli Mao, Yuxin Huang, Hua Lai, Wenjun Wang


Abstract
Large Language Models (LLMs) exhibit strong language understanding and instruction-following abilities, making them promising backbones for grammatical error correction (GEC). However, prompt-only correction for low-resource languages still suffers from the over-correction challenge, since LLMs cannot fully understand their internal grammar. To address this issue, we propose an automatic linguistic neuron probing and optimizing approach to improve the low-resource GEC with only a few neuron activations. Concretely, we first utilize multiple low-resource GEC corpora to observe the changes in neurons, thus obtaining a linguistically specific probe matrix to ensure whether the neuron is activated. Then, we construct an extra weight matrix to determine the activation intensity of each neuron. Finally, we combine the probe matrix and the weight matrix to obtain an activation matrix, which is injected into selected model layers during inference to guide the frozen LLM toward more controllable GEC. Experiments on four benchmark datasets show that our approach consistently improves GEC performance, indicating that lightweight sparse activation rescaling is extremely useful for low-resource grammatical knowledge understanding. Detailed analysis demonstrates that our approach can further provide interpretable neuron-level control without large-scale parameter fine-tuning.
Anthology ID:
2026.findings-emnlp.909
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
19241–19252
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.909/
DOI:
Bibkey:
Cite (ACL):
Zihao Yu, Ying Li, Zhengtao Yu, Shengxiang Gao, Cunli Mao, Yuxin Huang, Hua Lai, and Wenjun Wang. 2026. Improving Low-resource Grammatical Error Correction Via Automatic Linguistic Neurons Probing and Optimizing. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 19241–19252, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Improving Low-resource Grammatical Error Correction Via Automatic Linguistic Neurons Probing and Optimizing (Yu et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.909.pdf