Quantifying Error Tolerance in Synthetic Data: An Atomic-level Operand vs. Operator Perturbation Study

Jiaxiang Liu, Chenhao Yuan, Shuwen Xu, Boxuan Xing, Xiusheng Huang, Yinhao Xu, Hao Liu, Wenhao Teng, Xiangwen Liao, Pengfei Cao, Jun Zhao, Kang Liu


Abstract
Synthetic data generation has become a cornerstone for advancing large language models. However, the lack of the quantitative analysis for error tolerance became a critical bottleneck. Consequently, current filtering strategies fluctuate between two extremes: they are either overly aggressive, risking the exclusion of potentially valuable samples, or overly permissive, failing to eliminate erroneous samples effectively. To bridge this gap, this paper introduces **A**tomic **T**ree **O**peration **M**odeling (**ATOM**), a framework that decomposes data into functional units (f(x)→ y). ATOM distinguishes *benign Operand* x *perturbations* from *fatal Operator* f *perturbations*. The former are needlessly discarded by aggressive filtering, while the latter slip through permissive filtering. Our experiments reveal a **double dissociation**: models are robust to operand perturbations but collapse under operator perturbations. By prioritizing operator over aggressive operand precision, our ATOM-synthesized data outperforms rigorous baselines (e.g., +3.1% gain over LIMA), suggesting that operator diversity matters more than operand precision. Our code is available at [GitHub](https://github.com/Lut-hub/ATOM).
Anthology ID:
2026.findings-emnlp.179
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
3775–3805
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.179/
DOI:
Bibkey:
Cite (ACL):
Jiaxiang Liu, Chenhao Yuan, Shuwen Xu, Boxuan Xing, Xiusheng Huang, Yinhao Xu, Hao Liu, Wenhao Teng, Xiangwen Liao, Pengfei Cao, Jun Zhao, and Kang Liu. 2026. Quantifying Error Tolerance in Synthetic Data: An Atomic-level Operand vs. Operator Perturbation Study. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 3775–3805, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Quantifying Error Tolerance in Synthetic Data: An Atomic-level Operand vs. Operator Perturbation Study (Liu et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.179.pdf