ComSearch: Equation Searching with Combinatorial Strategy for Solving Math Word Problems with Weak Supervision

Qianying Liu, Wenyu Guan, Jianhao Shen, Fei Cheng, Sadao Kurohashi


Abstract
Previous studies have introduced a weakly-supervised paradigm for solving math word problems requiring only the answer value annotation. While these methods search for correct value equation candidates as pseudo labels, they search among a narrow sub-space of the enormous equation space. To address this problem, we propose a novel search algorithm with combinatorial strategy ComSearch, which can compress the search space by excluding mathematically equivalent equations. The compression allows the searching algorithm to enumerate all possible equations and obtain high-quality data. We investigate the noise in the pseudo labels that hold wrong mathematical logic, which we refer to as the false-matching problem, and propose a ranking model to denoise the pseudo labels. Our approach holds a flexible framework to utilize two existing supervised math word problem solvers to train pseudo labels, and both achieve state-of-the-art performance in the weak supervision task.
Anthology ID:
2023.eacl-main.186
Volume:
Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics
Month:
May
Year:
2023
Address:
Dubrovnik, Croatia
Editors:
Andreas Vlachos, Isabelle Augenstein
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2549–2562
Language:
URL:
https://aclanthology.org/2023.eacl-main.186
DOI:
10.18653/v1/2023.eacl-main.186
Bibkey:
Cite (ACL):
Qianying Liu, Wenyu Guan, Jianhao Shen, Fei Cheng, and Sadao Kurohashi. 2023. ComSearch: Equation Searching with Combinatorial Strategy for Solving Math Word Problems with Weak Supervision. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, pages 2549–2562, Dubrovnik, Croatia. Association for Computational Linguistics.
Cite (Informal):
ComSearch: Equation Searching with Combinatorial Strategy for Solving Math Word Problems with Weak Supervision (Liu et al., EACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.eacl-main.186.pdf
Video:
 https://aclanthology.org/2023.eacl-main.186.mp4