GraphMR: Graph Neural Network for Mathematical Reasoning

Weijie Feng, Binbin Liu, Dongpeng Xu, Qilong Zheng, Yun Xu


Abstract
Mathematical reasoning aims to infer satisfiable solutions based on the given mathematics questions. Previous natural language processing researches have proven the effectiveness of sequence-to-sequence (Seq2Seq) or related variants on mathematics solving. However, few works have been able to explore structural or syntactic information hidden in expressions (e.g., precedence and associativity). This dissertation set out to investigate the usefulness of such untapped information for neural architectures. Firstly, mathematical questions are represented in the format of graphs within syntax analysis. The structured nature of graphs allows them to represent relations of variables or operators while preserving the semantics of the expressions. Having transformed to the new representations, we proposed a graph-to-sequence neural network GraphMR, which can effectively learn the hierarchical information of graphs inputs to solve mathematics and speculate answers. A complete experimental scenario with four classes of mathematical tasks and three Seq2Seq baselines is built to conduct a comprehensive analysis, and results show that GraphMR outperforms others in hidden information learning and mathematics resolving.
Anthology ID:
2021.emnlp-main.273
Volume:
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2021
Address:
Online and Punta Cana, Dominican Republic
Editors:
Marie-Francine Moens, Xuanjing Huang, Lucia Specia, Scott Wen-tau Yih
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3395–3404
Language:
URL:
https://aclanthology.org/2021.emnlp-main.273
DOI:
10.18653/v1/2021.emnlp-main.273
Bibkey:
Cite (ACL):
Weijie Feng, Binbin Liu, Dongpeng Xu, Qilong Zheng, and Yun Xu. 2021. GraphMR: Graph Neural Network for Mathematical Reasoning. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 3395–3404, Online and Punta Cana, Dominican Republic. Association for Computational Linguistics.
Cite (Informal):
GraphMR: Graph Neural Network for Mathematical Reasoning (Feng et al., EMNLP 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.emnlp-main.273.pdf
Video:
 https://aclanthology.org/2021.emnlp-main.273.mp4