Identifying Quantifiably Verifiable Statements from Text

Pegah Jandaghi, Jay Pujara


Abstract
Humans often describe complex quantitative data using trend-based patterns. Trend-based patterns can be interpreted as higher order functions and relations over numerical data such as extreme values, rates of change, or cyclical repetition. One application where trends abound are descriptions of numerical tabular data. Therefore, the alignment of numerical tables and textual description of trends enables easier interpretations of tables. Most existing approaches can align quantities in text with tabular data but are unable to detect and align trend-based patterns about data. In this paper, we introduce the initial steps for aligning trend-based patterns about the data, i.e. the detection of textual description of trends and the alignment of trends with a relevant table. We introduce the problem of identifying quantifiably verifiable statements (QVS) in the text and aligning them with tables and datasets. We define the structure of these statements and implement a structured based detection. In our experiments, we demonstrate our method can detect and align these statements from several domains and compare favorably with traditional sequence labeling methods.
Anthology ID:
2023.matching-1.2
Volume:
Proceedings of the First Workshop on Matching From Unstructured and Structured Data (MATCHING 2023)
Month:
July
Year:
2023
Address:
Toronto, ON, Canada
Editors:
Estevam Hruschka, Tom Mitchell, Sajjadur Rahman, Dunja Mladenić, Marko Grobelnik
Venue:
MATCHING
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
14–22
Language:
URL:
https://aclanthology.org/2023.matching-1.2
DOI:
10.18653/v1/2023.matching-1.2
Bibkey:
Cite (ACL):
Pegah Jandaghi and Jay Pujara. 2023. Identifying Quantifiably Verifiable Statements from Text. In Proceedings of the First Workshop on Matching From Unstructured and Structured Data (MATCHING 2023), pages 14–22, Toronto, ON, Canada. Association for Computational Linguistics.
Cite (Informal):
Identifying Quantifiably Verifiable Statements from Text (Jandaghi & Pujara, MATCHING 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.matching-1.2.pdf
Video:
 https://aclanthology.org/2023.matching-1.2.mp4