Is Shortest Always Best? The Role of Brevity in Logic-to-Text Generation

Eduardo Calò, Jordi Levy, Albert Gatt, Kees Van Deemter


Abstract
Some applications of artificial intelligence make it desirable that logical formulae be converted computationally to comprehensible natural language sentences. As there are many logical equivalents to a given formula, finding the most suitable equivalent to be used as input for such a “logic-to-text” generation system is a difficult challenge. In this paper, we focus on the role of brevity: Are the shortest formulae the most suitable? We focus on propositional logic (PL), framing formula minimization (i.e., the problem of finding the shortest equivalent of a given formula) as a Quantified Boolean Formulae (QBFs) satisfiability problem. We experiment with several generators and selection strategies to prune the resulting candidates. We conduct exhaustive automatic and human evaluations of the comprehensibility and fluency of the generated texts. The results suggest that while, in many cases, minimization has a positive impact on the quality of the sentences generated, formula minimization may ultimately not be the best strategy.
Anthology ID:
2023.starsem-1.17
Volume:
Proceedings of the 12th Joint Conference on Lexical and Computational Semantics (*SEM 2023)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Alexis Palmer, Jose Camacho-collados
Venue:
*SEM
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
180–192
Language:
URL:
https://aclanthology.org/2023.starsem-1.17
DOI:
10.18653/v1/2023.starsem-1.17
Bibkey:
Cite (ACL):
Eduardo Calò, Jordi Levy, Albert Gatt, and Kees Van Deemter. 2023. Is Shortest Always Best? The Role of Brevity in Logic-to-Text Generation. In Proceedings of the 12th Joint Conference on Lexical and Computational Semantics (*SEM 2023), pages 180–192, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Is Shortest Always Best? The Role of Brevity in Logic-to-Text Generation (Calò et al., *SEM 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.starsem-1.17.pdf