DimonGen: Diversified Generative Commonsense Reasoning for Explaining Concept Relationships

Chenzhengyi Liu, Jie Huang, Kerui Zhu, Kevin Chen-Chuan Chang


Abstract
In this paper, we propose DimonGen, which aims to generate diverse sentences describing concept relationships in various everyday scenarios. To support this, we first create a benchmark dataset for this task by adapting the existing CommonGen dataset. We then propose a two-stage model called MoREE to generate the target sentences. MoREE consists of a mixture of retrievers model that retrieves diverse context sentences related to the given concepts, and a mixture of generators model that generates diverse sentences based on the retrieved contexts. We conduct experiments on the DimonGen task and show that MoREE outperforms strong baselines in terms of both the quality and diversity of the generated sentences. Our results demonstrate that MoREE is able to generate diverse sentences that reflect different relationships between concepts, leading to a comprehensive understanding of concept relationships.
Anthology ID:
2023.acl-long.260
Volume:
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4719–4731
Language:
URL:
https://aclanthology.org/2023.acl-long.260
DOI:
10.18653/v1/2023.acl-long.260
Bibkey:
Cite (ACL):
Chenzhengyi Liu, Jie Huang, Kerui Zhu, and Kevin Chen-Chuan Chang. 2023. DimonGen: Diversified Generative Commonsense Reasoning for Explaining Concept Relationships. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 4719–4731, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
DimonGen: Diversified Generative Commonsense Reasoning for Explaining Concept Relationships (Liu et al., ACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.acl-long.260.pdf
Video:
 https://aclanthology.org/2023.acl-long.260.mp4