SARCAT: Generative Span-Act Guided Response Generation using Copy-enhanced Target Augmentation

Jeong-Doo Lee, Hyeongjun Choi, Beomseok Hong, Youngsub Han, Byoung-Ki Jeon, Seung-Hoon Na


Abstract
In this paper, we present a novel extension to improve the document grounded response generation, by proposing the Generative Span Act Guided Response Generation using Copy enhanced Target Augmentation (SARCAT) that consists of two major components as follows: 1) Copy-enhanced target-side input augmentation is an extended data augmentation to deal with the exposure bias problem by additionally incorporating the copy mechanism on top of the target-side augmentation (Xie et al., 2021). 2) Span-act guided response generation, which first predicts grounding spans and dialogue acts before generating a response. Experiment results on validation set in MultiDoc2Dial show that the proposed SARSAT leads to improvement over strong baselines on both seen and unseen settings and achieves the start-of the-art performance, even with the base reader using the pretrained T5-base model.
Anthology ID:
2024.findings-emnlp.867
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2024
Month:
November
Year:
2024
Address:
Miami, Florida, USA
Editors:
Yaser Al-Onaizan, Mohit Bansal, Yun-Nung Chen
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
14780–14787
Language:
URL:
https://aclanthology.org/2024.findings-emnlp.867/
DOI:
10.18653/v1/2024.findings-emnlp.867
Bibkey:
Cite (ACL):
Jeong-Doo Lee, Hyeongjun Choi, Beomseok Hong, Youngsub Han, Byoung-Ki Jeon, and Seung-Hoon Na. 2024. SARCAT: Generative Span-Act Guided Response Generation using Copy-enhanced Target Augmentation. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 14780–14787, Miami, Florida, USA. Association for Computational Linguistics.
Cite (Informal):
SARCAT: Generative Span-Act Guided Response Generation using Copy-enhanced Target Augmentation (Lee et al., Findings 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.findings-emnlp.867.pdf