Entity Tracking via Effective Use of Multi-Task Learning Model and Mention-guided Decoding

Janvijay Singh, Fan Bai, Zhen Wang


Abstract
Cross-task knowledge transfer via multi-task learning has recently made remarkable progress in general NLP tasks. However, entity tracking on the procedural text has not benefited from such knowledge transfer because of its distinct formulation, i.e., tracking the event flow while following structural constraints. State-of-the-art entity tracking approaches either design complicated model architectures or rely on task-specific pre-training to achieve good results. To this end, we propose MeeT, a Multi-task learning-enabled entity Tracking approach, which utilizes knowledge gained from general domain tasks to improve entity tracking. Specifically, MeeT first fine-tunes T5, a pre-trained multi-task learning model, with entity tracking-specialized QA formats, and then employs our customized decoding strategy to satisfy the structural constraints. MeeT achieves state-of-the-art performances on two popular entity tracking datasets, even though it does not require any task-specific architecture design or pre-training.
Anthology ID:
2023.eacl-main.90
Volume:
Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics
Month:
May
Year:
2023
Address:
Dubrovnik, Croatia
Editors:
Andreas Vlachos, Isabelle Augenstein
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1255–1263
Language:
URL:
https://aclanthology.org/2023.eacl-main.90
DOI:
10.18653/v1/2023.eacl-main.90
Bibkey:
Cite (ACL):
Janvijay Singh, Fan Bai, and Zhen Wang. 2023. Entity Tracking via Effective Use of Multi-Task Learning Model and Mention-guided Decoding. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, pages 1255–1263, Dubrovnik, Croatia. Association for Computational Linguistics.
Cite (Informal):
Entity Tracking via Effective Use of Multi-Task Learning Model and Mention-guided Decoding (Singh et al., EACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.eacl-main.90.pdf
Video:
 https://aclanthology.org/2023.eacl-main.90.mp4