Generate-then-Revise: An Effective Synthetic Training Data Generation Framework For Event Detection Retrieval

Du Huidong, Sun Hao, Liu Pengyuan, Yu Dong


Abstract
“Large language models (LLMs) struggle with event detection (ED) due to the structured and vari-able number of events in the output. Existing supervised approaches rely on a large amount ofmanually annotated corpora, facing challenges in practice when event types are diverse and theannotated data is scarce. We propose Generate-then-Revise (GtR), a framework that leveragesLLMs in the opposite direction to address these challenges in ED. GtR utilizes an LLM to gen-erate high-quality training data in three stages, including a novel data revision step to minimizenoise in the synthetic data. The generated data is then used to train a smaller model for evalua-tion. Our approach demonstrates significant improvements on the low-resource ED. We furtheranalyze the generated data, highlighting the potential of synthetic data generation for enhancingED performance.Introduction”
Anthology ID:
2024.ccl-1.78
Volume:
Proceedings of the 23rd Chinese National Conference on Computational Linguistics (Volume 1: Main Conference)
Month:
July
Year:
2024
Address:
Taiyuan, China
Editors:
Maosong Sun, Jiye Liang, Xianpei Han, Zhiyuan Liu, Yulan He
Venue:
CCL
SIG:
Publisher:
Chinese Information Processing Society of China
Note:
Pages:
1011–1022
Language:
English
URL:
https://aclanthology.org/2024.ccl-1.78/
DOI:
Bibkey:
Cite (ACL):
Du Huidong, Sun Hao, Liu Pengyuan, and Yu Dong. 2024. Generate-then-Revise: An Effective Synthetic Training Data Generation Framework For Event Detection Retrieval. In Proceedings of the 23rd Chinese National Conference on Computational Linguistics (Volume 1: Main Conference), pages 1011–1022, Taiyuan, China. Chinese Information Processing Society of China.
Cite (Informal):
Generate-then-Revise: An Effective Synthetic Training Data Generation Framework For Event Detection Retrieval (Huidong et al., CCL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.ccl-1.78.pdf