EventKD: Event-Aware Knowledge Distillation for Generative Event Extraction

Hoang Thanh Dat, Quoc Phong Dao, Nam Le Hai, Franck Dernoncourt, Linh Ngo Van, Trung Le, Thien Huu Nguyen


Abstract
Event extraction aims to identify triggers in text, classify them into predefined event types, and recognize associated arguments such as participants and locations. Large language model (LLM)-based generative approaches provide a unified paradigm for joint trigger identification, classification, and argument extraction; however, their computational cost necessitates knowledge distillation (KD) into smaller student models. Existing KD methods operate at the token level, treating each output position independently and thus failing to concentrate the distillation signal on event-relevant spans or to capture the relational structure among event components. We propose EventKD, a two-level distillation framework tailored for event extraction. At the token level, a distributional divergence loss incorporates event-aware span importance weighting to prioritize tokens corresponding to triggers, arguments, and type labels. At the span level, a Relational-Aware (RA) loss preserves pairwise geometric relationships among event-aware spans across Transformer layers. Experiments on four benchmarks (ACE05, MAVEN, GENEVA, and RAMS) demonstrate that EventKD consistently outperforms existing distillation methods on both trigger identification and argument extraction.
Anthology ID:
2026.findings-emnlp.154
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
3240–3253
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.154/
DOI:
Bibkey:
Cite (ACL):
Hoang Thanh Dat, Quoc Phong Dao, Nam Le Hai, Franck Dernoncourt, Linh Ngo Van, Trung Le, and Thien Huu Nguyen. 2026. EventKD: Event-Aware Knowledge Distillation for Generative Event Extraction. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 3240–3253, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
EventKD: Event-Aware Knowledge Distillation for Generative Event Extraction (Dat et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.154.pdf