Towards Few-Shot Event Mention Retrieval: An Evaluation Framework and A Siamese Network Approach

Bonan Min, Yee Seng Chan, Lingjun Zhao


Abstract
Automatically analyzing events in a large amount of text is crucial for situation awareness and decision making. Previous approaches treat event extraction as “one size fits all” with an ontology defined a priori. The resulted extraction models are built just for extracting those types in the ontology. These approaches cannot be easily adapted to new event types nor new domains of interest. To accommodate personalized event-centric information needs, this paper introduces the few-shot Event Mention Retrieval (EMR) task: given a user-supplied query consisting of a handful of event mentions, return relevant event mentions found in a corpus. This formulation enables “query by example”, which drastically lowers the bar of specifying event-centric information needs. The retrieval setting also enables fuzzy search. We present an evaluation framework leveraging existing event datasets such as ACE. We also develop a Siamese Network approach, and show that it performs better than ad-hoc retrieval models in the few-shot EMR setting.
Anthology ID:
2020.lrec-1.216
Volume:
Proceedings of the Twelfth Language Resources and Evaluation Conference
Month:
May
Year:
2020
Address:
Marseille, France
Editors:
Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
1747–1752
Language:
English
URL:
https://aclanthology.org/2020.lrec-1.216
DOI:
Bibkey:
Cite (ACL):
Bonan Min, Yee Seng Chan, and Lingjun Zhao. 2020. Towards Few-Shot Event Mention Retrieval: An Evaluation Framework and A Siamese Network Approach. In Proceedings of the Twelfth Language Resources and Evaluation Conference, pages 1747–1752, Marseille, France. European Language Resources Association.
Cite (Informal):
Towards Few-Shot Event Mention Retrieval: An Evaluation Framework and A Siamese Network Approach (Min et al., LREC 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.lrec-1.216.pdf