Open Relation and Event Type Discovery with Type Abstraction

Sha Li, Heng Ji, Jiawei Han


Abstract
Conventional “closed-world” information extraction (IE) approaches rely on human ontologies to define the scope for extraction. As a result, such approaches fall short when applied to new domains. This calls for systems that can automatically infer new types from given corpora, a task which we refer to as type discovery. To tackle this problem, we introduce the idea of type abstraction, where the model is prompted to generalize and name the type. Then we use the similarity between inferred names to induce clusters. Observing that this abstraction-based representation is often complementary to the entity/trigger token representation, we set up these two representations as two views and design our model as a co-training framework. Our experiments on multiple relation extraction and event extraction datasets consistently show the advantage of our type abstraction approach.
Anthology ID:
2022.emnlp-main.461
Volume:
Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
Month:
December
Year:
2022
Address:
Abu Dhabi, United Arab Emirates
Editors:
Yoav Goldberg, Zornitsa Kozareva, Yue Zhang
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
6864–6877
Language:
URL:
https://aclanthology.org/2022.emnlp-main.461
DOI:
10.18653/v1/2022.emnlp-main.461
Bibkey:
Cite (ACL):
Sha Li, Heng Ji, and Jiawei Han. 2022. Open Relation and Event Type Discovery with Type Abstraction. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 6864–6877, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
Cite (Informal):
Open Relation and Event Type Discovery with Type Abstraction (Li et al., EMNLP 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.emnlp-main.461.pdf