Unsupervised Relation Extraction: A Variational Autoencoder Approach

Chenhan Yuan, Hoda Eldardiry


Abstract
Unsupervised relation extraction works by clustering entity pairs that have the same relations in the text. Some existing variational autoencoder (VAE)-based approaches train the relation extraction model as an encoder that generates relation classifications. A decoder is trained along with the encoder to reconstruct the encoder input based on the encoder-generated relation classifications. These classifications are a latent variable so they are required to follow a pre-defined prior distribution which results in unstable training. We propose a VAE-based unsupervised relation extraction technique that overcomes this limitation by using the classifications as an intermediate variable instead of a latent variable. Specifically, classifications are conditioned on sentence input, while the latent variable is conditioned on both the classifications and the sentence input. This allows our model to connect the decoder with the encoder without putting restrictions on the classification distribution; which improves training stability. Our approach is evaluated on the NYT dataset and outperforms state-of-the-art methods.
Anthology ID:
2021.emnlp-main.147
Volume:
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2021
Address:
Online and Punta Cana, Dominican Republic
Editors:
Marie-Francine Moens, Xuanjing Huang, Lucia Specia, Scott Wen-tau Yih
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1929–1938
Language:
URL:
https://aclanthology.org/2021.emnlp-main.147
DOI:
10.18653/v1/2021.emnlp-main.147
Bibkey:
Cite (ACL):
Chenhan Yuan and Hoda Eldardiry. 2021. Unsupervised Relation Extraction: A Variational Autoencoder Approach. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 1929–1938, Online and Punta Cana, Dominican Republic. Association for Computational Linguistics.
Cite (Informal):
Unsupervised Relation Extraction: A Variational Autoencoder Approach (Yuan & Eldardiry, EMNLP 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.emnlp-main.147.pdf
Video:
 https://aclanthology.org/2021.emnlp-main.147.mp4