Deep Neural Representations for Multiword Expressions Detection

Kamil Kanclerz, Maciej Piasecki


Abstract
Effective methods for multiword expressions detection are important for many technologies related to Natural Language Processing. Most contemporary methods are based on the sequence labeling scheme applied to an annotated corpus, while traditional methods use statistical measures. In our approach, we want to integrate the concepts of those two approaches. We present a novel weakly supervised multiword expressions extraction method which focuses on their behaviour in various contexts. Our method uses a lexicon of English multiword lexical units acquired from The Oxford Dictionary of English as a reference knowledge base and leverages neural language modelling with deep learning architectures. In our approach, we do not need a corpus annotated specifically for the task. The only required components are: a lexicon of multiword units, a large corpus, and a general contextual embeddings model. We propose a method for building a silver dataset by spotting multiword expression occurrences and acquiring statistical collocations as negative samples. Sample representation has been inspired by representations used in Natural Language Inference and relation recognition. Very good results (F1=0.8) were obtained with CNN network applied to individual occurrences followed by weighted voting used to combine results from the whole corpus. The proposed method can be quite easily applied to other languages.
Anthology ID:
2022.acl-srw.36
Volume:
Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop
Month:
May
Year:
2022
Address:
Dublin, Ireland
Editors:
Samuel Louvan, Andrea Madotto, Brielen Madureira
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
444–453
Language:
URL:
https://aclanthology.org/2022.acl-srw.36
DOI:
10.18653/v1/2022.acl-srw.36
Bibkey:
Cite (ACL):
Kamil Kanclerz and Maciej Piasecki. 2022. Deep Neural Representations for Multiword Expressions Detection. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop, pages 444–453, Dublin, Ireland. Association for Computational Linguistics.
Cite (Informal):
Deep Neural Representations for Multiword Expressions Detection (Kanclerz & Piasecki, ACL 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.acl-srw.36.pdf
Code
 CLARIN-PL/mwe-vector-methods