Vector Spaces for Quantifying Disparity of Multiword Expressions in Annotated Text

Louis Est�ve, Agata Savary, Thomas Lavergne


Abstract
Multiword Expressions (MWEs) make a goodcase study for linguistic diversity due to theiridiosyncratic nature. Defining MWE canonicalforms as types, diversity may be measurednotably through disparity, based on pairwisedistances between types. To this aim, wetrain static MWE-aware word embeddings forverbal MWEs in 14 languages, and we showinteresting properties of these vector spaces.We use these vector spaces to implement theso-called functional diversity measure. Weapply this measure to the results of severalMWE identification systems. We find that,although MWE vector spaces are meaningful ata local scale, the disparity measure aggregatingthem at a global scale strongly correlateswith the number of types, which questions itsusefulness in presence of simpler diversitymetrics such as variety. We make the vectorspaces we generated available.
Anthology ID:
2024.acl-srw.20
Volume:
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop)
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Xiyan Fu, Eve Fleisig
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
204–224
Language:
URL:
https://aclanthology.org/2024.acl-srw.20
DOI:
Bibkey:
Cite (ACL):
Louis Est�ve, Agata Savary, and Thomas Lavergne. 2024. Vector Spaces for Quantifying Disparity of Multiword Expressions in Annotated Text. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop), pages 204–224, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
Vector Spaces for Quantifying Disparity of Multiword Expressions in Annotated Text (Est�ve et al., ACL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.acl-srw.20.pdf