Unsupervised Discontinuous Constituency Parsing with Mildly Context-Sensitive Grammars

Songlin Yang, Roger Levy, Yoon Kim


Abstract
We study grammar induction with mildly context-sensitive grammars for unsupervised discontinuous parsing. Using the probabilistic linear context-free rewriting system (LCFRS) formalism, our approach fixes the rule structure in advance and focuses on parameter learning with maximum likelihood. To reduce the computational complexity of both parsing and parameter estimation, we restrict the grammar formalism to LCFRS-2 (i.e., binary LCFRS with fan-out two) and further discard rules that require O(l6) time to parse, reducing inference to O(l5). We find that using a large number of nonterminals is beneficial and thus make use of tensor decomposition-based rank-space dynamic programming with an embedding-based parameterization of rule probabilities to scale up the number of nonterminals. Experiments on German and Dutch show that our approach is able to induce linguistically meaningful trees with continuous and discontinuous structures.
Anthology ID:
2023.acl-long.316
Volume:
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
5747–5766
Language:
URL:
https://aclanthology.org/2023.acl-long.316
DOI:
10.18653/v1/2023.acl-long.316
Bibkey:
Cite (ACL):
Songlin Yang, Roger Levy, and Yoon Kim. 2023. Unsupervised Discontinuous Constituency Parsing with Mildly Context-Sensitive Grammars. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 5747–5766, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Unsupervised Discontinuous Constituency Parsing with Mildly Context-Sensitive Grammars (Yang et al., ACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.acl-long.316.pdf
Video:
 https://aclanthology.org/2023.acl-long.316.mp4