Weighted parsing for grammar-based language models

Richard Mörbitz, Heiko Vogler


Abstract
We develop a general framework for weighted parsing which is built on top of grammar-based language models and employs flexible weight algebras. It generalizes previous work in that area (semiring parsing, weighted deductive parsing) and also covers applications outside the classical scope of parsing, e.g., algebraic dynamic programming. We show an algorithm which terminates and is correct for a large class of weighted grammar-based language models.
Anthology ID:
W19-3108
Volume:
Proceedings of the 14th International Conference on Finite-State Methods and Natural Language Processing
Month:
September
Year:
2019
Address:
Dresden, Germany
Editors:
Heiko Vogler, Andreas Maletti
Venue:
FSMNLP
SIG:
SIGFSM
Publisher:
Association for Computational Linguistics
Note:
Pages:
46–55
Language:
URL:
https://aclanthology.org/W19-3108
DOI:
10.18653/v1/W19-3108
Bibkey:
Cite (ACL):
Richard Mörbitz and Heiko Vogler. 2019. Weighted parsing for grammar-based language models. In Proceedings of the 14th International Conference on Finite-State Methods and Natural Language Processing, pages 46–55, Dresden, Germany. Association for Computational Linguistics.
Cite (Informal):
Weighted parsing for grammar-based language models (Mörbitz & Vogler, FSMNLP 2019)
Copy Citation:
PDF:
https://aclanthology.org/W19-3108.pdf
Presentation:
 W19-3108.Presentation.pdf