Compound noun decomposition using a Markov model
Jongwoo
Lee
author
Byoung-Tak
Zhang
author
Yung
Taek
Kim
author
1999-sep 13-17
text
Proceedings of Machine Translation Summit VII
Singapore, Singapore
conference publication
A statistical method for compound noun decomposition is presented. Previous studies on this problem showed some statistical information are helpful. But applying statistical information was not so systemic that performance depends heavily on the algorithm and some algorithms usually have many separated steps. In our work statistical information is collected from manually decomposed compound noun corpus to build a Markov model for composition. Two Markov chains representing statistical information are assumed independent: one for the sequence of participants’ lengths and another for the sequence of participants ’ features. Besides Markov assumptions, least participants preference assumption also is used. These two assumptions enable the decomposition algorithm to be a kind of conditional dynamic programming so that efficient and systemic computation can be performed. When applied to test data of size 5027, we obtained a precision of 98.4%.
lee-etal-1999-compound
https://aclanthology.org/1999.mtsummit-1.63
1999-sep 13-17
427
431