A Generative Model of Phonotactics

Richard Futrell, Adam Albright, Peter Graff, Timothy J. O’Donnell


Abstract
We present a probabilistic model of phonotactics, the set of well-formed phoneme sequences in a language. Unlike most computational models of phonotactics (Hayes and Wilson, 2008; Goldsmith and Riggle, 2012), we take a fully generative approach, modeling a process where forms are built up out of subparts by phonologically-informed structure building operations. We learn an inventory of subparts by applying stochastic memoization (Johnson et al., 2007; Goodman et al., 2008) to a generative process for phonemes structured as an and-or graph, based on concepts of feature hierarchy from generative phonology (Clements, 1985; Dresher, 2009). Subparts are combined in a way that allows tier-based feature interactions. We evaluate our models’ ability to capture phonotactic distributions in the lexicons of 14 languages drawn from the WOLEX corpus (Graff, 2012). Our full model robustly assigns higher probabilities to held-out forms than a sophisticated N-gram model for all languages. We also present novel analyses that probe model behavior in more detail.
Anthology ID:
Q17-1006
Volume:
Transactions of the Association for Computational Linguistics, Volume 5
Month:
Year:
2017
Address:
Cambridge, MA
Editors:
Lillian Lee, Mark Johnson, Kristina Toutanova
Venue:
TACL
SIG:
Publisher:
MIT Press
Note:
Pages:
73–86
Language:
URL:
https://aclanthology.org/Q17-1006
DOI:
10.1162/tacl_a_00047
Bibkey:
Cite (ACL):
Richard Futrell, Adam Albright, Peter Graff, and Timothy J. O’Donnell. 2017. A Generative Model of Phonotactics. Transactions of the Association for Computational Linguistics, 5:73–86.
Cite (Informal):
A Generative Model of Phonotactics (Futrell et al., TACL 2017)
Copy Citation:
PDF:
https://aclanthology.org/Q17-1006.pdf
Video:
 https://aclanthology.org/Q17-1006.mp4