Exploring How Generative Adversarial Networks Learn Phonological Representations

Jingyi Chen, Micha Elsner


Abstract
This paper explores how Generative Adversarial Networks (GANs) learn representations of phonological phenomena. We analyze how GANs encode contrastive and non-contrastive nasality in French and English vowels by applying the ciwGAN architecture (Begus, 2021). Begus claims that ciwGAN encodes linguistically meaningful representations with categorical variables in its latent space and manipulating the latent variables shows an almost one to one corresponding control of the phonological features in ciwGAN’s generated outputs. However, our results show an interactive effect of latent variables on the features in the generated outputs, which suggests the learned representations in neural networks are different from the phonological representations proposed by linguists. On the other hand, ciwGAN is able to distinguish contrastive and noncontrastive features in English and French by encoding them differently. Comparing the performance of GANs learning from different languages results in a better understanding of what language specific features contribute to developing language specific phonological representations. We also discuss the role of training data frequencies in phonological feature learning.
Anthology ID:
2023.acl-long.175
Volume:
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3115–3129
Language:
URL:
https://aclanthology.org/2023.acl-long.175
DOI:
10.18653/v1/2023.acl-long.175
Bibkey:
Cite (ACL):
Jingyi Chen and Micha Elsner. 2023. Exploring How Generative Adversarial Networks Learn Phonological Representations. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 3115–3129, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Exploring How Generative Adversarial Networks Learn Phonological Representations (Chen & Elsner, ACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.acl-long.175.pdf
Video:
 https://aclanthology.org/2023.acl-long.175.mp4