Personalized Filled-pause Generation with Group-wise Prediction Models

Yuta Matsunaga, Takaaki Saeki, Shinnosuke Takamichi, Hiroshi Saruwatari


Abstract
In this paper, we propose a method to generate personalized filled pauses (FPs) with group-wise prediction models. Compared with fluent text generation, disfluent text generation has not been widely explored. To generate more human-like texts, we addressed disfluent text generation. The usage of disfluency, such as FPs, rephrases, and word fragments, differs from speaker to speaker, and thus, the generation of personalized FPs is required. However, it is difficult to predict them because of the sparsity of position and the frequency difference between more and less frequently used FPs. Moreover, it is sometimes difficult to adapt FP prediction models to each speaker because of the large variation of the tendency within each speaker. To address these issues, we propose a method to build group-dependent prediction models by grouping speakers on the basis of their tendency to use FPs. This method does not require a large amount of data and time to train each speaker model. We further introduce a loss function and a word embedding model suitable for FP prediction. Our experimental results demonstrate that group-dependent models can predict FPs with higher scores than a non-personalized one and the introduced loss function and word embedding model improve the prediction performance.
Anthology ID:
2022.lrec-1.40
Volume:
Proceedings of the Thirteenth Language Resources and Evaluation Conference
Month:
June
Year:
2022
Address:
Marseille, France
Editors:
Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
385–392
Language:
URL:
https://aclanthology.org/2022.lrec-1.40
DOI:
Bibkey:
Cite (ACL):
Yuta Matsunaga, Takaaki Saeki, Shinnosuke Takamichi, and Hiroshi Saruwatari. 2022. Personalized Filled-pause Generation with Group-wise Prediction Models. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 385–392, Marseille, France. European Language Resources Association.
Cite (Informal):
Personalized Filled-pause Generation with Group-wise Prediction Models (Matsunaga et al., LREC 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.lrec-1.40.pdf
Code
 ndkgit339/filledpause_prediction_group