Generating Text through Adversarial Training Using Skip-Thought Vectors

Afroz Ahamad


Abstract
GANs have been shown to perform exceedingly well on tasks pertaining to image generation and style transfer. In the field of language modelling, word embeddings such as GLoVe and word2vec are state-of-the-art methods for applying neural network models on textual data. Attempts have been made to utilize GANs with word embeddings for text generation. This study presents an approach to text generation using Skip-Thought sentence embeddings with GANs based on gradient penalty functions and f-measures. The proposed architecture aims to reproduce writing style in the generated text by modelling the way of expression at a sentence level across all the works of an author. Extensive experiments were run in different embedding settings on a variety of tasks including conditional text generation and language generation. The model outperforms baseline text generation networks across several automated evaluation metrics like BLEU-n, METEOR and ROUGE. Further, wide applicability and effectiveness in real life tasks are demonstrated through human judgement scores.
Anthology ID:
N19-3008
Volume:
Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Student Research Workshop
Month:
June
Year:
2019
Address:
Minneapolis, Minnesota
Editors:
Sudipta Kar, Farah Nadeem, Laura Burdick, Greg Durrett, Na-Rae Han
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
53–60
Language:
URL:
https://aclanthology.org/N19-3008
DOI:
10.18653/v1/N19-3008
Bibkey:
Cite (ACL):
Afroz Ahamad. 2019. Generating Text through Adversarial Training Using Skip-Thought Vectors. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Student Research Workshop, pages 53–60, Minneapolis, Minnesota. Association for Computational Linguistics.
Cite (Informal):
Generating Text through Adversarial Training Using Skip-Thought Vectors (Ahamad, NAACL 2019)
Copy Citation:
PDF:
https://aclanthology.org/N19-3008.pdf
Code
 afrozas/skip-thought-gan