Towards Integration of Statistical Hypothesis Tests into Deep Neural Networks

Ahmad Aghaebrahimian, Mark Cieliebak


Abstract
We report our ongoing work about a new deep architecture working in tandem with a statistical test procedure for jointly training texts and their label descriptions for multi-label and multi-class classification tasks. A statistical hypothesis testing method is used to extract the most informative words for each given class. These words are used as a class description for more label-aware text classification. Intuition is to help the model to concentrate on more informative words rather than more frequent ones. The model leverages the use of label descriptions in addition to the input text to enhance text classification performance. Our method is entirely data-driven, has no dependency on other sources of information than the training data, and is adaptable to different classification problems by providing appropriate training data without major hyper-parameter tuning. We trained and tested our system on several publicly available datasets, where we managed to improve the state-of-the-art on one set with a high margin and to obtain competitive results on all other ones.
Anthology ID:
P19-1557
Volume:
Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics
Month:
July
Year:
2019
Address:
Florence, Italy
Editors:
Anna Korhonen, David Traum, Lluís Màrquez
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
5551–5557
Language:
URL:
https://aclanthology.org/P19-1557
DOI:
10.18653/v1/P19-1557
Bibkey:
Cite (ACL):
Ahmad Aghaebrahimian and Mark Cieliebak. 2019. Towards Integration of Statistical Hypothesis Tests into Deep Neural Networks. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 5551–5557, Florence, Italy. Association for Computational Linguistics.
Cite (Informal):
Towards Integration of Statistical Hypothesis Tests into Deep Neural Networks (Aghaebrahimian & Cieliebak, ACL 2019)
Copy Citation:
PDF:
https://aclanthology.org/P19-1557.pdf