Towards Open-Domain Topic Classification

Hantian Ding, Jinrui Yang, Yuqian Deng, Hongming Zhang, Dan Roth


Abstract
We introduce an open-domain topic classification system that accepts user-defined taxonomy in real time. Users will be able to classify a text snippet with respect to any candidate labels they want, and get instant response from our web interface. To obtain such flexibility, we build the backend model in a zero-shot way. By training on a new dataset constructed from Wikipedia, our label-aware text classifier can effectively utilize implicit knowledge in the pretrained language model to handle labels it has never seen before. We evaluate our model across four datasets from various domains with different label sets. Experiments show that the model significantly improves over existing zero-shot baselines in open-domain scenarios, and performs competitively with weakly-supervised models trained on in-domain data.
Anthology ID:
2022.naacl-demo.10
Volume:
Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: System Demonstrations
Month:
July
Year:
2022
Address:
Hybrid: Seattle, Washington + Online
Editors:
Hannaneh Hajishirzi, Qiang Ning, Avi Sil
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
90–98
Language:
URL:
https://aclanthology.org/2022.naacl-demo.10
DOI:
10.18653/v1/2022.naacl-demo.10
Bibkey:
Cite (ACL):
Hantian Ding, Jinrui Yang, Yuqian Deng, Hongming Zhang, and Dan Roth. 2022. Towards Open-Domain Topic Classification. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: System Demonstrations, pages 90–98, Hybrid: Seattle, Washington + Online. Association for Computational Linguistics.
Cite (Informal):
Towards Open-Domain Topic Classification (Ding et al., NAACL 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.naacl-demo.10.pdf
Video:
 https://aclanthology.org/2022.naacl-demo.10.mp4
Data
AG NewsFEVERGLUEMultiNLI