Learning with Limited Text Data

Diyi Yang, Ankur Parikh, Colin Raffel


Abstract
Natural Language Processing (NLP) has achieved great progress in the past decade on the basis of neural models, which often make use of large amounts of labeled data to achieve state-of-the-art performance. The dependence on labeled data prevents NLP models from being applied to low-resource settings and languages because of the time, money, and expertise that is often required to label massive amounts of textual data. Consequently, the ability to learn with limited labeled data is crucial for deploying neural systems to real-world NLP applications. Recently, numerous approaches have been explored to alleviate the need for labeled data in NLP such as data augmentation and semi-supervised learning. This tutorial aims to provide a systematic and up-to-date overview of these methods in order to help researchers and practitioners understand the landscape of approaches and the challenges associated with learning from limited labeled data, an emerging topic in the computational linguistics community. We will consider applications to a wide variety of NLP tasks (including text classification, generation, and structured prediction) and will highlight current challenges and future directions.
Anthology ID:
2022.acl-tutorials.5
Volume:
Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: Tutorial Abstracts
Month:
May
Year:
2022
Address:
Dublin, Ireland
Editors:
Luciana Benotti, Naoaki Okazaki, Yves Scherrer, Marcos Zampieri
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
28–31
Language:
URL:
https://aclanthology.org/2022.acl-tutorials.5
DOI:
10.18653/v1/2022.acl-tutorials.5
Bibkey:
Cite (ACL):
Diyi Yang, Ankur Parikh, and Colin Raffel. 2022. Learning with Limited Text Data. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: Tutorial Abstracts, pages 28–31, Dublin, Ireland. Association for Computational Linguistics.
Cite (Informal):
Learning with Limited Text Data (Yang et al., ACL 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.acl-tutorials.5.pdf