Towards Linguistically Generalizable NLP Systems: A Workshop and Shared Task

Allyson Ettinger, Sudha Rao, Hal Daumé III, Emily M. Bender


Abstract
This paper presents a summary of the first Workshop on Building Linguistically Generalizable Natural Language Processing Systems, and the associated Build It Break It, The Language Edition shared task. The goal of this workshop was to bring together researchers in NLP and linguistics with a carefully designed shared task aimed at testing the generalizability of NLP systems beyond the distributions of their training data. We describe the motivation, setup, and participation of the shared task, provide discussion of some highlighted results, and discuss lessons learned.
Anthology ID:
W17-5401
Volume:
Proceedings of the First Workshop on Building Linguistically Generalizable NLP Systems
Month:
September
Year:
2017
Address:
Copenhagen, Denmark
Editors:
Emily Bender, Hal Daumé III, Allyson Ettinger, Sudha Rao
Venue:
WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1–10
Language:
URL:
https://aclanthology.org/W17-5401
DOI:
10.18653/v1/W17-5401
Bibkey:
Cite (ACL):
Allyson Ettinger, Sudha Rao, Hal Daumé III, and Emily M. Bender. 2017. Towards Linguistically Generalizable NLP Systems: A Workshop and Shared Task. In Proceedings of the First Workshop on Building Linguistically Generalizable NLP Systems, pages 1–10, Copenhagen, Denmark. Association for Computational Linguistics.
Cite (Informal):
Towards Linguistically Generalizable NLP Systems: A Workshop and Shared Task (Ettinger et al., 2017)
Copy Citation:
PDF:
https://aclanthology.org/W17-5401.pdf
Data
QA-SRL