UnImplicit Shared Task Report: Detecting Clarification Requirements in Instructional Text

Michael Roth, Talita Anthonio


Abstract
This paper describes the data, task setup, and results of the shared task at the First Workshop on Understanding Implicit and Underspecified Language (UnImplicit). The task requires computational models to predict whether a sentence contains aspects of meaning that are contextually unspecified and thus require clarification. Two teams participated and the best scoring system achieved an accuracy of 68%.
Anthology ID:
2021.unimplicit-1.4
Volume:
Proceedings of the 1st Workshop on Understanding Implicit and Underspecified Language
Month:
August
Year:
2021
Address:
Online
Editors:
Michael Roth, Reut Tsarfaty, Yoav Goldberg
Venue:
unimplicit
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
28–32
Language:
URL:
https://aclanthology.org/2021.unimplicit-1.4
DOI:
10.18653/v1/2021.unimplicit-1.4
Bibkey:
Cite (ACL):
Michael Roth and Talita Anthonio. 2021. UnImplicit Shared Task Report: Detecting Clarification Requirements in Instructional Text. In Proceedings of the 1st Workshop on Understanding Implicit and Underspecified Language, pages 28–32, Online. Association for Computational Linguistics.
Cite (Informal):
UnImplicit Shared Task Report: Detecting Clarification Requirements in Instructional Text (Roth & Anthonio, unimplicit 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.unimplicit-1.4.pdf