Interpreting Answers to Yes-No Questions in User-Generated Content

Shivam Mathur, Keun Park, Dhivya Chinnappa, Saketh Kotamraju, Eduardo Blanco


Abstract
Interpreting answers to yes-no questions in social media is difficult. Yes and no keywords are uncommon, and the few answers that include them are rarely to be interpreted what the keywords suggest. In this paper, we present a new corpus of 4,442 yes-no question-answer pairs from Twitter. We discuss linguistic characteristics of answers whose interpretation is yes or no, as well as answers whose interpretation is unknown. We show that large language models are far from solving this problem, even after fine-tuning and blending other corpora for the same problem but outside social media.
Anthology ID:
2023.findings-emnlp.942
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2023
Month:
December
Year:
2023
Address:
Singapore
Editors:
Houda Bouamor, Juan Pino, Kalika Bali
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
14137–14161
Language:
URL:
https://aclanthology.org/2023.findings-emnlp.942
DOI:
10.18653/v1/2023.findings-emnlp.942
Bibkey:
Cite (ACL):
Shivam Mathur, Keun Park, Dhivya Chinnappa, Saketh Kotamraju, and Eduardo Blanco. 2023. Interpreting Answers to Yes-No Questions in User-Generated Content. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 14137–14161, Singapore. Association for Computational Linguistics.
Cite (Informal):
Interpreting Answers to Yes-No Questions in User-Generated Content (Mathur et al., Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-emnlp.942.pdf