What Are the Implications of Your Question? Non-Information Seeking Question-Type Identification in CNN Transcripts

Yao Sun, Anastasiia Tatlubaeva, Zhihan Li, Chester Palen-Michel


Abstract
Non-information seeking questions (NISQ) capture the subtle dynamics of human discourse. In this work, we utilize a dataset of over 1,500 information-seeking question(ISQ) and NISQ to evaluate human and machine performance on classifying fine-grained NISQ types. We introduce the first publicly available corpus focused on annotating both ISQs and NISQs as an initial benchmark. Additionally, we establish competitive baselines by assessing diverse systems, including Generative Pre-Trained Transformer Language models, on a new question classification task. Our results demonstrate the inherent complexity of making nuanced NISQ distinctions. The dataset is publicly available at https://github.com/YaoSun0422/NISQ_dataset.git
Anthology ID:
2024.lrec-main.1516
Volume:
Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
Month:
May
Year:
2024
Address:
Torino, Italia
Editors:
Nicoletta Calzolari, Min-Yen Kan, Veronique Hoste, Alessandro Lenci, Sakriani Sakti, Nianwen Xue
Venues:
LREC | COLING
SIG:
Publisher:
ELRA and ICCL
Note:
Pages:
17444–17448
Language:
URL:
https://aclanthology.org/2024.lrec-main.1516
DOI:
Bibkey:
Cite (ACL):
Yao Sun, Anastasiia Tatlubaeva, Zhihan Li, and Chester Palen-Michel. 2024. What Are the Implications of Your Question? Non-Information Seeking Question-Type Identification in CNN Transcripts. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 17444–17448, Torino, Italia. ELRA and ICCL.
Cite (Informal):
What Are the Implications of Your Question? Non-Information Seeking Question-Type Identification in CNN Transcripts (Sun et al., LREC-COLING 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.lrec-main.1516.pdf