Yoo Yeon Sung
2024
You Make me Feel like a Natural Question: Training QA Systems on Transformed Trivia Questions
Tasnim Kabir
|
Yoo Yeon Sung
|
Saptarashmi Bandyopadhyay
|
Hao Zou
|
Abhranil Chandra
|
Jordan Lee Boyd-Graber
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
Training question-answering QA and information retrieval systems for web queries require large, expensive datasets that are difficult to annotate and time-consuming to gather. Moreover, while natural datasets of information-seeking questions are often prone to ambiguity or ill-formed, there are troves of freely available, carefully crafted question datasets for many languages. Thus, we automatically generate shorter, information-seeking questions, resembling web queries in the style of the Natural Questions (NQ) dataset from longer trivia data. Training a QA system on these transformed questions is a viable strategy for alternating to more expensive training setups showing the F1 score difference of less than six points and contrasting the final systems.
2023
Not all Fake News is Written: A Dataset and Analysis of Misleading Video Headlines
Yoo Yeon Sung
|
Jordan Boyd-Graber
|
Naeemul Hassan
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
Polarization and the marketplace for impressions have conspired to make navigating information online difficult for users, and while there has been a significant effort to detect false or misleading text, multimodal datasets have received considerably less attention. To complement existing resources, we present multimodal Video Misleading Headline (VMH), a dataset that consists of videos and whether annotators believe the headline is representative of the video’s contents. After collecting and annotating this dataset, we analyze multimodal baselines for detecting misleading headlines. Our annotation process also focuses on why annotators view a video as misleading, allowing us to better understand the interplay of annotators’ background and the content of the videos.
Search
Co-authors
- Tasnim Kabir 1
- Saptarashmi Bandyopadhyay 1
- Hao Zou 1
- Abhranil Chandra 1
- Jordan Lee Boyd-Graber 1
- show all...