WaymoQA: A Multi-View Visual Question Answering Dataset for Safety-Critical Reasoning in Autonomous Driving

Seungjun Yu, Seonho Lee, Namho Kim, Jaeyo Shin, Junsung Park, Wonjeong Ryu, Raehyuk Jung, Hyunjung Shim


Abstract
In real-world driving, resolving a primary hazard often precipitates a secondary one: swerving to avoid a stalled vehicle may force the ego car into oncoming traffic. Existing driving QA datasets fail to capture this cascading causality, evaluating perception, prediction, and planning in silos without anticipating the risks action induces. We introduce WaymoQA, a multi-view dataset that frames safety-critical reasoning as a two-stage task: resolving the immediate threat, then mitigating the action-induced secondary risk. WaymoQA provides 35,000 human-annotated QA pairs across image and video modalities, with 28K training and 6.4K test examples. Experiments show that SOTA models struggle on safety-critical scenes, while fine-tuning on WaymoQA improves both reasoning accuracy and consistency. WaymoQA thus serves as a rigorous benchmark and resource for safety-aware autonomous driving.
Anthology ID:
2026.findings-emnlp.1028
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
21721–21744
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1028/
DOI:
10.18653/2026.findings-emnlp.1028
Bibkey:
Cite (ACL):
Seungjun Yu, Seonho Lee, Namho Kim, Jaeyo Shin, Junsung Park, Wonjeong Ryu, Raehyuk Jung, and Hyunjung Shim. 2026. WaymoQA: A Multi-View Visual Question Answering Dataset for Safety-Critical Reasoning in Autonomous Driving. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 21721–21744, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
WaymoQA: A Multi-View Visual Question Answering Dataset for Safety-Critical Reasoning in Autonomous Driving (Yu et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1028.pdf