Overreliance on AI in Information-seeking from Video Content

Anders Giovanni Møller, Elisa Bassignana, Francesco Pierri, Luca Maria Aiello


Abstract
The ubiquity of multimedia content is reshaping online information spaces, particularly in social media environments. At the same time, search is being rapidly transformed by generative AI, with large language models (LLMs) routinely deployed as intermediaries between users and multimedia content to retrieve and summarize information. Despite their growing influence, the impact of LLM inaccuracies and potential vulnerabilities on multimedia information-seeking tasks remains largely unexplored. We investigate how generative AI affects accuracy, efficiency, and confidence in information retrieval from videos. We conduct an experiment with around 900 participants on 8,000+ video-based information-seeking tasks, comparing behavior across three conditions: (1) access to videos only, (2) access to videos with LLM-based AI assistance, and (3) access to videos with a deceiving AI assistant designed to provide false answers. We find that AI assistance increases accuracy by 3–7% when participants viewed the relevant video segment, and by 27–35% when they did not. Efficiency increases by 10% for short videos and 25% for longer ones. However, participants tend to over-rely on AI outputs, resulting in accuracy drops of up to 32% when interacting with the deceiving AI. Alarmingly, self-reported confidence in answers remains stable across all three conditions. Our findings expose fundamental safety risks in AI-mediated video information retrieval.
Anthology ID:
2026.emnlp-main.137
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
3147–3167
Language:
URL:
https://aclanthology.org/2026.emnlp-main.137/
DOI:
Bibkey:
Cite (ACL):
Anders Giovanni Møller, Elisa Bassignana, Francesco Pierri, and Luca Maria Aiello. 2026. Overreliance on AI in Information-seeking from Video Content. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 3147–3167, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Overreliance on AI in Information-seeking from Video Content (Møller et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.137.pdf