Junling Zhuang

Author directory

2026

Multimodal agents are increasingly evaluated on their ability to search the web, invoke tools, and solve complex tasks autonomously. Yet no existing benchmark systematically evaluates the capability of autonomously searching, parsing, and extracting precise answers from multimodal raw media files as a unified, end-to-end agentic task. We introduce RDQA - Raw Data Question Answering, a benchmark of 1,350 questions across three source modalities (document, video, audio), and 20 real-world task scenarios, where every answer is designed to require source access rather than model knowledge alone. RDQA provides capability-stratified evaluation through 9 capability families organized by modality and cognitive complexity, and introduces the Parametric Leakage Rate (PLR), a process-aware metric that flags correct answers produced without genuine evidence retrieval. We evaluate 12 agent systems spanning 6 backbone models and 2 scaffoldings. Our results show that the the best generic agent reaches only 24.0% adjusted accuracy, while a process-aware baseline (RDQA-Skill) reaches 41.1%. PLR reaches as high as 96.0%, indicating that many ostensibly correct answers are not grounded in retrieved evidence. We release the full dataset, evaluation framework, and a baseline to support future research.