Xuan Yao
Author directory2026
DelistBench: Evaluating Search-Enabled LLMs for Auditable Corporate-Event Database Completion
Xuan Yao | Shuping Li | Yang Dai | Yi Zhou | Ke-Wei Huang
Proceedings of the 11th Workshop on Financial Technology and Natural Language Processing
Xuan Yao | Shuping Li | Yang Dai | Yi Zhou | Ke-Wei Huang
Proceedings of the 11th Workshop on Financial Technology and Natural Language Processing
Financial institutions need an independent way to detect missing, stale, and misclassified corporate-event records in vendor databases. We introduce Search-to-Record, a database-assurance task in which search-enabled large language models reconstruct institution-defined event records from public sources for a known security universe and historical cutoff, and DelistBench, a 1,200-record benchmark for security-level delisting announcements. We evaluate five models in paired closed-book and web-enabled conditions. Web access raises announcement-date accuracy within seven days by 34.0–48.0 percentage points and event-status accuracy by approximately 2.8–21.7 points; the best system achieves 81.5% overall joint accuracy within seven days. Economy web systems achieve 75.9–78.3% overall joint accuracy within seven days at 4.5–6.6% of the API cost of the most expensive web system. Risk-based triage identifies low-error subsets, although the highest-coverage operating point still sends 27.3% of the balanced test set to review. The evaluation identifies web retrieval as the main source of timing gains and shows that low-cost systems can approach the best system’s accuracy. Together, Search-to-Record, DelistBench, and the evaluation provide concrete deployment guidance: calibrate triage to local event prevalence and market mix, preserve positive-event recall, and route positive and ambiguous cases to targeted review. DelistBench is publicly available at https://github.com/tj-zyyyyyyy/DelistBench.
FinDeepForecast : A Live Multi-Agent System for Benchmarking Deep Research Agents in Financial Forecasting
Xiangyu Li | Xuan Yao | Guohao Qi | Fengbin Zhu | Kelvin J.L. Koa | Xiang Yao Ng | Ziyang Liu | Ni Xingyu | Liu Chang | Yonghui Yang | Yang Zhang | Wenjie Wang | Fuli Feng | Chao Wang | Huanbo Luan | Xiaofen Xing | Xiangmin Xu | Tat-Seng Chua | Ke-Wei Huang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Xiangyu Li | Xuan Yao | Guohao Qi | Fengbin Zhu | Kelvin J.L. Koa | Xiang Yao Ng | Ziyang Liu | Ni Xingyu | Liu Chang | Yonghui Yang | Yang Zhang | Wenjie Wang | Fuli Feng | Chao Wang | Huanbo Luan | Xiaofen Xing | Xiangmin Xu | Tat-Seng Chua | Ke-Wei Huang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Deep Research (DR) Agents powered by advanced Large Language Models (LLMs) have fundamentally shifted the paradigm for completing complex research tasks. Yet, a comprehensive and live evaluation of their forecasting performance on real-world, research-oriented tasks in high-stakes domains (eg finance) remains underexplored. We introduce FinDeepForecast, the first live, end-to-end multi-agent system for automatically evaluating DR agents by continuously generating research-oriented financial forecasting tasks. This system is equipped with a dual-track taxonomy, enabling the dynamic generation of recurrent and non-recurrent forecasting tasks at both corporate and macro levels. With this system, we generate FinDeepForecastBench, a weekly evaluation benchmark over a ten-week horizon, encompassing 8 global economies and 1,314 listed companies, and evaluate 13 representative methods. Extensive experiments show that, while DR agents consistently outperform strong baselines, their performance still falls short of genuine forward-looking financial reasoning. We expect the proposed FinDeepForecast system to consistently facilitate future advancements of DR agents in research-oriented financial forecasting tasks. The project website is available at https://OpenFinArena.com.