Yanwei Yu
Author directory2026
TimeClaimBench: A Claim-Level Benchmark for Grounded LLM Explanations of Time Series
Sijia Peng | Fan Zhang | Yixi Zhou | Changlun Li | Yun Xiong | Yangyong Zhu | Xi Chen | Yanwei Yu | Nan Tang
Findings of the Association for Computational Linguistics: EMNLP 2026
Sijia Peng | Fan Zhang | Yixi Zhou | Changlun Li | Yun Xiong | Yangyong Zhu | Xi Chen | Yanwei Yu | Nan Tang
Findings of the Association for Computational Linguistics: EMNLP 2026
Large language models (LLMs) are increasingly used to explain numerical time series, but fluent explanations can misstate when a change occurs, overstate a trend, or introduce unsupported patterns. Existing evaluations often score forecasts, answers, or whole explanations, leaving claim-level temporal grounding undermeasured. We introduce TimeClaimBench, a benchmark that parses explanations into atomic temporal claims and verifies them against a deterministic extracted event graph. Across five LLMs on controlled synthetic series, event-grounded prompting raises the strict graph-supported rate by 18.3 points and reduces graph-unsupported claims by 27.9 points under this fixed operational criterion. Calibration analyses show the boundary of that result. The extractor recovers the designed primary event in 394 of 400 series, but this does not estimate the precision of additional extracted events. A blinded two-annotator comparison on one model and 40 series reverses the automatic ordering: holistic ratings favor Direct and chain-of-thought outputs over event-grounded outputs. therefore distinguishes four axes that should not be conflated: designed-event recovery, the unresolved precision of additional events, claim-to-graph consistency, and whole-explanation human judgment. Code: https://github.com/lunaaa95/TimeClaimBench