Can LLMs Access their World Knowledge for Event Prediction?

Zijun Wu, Zhitian Zhang, Hossein Hajimirsadeghi, Nikita Dvornik, Alexander Pashevich


Abstract
Recent work has questioned whether large language models (LLMs) can be useful for temporal event prediction. Despite vast pretrained world knowledge, LLMs often underperform simpler specialized models. We ask whether this knowledge is truly inaccessible, or whether current methods fail to present event prediction in a form LLMs can use. We argue for the latter and show that LLMs become effective event forecasters when the interface is designed around two choices. The first grounds each event in a natural-language description, and the second separates event semantics from the prediction space to prevent semantic bias from label associations. To test this, we introduce DescribeEvent, a benchmark of ~150K events across seven datasets and six domains with event-level descriptions. We find that capable LLMs substantially benefit from descriptions and symbolic labels, outperforming description-free variants and non-LLM baselines, while weaker models gain little. These results suggest that accessing LLM world knowledge for event prediction is an interface problem, and that event descriptions offer a practical way to elicit the knowledge LLMs already encode.
Anthology ID:
2026.findings-emnlp.823
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
17442–17457
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.823/
DOI:
10.18653/2026.findings-emnlp.823
Bibkey:
Cite (ACL):
Zijun Wu, Zhitian Zhang, Hossein Hajimirsadeghi, Nikita Dvornik, and Alexander Pashevich. 2026. Can LLMs Access their World Knowledge for Event Prediction?. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 17442–17457, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Can LLMs Access their World Knowledge for Event Prediction? (Wu et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.823.pdf