ESGPT: A Data-Centric ESG Language Model with Unified Instruction and Benchmark Resources

Jaeyoung Lee, Misuk Kim


Abstract
ESG analysis requires complex language understanding across diverse sources, including corporate reports, news, and disclosures, for tasks such as ESG relevance detection, action interpretation, impact analysis, and question answering. However, existing ESG datasets are fragmented by task and source, with heterogeneous formats and annotation schemes, limiting their use for training general-purpose ESG LLMs and unified evaluation. In this work, we construct ESG-Instruct, a 30,000-instance ESG instruction dataset built from public ESG resources, and ESGU-Bench, an ESG understanding benchmark covering six representative ESG tasks. Based on these resources, we further develop ESGPT, an 8B ESG-specialized LLM, and evaluate it against diverse open-source and API-based LLMs. Experimental results show that general-purpose LLMs exhibit substantial performance variation across ESG tasks, while ESGPT, despite its relatively small scale, achieves the best performance on multiple ESG tasks. This work provides unified data and benchmark resources for training and evaluating ESG-specialized LLMs.
Anthology ID:
2026.emnlp-main.1361
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Junyi Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
31043–31064
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1361/
DOI:
10.18653/2026.emnlp-main.1361
Bibkey:
Cite (ACL):
Jaeyoung Lee and Misuk Kim. 2026. ESGPT: A Data-Centric ESG Language Model with Unified Instruction and Benchmark Resources. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 31043–31064, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
ESGPT: A Data-Centric ESG Language Model with Unified Instruction and Benchmark Resources (Lee & Kim, EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1361.pdf