Towards Reasoning in Large Language Models: A Survey

Jie Huang, Kevin Chen-Chuan Chang


Abstract
Reasoning is a fundamental aspect of human intelligence that plays a crucial role in activities such as problem solving, decision making, and critical thinking. In recent years, large language models (LLMs) have made significant progress in natural language processing, and there is observation that these models may exhibit reasoning abilities when they are sufficiently large. However, it is not yet clear to what extent LLMs are capable of reasoning. This paper provides a comprehensive overview of the current state of knowledge on reasoning in LLMs, including techniques for improving and eliciting reasoning in these models, methods and benchmarks for evaluating reasoning abilities, findings and implications of previous research in this field, and suggestions on future directions. Our aim is to provide a detailed and up-to-date review of this topic and stimulate meaningful discussion and future work.
Anthology ID:
2023.findings-acl.67
Volume:
Findings of the Association for Computational Linguistics: ACL 2023
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1049–1065
Language:
URL:
https://aclanthology.org/2023.findings-acl.67
DOI:
10.18653/v1/2023.findings-acl.67
Bibkey:
Cite (ACL):
Jie Huang and Kevin Chen-Chuan Chang. 2023. Towards Reasoning in Large Language Models: A Survey. In Findings of the Association for Computational Linguistics: ACL 2023, pages 1049–1065, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Towards Reasoning in Large Language Models: A Survey (Huang & Chang, Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-acl.67.pdf
Video:
 https://aclanthology.org/2023.findings-acl.67.mp4