Self-Correcting Large Language Models: Generation vs. Multiple Choice

Hossein A. Rahmani, Satyapriya Krishna, Xi Wang, Mohammadmehdi Naghiaei, Emine Yilmaz


Abstract
Large language models have recently demonstrated remarkable abilities to self-correct their responses through iterative refinement, often referred to as self-consistency or self-reflection. However, the dynamics of this self-correction mechanism may differ substantially depending on whether the model is tasked with open-ended text generation or with selecting the most appropriate response from multiple predefined options. In this paper, we conduct a systematic investigation of these two paradigms by comparing performance trends and error-correction behaviors across question answering tasks, covering language models of different scales and families. Our experimental results reveal distinct patterns of improvement and failure modes:

While open-ended generation often benefits from the flexibility of re-interpretation and compositional refinement, multiple-choice selection can leverage clearer solution boundaries but may be limited by the provided options. This contrast also reflects the dual demands faced by emerging agentic LLM applications: effective agents must not only generate and refine open-ended plans or explanations, but also make reliable discrete choices when operating within constrained action spaces. Our findings, therefore, highlight that the design of self-correction mechanisms should take into account the interaction between task structure and output space, with implications for both knowledge-intensive reasoning and decision-oriented applications of LLMs.
Anthology ID:
2026.realm-1.4
Volume:
Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Ehsan Kamalloo, Nicolas Gontier, Nikolai Rozanov, Maryam Hashemzadeh, Akhil Arora
Venues:
REALM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
38–56
Language:
URL:
https://aclanthology.org/2026.realm-1.4/
DOI:
Bibkey:
Cite (ACL):
Hossein A. Rahmani, Satyapriya Krishna, Xi Wang, Mohammadmehdi Naghiaei, and Emine Yilmaz. 2026. Self-Correcting Large Language Models: Generation vs. Multiple Choice. In Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026), pages 38–56, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Self-Correcting Large Language Models: Generation vs. Multiple Choice (Rahmani et al., REALM 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.realm-1.4.pdf