SALA: Semantic-Aware Logical Alignment for Complex Reasoning in In-Context Learning

Zhao Ji, Wenqing Chen, Zhixuan Chu, Jianxing Yu, Jingping Liu, Shanhe Zhao, Zibin Zheng


Abstract
Effective in-context learning (ICL) for complex reasoning relies on selecting the right demonstrations. Traditional retrieval methods based on surface similarity fail to capture the underlying problem-solving logic. Recent logic-based methods address this by matching predefined reasoning steps, but the rigid rules and exact-match criteria is improper to handle flexible or diverse reasoning processes. To address the problem, we propose SALA, a Semantic-Aware Logical Alignment framework. Instead of relying on a fixed inventory, SALA automatically learns task-specific reasoning operations. It then embeds these operations into a continuous semantic space and uses dynamic time warping (DTW) to align the reasoning sequences. This approach allows for soft, flexible matching of reasoning logic while remaining highly interpretable. Experiments across four reasoning benchmarks and three LLMs demonstrate that SALA outperforms existing demonstration selection methods. Further analysis confirming the roles of the operation induction and the logical semantic alignment.
Anthology ID:
2026.findings-emnlp.1015
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
21440–21456
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1015/
DOI:
Bibkey:
Cite (ACL):
Zhao Ji, Wenqing Chen, Zhixuan Chu, Jianxing Yu, Jingping Liu, Shanhe Zhao, and Zibin Zheng. 2026. SALA: Semantic-Aware Logical Alignment for Complex Reasoning in In-Context Learning. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 21440–21456, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
SALA: Semantic-Aware Logical Alignment for Complex Reasoning in In-Context Learning (Ji et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1015.pdf