2026

Large Language Models (LLMs) have achieved strong performance on Table Question Answering (TableQA), yet their reasoning processes often remain misaligned with the underlying table semantics. This misalignment can lead to decompositions and validation steps that fail to faithfully capture the table operations required by the question. In this paper, we introduce SIP, a SQL Logic-aligned framework for improving the semantic consistency of LLM-based table reasoning. SIP is built around SQL Logic, a natural-language abstraction of standard SQL operators that explicitly represents operations such as projection, filtering, ordering, and aggregation while avoiding the syntactic brittleness of executable SQL. SQL Logic serves as a shared operator-level representation that guides sub-question decomposition and supports operator-aware validation in both Direct Prompting and Python Agent settings. Experiments on three TableQA benchmarks show that SIP achieves state-of-the-art performance and consistently improves robustness across diverse LLMs, demonstrating the value of explicit semantic representations for structured table reasoning.
Recent progress in Large Language Model (LLM) based Table Question Answering (TableQA) has demonstrated strong performance on standard benchmarks. However, existing benchmarks mainly focus on well-structured tables and fail to reflect the irregular structures and complex reasoning commonly encountered in real-world scenarios. We propose CompTab, a benchmark designed to evaluate TableQA under complex reasoning and irregular table conditions. CompTab covers six representative types, including semantic ambiguity, multi-hop reasoning, transposed tables, merged cells, missing values, and outliers. It is constructed from real-world seed tables across multiple domains using controlled LLM based generation and human verification to ensure realism and diversity. In addition, to improve the generalization of LLMs under complex and irregular table settings, we propose a two-stage training framework that progressively aligns models with textual reasoning and executable decision signals, instantiated as CompTabLLM. Evaluations on 38 representative LLMs and CompTabLLM show clear limitations of existing LLMs under realistic conditions, while the proposed framework improves generalization. CompTab thus provides a challenging benchmark for advancing TableQA in real-world.