Ziwei Du
Author directory2026
SIP: Aligning LLM-based TableQA with Table Semantics via SQL Logic
Zhen Yang | Ziwei Du | Minghan Zhang | Wei Du | Haodong Zou | Shicheng Tan | Jie Chen | Shu Zhao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Zhen Yang | Ziwei Du | Minghan Zhang | Wei Du | Haodong Zou | Shicheng Tan | Jie Chen | Shu Zhao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Large Language Models (LLMs) have achieved strong performance on Table Question Answering (TableQA), yet their reasoning processes often remain misaligned with the underlying table semantics. This misalignment can lead to decompositions and validation steps that fail to faithfully capture the table operations required by the question. In this paper, we introduce SIP, a SQL Logic-aligned framework for improving the semantic consistency of LLM-based table reasoning. SIP is built around SQL Logic, a natural-language abstraction of standard SQL operators that explicitly represents operations such as projection, filtering, ordering, and aggregation while avoiding the syntactic brittleness of executable SQL. SQL Logic serves as a shared operator-level representation that guides sub-question decomposition and supports operator-aware validation in both Direct Prompting and Python Agent settings. Experiments on three TableQA benchmarks show that SIP achieves state-of-the-art performance and consistently improves robustness across diverse LLMs, demonstrating the value of explicit semantic representations for structured table reasoning.
CompTab: A Comprehensive Benchmark for Real-World TableQA with Complex Reasoning and Irregular Tables
Zhen Yang | Wei Du | Jie Wang | Wenze Zhou | Xiangfeng Meng | Zhengyang Wang | Suping Sun | Ziwei Du | Haodong Zou | Jie Chen | Yongbin Liu | Shicheng Tan | Jiahao Ying | Shu Zhao
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Zhen Yang | Wei Du | Jie Wang | Wenze Zhou | Xiangfeng Meng | Zhengyang Wang | Suping Sun | Ziwei Du | Haodong Zou | Jie Chen | Yongbin Liu | Shicheng Tan | Jiahao Ying | Shu Zhao
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Recent progress in Large Language Model (LLM) based Table Question Answering (TableQA) has demonstrated strong performance on standard benchmarks. However, existing benchmarks mainly focus on well-structured tables and fail to reflect the irregular structures and complex reasoning commonly encountered in real-world scenarios. We propose CompTab, a benchmark designed to evaluate TableQA under complex reasoning and irregular table conditions. CompTab covers six representative types, including semantic ambiguity, multi-hop reasoning, transposed tables, merged cells, missing values, and outliers. It is constructed from real-world seed tables across multiple domains using controlled LLM based generation and human verification to ensure realism and diversity. In addition, to improve the generalization of LLMs under complex and irregular table settings, we propose a two-stage training framework that progressively aligns models with textual reasoning and executable decision signals, instantiated as CompTabLLM. Evaluations on 38 representative LLMs and CompTabLLM show clear limitations of existing LLMs under realistic conditions, while the proposed framework improves generalization. CompTab thus provides a challenging benchmark for advancing TableQA in real-world.