Chaojian Shi
Author directory2026
EvoSQL: Memory-Augmented Critic-Generator Co-Evolution for Text-to-SQL
Jiawei Zhou | Jianwei Wang | Chenyu Zhou | Chaojian Shi | Ming Dong | Kai Wang
Findings of the Association for Computational Linguistics: EMNLP 2026
Jiawei Zhou | Jianwei Wang | Chenyu Zhou | Chaojian Shi | Ming Dong | Kai Wang
Findings of the Association for Computational Linguistics: EMNLP 2026
Text-to-SQL has advanced rapidly with large language models, but complex database queries still require reasoning beyond one-shot generation, including multi-step decomposition, execution-based diagnosis, and targeted correction. We present EvoSQL, a co-evolution framework that formulates SQL synthesis as an iterative interaction between a generator and a critic. Moreover, EvoSQL maintains a contextualized candidate memory, verifies SQL candidates with both execution signals and LLM-based critique, and updates its memory through utility-guided aggregation. To strengthen the underlying generator–critic pair, we further introduce a Self-Distillation Policy Optimization (SDPO) fine-tuning stage that injects execution-aware supervision into current coding LLM backbones. Experiments on Spider and BIRD show that EvoSQL consistently improves open-source models over Maj@16 baselines, with particularly large gains on BIRD-Dev, ranging from +1.37% for Qwen3-4B to +9.19% for Qwen2.5-Coder-3B. SDPO initialization further improves selected backbones on Spider-Test and BIRD-Dev. These results suggest that memory-grounded co-evolution is an effective path toward more reliable and generalizable Text-to-SQL systems.
Modular Representation Steering for Multi-Attribute LLM Alignment
Chaojian Shi | Renhong Huang | Xulan Qiu | Jiawei Zhou | Yunsong Zhou
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Chaojian Shi | Renhong Huang | Xulan Qiu | Jiawei Zhou | Yunsong Zhou
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Aligning large language models (LLMs) with multiple behavioral objectives from a certain corpus remains challenging, as joint optimization of attributes often leads to interference and trade-offs. While recent representation steering methods enable lightweight control over individual behaviors through hidden-state interventions, their composability for multi-attribute alignment remains underexplored. We present POLAR, Poly-attribute Alignment via Modular Representation Steering, a modular framework that composes independently trained alignment interventions within a frozen LLM. To mitigate conflicts between steering modules, we introduce calibrated and compatibility-aware intervention composition in hidden-state space. Experiments across heterogeneous alignment attributes show that POLAR achieves the best overall trade-off, with a 37.4% improvement in average rank over the strongest multi-attribute baseline while preserving response quality and controllability. The code and data will be publicly available.