Kaike Zhang

Author directory

2026

Enabling Large Language Models (LLMs) to perform tool-free Table Question Answering (TableQA) presents two critical challenges: "question-first" data synthesis often introduces logical hallucinations, while standard reinforcement learning (RL) suffers from sparse rewards over long reasoning chains. We propose ProbeTQA, a unified framework that couples execution-verified data construction with process-supervised RL. To mitigate synthesis hallucinations, ProbeTQA adopts an answer-first executable probing paradigm, in which an agent performs multi-round exploratory programming over real tables so that every synthesized instance is grounded in a verifiable witness program. To address reward sparsity, we convert verified code trajectories into natural-language reasoning traces and derive execution-grounded process rubrics directly from runtime states, providing reliable dense supervision. Using these rubrics, we optimize the model with Group Relative Policy Optimization (GRPO) under a Two-Stage Reward Curriculum, thereby internalizing complex tool-use reasoning into the model parameters. Experiments show that our 8B model achieves state-of-the-art tool-free performance on challenging benchmarks, attaining 65.8% accuracy on TableBench and outperforming GPT-5.4 and DeepSeek-v3.2 by 13.4 and 6.8 percentage points, respectively.
Large language models achieve remarkable performance via extended chain-of-thought (CoT) reasoning, yet this lengthy process incurs substantial inference overhead. Existing CoT compression methods struggle with inflexible manual length budgets, computationally expensive multi-stage training pipelines, and fragile scalability restricted to small models. We propose **HMPO** (**H**ybrid **M**edian-length **P**olicy **O**ptimization), a cost-effective, single-stage reinforcement learning framework. HMPO efficiently compresses CoT via three synergistic components: an *adaptive median-based budget* derived from successful rollouts to eliminate manual tuning, a *cosine-decay token reward* for smooth length penalization, and a *multiplicative reward formulation* that substantially mitigates trivial reward hacking by strictly prioritizing answer correctness. Trained exclusively on mathematical data, HMPO generalizes seamlessly across math, code, science, and instruction-following tasks. Extensive experiments scaling from 9B to 122B parameters across dense and Mixture-of-Experts (MoE) architectures demonstrate that HMPO achieves **19%–46% token compression with negligible accuracy degradation**, all while drastically reducing training costs compared to existing multi-stage baselines.
Reinforcement Learning with Verifiable Rewards (RLVR) has driven substantial progress in reasoning-intensive domains like mathematics. However, optimizing open-ended generation remains challenging due to the lack of ground truth. While rubric-based evaluation offers a structured proxy for verification, existing methods suffer from scalability bottlenecks and coarse criteria, resulting in a supervision ceiling effect. To address this, we propose an automated Coarse-to-Fine Rubric Generation framework. By synergizing principle-guided synthesis, multi-model aggregation, and difficulty evolution, our approach produces comprehensive and highly discriminative criteria capable of capturing the subtle nuances. Based on this framework, we introduce RubricHub, a large-scale (110k) and multi-domain dataset. We validate its utility through a two-stage post-training pipeline comprising Rubric-based Rejection Sampling Fine-Tuning (RuFT) and Reinforcement Learning (RuRL). Experimental results demonstrate that RubricHub unlocks significant performance gains: our post-trained Qwen3-14B achieves state-of-the-art (SOTA) results on HealthBench (69.3), surpassing proprietary frontier models such as GPT-5.

2024

In textual backdoor attacks, attackers insert poisoned samples with triggered inputs and target labels into training datasets to manipulate model behavior, threatening the model’s security and reliability. Current defense methods can generally be categorized into inference-time and training-time ones. The former often requires a part of clean samples to set detection thresholds, which may be hard to obtain in practical application scenarios, while the latter usually requires an additional retraining or unlearning process to get a clean model, significantly increasing training costs. To avoid these drawbacks, we focus on developing a practical defense method before model training without using any clean samples. Our analysis reveals that with the help of a pre-trained language model (PLM), poisoned samples, different from clean ones, exhibit mismatched relationship and shared characteristics. Based on these observations, we further propose a two-stage poison detection strategy solely leveraging insights from PLM before model training. Extensive experiments confirm our approach’s effectiveness, achieving better performance than current leading methods more swiftly. Our code is available at https://github.com/Ascian/PKAD.