Maxm Pan
Author directory2026
AEGIS-D: Multi-Agent Debate for High-Precision Verification of Hard Competition Mathematics
Jiayang Sun | Jiawei Xu | Maxm Pan | Zerui Cheng | Pramod Viswanath
Findings of the Association for Computational Linguistics: EMNLP 2026
Jiayang Sun | Jiawei Xu | Maxm Pan | Zerui Cheng | Pramod Viswanath
Findings of the Association for Computational Linguistics: EMNLP 2026
Fluent but subtly wrong mathematical solutions can contaminate training, evaluation, and reward-labeling data. We present AEGIS-D (Assessment- and Evidence-Gated Inspection System via Debate), a precision-first multi-agent pipeline for blind verification of competition-level mathematics. Five same-model, role-prompted agents exchange structured arguments, while an assessment gate accepts a candidate only when at least three report positive confirming evidence rather than mere non-refutation. On 195 hard-to-verify variants from 58 IMO/USAMO/Putnam-level problems, a single judge achieves 55.1% precision; AEGIS-D achieves 92.5% precision and 63.8% recall, reducing false positives from 24.7 to 3.0 per run (8.2-fold). A repeated two-by-two factorial associates role prompting with the largest observed false-positive reduction and finds a smaller conditional benefit from gating. Paired round and threshold analyses expose the cost-precision trade-off, and single-run transfers to Omni-MATH and OlymMATH provide preliminary evidence beyond the constructed stress test.
TIDE: Tree-Induced Fine-Grained Diagnostic Evaluation from Model Behaviors
Jiayi Chen | Hui Li | Yujiong Shen | Qiyuan Peng | Yanxin Li | Chenhao Huang | Shaofan Liu | Guoqiang Zhang | Junjie Ye | Shihan Dou | Ming Zhang | Maxm Pan | Tao Gui | Qi Zhang | Xuanjing Huang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Jiayi Chen | Hui Li | Yujiong Shen | Qiyuan Peng | Yanxin Li | Chenhao Huang | Shaofan Liu | Guoqiang Zhang | Junjie Ye | Shihan Dou | Ming Zhang | Maxm Pan | Tao Gui | Qi Zhang | Xuanjing Huang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Benchmark performance is the dominant standard for comparing large language models (LLMs), typically summarized by a single aggregate score, such as accuracy, pass rate, or rubric score. This aggregate score provides limited information about a model’s underlying capabilities, yet understanding these capabilities is crucial for model development and evaluation. To this end, we propose Tree-Induced Diagnostic Evaluation (TIDE), which recasts diagnostic evaluation as behavior-driven decision-tree induction to perform fine-grained capability diagnosis. TIDE recursively builds a hierarchical capability tree from benchmark samples and model scores: at each node, an LLM judge proposes candidate splits and performs sample-to-group classification, and behavior-based information gain selects among them. We apply TIDE to five models across four benchmarks to demonstrate its effectiveness, and find fine-grained capability contrasts invisible at the aggregate level: Claude Opus 4.6 achieves 100% on microeconomic market reasoning where GPT-5.4 scores 83.3%, but trails GPT-5.4 on contract law reasoning with 77.8% versus 88.9%. We hope TIDE can be extended to past and future benchmarks so that the rich behavioral signal in evaluation results is fully leveraged for understanding model capabilities.