Zizheng Zhan
Author directory2026
WebCompass: Evaluating Multimodal Code Agents in Web Development from Vision, Instruction, and Interaction to Implementation
Xinping Lei | Xinyu Che | Junqi Xiong | Chenchen Zhang | Yukai Huang | Chenyu Zhou | Haoyang Huang | Minghao Liu | Letian Zhu | Hongyi Ye | Ken Deng | Zizheng Zhan | Han Li | Yifan Yao | Ming Sun | Zhaoxiang Zhang | Jiaheng Liu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Xinping Lei | Xinyu Che | Junqi Xiong | Chenchen Zhang | Yukai Huang | Chenyu Zhou | Haoyang Huang | Minghao Liu | Letian Zhu | Hongyi Ye | Ken Deng | Zizheng Zhan | Han Li | Yifan Yao | Ming Sun | Zhaoxiang Zhang | Jiaheng Liu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Large language models are increasingly deployed as interactive coding agents for end-to-end web development, yet existing benchmarks evaluate narrow slices of this workflow—typically text-conditioned generation with static correctness metrics—overlooking visual fidelity, interactivity, and codebase-level reasoning. We introduce WebCompass, a benchmark that covers the full web development lifecycle by spanning three input modalities (text, image, video) and three task types (generation, editing, repair). To match the diverse nature of these tasks, we pair checklist-guided LLM-as-a-Judge for patch-based evaluation with a novel Agent-as-a-Judge protocol that executes generated websites in a real browser and synthesizes targeted test cases. Experiments on ten models reveal a 25-point gap between the best closed- and open-source models, persistent weaknesses in visual aesthetics even among frontier systems, and divergent performance profiles across task types that challenge the notion of a single "best" web coding agent.
2025
OASIS: Order-Augmented Strategy for Improved Code Search
Zuchen Gao | Zizheng Zhan | Xianming Li | Erxin Yu | Haotian Zhang | Bin Chen | Yuqun Zhang | Jing Li
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Zuchen Gao | Zizheng Zhan | Xianming Li | Erxin Yu | Haotian Zhang | Bin Chen | Yuqun Zhang | Jing Li
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Code embeddings capture the semantic representations of code and are crucial for various code-related large language model (LLM) applications, such as code search. Previous training primarily relies on optimizing the InfoNCE loss by comparing positive natural language (NL)-code pairs with in-batch negatives. However, due to the sparse nature of code contexts, training solely by comparing the major differences between positive and negative pairs may fail to capture deeper semantic nuances. To address this issue, we propose a novel order-augmented strategy for improved code search (OASIS). It leverages order-based similarity labels to train models to capture subtle differences in similarity among negative pairs. Extensive benchmark evaluations demonstrate that our OASIS model significantly outperforms previous state-of-the-art models focusing solely on major positive-negative differences. It underscores the value of exploiting subtle differences among negative pairs with order labels for effective code embedding training.