Keyan Guo
Author directory2026
DualGauge: Automated Joint Security-Functionality Benchmarking of Specification-Only Code Generation by LLMs and Coding Agents
Rupam Patir | Keyan Guo | Suvadra Barua | Jiawei Guo | Abhijeet Pathak | Dinesh Gudimetla | Hongxin Hu | Haipeng Cai
Findings of the Association for Computational Linguistics: EMNLP 2026
Rupam Patir | Keyan Guo | Suvadra Barua | Jiawei Guo | Abhijeet Pathak | Dinesh Gudimetla | Hongxin Hu | Haipeng Cai
Findings of the Association for Computational Linguistics: EMNLP 2026
Large language models (LLMs) and LLM-based coding agents are now used to generate code from natural-language specifications, yet ensuring such code is both functionally correct and secure remains a challenge. We present DualGauge, the first fully automated framework for jointly evaluating correctness and security of specification-only code generation, supported by DualGauge-Bench, a language-agnostic benchmark of 307 coding tasks each paired with functional and security tests derived from the same specification. Evaluating 10 representative LLMs across Python, C++, and JavaScript, we find that functional correctness substantially overestimates reliable code generation: even the strongest model remains below 15% joint security-functionality success in every language. Common model-side factors—scale, extended thinking, quantization, instruction tuning, and code specialization—do not reliably improve joint performance, suggesting secure-and-correct code generation does not simply emerge from stronger coding capability. Evaluation of 3 leading agentic coding systems (Codex, OpenHands, and Claude Code) shows that iterative scaffolding provides no advantage over direct (LLM-based) generation on specification-only tasks. A qualitative audit reveals failures concentrate at the output contract boundary and in guards that exist but are insufficient—patterns that only joint benchmarking reliably exposes.
2025
HVGuard: Utilizing Multimodal Large Language Models for Hateful Video Detection
Yiheng Jing | Mingming Zhang | Yong Zhuang | Jiacheng Guo | Juan Wang | Xiaoyang Xu | Wenzhe Yi | Keyan Guo | Hongxin Hu
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Yiheng Jing | Mingming Zhang | Yong Zhuang | Jiacheng Guo | Juan Wang | Xiaoyang Xu | Wenzhe Yi | Keyan Guo | Hongxin Hu
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
The rapid growth of video platforms has transformed information dissemination and led to an explosion of multimedia content. However, this widespread reach also introduces risks, as some users exploit these platforms to spread hate speech, which is often concealed through complex rhetoric, making hateful video detection a critical challenge. Existing detection methods rely heavily on unimodal analysis or simple feature fusion, struggling to capture cross-modal interactions and reason through implicit hate in sarcasm and metaphor. To address these limitations, we propose HVGuard, the first reasoning-based hateful video detection framework with multimodal large language models (MLLMs). Our approach integrates Chain-of-Thought (CoT) reasoning to enhance multimodal interaction modeling and implicit hate interpretation. Additionally, we design a Mixture-of-Experts (MoE) network for efficient multimodal fusion and final decision-making. The framework is modular and extensible, allowing flexible integration of different MLLMs and encoders. Experimental results demonstrate that HVGuard outperforms all existing advanced detection tools, achieving an improvement of 6.88% to 13.13% in accuracy and 9.21% to 34.37% in M-F1 on two public datasets covering both English and Chinese.