Ruilin Lv
Author directory2026
ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation Evaluation
Chenchen Zhang | Yuhang Li | Jiaheng Liu | Can Xu | Ao Liu | Changzhi Zhou | Ken Deng | Dengpeng Wu | Guanhua Huang | Kejiao Li | Qi Yi | Ruilin Lv | Shihui Hu | Yue Zhang | Yuhao Jiang | Zenan Xu | Yuanxing Zhang | Wiggin Zhou | Bo Zhou | Fengzong Lian
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Chenchen Zhang | Yuhang Li | Jiaheng Liu | Can Xu | Ao Liu | Changzhi Zhou | Ken Deng | Dengpeng Wu | Guanhua Huang | Kejiao Li | Qi Yi | Ruilin Lv | Shihui Hu | Yue Zhang | Yuhao Jiang | Zenan Xu | Yuanxing Zhang | Wiggin Zhou | Bo Zhou | Fengzong Lian
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Large Language Models (LLMs) increasingly generate executable visual artifacts, yet established code benchmarks largely overlook the visual fidelity and interaction behavior that shape user experience. We introduce ArtifactsBench, a benchmark and automated multimodal evaluation framework for visual code generation. The framework executes each artifact and records three staged screenshots—before, during, and after a scripted interaction—then scores the evidence and source code with a checklist-guided Multimodal LLM (MLLM) referee. ArtifactsBench contains 1,825 tasks across nine domains and evaluates more than 30 LLMs. On a 280-query, six-model expert study, three staged screenshots yield 90.95% referee–human Pair ACC. Across the models shared with WebDev Arena, ArtifactsBench reaches 94.4% normalized Footrule consistency with that public human-preference ranking. We release the benchmark, evaluation harness, and baseline results at https://artifactsbenchmark.github.io/.
ReLook: Vision-Grounded RL with a Multimodal LLM Critic for Agentic Web Coding
Yuhang Li | Chenchen Zhang | Ruilin Lv | Ao Liu | Ken Deng | Yuanxing Zhang | Jiaheng Liu | Bo Zhou
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Yuhang Li | Chenchen Zhang | Ruilin Lv | Ao Liu | Ken Deng | Yuanxing Zhang | Jiaheng Liu | Bo Zhou
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
While Large Language Models (LLMs) excel at algorithmic code generation, they struggle with front-end development, where correctness is judged on rendered pixels and interaction. We present ReLook, an agentic, vision-grounded reinforcement learning framework that empowers an agent to close a robust generate–diagnose–refine loop by invoking a multimodal LLM (MLLM) as a tool. During training, the agent employs an MLLM-in-the-loop to serve as a visual critic, evaluating code via screenshots and providing actionable feedback. Crucially, we enforce a strict zero-reward policy for invalid renders to guarantee renderability and mitigate reward hacking. To prevent behavioral collapse, we introduce Forced Optimization, a strict acceptance rule that admits only improving revisions, yielding monotonically better trajectories. At inference, we decouple the critic and run a lightweight, critic-free self-edit cycle, keeping latency comparable to base decoding while retaining most of the gains. Across three widely used benchmarks, ReLook consistently outperforms strong baselines in vision-grounded front-end code generation, highlighting the benefits of agentic perception, visual rewards, and training–inference decoupling.