Wiggin Zhou
Author directory2026
ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation Evaluation
Chenchen Zhang | Yuhang Li | Jiaheng Liu | Can Xu | Ao Liu | Changzhi Zhou | Ken Deng | Dengpeng Wu | Guanhua Huang | Kejiao Li | Qi Yi | Ruilin Lv | Shihui Hu | Yue Zhang | Yuhao Jiang | Zenan Xu | Yuanxing Zhang | Wiggin Zhou | Bo Zhou | Fengzong Lian
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Chenchen Zhang | Yuhang Li | Jiaheng Liu | Can Xu | Ao Liu | Changzhi Zhou | Ken Deng | Dengpeng Wu | Guanhua Huang | Kejiao Li | Qi Yi | Ruilin Lv | Shihui Hu | Yue Zhang | Yuhao Jiang | Zenan Xu | Yuanxing Zhang | Wiggin Zhou | Bo Zhou | Fengzong Lian
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Large Language Models (LLMs) increasingly generate executable visual artifacts, yet established code benchmarks largely overlook the visual fidelity and interaction behavior that shape user experience. We introduce ArtifactsBench, a benchmark and automated multimodal evaluation framework for visual code generation. The framework executes each artifact and records three staged screenshots—before, during, and after a scripted interaction—then scores the evidence and source code with a checklist-guided Multimodal LLM (MLLM) referee. ArtifactsBench contains 1,825 tasks across nine domains and evaluates more than 30 LLMs. On a 280-query, six-model expert study, three staged screenshots yield 90.95% referee–human Pair ACC. Across the models shared with WebDev Arena, ArtifactsBench reaches 94.4% normalized Footrule consistency with that public human-preference ranking. We release the benchmark, evaluation harness, and baseline results at https://artifactsbenchmark.github.io/.