Dianqiao Lei
Author directory2026
EnterpriseClawBench: Building Enterprise Agent Benchmarks from Real Workplace Sessions
Jincheng Zhong | Weizhi Wang | Che Jiang | Kai Tian | Zhenzhao Yuan | Junlin Yang | Dianqiao Lei | Kaiyan Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Jincheng Zhong | Weizhi Wang | Che Jiang | Kai Tian | Zhenzhao Yuan | Junlin Yang | Dianqiao Lei | Kaiyan Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Enterprise agents increasingly operate in workspaces, read heterogeneous files, use tools, and deliver business artifacts. We introduce EnterpriseClawBench, an internal enterprise agent benchmark constructed from proprietary agent sessions. Starting from a large archive of real workplace sessions, the EnterpriseClawBench pipeline produces 852 reproducible tasks with recovered fixtures, rewritten prompts, role classes, skill subclasses, hard rules, and semantic rubrics. Because the data contain internal enterprise content, the benchmark data are not released; the reusable contribution is the construction and evaluation protocol. On a manually audited 120-task Lite subset, the best score is only 0.663 for Codex with GPT-5.5. The results show that enterprise agent evaluation must report harness–model combinations, artifact delivery, visual quality, cost, runtime, and skill-transfer behavior rather than a single score.