Yaoming Li
Author directory2026
ScienceArena: Benchmarking LLMs on Latest Scientific Olympiad Competitions
Guangxiang Zhao | Qilong Shi | Xusen Xiao | Liuwenpu | Yaoming Li | Linfeng Hao | Shuyang Hou | Zijian Guo | Xinrui Zhang | Yuntian Zhao | Zhengyang Wang | Wenrui Liu | Yuhan Wu | Tong Yang | Lin Sun | Xiangzheng Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Guangxiang Zhao | Qilong Shi | Xusen Xiao | Liuwenpu | Yaoming Li | Linfeng Hao | Shuyang Hou | Zijian Guo | Xinrui Zhang | Yuntian Zhao | Zhengyang Wang | Wenrui Liu | Yuhan Wu | Tong Yang | Lin Sun | Xiangzheng Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Benchmark saturation and data contamination increasingly obscure genuine scientific reasoning in frontier LLMs. We introduce ScienceArena, an olympiad-style benchmark from thirteen public science competitions in physics, chemistry, and biology, including IPhO and IChO 2025–2026, IBO 2023, USAPhO 2026, and USNCO 2025. Its open-ended, multi-step problems use process-credit rubrics, making faithful scoring difficult. We build ScienceArena through an expert-audited digitization pipeline that converts official exams, figures, solutions, and rubrics into structured items verified by olympiad medalists. To scale evaluation beyond costly human grading, we calibrate LLM-as-judge against medalist ground truth on archived answers from five models across IPhO and IChO; two strong judges stay within one point of expert total scores. Medalist notes show that failures often stem from visual grounding, structure fidelity, and global problem control rather than missing terminology. Evaluating fourteen recent LLMs with interleaved solving, we find that top models obtain medal-equivalent rubric scores on several public international exams, while chemistry and long-horizon consistency remain key bottlenecks. We provide an interactive demo.
RealClawBench: Live OpenClaw Benchmarks from Real Developer-Agent Sessions
Zongwei Lv | Yaoming Li | Zhewen Tan | Yilun Yao | Yuxuan Tian | Lin Sun | Xiangzheng Zhang | Weihong Lin | Tong Yang | Guangxiang Zhao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Zongwei Lv | Yaoming Li | Zhewen Tan | Yilun Yao | Yuxuan Tian | Lin Sun | Xiangzheng Zhang | Weihong Lin | Tong Yang | Guangxiang Zhao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Agent benchmarks should reflect what users actually ask deployed agents to do, yet existing benchmarks often miss the realism of real developer-agent sessions. We introduce RealClawBench, a live benchmark framework built from real OpenClaw sessions to capture the distribution, diversity, and real-world difficulty of deployed agent use. Real user requests are challenging to benchmark because they often depend on local execution environments, involve implicit or underspecified intent, and require nontrivial verification. RealClawBench addresses these challenges with two core mechanisms: reconstructed execution environments and deterministic verifiable scorers, which together convert real sessions into reproducible, automatically scored tasks. The resulting release contains 281 executable tasks sampled from a much larger real-session pool while preserving the source distribution, with maximum final-vs-source Jensen-Shannon divergence of 0.0448. Evaluating 14 contemporary models shows that the best system solves only 65.8% of tasks, revealing substantial headroom on realistic developer-agent workloads. By turning real deployed sessions into controlled evaluation instances, RealClawBench provides a practical path toward benchmarks that better measure agent capability in actual use.