Yun Song
Author directoryOther people with similar names: Yun Song
2026
LegalWorld: A Life-Cycle Interactive Environment for Legal Agents
Songhan Zuo | Shengbin Yue | Tao Chiang | Guanying LI | Yun Song | Xuanjing Huang | Zhongyu Wei
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Songhan Zuo | Shengbin Yue | Tao Chiang | Guanying LI | Yun Song | Xuanjing Huang | Zhongyu Wei
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Civil litigation is inherently a life-cycle process: what a lawyer drafts on day one constrains what unfolds at trial months later. Yet existing legal benchmarks evaluate isolated subtasks, and prior legal-agent simulators reinitialize each scenario from shared ground truth, leaving cross-stage causal dependencies unmodeled. We present LegalWorld, a life-cycle interactive environment that models Chinese civil litigation as a causally connected state chain of five stages (seven sub-scenarios), grounded in 75,309 paired Chinese civil judgments. We pair it with reusable infrastructure (local memory, global case memory, a Skill/Tool library) and Reflective Legal Skill (RLS), which distills completed trajectories into reusable procedural skills. Building on this environment, we construct LongJud-Bench to evaluate agent capability across all five connected stages. 18,992 ratings from 217 legal-background evaluators confirm that LegalWorld trajectories are procedurally faithful and role-consistent; cross-model evaluation reveals stage-level divergences invisible to aggregate scores (backbones within 4 overall points can differ by up to 15 normalized points on individual stages), and RLS yields consistent gains on both reflected and held-out cases. Detailed resources will be provided upon acceptance.
Ready Jurist One: Benchmarking Language Agents for Legal Intelligence in Dynamic Environments
Zheng Jia | Shengbin Yue | Wei Chen | Siyuan Wang | Yidong Liu | Zejun Li | Yun Song | Zhongyu Wei
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Zheng Jia | Shengbin Yue | Wei Chen | Siyuan Wang | Yidong Liu | Zejun Li | Yun Song | Zhongyu Wei
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
The gap between existing benchmarks and the dynamic nature of real-world legal practice poses a key barrier to advancing legal intelligence. To this end, we introduce J1-ENVS, the first interactive and dynamic legal environment tailored for LLM-based agents. Guided by legal experts, it comprises six representative scenarios from Chinese legal practices at three levels of environmental complexity. We further introduce J1-EVAL, a dual-metric evaluation framework, designed to assess both task performance and procedural compliance across varying levels of legal proficiency. Extensive experiments on 17 LLM agents reveal that while many models demonstrate solid legal knowledge, they struggle with procedural execution in dynamic settings. Even the SOTA model is below 60% overall performance . These findings highlight persistent challenges in achieving dynamic legal intelligence and offer valuable insights to guide future research.
2025
Multi-Agent Simulator Drives Language Models for Legal Intensive Interaction
Shengbin Yue | Ting Huang | Zheng Jia | Siyuan Wang | Shujun Liu | Yun Song | Xuanjing Huang | Zhongyu Wei
Findings of the Association for Computational Linguistics: NAACL 2025
Shengbin Yue | Ting Huang | Zheng Jia | Siyuan Wang | Shujun Liu | Yun Song | Xuanjing Huang | Zhongyu Wei
Findings of the Association for Computational Linguistics: NAACL 2025
Large Language Models (LLMs) have significantly advanced legal intelligence, but the scarcity of scenario data impedes the progress toward interactive legal scenarios. This paper introduces a Multi-agent Legal Simulation Driver (MASER) to scalably generate synthetic data by simulating interactive legal scenarios. Leveraging real-legal case sources, MASER ensures the consistency of legal attributes between participants and introduces a supervisory mechanism to align participants’ characters and behaviors as well as addressing distractions. A Multi-stage Interactive Legal Evaluation (MILE) benchmark is further constructed to evaluate LLMs’ performance in dynamic legal scenarios. Extensive experiments confirm the effectiveness of our framework.