Xiangning Yu
Author directory2026
From Script to Stage: Automating Experimental Design for Social Simulations with LLMs
Yuwei Guo | Zihan Zhao | Xiaowei Liu | Xiangning Yu | Qun Ma | Deyu Zhou | Xiao Xue
Findings of the Association for Computational Linguistics: ACL 2026
Yuwei Guo | Zihan Zhao | Xiaowei Liu | Xiangning Yu | Qun Ma | Deyu Zhou | Xiao Xue
Findings of the Association for Computational Linguistics: ACL 2026
Multi-agent simulation based on LLMs has increasingly emerged as a new paradigm for exploring complex social phenomena and validating theoretical hypotheses. However, traditional experimental design in the social sciences relies heavily on interdisciplinary expert knowledge, involving cumbersome procedures and high technical barriers. While LLM-driven agents demonstrate broad prospects for designing experiments, their limitations regarding reliability and scientific rigor continue to significantly hinder their in-depth application in social science research. To address these challenges, this paper proposes FSTS, an automated framework for multi-agent experiment design based on script generation. Drawing on the concept of the “Decision Theater,” the framework deconstructs experimental design into three core phases: Script Composition, Script Finalization, and Actor Generation. Tests across multiple scenarios indicate that the agents generated by this framework can enact the script within the “experimental theater,” reproducing results consistent with real-world situations. The proposal of FSTS not only effectively lowers the barrier for social science experimental design but also provides scientifically grounded decision support for policy-making.
CAMO: An Agentic Framework for Automated Causal Discovery from Micro Behaviors to Macro Emergence in LLM Agent Simulations
Xiangning Yu | Yuwei Guo | Yuqi Hou | Xiao Xue | Qun Ma
Findings of the Association for Computational Linguistics: ACL 2026
Xiangning Yu | Yuwei Guo | Yuqi Hou | Xiao Xue | Qun Ma
Findings of the Association for Computational Linguistics: ACL 2026
LLM-empowered agent simulations are increasingly used to study social emergence, yet the micro-to-macro causal mechanisms behind macro outcomes often remain unclear. This is challenging because emergence arises from intertwined agent interactions and meso-level feedback and nonlinearity, making generative mechanisms hard to disentangle. To this end, we introduce CAMO, an automated Causal discovery framework from Micro behaviors to Macro Emergence in LLM agent simulations. CAMO converts mechanistic hypotheses into computable factors grounded in simulation records and learns a compact causal representation centered on an emergent target . CAMO outputs a computable Markov boundary and a minimal upstream explanatory subgraph, yielding interpretable causal chains and actionable intervention levers. It also uses simulator-internal counterfactual probing to orient ambiguous edges and revise hypotheses when evidence contradicts the current view. Experiments across four emergent settings demonstrate the promise of CAMO.[The code is available at an anonymous link: https://anonymous.4open.science/r/CAMO-0E6C/.]
Superficial Reflection or Genuine Thought? A Fine-Grained Cognitive Analysis of Large Reasoning Models
Yuxiang Chen | Zuohan Wu | Ziwei Wang | Xiangning Yu | Xujia Li | Linyi Yang | Mengyue Yang | Jun Wang | Lei Chen
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
Yuxiang Chen | Zuohan Wu | Ziwei Wang | Xiangning Yu | Xujia Li | Linyi Yang | Mengyue Yang | Jun Wang | Lei Chen
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
Motivated by the observed human-like behaviours in Large Reasoning Models (LRMs), this paper introduces a comprehensive taxonomy to characterise atomic reasoning steps and analyse the reasoning behaviours of LRMs. Grounded in human cognitive processes, we propose a taxonomy comprising five groups and seventeen categories. Through this taxonomy, we conduct an in-depth analysis of contemporary LRMs and distil four actionable takeaways for model optimisation. Most notably, we reveal that prevailing post-answer “double-checks” are largely superficial and rarely yield substantive revisions. A targeted intervention further shows that explicitly eliciting richer reflection processes can substantially improve failed self-correction. To support this large-scale study, we propose CAPO, an automated annotation method used to construct a dataset of 277,534 reasoning steps with strong agreement with human expert annotations. We further validate the main behavioural patterns on a newer reasoning model and a coding domain, demonstrating the broader applicability of the proposed taxonomy. All source code and data are available at https://github.com/hehepig4/psyche.