Haoran Zhao
Author directoryPapers on this page may belong to the following people: Haoran Zhao, Haoran Zhao
2026
Attribution-Based Analysis and Optimization of Modular Agentic Workflows
Yingxuan Yang | Bo Huang | Siyuan Qi | Chao Feng | Haoyi Hu | Yuxuan Zhu | Jinbo Hu | Haoran Zhao | Ziyi He | Xiao Liu | ZongYu Wang | Muning Wen | Lin Qiu | Xuezhi Cao | Xunliang Cai | Yong Yu | Weinan Zhang
Findings of the Association for Computational Linguistics: ACL 2026
Yingxuan Yang | Bo Huang | Siyuan Qi | Chao Feng | Haoyi Hu | Yuxuan Zhu | Jinbo Hu | Haoran Zhao | Ziyi He | Xiao Liu | ZongYu Wang | Muning Wen | Lin Qiu | Xuezhi Cao | Xunliang Cai | Yong Yu | Weinan Zhang
Findings of the Association for Computational Linguistics: ACL 2026
Agentic workflows solve complex tasks by orchestrating modular components (e.g., planning, reasoning, action, reflection) built on top of LLM backbones. A practical but underexplored question is model allocation: given a fixed workflow decomposition and a pool of candidate LLMs, which components should be upgraded (and with which models) to upgrade task performance, and how can we attribute gains to individual upgrades and their interactions?We present ShapleyFlow, a cooperative game theoretic framework that models component upgrades as players and evaluates component coalitions to compute Shapley values. This yields interaction-aware attribution and supports Shapley-guided configuration recommendation for model allocation under a fixed workflow structure.We further introduce CapaBench, a benchmark of 1,500+ tasks across seven domains (shopping, navigation, ticketing, mathematics, operating systems, robotic coordination, and automated theorem proving).Across 9 representative LLMs and all 24 upgrade coalitions in a 4-component workflow, ShapleyFlow provides (i) principled, interaction-aware attribution for modular workflows and (ii) actionable model-allocation recommendations that improve over strong single-model baselines.
2025
Comparing human and LLM politeness strategies in free production
Haoran Zhao | Robert D. Hawkins
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Haoran Zhao | Robert D. Hawkins
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Polite speech poses a fundamental alignment challenge for large language models (LLMs). Humans deploy a rich repertoire of linguistic strategies to balance informational and social goals – from positive approaches that build rapport (compliments, expressions of interest) to negative strategies that minimize imposition (hedging, indirectness).We investigate whether LLMs employ a similarly context-sensitive repertoire by comparing human and LLM responses to English-language scenarios in both constrained and open-ended production tasks.We find that larger models (≥70B parameters) successfully replicate key effects from the computational pragmatics literature, and human evaluators prefer LLM-generated responses in open-ended contexts. However, further linguistic analyses reveal that models disproportionately rely on negative politeness strategies to create distance even in positive contexts, potentially leading to misinterpretations. While LLMs thus demonstrate an impressive command of politeness strategies, these systematic differences provide important groundwork for making intentional choices about pragmatic behavior in human-AI communication.