Wenjie Fu
2026
MulDimIF: A Multi-Dimensional Constraint Framework for Evaluating and Improving Instruction Following in Large Language Models
Junjie Ye | Caishuang Huang | Zhuohan Chen | Wenjie Fu | Chenyuan Yang | Leyi Yang | Yilong Wu | Peng Wang | Meng Zhou | Xiaolong Yang | Tao Gui | Qi Zhang | Zhongchao Shi | Jianping Fan | Xuanjing Huang
Findings of the Association for Computational Linguistics: ACL 2026
Junjie Ye | Caishuang Huang | Zhuohan Chen | Wenjie Fu | Chenyuan Yang | Leyi Yang | Yilong Wu | Peng Wang | Meng Zhou | Xiaolong Yang | Tao Gui | Qi Zhang | Zhongchao Shi | Jianping Fan | Xuanjing Huang
Findings of the Association for Computational Linguistics: ACL 2026
Instruction following refers to the ability of large language models (LLMs) to generate outputs that satisfy all specified constraints. Existing research has primarily focused on constraint categories, offering limited evaluation dimensions and little guidance for improving instruction-following abilities. To address this gap, we introduce MulDimIF, a multi-dimensional constraint framework encompassing three constraint patterns, four constraint categories, and four difficulty levels. Based on this framework, we design a controllable instruction generation pipeline. Through constraint expansion, conflict detection, and instruction rewriting, we construct 9,106 code-verifiable samples. We evaluate 18 LLMs from six model families and find marked performance differences across constraint settings. For instance, average accuracy decreases from 80.82% at Level I to 36.76% at Level IV. Moreover, training with data generated by our framework significantly improves instruction following without compromising general performance. In-depth analysis indicates that these gains stem largely from parameter updates in attention modules, which strengthen constraint recognition and adherence. Code and data are available in https://github.com/Junjie-Ye/MulDimIF.
CI-Work: Benchmarking Contextual Integrity in Enterprise LLM Agents
Wenjie Fu | Xiaoting Qin | Jue Zhang | Qingwei Lin | Lukas Wutschitz | Robert Sim | Saravan Rajmohan | Dongmei Zhang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026)
Wenjie Fu | Xiaoting Qin | Jue Zhang | Qingwei Lin | Lukas Wutschitz | Robert Sim | Saravan Rajmohan | Dongmei Zhang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026)
Enterprise LLM agents can dramatically improve workplace productivity, but their core capability, retrieving and using internal context to act on a user’s behalf, also creates new risks for sensitive information leakage. We introduce **CI-Work**, a Contextual Integrity (CI)-grounded benchmark that simulates enterprise workflows across five information-flow directions and evaluates whether agents can convey *essential* content while withholding *sensitive* context in dense retrieval settings.Our evaluation of frontier models reveals that privacy failures are prevalent (violation rates range from 15.8%-50.9%, with leakage reaching up to 26.7%) and uncovers a counterintuitive trade-off critical for industrial deployment: higher task utility often correlates with increased privacy violations.Moreover, the massive scale of enterprise data and potential user behavior further amplify this vulnerability. Simply increasing model size or reasoning depth fails to address the problem. We conclude that safeguarding enterprise workflows requires a paradigm shift, moving beyond model-centric scaling toward context-centric architectures.