Zhonghua Hong
Author directory2026
Knowing but Not Doing: Discourse-level Constraints Adherence of Large Language Models
Zhonghua Hong | Sihang Jiang | Keyi Wang | Xiaojun Meng | Jiansheng Wei | Jiaqing Liang | Yanghua Xiao
Findings of the Association for Computational Linguistics: EMNLP 2026
Zhonghua Hong | Sihang Jiang | Keyi Wang | Xiaojun Meng | Jiansheng Wei | Jiaqing Liang | Yanghua Xiao
Findings of the Association for Computational Linguistics: EMNLP 2026
Instruction following in large language models (LLMs) is commonly evaluated at the sentence or surface level, leaving discourse-level constraints underexplored. We study discourse-level instruction following by formalizing it as a structured constraint adherence problem and constructing both explicit and implicit benchmarks for evaluation. Experiments are conducted across models of different scales, revealing a systematic recognition–adherence gap: models can identify discourse constraints but frequently fail to adhere to them during generation with specific failure modes. This failure stems from a fundamental misalignment between standard training objectives and global structural integrity. Importantly, models show substantially improved adherence when discourse-level structural objectives are explicitly optimized.