Chenxi Miao
Author directory2026
ActTraitBench: Quantifying the Knowledge-Decision Gap in Large Language Models via Human-Grounded Behavioral Validation
Yutong Yang | Chenxi Miao | Weikang Li | Yunfang Wu
Findings of the Association for Computational Linguistics: EMNLP 2026
Yutong Yang | Chenxi Miao | Weikang Li | Yunfang Wu
Findings of the Association for Computational Linguistics: EMNLP 2026
While Large Language Models (LLMs) can convincingly simulate personas in explicit self-reports, they often deviate in implicit behavioral decisions, revealing a substantial Knowledge–Decision Gap (GKD). Existing benchmarks struggle to measure this discrepancy due to limited construct validity, multidimensional entanglement, and distributional biases in LLM-based evaluation. To address these issues, we propose ActTraitBench, a human-grounded evaluation framework for measuring personality consistency in LLMs. Grounded in empirical human data, ActTraitBench establishes one-to-one mappings between psychometric facets and behavioral paradigms and applies Distributional Calibration via Quantile Mapping to reduce distributional mismatch between LLM-judge scores and human responses. Experiments on 14 mainstream LLMs reveal substantial knowledge–decision gaps and show that assigned personas are reflected more consistently in self-reports than in behavioral decisions for most evaluated models. To mitigate this gap, we further introduce the Chain of Cognitive Alignment (CoCA), an inference-time intervention that reduces GKD for 12 of the 13 models with paired results. Code and resources are available at https://github.com/Selina233/ActTraitBench.
Trait-Aware Policy Optimization for Autoregressive Multi-Trait Essay Scoring
Zhengyang Wang | Sanwoo Lee | Jiaxin Wang | Chenxi Miao | Weikang Li | Yunfang Wu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Zhengyang Wang | Sanwoo Lee | Jiaxin Wang | Chenxi Miao | Weikang Li | Yunfang Wu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Multi-trait essay scoring aims to provide fine-grained evaluation of writing quality across multiple dimensions. However, how to effectively post-train autoregressive scoring models remains underexplored. In this paper, we propose Trait-Aware Policy Optimization (TAPO), a post-training framework tailored to autoregressive multi-trait scoring. Our method decomposes rewards along both the sample and trait dimensions, combining global scoring consistency, trait-level accuracy, format validity, and inter-trait dependency preservation. In addition, we use enhanced prompts throughout training by incorporating original prompt texts and trait descriptions, providing richer semantic information for trait-specific score generation. Experiments across multiple backbone models show that our method consistently improves multi-trait scoring performance over supervised fine-tuning and scalar-reward optimization baselines, demonstrating the effectiveness and transferability of trait-aware post-training for essay scoring.