Gian Maria Marconi
Author directory2026
PerceptUI: LLM Agents as Human-Aligned Synthetic Users for UI/UX Evaluation
Nicolas Bougie | Xiaotong Ye | Gian Maria Marconi | Narimawa Watanabe
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Nicolas Bougie | Xiaotong Ye | Gian Maria Marconi | Narimawa Watanabe
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
User interface (UI) and user experience (UX) evaluation is central to product development, yet reliable feedback still relies on recruiting human participants or running online A/B tests, making early-stage iteration slow and costly. In light of this, recent work has explored Multimodal Large Language Models as proxy evaluators. However, existing approaches either produce surface-level critiques or a judgment that reflects the model’s own biases rather than the genuine response of a particular user. We introduce PerceptUI, a framework for persona-conditioned UI/UX evaluation that predicts how a specific user would answer interface-related questions and produces natural-language rationales. PerceptUI is trained in two stages: (i) contrastive reflection fine-tuning distills teacher-generated rationales by extracting lessons from human decisions, and (ii) reflective prompt-evolution, which refines prompts using the model’s failure traces. Across multiple domains and datasets, PerceptUI improves alignment with human responses, generalizes to unseen questions and personas, and yields population-level response distributions.
Beyond Offline A/B Testing: Context-Aware Agent Simulation for Recommender System Evaluation
Nicolas Bougie | Gian Maria Marconi | Xiaotong Ye | Narimawa Watanabe
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Nicolas Bougie | Gian Maria Marconi | Xiaotong Ye | Narimawa Watanabe
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Recommender systems are central to online services, enabling users to navigate through massive amounts of content across various domains. However, their evaluation remains challenging due to the disconnect between offline metrics and online performance. The emergence of Large Language Model-powered agents offers a promising solution, yet existing studies model users in isolation, neglecting the contextual factors such as time, location, and needs, which fundamentally shape human decision-making. We introduce ContextSim, an LLM agent framework that simulates believable user proxies by anchoring interactions in daily life activities. A life simulation module generates scenarios specifying when, where, and why users engage with recommendations. To align preferences with genuine humans, we model agents’ internal thoughts and enforce consistency at both action and trajectory levels. Experiments across domains demonstrate closer alignment with human behavior than prior work. We further validate our approach through offline A/B testing correlation and show that RS parameters optimized using ContextSim yield improved real-world engagement.
AlignUSER: Human-Aligned LLM Agents via World Models for Recommender System Evaluation
Nicolas Bougie | Gian Maria Marconi | Xiaotong Ye | Narimawa Watanabe
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Nicolas Bougie | Gian Maria Marconi | Xiaotong Ye | Narimawa Watanabe
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Evaluating recommender systems remains challenging due to the gap between offline metrics and real user behavior, as well as the scarcity of interaction data. Recent work explores large language model (LLM) agents as synthetic users, yet they typically rely on few-shot prompting, which yields a shallow understanding of the environment and limits their ability to faithfully reproduce user actions. We introduce AlignUSER, a framework that learns world-model-driven agents from human interactions. Given rollout sequences of actions and states, we formalize world modeling as a next state prediction task that helps the agent internalize the environment. To align actions with human personas, we generate counterfactual trajectories around demonstrations and prompt the LLM to compare its decisions with human choices, identify suboptimal actions, and extract lessons. The learned policy is then used to drive agent interactions with the recommender system. We evaluate AlignUSER across multiple datasets and demonstrate closer alignment with genuine humans than prior work, both at the micro and macro levels.