Jiarui Zhang
Author directoryOther people with similar names: JiaRui Zhang
Unverified author pages with similar names: Jiarui Zhang
2026
Self-Evolving Vision Language Models for Structured Visual Understanding
Zongxia Li | Xiaomin Wu | Chengsong Huang | Hongyang Du | Xiyang Wu | Lantao Yu | Yicheng He | Zhichao Liu | Jiarui Zhang | Fuxiao Liu | Jing Xie
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Zongxia Li | Xiaomin Wu | Chengsong Huang | Hongyang Du | Xiyang Wu | Lantao Yu | Yicheng He | Zhichao Liu | Jiarui Zhang | Fuxiao Liu | Jing Xie
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Self-evolving has emerged as a key paradigm for improving foundational models such as Large Language Models (LLMs) and Vision Language Models (VLMs) with minimal human intervention. While recent approaches have demonstrated that LLM agents can self-evolve from scratch with little to no data, VLMs introduce an additional visual modality that typically requires at least some seed data, such as images, to bootstrap the self-evolution process. In this work, we present Multi-model Multi-modal Zero (MM-Zero), the first RL-based framework to achieve zero-data self-evolution for VLM reasoning. Moving beyond prior dual-role (Proposer and Solver) setups, MM-Zero introduces a multi-role self-evolving training framework comprising three specialized roles: a Proposer that generates structured visual concepts and formulates questions; a Coder that translates these concepts into executable code (e.g., Python, SVG) to render visual images; and a Solver that performs multimodal reasoning over the generated visual content. All three roles are initialized from the same base model and trained using Group Relative Policy Optimization (GRPO), with carefully designed reward mechanisms that integrate execution feedback, visual verification, and difficulty balancing. Our experiments show that MM-Zero improves VLM reasoning performance across a wide range of multimodal benchmarks. MM-Zero establishes a scalable path toward self-evolving multi-model systems for multimodal models, extending the frontier of self-improvement beyond the conventional two-model paradigm.
2024
Guided Profile Generation Improves Personalization with Large Language Models
Jiarui Zhang
Findings of the Association for Computational Linguistics: EMNLP 2024
Jiarui Zhang
Findings of the Association for Computational Linguistics: EMNLP 2024
In modern commercial systems, including Recommendation, Ranking, and E-Commerce platforms, there is a trend towards improving customer experiences by incorporating Personalization context as input into Large Language Models (LLM). However, LLMs often struggle to effectively parse and utilize sparse and complex personal context without additional processing or contextual enrichment, underscoring the need for more sophisticated context understanding mechanisms. In this work, we propose Guided Profile Generation (GPG), a general method designed to generate personal profiles in natural language. As is observed, intermediate guided profile generation enables LLMs to summarize, and extract the important, distinctive features from the personal context into concise, descriptive sentences, precisely tailoring their generation more closely to an individual’s unique habits and preferences. Our experimental results show that GPG improves LLM’s personalization ability across different tasks, for example, it increases 37% accuracy in predicting personal preference compared to directly feeding the LLMs with raw personal context.