CamPilot: A Multi-Agent Cinematic Assistant for Camera-Controlled Movie Generation

Yang Wu, Stefano Petrangeli, Ishita Dasgupta, Yu Shen


Abstract
The integration of large language models (LLMs) into video generation has enabled rapid text-to-video creation and improved visual quality. However, it still falls short of professional filmmaking, where cinematographic language is less refined than human-crafted camera work and multi-shot continuity remains challenging. To address these limitations, we introduce CamPilot, a multi-agent framework that integrates cinematographic planning and camera-work control to produce more coherent, logically structured, and human-aesthetic movies. CamPilot adopts a GRPO-based learning paradigm to learn camera work planning from 14K real-world professional movies, internalizing motion patterns and composition principles that support reasoning over shooting techniques (e.g., camera angle, motion, and focal behavior) and cross-shot relationships for controllable camera-viewpoint generation. Multiple agents further collaborate and evolve to improve overall output quality. To support this work and further studies in this domain, we establish CamEval, a benchmark for evaluating camera work quality and cinematic engagement. Empirical results show that CamPilot outperforms state-of-the-art text-to-movie generation methods on cinematographic control and quality, highlighting the impact of professional camera design on movie generation.
Anthology ID:
2026.realm-1.105
Volume:
Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Ehsan Kamalloo, Nicolas Gontier, Nikolai Rozanov, Maryam Hashemzadeh, Akhil Arora
Venues:
REALM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1551–1564
Language:
URL:
https://aclanthology.org/2026.realm-1.105/
DOI:
Bibkey:
Cite (ACL):
Yang Wu, Stefano Petrangeli, Ishita Dasgupta, and Yu Shen. 2026. CamPilot: A Multi-Agent Cinematic Assistant for Camera-Controlled Movie Generation. In Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026), pages 1551–1564, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
CamPilot: A Multi-Agent Cinematic Assistant for Camera-Controlled Movie Generation (Wu et al., REALM 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.realm-1.105.pdf