MANGO: Manga Active Narrative Grounding Optimization

Hao Qiu, Junyan Wang, Zheyuan Liu, Lei Fan, Hong Jia, Lianbo Guo, Zhulin Tao


Abstract
Manga visual question answering requires models to answer questions over panel-based visual narratives, where relevant evidence is distributed across ordered panels, embedded text, recurring characters, and implicit event transitions. This structure makes passive page encoding insufficient, as the model must identify which panels to inspect, what clues to retain, and when the accumulated evidence is sufficient for answering. We propose MANGO (Manga Active Narrative Grounding Optimization), an unsupervised framework for active manga visual question answering. MANGO introduces Active Narrative Sketching (ANS), which iteratively selects panels, extracts concise grounded clues, and decides when to stop, forming a compact question-directed evidence sketch before answer generation. To optimize this behavior without human-annotated answers or rationale paths, MANGO samples multiple ANS rollouts and applies group-relative training with two rewards: answer preference from listwise self-ranking and path consistency from stable ordered panel trajectories. The combined reward is optimized with group-relative policy training, encouraging the model to improve both final answers and the panel-level evidence paths that support them. Experiments on standard manga understanding benchmarks show that MANGO achieves state-of-the-art performance across different settings.
Anthology ID:
2026.findings-emnlp.753
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
15858–15873
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.753/
DOI:
Bibkey:
Cite (ACL):
Hao Qiu, Junyan Wang, Zheyuan Liu, Lei Fan, Hong Jia, Lianbo Guo, and Zhulin Tao. 2026. MANGO: Manga Active Narrative Grounding Optimization. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 15858–15873, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
MANGO: Manga Active Narrative Grounding Optimization (Qiu et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.753.pdf