<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="paik-etal-2025-mmrefine">
    <titleInfo>
        <title>MMRefine: Unveiling the Obstacles to Robust Refinement in Multimodal Large Language Models</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Gio</namePart>
        <namePart type="family">Paik</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Geewook</namePart>
        <namePart type="family">Kim</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Jinbae</namePart>
        <namePart type="family">Im</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2025-07</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Findings of the Association for Computational Linguistics: ACL 2025</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Wanxiang</namePart>
            <namePart type="family">Che</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Joyce</namePart>
            <namePart type="family">Nabende</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Ekaterina</namePart>
            <namePart type="family">Shutova</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Mohammad</namePart>
            <namePart type="given">Taher</namePart>
            <namePart type="family">Pilehvar</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Vienna, Austria</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
        <identifier type="isbn">979-8-89176-256-5</identifier>
    </relatedItem>
    <abstract>This paper introduces MMRefine, a MultiModal Refinement benchmark designed to evaluate the error refinement capabilities of Multimodal Large Language Models (MLLMs). As the emphasis shifts toward enhancing reasoning during inference, MMRefine provides a framework that evaluates MLLMs’ abilities to detect and correct errors across six distinct scenarios beyond just comparing final accuracy before and after refinement. Furthermore, the benchmark analyzes the refinement performance by categorizing errors into six error types.Experiments with various open and closed MLLMs reveal bottlenecks and factors impeding refinement performance, highlighting areas for improvement in effective reasoning enhancement. Our code and dataset are publicly available at https://github.com/naver-ai/MMRefine.</abstract>
    <identifier type="citekey">paik-etal-2025-mmrefine</identifier>
    <identifier type="doi">10.18653/v1/2025.findings-acl.1378</identifier>
    <location>
        <url>https://aclanthology.org/2025.findings-acl.1378/</url>
    </location>
    <part>
        <date>2025-07</date>
        <extent unit="page">
            <start>26883</start>
            <end>26904</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T MMRefine: Unveiling the Obstacles to Robust Refinement in Multimodal Large Language Models
%A Paik, Gio
%A Kim, Geewook
%A Im, Jinbae
%Y Che, Wanxiang
%Y Nabende, Joyce
%Y Shutova, Ekaterina
%Y Pilehvar, Mohammad Taher
%S Findings of the Association for Computational Linguistics: ACL 2025
%D 2025
%8 July
%I Association for Computational Linguistics
%C Vienna, Austria
%@ 979-8-89176-256-5
%F paik-etal-2025-mmrefine
%X This paper introduces MMRefine, a MultiModal Refinement benchmark designed to evaluate the error refinement capabilities of Multimodal Large Language Models (MLLMs). As the emphasis shifts toward enhancing reasoning during inference, MMRefine provides a framework that evaluates MLLMs’ abilities to detect and correct errors across six distinct scenarios beyond just comparing final accuracy before and after refinement. Furthermore, the benchmark analyzes the refinement performance by categorizing errors into six error types.Experiments with various open and closed MLLMs reveal bottlenecks and factors impeding refinement performance, highlighting areas for improvement in effective reasoning enhancement. Our code and dataset are publicly available at https://github.com/naver-ai/MMRefine.
%R 10.18653/v1/2025.findings-acl.1378
%U https://aclanthology.org/2025.findings-acl.1378/
%U https://doi.org/10.18653/v1/2025.findings-acl.1378
%P 26883-26904

Markdown (Informal)

[MMRefine: Unveiling the Obstacles to Robust Refinement in Multimodal Large Language Models](https://aclanthology.org/2025.findings-acl.1378/) (Paik et al., Findings 2025)

• MMRefine: Unveiling the Obstacles to Robust Refinement in Multimodal Large Language Models (Paik et al., Findings 2025)

ACL

• Gio Paik, Geewook Kim, and Jinbae Im. 2025. MMRefine: Unveiling the Obstacles to Robust Refinement in Multimodal Large Language Models. In Findings of the Association for Computational Linguistics: ACL 2025, pages 26883–26904, Vienna, Austria. Association for Computational Linguistics.