<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="regan-etal-2024-massive">
    <titleInfo>
        <title>MASSIVE Multilingual Abstract Meaning Representation: A Dataset and Baselines for Hallucination Detection</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Michael</namePart>
        <namePart type="family">Regan</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Shira</namePart>
        <namePart type="family">Wein</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">George</namePart>
        <namePart type="family">Baker</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Emilio</namePart>
        <namePart type="family">Monti</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2024-06</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 13th Joint Conference on Lexical and Computational Semantics (*SEM 2024)</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Danushka</namePart>
            <namePart type="family">Bollegala</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Vered</namePart>
            <namePart type="family">Shwartz</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Mexico City, Mexico</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Abstract Meaning Representation (AMR) is a semantic formalism that captures the core meaning of an utterance. There has been substantial work developing AMR corpora in English and more recently across languages, though the limited size of existing datasets and the cost of collecting more annotations are prohibitive. With both engineering and scientific questions in mind, we introduce MASSIVE-AMR, a dataset with more than 84,000 text-to-graph annotations, currently the largest and most diverse of its kind: AMR graphs for 1,685 information-seeking utterances mapped to 50+ typologically diverse languages. We describe how we built our resource and its unique features before reporting on experiments using large language models for multilingual AMR and SPARQL parsing as well as applying AMRs for hallucination detection in the context of knowledge base question answering, with results shedding light on persistent issues using LLMs for structured parsing.</abstract>
    <identifier type="citekey">regan-etal-2024-massive</identifier>
    <identifier type="doi">10.18653/v1/2024.starsem-1.1</identifier>
    <location>
        <url>https://aclanthology.org/2024.starsem-1.1/</url>
    </location>
    <part>
        <date>2024-06</date>
        <extent unit="page">
            <start>1</start>
            <end>17</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T MASSIVE Multilingual Abstract Meaning Representation: A Dataset and Baselines for Hallucination Detection
%A Regan, Michael
%A Wein, Shira
%A Baker, George
%A Monti, Emilio
%Y Bollegala, Danushka
%Y Shwartz, Vered
%S Proceedings of the 13th Joint Conference on Lexical and Computational Semantics (*SEM 2024)
%D 2024
%8 June
%I Association for Computational Linguistics
%C Mexico City, Mexico
%F regan-etal-2024-massive
%X Abstract Meaning Representation (AMR) is a semantic formalism that captures the core meaning of an utterance. There has been substantial work developing AMR corpora in English and more recently across languages, though the limited size of existing datasets and the cost of collecting more annotations are prohibitive. With both engineering and scientific questions in mind, we introduce MASSIVE-AMR, a dataset with more than 84,000 text-to-graph annotations, currently the largest and most diverse of its kind: AMR graphs for 1,685 information-seeking utterances mapped to 50+ typologically diverse languages. We describe how we built our resource and its unique features before reporting on experiments using large language models for multilingual AMR and SPARQL parsing as well as applying AMRs for hallucination detection in the context of knowledge base question answering, with results shedding light on persistent issues using LLMs for structured parsing.
%R 10.18653/v1/2024.starsem-1.1
%U https://aclanthology.org/2024.starsem-1.1/
%U https://doi.org/10.18653/v1/2024.starsem-1.1
%P 1-17

Markdown (Informal)

[MASSIVE Multilingual Abstract Meaning Representation: A Dataset and Baselines for Hallucination Detection](https://aclanthology.org/2024.starsem-1.1/) (Regan et al., *SEM 2024)

• MASSIVE Multilingual Abstract Meaning Representation: A Dataset and Baselines for Hallucination Detection (Regan et al., *SEM 2024)

ACL

• Michael Regan, Shira Wein, George Baker, and Emilio Monti. 2024. MASSIVE Multilingual Abstract Meaning Representation: A Dataset and Baselines for Hallucination Detection. In Proceedings of the 13th Joint Conference on Lexical and Computational Semantics (*SEM 2024), pages 1–17, Mexico City, Mexico. Association for Computational Linguistics.