<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="zhang-kordjamshidi-2022-explicit">
    <titleInfo>
        <title>Explicit Object Relation Alignment for Vision and Language Navigation</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Yue</namePart>
        <namePart type="family">Zhang</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Parisa</namePart>
        <namePart type="family">Kordjamshidi</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2022-05</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Samuel</namePart>
            <namePart type="family">Louvan</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Andrea</namePart>
            <namePart type="family">Madotto</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Brielen</namePart>
            <namePart type="family">Madureira</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Dublin, Ireland</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>In this paper, we investigate the problem of vision and language navigation. To solve this problem, grounding the landmarks and spatial relations in the textual instructions into visual modality is important. We propose a neural agent named Explicit Object Relation Alignment Agent (EXOR),to explicitly align the spatial information in both instruction and the visual environment, including landmarks and spatial relationships between the agent and landmarks. Empirically, our proposed method surpasses the baseline by a large margin on the R2R dataset. We provide a comprehensive analysis to show our model’s spatial reasoning ability and explainability.</abstract>
    <identifier type="citekey">zhang-kordjamshidi-2022-explicit</identifier>
    <identifier type="doi">10.18653/v1/2022.acl-srw.24</identifier>
    <location>
        <url>https://aclanthology.org/2022.acl-srw.24</url>
    </location>
    <part>
        <date>2022-05</date>
        <extent unit="page">
            <start>322</start>
            <end>331</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Explicit Object Relation Alignment for Vision and Language Navigation
%A Zhang, Yue
%A Kordjamshidi, Parisa
%Y Louvan, Samuel
%Y Madotto, Andrea
%Y Madureira, Brielen
%S Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop
%D 2022
%8 May
%I Association for Computational Linguistics
%C Dublin, Ireland
%F zhang-kordjamshidi-2022-explicit
%X In this paper, we investigate the problem of vision and language navigation. To solve this problem, grounding the landmarks and spatial relations in the textual instructions into visual modality is important. We propose a neural agent named Explicit Object Relation Alignment Agent (EXOR),to explicitly align the spatial information in both instruction and the visual environment, including landmarks and spatial relationships between the agent and landmarks. Empirically, our proposed method surpasses the baseline by a large margin on the R2R dataset. We provide a comprehensive analysis to show our model’s spatial reasoning ability and explainability.
%R 10.18653/v1/2022.acl-srw.24
%U https://aclanthology.org/2022.acl-srw.24
%U https://doi.org/10.18653/v1/2022.acl-srw.24
%P 322-331

Markdown (Informal)

[Explicit Object Relation Alignment for Vision and Language Navigation](https://aclanthology.org/2022.acl-srw.24) (Zhang & Kordjamshidi, ACL 2022)

• Explicit Object Relation Alignment for Vision and Language Navigation (Zhang & Kordjamshidi, ACL 2022)

ACL

• Yue Zhang and Parisa Kordjamshidi. 2022. Explicit Object Relation Alignment for Vision and Language Navigation. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop, pages 322–331, Dublin, Ireland. Association for Computational Linguistics.