<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="badaro-etal-2023-transformers">
    <titleInfo>
        <title>Transformers for Tabular Data Representation: A Survey of Models and Applications</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Gilbert</namePart>
        <namePart type="family">Badaro</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Mohammed</namePart>
        <namePart type="family">Saeed</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Paolo</namePart>
        <namePart type="family">Papotti</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2023</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <genre authority="bibutilsgt">journal article</genre>
    <relatedItem type="host">
        <titleInfo>
            <title>Transactions of the Association for Computational Linguistics</title>
        </titleInfo>
        <originInfo>
            <issuance>continuing</issuance>
            <publisher>MIT Press</publisher>
            <place>
                <placeTerm type="text">Cambridge, MA</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">periodical</genre>
        <genre authority="bibutilsgt">academic journal</genre>
    </relatedItem>
    <abstract>In the last few years, the natural language processing community has witnessed advances in neural representations of free texts with transformer-based language models (LMs). Given the importance of knowledge available in tabular data, recent research efforts extend LMs by developing neural representations for structured data. In this article, we present a survey that analyzes these efforts. We first abstract the different systems according to a traditional machine learning pipeline in terms of training data, input representation, model training, and supported downstream tasks. For each aspect, we characterize and compare the proposed solutions. Finally, we discuss future work directions.</abstract>
    <identifier type="citekey">badaro-etal-2023-transformers</identifier>
    <identifier type="doi">10.1162/tacl_a_00544</identifier>
    <location>
        <url>https://aclanthology.org/2023.tacl-1.14</url>
    </location>
    <part>
        <date>2023</date>
        <detail type="volume"><number>11</number></detail>
        <extent unit="page">
            <start>227</start>
            <end>249</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Journal Article
%T Transformers for Tabular Data Representation: A Survey of Models and Applications
%A Badaro, Gilbert
%A Saeed, Mohammed
%A Papotti, Paolo
%J Transactions of the Association for Computational Linguistics
%D 2023
%V 11
%I MIT Press
%C Cambridge, MA
%F badaro-etal-2023-transformers
%X In the last few years, the natural language processing community has witnessed advances in neural representations of free texts with transformer-based language models (LMs). Given the importance of knowledge available in tabular data, recent research efforts extend LMs by developing neural representations for structured data. In this article, we present a survey that analyzes these efforts. We first abstract the different systems according to a traditional machine learning pipeline in terms of training data, input representation, model training, and supported downstream tasks. For each aspect, we characterize and compare the proposed solutions. Finally, we discuss future work directions.
%R 10.1162/tacl_a_00544
%U https://aclanthology.org/2023.tacl-1.14
%U https://doi.org/10.1162/tacl_a_00544
%P 227-249

Markdown (Informal)

[Transformers for Tabular Data Representation: A Survey of Models and Applications](https://aclanthology.org/2023.tacl-1.14) (Badaro et al., TACL 2023)

• Transformers for Tabular Data Representation: A Survey of Models and Applications (Badaro et al., TACL 2023)

ACL

• Gilbert Badaro, Mohammed Saeed, and Paolo Papotti. 2023. Transformers for Tabular Data Representation: A Survey of Models and Applications. Transactions of the Association for Computational Linguistics, 11:227–249.