<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="gu-budhkar-2021-package">
    <titleInfo>
        <title>A Package for Learning on Tabular and Text Data with Transformers</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Ken</namePart>
        <namePart type="family">Gu</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Akshay</namePart>
        <namePart type="family">Budhkar</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2021-06</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the Third Workshop on Multimodal Artificial Intelligence</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Amir</namePart>
            <namePart type="family">Zadeh</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Louis-Philippe</namePart>
            <namePart type="family">Morency</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Paul</namePart>
            <namePart type="given">Pu</namePart>
            <namePart type="family">Liang</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Candace</namePart>
            <namePart type="family">Ross</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Ruslan</namePart>
            <namePart type="family">Salakhutdinov</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Soujanya</namePart>
            <namePart type="family">Poria</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Erik</namePart>
            <namePart type="family">Cambria</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Kelly</namePart>
            <namePart type="family">Shi</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Mexico City, Mexico</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Recent progress in natural language processing has led to Transformer architectures becoming the predominant model used for natural language tasks. However, in many real- world datasets, additional modalities are included which the Transformer does not directly leverage. We present Multimodal- Toolkit, an open-source Python package to incorporate text and tabular (categorical and numerical) data with Transformers for downstream applications. Our toolkit integrates well with Hugging Face’s existing API such as tokenization and the model hub which allows easy download of different pre-trained models.</abstract>
    <identifier type="citekey">gu-budhkar-2021-package</identifier>
    <identifier type="doi">10.18653/v1/2021.maiworkshop-1.10</identifier>
    <location>
        <url>https://aclanthology.org/2021.maiworkshop-1.10</url>
    </location>
    <part>
        <date>2021-06</date>
        <extent unit="page">
            <start>69</start>
            <end>73</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T A Package for Learning on Tabular and Text Data with Transformers
%A Gu, Ken
%A Budhkar, Akshay
%Y Zadeh, Amir
%Y Morency, Louis-Philippe
%Y Liang, Paul Pu
%Y Ross, Candace
%Y Salakhutdinov, Ruslan
%Y Poria, Soujanya
%Y Cambria, Erik
%Y Shi, Kelly
%S Proceedings of the Third Workshop on Multimodal Artificial Intelligence
%D 2021
%8 June
%I Association for Computational Linguistics
%C Mexico City, Mexico
%F gu-budhkar-2021-package
%X Recent progress in natural language processing has led to Transformer architectures becoming the predominant model used for natural language tasks. However, in many real- world datasets, additional modalities are included which the Transformer does not directly leverage. We present Multimodal- Toolkit, an open-source Python package to incorporate text and tabular (categorical and numerical) data with Transformers for downstream applications. Our toolkit integrates well with Hugging Face’s existing API such as tokenization and the model hub which allows easy download of different pre-trained models.
%R 10.18653/v1/2021.maiworkshop-1.10
%U https://aclanthology.org/2021.maiworkshop-1.10
%U https://doi.org/10.18653/v1/2021.maiworkshop-1.10
%P 69-73

Markdown (Informal)

[A Package for Learning on Tabular and Text Data with Transformers](https://aclanthology.org/2021.maiworkshop-1.10) (Gu & Budhkar, maiworkshop 2021)

• A Package for Learning on Tabular and Text Data with Transformers (Gu & Budhkar, maiworkshop 2021)

ACL

• Ken Gu and Akshay Budhkar. 2021. A Package for Learning on Tabular and Text Data with Transformers. In Proceedings of the Third Workshop on Multimodal Artificial Intelligence, pages 69–73, Mexico City, Mexico. Association for Computational Linguistics.