<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="francis-moens-2022-kul">
    <titleInfo>
        <title>KUL@SMM4H’22: Template Augmented Adaptive Pre-training for Tweet Classification</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Sumam</namePart>
        <namePart type="family">Francis</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Marie-Francine</namePart>
        <namePart type="family">Moens</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2022-10</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of The Seventh Workshop on Social Media Mining for Health Applications, Workshop &amp; Shared Task</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Graciela</namePart>
            <namePart type="family">Gonzalez-Hernandez</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Davy</namePart>
            <namePart type="family">Weissenbacher</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Gyeongju, Republic of Korea</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>This paper describes models developed for the Social Media Mining for Health (SMM4H) 2022 shared tasks. Our team participated in the first subtask that classifies tweets with Adverse Drug Effect (ADE) mentions. Our best-performing model comprises of a template augmented task adaptive pre-training and further fine-tuning on target task data. Augmentation with random prompt templates increases the amount of task-specific data to generalize the LM to the target task domain. We explore 2 pre-training strategies: Masked language modeling (MLM) and Simple contrastive pre-training (SimSCE) and the impact of adding template augmentations with these pre-training strategies. Our system achieves an F1 score of 0.433 on the test set without using supplementary resources and medical dictionaries.</abstract>
    <identifier type="citekey">francis-moens-2022-kul</identifier>
    <location>
        <url>https://aclanthology.org/2022.smm4h-1.41</url>
    </location>
    <part>
        <date>2022-10</date>
        <extent unit="page">
            <start>153</start>
            <end>155</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T KUL@SMM4H’22: Template Augmented Adaptive Pre-training for Tweet Classification
%A Francis, Sumam
%A Moens, Marie-Francine
%Y Gonzalez-Hernandez, Graciela
%Y Weissenbacher, Davy
%S Proceedings of The Seventh Workshop on Social Media Mining for Health Applications, Workshop & Shared Task
%D 2022
%8 October
%I Association for Computational Linguistics
%C Gyeongju, Republic of Korea
%F francis-moens-2022-kul
%X This paper describes models developed for the Social Media Mining for Health (SMM4H) 2022 shared tasks. Our team participated in the first subtask that classifies tweets with Adverse Drug Effect (ADE) mentions. Our best-performing model comprises of a template augmented task adaptive pre-training and further fine-tuning on target task data. Augmentation with random prompt templates increases the amount of task-specific data to generalize the LM to the target task domain. We explore 2 pre-training strategies: Masked language modeling (MLM) and Simple contrastive pre-training (SimSCE) and the impact of adding template augmentations with these pre-training strategies. Our system achieves an F1 score of 0.433 on the test set without using supplementary resources and medical dictionaries.
%U https://aclanthology.org/2022.smm4h-1.41
%P 153-155

Markdown (Informal)

[KUL@SMM4H’22: Template Augmented Adaptive Pre-training for Tweet Classification](https://aclanthology.org/2022.smm4h-1.41) (Francis & Moens, SMM4H 2022)

• KUL@SMM4H’22: Template Augmented Adaptive Pre-training for Tweet Classification (Francis & Moens, SMM4H 2022)

ACL

• Sumam Francis and Marie-Francine Moens. 2022. KUL@SMM4H’22: Template Augmented Adaptive Pre-training for Tweet Classification. In Proceedings of The Seventh Workshop on Social Media Mining for Health Applications, Workshop & Shared Task, pages 153–155, Gyeongju, Republic of Korea. Association for Computational Linguistics.