<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="ghosal-etal-2022-two">
    <titleInfo>
        <title>Two is Better than Many? Binary Classification as an Effective Approach to Multi-Choice Question Answering</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Deepanway</namePart>
        <namePart type="family">Ghosal</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Navonil</namePart>
        <namePart type="family">Majumder</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Rada</namePart>
        <namePart type="family">Mihalcea</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Soujanya</namePart>
        <namePart type="family">Poria</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2022-12</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing</title>
        </titleInfo>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Abu Dhabi, United Arab Emirates</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>We propose a simple refactoring of multi-choice question answering (MCQA) tasks as a series of binary classifications. The MCQA task is generally performed by scoring each (question, answer) pair normalized over all the pairs, and then selecting the answer from the pair that yield the highest score. For n answer choices, this is equivalent to an n-class classification setup where only one class (true answer) is correct. We instead show that classifying (question, true answer) as positive instances and (question, false answer) as negative instances is significantly more effective across various models and datasets. We show the efficacy of our proposed approach in different tasks – abductive reasoning, commonsense question answering, science question answering, and sentence completion. Our DeBERTa binary classification model reaches the top or close to the top performance on public leaderboards for these tasks. The source code of the proposed approach is available at https://github.com/declare-lab/TEAM.</abstract>
    <identifier type="citekey">ghosal-etal-2022-two</identifier>
    <location>
        <url>https://aclanthology.org/2022.emnlp-main.691</url>
    </location>
    <part>
        <date>2022-12</date>
        <extent unit="page">
            <start>10158</start>
            <end>10166</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Two is Better than Many? Binary Classification as an Effective Approach to Multi-Choice Question Answering
%A Ghosal, Deepanway
%A Majumder, Navonil
%A Mihalcea, Rada
%A Poria, Soujanya
%S Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
%D 2022
%8 December
%I Association for Computational Linguistics
%C Abu Dhabi, United Arab Emirates
%F ghosal-etal-2022-two
%X We propose a simple refactoring of multi-choice question answering (MCQA) tasks as a series of binary classifications. The MCQA task is generally performed by scoring each (question, answer) pair normalized over all the pairs, and then selecting the answer from the pair that yield the highest score. For n answer choices, this is equivalent to an n-class classification setup where only one class (true answer) is correct. We instead show that classifying (question, true answer) as positive instances and (question, false answer) as negative instances is significantly more effective across various models and datasets. We show the efficacy of our proposed approach in different tasks – abductive reasoning, commonsense question answering, science question answering, and sentence completion. Our DeBERTa binary classification model reaches the top or close to the top performance on public leaderboards for these tasks. The source code of the proposed approach is available at https://github.com/declare-lab/TEAM.
%U https://aclanthology.org/2022.emnlp-main.691
%P 10158-10166

Markdown (Informal)

[Two is Better than Many? Binary Classification as an Effective Approach to Multi-Choice Question Answering](https://aclanthology.org/2022.emnlp-main.691) (Ghosal et al., EMNLP 2022)

• Two is Better than Many? Binary Classification as an Effective Approach to Multi-Choice Question Answering (Ghosal et al., EMNLP 2022)

ACL

• Deepanway Ghosal, Navonil Majumder, Rada Mihalcea, and Soujanya Poria. 2022. Two is Better than Many? Binary Classification as an Effective Approach to Multi-Choice Question Answering. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 10158–10166, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.