Overview of the 2020 WOSP 3C Citation Context Classification Task

Suchetha Nambanoor Kunnath, David Pride, Bikash Gyawali, Petr Knoth


Abstract
The 3C Citation Context Classification task is the first shared task addressing citation context classification. The two subtasks, A and B, associated with this shared task, involves the classification of citations based on their purpose and influence, respectively. Both tasks use a portion of the new ACT dataset, developed by the researchers at The Open University, UK. The tasks were hosted on Kaggle, and the participated systems were evaluated using the macro f-score. Three teams participated in subtask A and four teams participated in subtask B. The best performing systems obtained an overall score of 0.2056 for subtask A and 0.5556 for subtask B, outperforming the simple majority class baseline models, which scored 0.11489 and 0.32249, respectively. In this paper we provide a report specifying the shared task, the dataset used, a short description of the participating systems and the final results obtained by the teams based on the evaluation criteria. The shared task has been organised as part of the 8th International Workshop on Mining Scientific Publications (WOSP 2020) workshop.
Anthology ID:
2020.wosp-1.12
Volume:
Proceedings of the 8th International Workshop on Mining Scientific Publications
Month:
05 August
Year:
2020
Address:
Wuhan, China
Venue:
WOSP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
75–83
Language:
URL:
https://aclanthology.org/2020.wosp-1.12
DOI:
Bibkey:
Cite (ACL):
Suchetha Nambanoor Kunnath, David Pride, Bikash Gyawali, and Petr Knoth. 2020. Overview of the 2020 WOSP 3C Citation Context Classification Task. In Proceedings of the 8th International Workshop on Mining Scientific Publications, pages 75–83, Wuhan, China. Association for Computational Linguistics.
Cite (Informal):
Overview of the 2020 WOSP 3C Citation Context Classification Task (Kunnath et al., WOSP 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.wosp-1.12.pdf
Data
SciCite