Universal Language Model Fine-tuning for Patent Classification

Jason Hepburn


Abstract
This paper describes the methods used for the 2018 ALTA Shared Task. The task this year was to automatically classify Australian patents into their main International Patent Classification section. Our final submission used a Support Vector Machine (SVM) and Universal Language Model with Fine-tuning (ULMFiT). Our system achieved the best results in the student category.
Anthology ID:
U18-1013
Volume:
Proceedings of the Australasian Language Technology Association Workshop 2018
Month:
December
Year:
2018
Address:
Dunedin, New Zealand
Editors:
Sunghwan Mac Kim, Xiuzhen (Jenny) Zhang
Venue:
ALTA
SIG:
Publisher:
Note:
Pages:
93–96
Language:
URL:
https://aclanthology.org/U18-1013
DOI:
Bibkey:
Cite (ACL):
Jason Hepburn. 2018. Universal Language Model Fine-tuning for Patent Classification. In Proceedings of the Australasian Language Technology Association Workshop 2018, pages 93–96, Dunedin, New Zealand.
Cite (Informal):
Universal Language Model Fine-tuning for Patent Classification (Hepburn, ALTA 2018)
Copy Citation:
PDF:
https://aclanthology.org/U18-1013.pdf