Clause Topic Classification in German and English Standard Form Contracts

Daniel Braun, Florian Matthes


Abstract
So-called standard form contracts, i.e. contracts that are drafted unilaterally by one party, like terms and conditions of online shops or terms of services of social networks, are cornerstones of our modern economy. Their processing is, therefore, of significant practical value. Often, the sheer size of these contracts allows the drafting party to hide unfavourable terms from the other party. In this paper, we compare different approaches for automatically classifying the topics of clauses in standard form contracts, based on a data-set of more than 6,000 clauses from more than 170 contracts, which we collected from German and English online shops and annotated based on a taxonomy of clause topics, that we developed together with legal experts. We will show that, in our comparison of seven approaches, from simple keyword matching to transformer language models, BERT performed best with an F1-score of up to 0.91, however much simpler and computationally cheaper models like logistic regression also achieved similarly good results of up to 0.87.
Anthology ID:
2022.ecnlp-1.23
Volume:
Proceedings of the Fifth Workshop on e-Commerce and NLP (ECNLP 5)
Month:
May
Year:
2022
Address:
Dublin, Ireland
Editors:
Shervin Malmasi, Oleg Rokhlenko, Nicola Ueffing, Ido Guy, Eugene Agichtein, Surya Kallumadi
Venue:
ECNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
199–209
Language:
URL:
https://aclanthology.org/2022.ecnlp-1.23
DOI:
10.18653/v1/2022.ecnlp-1.23
Bibkey:
Cite (ACL):
Daniel Braun and Florian Matthes. 2022. Clause Topic Classification in German and English Standard Form Contracts. In Proceedings of the Fifth Workshop on e-Commerce and NLP (ECNLP 5), pages 199–209, Dublin, Ireland. Association for Computational Linguistics.
Cite (Informal):
Clause Topic Classification in German and English Standard Form Contracts (Braun & Matthes, ECNLP 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.ecnlp-1.23.pdf
Video:
 https://aclanthology.org/2022.ecnlp-1.23.mp4