Evaluating Automatically Inferred Linguistic Perspective as an Auxiliary Signal for Toxicity Detection

Meghana Gottapu


Abstract
Identity-related language occurs in both self-referential discussion and speech aboiut other groups, complicating toxicity detection. We ask whether an automatically inferred linguistic-perspective signal is useful as an auxiliary traiing objective. A regex and zero-shot NLI pipeline lables comments as SELF or OTHER; these are noisy linguistic proxies, not verified speak indetities. On Jigsaw Unintended Bias, we fine-tune a Toxic-BERT model with toxicity and proxy labels heads and compare it with a matched control whose perspective-loss weight is zero. The auxiliary objective gives a small descriptive mean ROC-AUC increase but lower mean accuracy. On decontaminated CivilComments-WILDS, ROC-AUC is 0.9346 while worst group accuracy is 0.5805. The main contribution is a leakage-controlled, matced evaluation showing that the full fine-tuning recipe improves toxic class F1 and ranking substantially, where as the automatic perspective proxy provides only limited additional benefit.
Anthology ID:
2026.woah-1.20
Volume:
Proceedings of the 10th Workshop on Online Abuse and Harms (WOAH)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Agostina Calabrese, Thomas Davidson, Christine de Kock, Urja Khurana, Marta Marchiori Manerba, Paloma Piot, Zeerak Talat
Venues:
WOAH | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
228–233
Language:
URL:
https://aclanthology.org/2026.woah-1.20/
DOI:
Bibkey:
Cite (ACL):
Meghana Gottapu. 2026. Evaluating Automatically Inferred Linguistic Perspective as an Auxiliary Signal for Toxicity Detection. In Proceedings of the 10th Workshop on Online Abuse and Harms (WOAH), pages 228–233, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Evaluating Automatically Inferred Linguistic Perspective as an Auxiliary Signal for Toxicity Detection (Gottapu, WOAH 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.woah-1.20.pdf
Supplementarymaterial:
 2026.woah-1.20.SupplementaryMaterial.zip