Birds of a Feather: Do Embedding Representations of Personal Information Flock Together?

Maria Irena Szawerna, Simon Dobnik


Abstract
Personally identifiable information (PII or PI) can appear in a wide variety of linguistic data, posing both ethical and legal challenges for conducting research and developing applications involving such texts. In this paper, we investigate the alignment between automatic clustering of FastText and Transformer embedding representations of personal information spans sourced from essays written by adult learners of Swedish as a second language and the general and detailed personal information labels assigned to these spans by expert annotators. Our goals are to assess the extent of overlap between the semantic categories and evaluate the semantic coherence of the human-assigned classes, which may have implications for de-identification procedures. We observe that while contextual embeddings, especially ones from a specialized word-in-context model, produce relatively good clustering results, they only partly map to the human understanding of how to classify personal information.
Anthology ID:
2026.legal-1.7
Volume:
Proceedings of the Joint Workshop on Legal and Ethical Issues in Human Language Technologies and Computational Approaches to Language Data Pseudonymization, Anonymization, De-identification, and Data Privacy (LEGAL2026 and CALD-pseudo 2026) @ LREC 2026
Month:
May
Year:
2026
Address:
Palma, Mallorca (Spain)
Editors:
Ingo Siegert, Maria Irena Szawerna, Khalid Choukri, Simon Dobnik, Paweł Kamocki, Therese Lindström Tiedemann, Pierre Lison, Ricardo Muñoz Sánchez, Ildikó Pilán, Lisa Södergård, Kossay Talmoudi, Elena Volodina, Xuan-Son Vu
Venues:
LEGAL | CALD-pseudo | WS
SIG:
Publisher:
ELRA
Note:
Pages:
62–72
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-legal-07
DOI:
10.63317/4ohwx42xhvzy
Bibkey:
Cite (ACL):
Maria Irena Szawerna and Simon Dobnik. 2026. Birds of a Feather: Do Embedding Representations of Personal Information Flock Together?. In Proceedings of the Joint Workshop on Legal and Ethical Issues in Human Language Technologies and Computational Approaches to Language Data Pseudonymization, Anonymization, De-identification, and Data Privacy (LEGAL2026 and CALD-pseudo 2026) @ LREC 2026, pages 62–72, Palma, Mallorca (Spain). ELRA.
Cite (Informal):
Birds of a Feather: Do Embedding Representations of Personal Information Flock Together? (Szawerna & Dobnik, LEGAL-CALD-pseudo 2026)
Copy Citation: